Jul 02 19:53:34.798646 ip-10-0-128-177 systemd[1]: Starting Kubernetes Kubelet... Jul 02 19:53:35.256645 ip-10-0-128-177 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 19:53:35.256645 ip-10-0-128-177 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 02 19:53:35.256645 ip-10-0-128-177 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 19:53:35.257184 ip-10-0-128-177 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 02 19:53:35.257184 ip-10-0-128-177 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 19:53:35.258811 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.258716 2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 02 19:53:35.262246 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262231 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 19:53:35.262246 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262246 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 19:53:35.262306 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262250 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 19:53:35.262306 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262253 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 19:53:35.262306 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262256 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 19:53:35.262306 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262259 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 19:53:35.262306 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262262 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 19:53:35.262306 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262267 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 19:53:35.262306 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262270 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 19:53:35.262306 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262273 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 19:53:35.262306 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262277 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 19:53:35.262306 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262281 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 19:53:35.262306 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262284 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 19:53:35.262306 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262287 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 19:53:35.262306 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262290 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 19:53:35.262306 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262293 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 19:53:35.262306 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262297 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 19:53:35.262306 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262299 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 19:53:35.262306 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262302 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 19:53:35.262306 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262305 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 19:53:35.262306 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262309 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 19:53:35.262774 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262312 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 19:53:35.262774 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262315 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 19:53:35.262774 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262318 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 19:53:35.262774 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262321 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 19:53:35.262774 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262323 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 19:53:35.262774 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262326 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 19:53:35.262774 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262328 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 19:53:35.262774 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262331 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 19:53:35.262774 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262333 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 19:53:35.262774 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262335 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 19:53:35.262774 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262350 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 19:53:35.262774 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262353 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 19:53:35.262774 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262355 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 19:53:35.262774 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262358 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 19:53:35.262774 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262360 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 19:53:35.262774 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262363 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 19:53:35.262774 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262365 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 19:53:35.262774 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262368 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 19:53:35.262774 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262371 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 19:53:35.263218 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262374 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 19:53:35.263218 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262377 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 19:53:35.263218 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262379 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 19:53:35.263218 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262382 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 19:53:35.263218 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262384 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 19:53:35.263218 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262387 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 19:53:35.263218 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262390 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 19:53:35.263218 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262393 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 19:53:35.263218 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262395 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 19:53:35.263218 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262398 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 19:53:35.263218 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262401 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 19:53:35.263218 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262403 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 19:53:35.263218 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262406 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 19:53:35.263218 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262409 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 19:53:35.263218 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262413 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 19:53:35.263218 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262417 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 19:53:35.263218 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262419 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 19:53:35.263218 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262422 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 19:53:35.263218 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262424 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 19:53:35.263218 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262427 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 19:53:35.263717 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262430 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 19:53:35.263717 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262432 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 19:53:35.263717 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262435 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 19:53:35.263717 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262437 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 19:53:35.263717 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262440 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 19:53:35.263717 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262442 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 19:53:35.263717 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262445 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 19:53:35.263717 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262447 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 19:53:35.263717 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262450 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 19:53:35.263717 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262452 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 19:53:35.263717 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262455 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 19:53:35.263717 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262458 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 19:53:35.263717 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262461 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 19:53:35.263717 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262464 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 19:53:35.263717 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262467 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 19:53:35.263717 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262469 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 02 19:53:35.263717 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262472 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 19:53:35.263717 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262474 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 19:53:35.263717 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262478 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 19:53:35.264185 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262481 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 19:53:35.264185 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262483 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 19:53:35.264185 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262486 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 19:53:35.264185 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262488 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 19:53:35.264185 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262491 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 19:53:35.264185 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262493 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 19:53:35.264185 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262497 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 19:53:35.264185 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262499 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 19:53:35.264185 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262502 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 19:53:35.264185 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262505 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 19:53:35.264185 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262508 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 19:53:35.264185 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262510 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 19:53:35.264185 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262513 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 19:53:35.264185 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262515 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 19:53:35.264185 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262518 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 19:53:35.264185 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262520 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 19:53:35.264185 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262523 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 19:53:35.264185 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262525 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 19:53:35.264185 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262528 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 19:53:35.264185 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.262530 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 19:53:35.264669 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263195 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 19:53:35.264669 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263201 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 19:53:35.264669 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263204 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 19:53:35.264669 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263207 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 19:53:35.264669 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263210 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 19:53:35.264669 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263214 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 19:53:35.264669 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263217 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 19:53:35.264669 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263219 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 19:53:35.264669 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263222 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 19:53:35.264669 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263225 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 19:53:35.264669 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263228 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 19:53:35.264669 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263231 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 19:53:35.264669 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263234 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 19:53:35.264669 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263237 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 19:53:35.264669 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263240 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 19:53:35.264669 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263242 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 19:53:35.264669 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263245 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 19:53:35.264669 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263247 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 19:53:35.264669 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263250 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 19:53:35.265131 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263253 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 19:53:35.265131 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263255 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 19:53:35.265131 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263258 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 19:53:35.265131 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263261 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 19:53:35.265131 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263263 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 19:53:35.265131 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263266 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 19:53:35.265131 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263268 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 19:53:35.265131 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263270 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 19:53:35.265131 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263273 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 19:53:35.265131 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263275 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 19:53:35.265131 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263278 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 19:53:35.265131 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263280 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 19:53:35.265131 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263283 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 19:53:35.265131 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263285 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 19:53:35.265131 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263288 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 19:53:35.265131 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263291 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 19:53:35.265131 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263293 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 19:53:35.265131 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263296 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 19:53:35.265131 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263299 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 19:53:35.265131 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263302 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 02 19:53:35.265626 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263304 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 19:53:35.265626 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263307 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 19:53:35.265626 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263309 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 19:53:35.265626 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263313 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 19:53:35.265626 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263317 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 19:53:35.265626 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263320 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 19:53:35.265626 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263323 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 19:53:35.265626 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263326 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 19:53:35.265626 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263330 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 19:53:35.265626 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263332 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 19:53:35.265626 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263335 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 19:53:35.265626 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263353 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 19:53:35.265626 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263356 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 19:53:35.265626 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263359 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 19:53:35.265626 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263362 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 19:53:35.265626 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263364 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 19:53:35.265626 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263367 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 19:53:35.265626 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263370 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 19:53:35.265626 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263372 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 19:53:35.266081 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263375 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 19:53:35.266081 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263377 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 19:53:35.266081 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263380 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 19:53:35.266081 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263384 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 19:53:35.266081 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263388 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 19:53:35.266081 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263391 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 19:53:35.266081 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263393 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 19:53:35.266081 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263396 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 19:53:35.266081 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263399 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 19:53:35.266081 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263402 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 19:53:35.266081 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263404 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 19:53:35.266081 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263407 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 19:53:35.266081 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263409 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 19:53:35.266081 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263413 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 19:53:35.266081 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263416 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 19:53:35.266081 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263418 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 19:53:35.266081 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263421 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 19:53:35.266081 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263424 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 19:53:35.266081 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263426 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 19:53:35.266565 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263429 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 19:53:35.266565 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263431 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 19:53:35.266565 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263434 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 19:53:35.266565 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263436 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 19:53:35.266565 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263440 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 19:53:35.266565 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263443 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 19:53:35.266565 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263446 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 19:53:35.266565 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263449 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 19:53:35.266565 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263452 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 19:53:35.266565 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263455 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 19:53:35.266565 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263457 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 19:53:35.266565 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263460 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 19:53:35.266565 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263463 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 19:53:35.266565 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263465 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 19:53:35.266565 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263468 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 19:53:35.266565 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263470 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 19:53:35.266565 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263472 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 19:53:35.266565 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263475 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 19:53:35.266565 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263477 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 19:53:35.266565 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263481 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 19:53:35.267047 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263484 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 19:53:35.267047 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263487 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 19:53:35.267047 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263834 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 19:53:35.267047 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263840 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 19:53:35.267047 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263844 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 19:53:35.267047 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263847 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 19:53:35.267047 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263850 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 19:53:35.267047 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263853 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 19:53:35.267047 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263857 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 19:53:35.267047 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263859 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 19:53:35.267047 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263862 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 19:53:35.267047 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263864 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 19:53:35.267047 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263867 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 19:53:35.267047 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263870 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 19:53:35.267047 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263873 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 19:53:35.267047 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263875 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 19:53:35.267047 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263878 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 19:53:35.267047 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263880 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 19:53:35.267047 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263883 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 19:53:35.267534 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263885 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 19:53:35.267534 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263888 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 19:53:35.267534 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263890 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 19:53:35.267534 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263892 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 19:53:35.267534 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263895 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 19:53:35.267534 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263898 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 19:53:35.267534 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263901 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 19:53:35.267534 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263903 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 19:53:35.267534 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263905 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 19:53:35.267534 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263908 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 19:53:35.267534 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263910 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 19:53:35.267534 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263913 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 19:53:35.267534 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263916 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 19:53:35.267534 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263919 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 19:53:35.267534 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263922 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 19:53:35.267534 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263925 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 19:53:35.267534 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263928 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 19:53:35.267534 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263930 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 19:53:35.267534 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263933 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 19:53:35.268004 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263935 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 19:53:35.268004 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263938 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 19:53:35.268004 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263941 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 19:53:35.268004 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263943 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 19:53:35.268004 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263946 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 19:53:35.268004 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263948 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 19:53:35.268004 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263951 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 19:53:35.268004 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263953 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 19:53:35.268004 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263956 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 19:53:35.268004 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263958 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 19:53:35.268004 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263961 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 19:53:35.268004 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263963 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 19:53:35.268004 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263966 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 19:53:35.268004 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263968 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 19:53:35.268004 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263970 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 19:53:35.268004 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263973 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 02 19:53:35.268004 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263975 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 19:53:35.268004 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263978 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 19:53:35.268004 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263980 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 19:53:35.268004 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263983 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 19:53:35.268502 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263985 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 19:53:35.268502 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263989 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 19:53:35.268502 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263992 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 19:53:35.268502 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263994 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 19:53:35.268502 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263996 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 19:53:35.268502 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.263999 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 19:53:35.268502 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264002 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 19:53:35.268502 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264005 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 19:53:35.268502 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264008 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 19:53:35.268502 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264011 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 19:53:35.268502 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264015 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 19:53:35.268502 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264018 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 19:53:35.268502 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264021 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 19:53:35.268502 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264024 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 19:53:35.268502 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264027 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 19:53:35.268502 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264030 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 19:53:35.268502 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264033 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 19:53:35.268502 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264035 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 19:53:35.268502 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264039 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 19:53:35.268982 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264041 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 19:53:35.268982 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264044 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 19:53:35.268982 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264046 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 19:53:35.268982 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264049 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 19:53:35.268982 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264051 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 19:53:35.268982 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264053 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 19:53:35.268982 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264056 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 19:53:35.268982 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264058 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 19:53:35.268982 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264061 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 19:53:35.268982 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264063 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 19:53:35.268982 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264067 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 19:53:35.268982 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264069 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 19:53:35.268982 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264072 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 19:53:35.268982 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264075 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 19:53:35.268982 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264077 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 19:53:35.268982 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264080 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 19:53:35.268982 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264082 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 19:53:35.268982 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264085 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 19:53:35.268982 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264088 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 19:53:35.268982 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264091 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 19:53:35.269492 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264093 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 19:53:35.269492 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264096 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 19:53:35.269492 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264107 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 19:53:35.269492 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264110 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 19:53:35.269492 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264196 2565 flags.go:64] FLAG: --address="0.0.0.0" Jul 02 19:53:35.269492 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264216 2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 02 19:53:35.269492 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264225 2565 flags.go:64] FLAG: --anonymous-auth="true" Jul 02 19:53:35.269492 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264230 2565 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 02 19:53:35.269492 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264234 2565 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 02 19:53:35.269492 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264237 2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 02 19:53:35.269492 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264241 2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 02 19:53:35.269492 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264245 2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 02 19:53:35.269492 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264248 2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 02 19:53:35.269492 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264251 2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 02 19:53:35.269492 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264254 2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 02 19:53:35.269492 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264257 2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 02 19:53:35.269492 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264260 2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 02 19:53:35.269492 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264263 2565 flags.go:64] FLAG: --cgroup-root="" Jul 02 19:53:35.269492 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264266 2565 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 02 19:53:35.269492 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264269 2565 flags.go:64] FLAG: --client-ca-file="" Jul 02 19:53:35.269492 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264272 2565 flags.go:64] FLAG: --cloud-provider="external" Jul 02 19:53:35.269492 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264275 2565 flags.go:64] FLAG: --cluster-dns="[]" Jul 02 19:53:35.269492 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264279 2565 flags.go:64] FLAG: --cluster-domain="" Jul 02 19:53:35.270037 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264281 2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 02 19:53:35.270037 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264284 2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 02 19:53:35.270037 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264287 2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 02 19:53:35.270037 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264290 2565 flags.go:64] FLAG: --container-log-max-files="5" Jul 02 19:53:35.270037 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264294 2565 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 02 19:53:35.270037 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264297 2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 02 19:53:35.270037 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264300 2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 02 19:53:35.270037 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264308 2565 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 02 19:53:35.270037 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264311 2565 flags.go:64] FLAG: --contention-profiling="false" Jul 02 19:53:35.270037 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264314 2565 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 02 19:53:35.270037 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264317 2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 02 19:53:35.270037 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264320 2565 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 02 19:53:35.270037 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264323 2565 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 02 19:53:35.270037 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264327 2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 02 19:53:35.270037 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264330 2565 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 02 19:53:35.270037 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264333 2565 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 02 19:53:35.270037 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264335 2565 flags.go:64] FLAG: --enable-load-reader="false" Jul 02 19:53:35.270037 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264350 2565 flags.go:64] FLAG: --enable-server="true" Jul 02 19:53:35.270037 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264353 2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 02 19:53:35.270037 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264358 2565 flags.go:64] FLAG: --event-burst="100" Jul 02 19:53:35.270037 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264361 2565 flags.go:64] FLAG: --event-qps="50" Jul 02 19:53:35.270037 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264364 2565 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 02 19:53:35.270037 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264367 2565 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 02 19:53:35.270037 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264369 2565 flags.go:64] FLAG: --eviction-hard="" Jul 02 19:53:35.270646 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264376 2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 02 19:53:35.270646 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264379 2565 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 02 19:53:35.270646 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264382 2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 02 19:53:35.270646 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264385 2565 flags.go:64] FLAG: --eviction-soft="" Jul 02 19:53:35.270646 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264388 2565 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 02 19:53:35.270646 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264391 2565 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 02 19:53:35.270646 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264393 2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 02 19:53:35.270646 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264396 2565 flags.go:64] FLAG: --experimental-mounter-path="" Jul 02 19:53:35.270646 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264399 2565 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 02 19:53:35.270646 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264402 2565 flags.go:64] FLAG: --fail-swap-on="true" Jul 02 19:53:35.270646 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264405 2565 flags.go:64] FLAG: --feature-gates="" Jul 02 19:53:35.270646 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264409 2565 flags.go:64] FLAG: --file-check-frequency="20s" Jul 02 19:53:35.270646 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264411 2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 02 19:53:35.270646 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264414 2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 02 19:53:35.270646 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264417 2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 02 19:53:35.270646 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264422 2565 flags.go:64] FLAG: --healthz-port="10248" Jul 02 19:53:35.270646 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264426 2565 flags.go:64] FLAG: --help="false" Jul 02 19:53:35.270646 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264429 2565 flags.go:64] FLAG: --hostname-override="ip-10-0-128-177.ec2.internal" Jul 02 19:53:35.270646 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264432 2565 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 02 19:53:35.270646 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264434 2565 flags.go:64] FLAG: --http-check-frequency="20s" Jul 02 19:53:35.270646 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264437 2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 02 19:53:35.270646 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264440 2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 02 19:53:35.270646 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264444 2565 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 02 19:53:35.271254 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264446 2565 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 02 19:53:35.271254 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264449 2565 flags.go:64] FLAG: --image-service-endpoint="" Jul 02 19:53:35.271254 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264452 2565 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 02 19:53:35.271254 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264455 2565 flags.go:64] FLAG: --kube-api-burst="100" Jul 02 19:53:35.271254 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264458 2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 02 19:53:35.271254 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264461 2565 flags.go:64] FLAG: --kube-api-qps="50" Jul 02 19:53:35.271254 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264464 2565 flags.go:64] FLAG: --kube-reserved="" Jul 02 19:53:35.271254 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264467 2565 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 02 19:53:35.271254 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264470 2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 02 19:53:35.271254 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264473 2565 flags.go:64] FLAG: --kubelet-cgroups="" Jul 02 19:53:35.271254 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264475 2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 02 19:53:35.271254 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264478 2565 flags.go:64] FLAG: --lock-file="" Jul 02 19:53:35.271254 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264481 2565 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 02 19:53:35.271254 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264483 2565 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 02 19:53:35.271254 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264486 2565 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 02 19:53:35.271254 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264491 2565 flags.go:64] FLAG: --log-json-split-stream="false" Jul 02 19:53:35.271254 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264494 2565 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 02 19:53:35.271254 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264496 2565 flags.go:64] FLAG: --log-text-split-stream="false" Jul 02 19:53:35.271254 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264499 2565 flags.go:64] FLAG: --logging-format="text" Jul 02 19:53:35.271254 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264502 2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 02 19:53:35.271254 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264505 2565 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 02 19:53:35.271254 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264508 2565 flags.go:64] FLAG: --manifest-url="" Jul 02 19:53:35.271254 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264511 2565 flags.go:64] FLAG: --manifest-url-header="" Jul 02 19:53:35.271254 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264515 2565 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 02 19:53:35.271254 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264521 2565 flags.go:64] FLAG: --max-open-files="1000000" Jul 02 19:53:35.271882 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264524 2565 flags.go:64] FLAG: --max-pods="110" Jul 02 19:53:35.271882 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264527 2565 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 02 19:53:35.271882 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264530 2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 02 19:53:35.271882 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264533 2565 flags.go:64] FLAG: --memory-manager-policy="None" Jul 02 19:53:35.271882 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264536 2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 02 19:53:35.271882 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264539 2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 02 19:53:35.271882 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264541 2565 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 02 19:53:35.271882 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264544 2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 02 19:53:35.271882 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264551 2565 flags.go:64] FLAG: --node-status-max-images="50" Jul 02 19:53:35.271882 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264554 2565 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 02 19:53:35.271882 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264557 2565 flags.go:64] FLAG: --oom-score-adj="-999" Jul 02 19:53:35.271882 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264560 2565 flags.go:64] FLAG: --pod-cidr="" Jul 02 19:53:35.271882 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264564 2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 02 19:53:35.271882 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264569 2565 flags.go:64] FLAG: --pod-manifest-path="" Jul 02 19:53:35.271882 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264572 2565 flags.go:64] FLAG: --pod-max-pids="-1" Jul 02 19:53:35.271882 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264575 2565 flags.go:64] FLAG: --pods-per-core="0" Jul 02 19:53:35.271882 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264578 2565 flags.go:64] FLAG: --port="10250" Jul 02 19:53:35.271882 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264581 2565 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 02 19:53:35.271882 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264584 2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02c03a57ef594ce4c" Jul 02 19:53:35.271882 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264587 2565 flags.go:64] FLAG: --qos-reserved="" Jul 02 19:53:35.271882 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264590 2565 flags.go:64] FLAG: --read-only-port="10255" Jul 02 19:53:35.271882 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264593 2565 flags.go:64] FLAG: --register-node="true" Jul 02 19:53:35.271882 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264595 2565 flags.go:64] FLAG: --register-with-taints="" Jul 02 19:53:35.271882 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264599 2565 flags.go:64] FLAG: --registry-burst="10" Jul 02 19:53:35.272481 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264602 2565 flags.go:64] FLAG: --registry-qps="5" Jul 02 19:53:35.272481 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264604 2565 flags.go:64] FLAG: --reserved-cpus="" Jul 02 19:53:35.272481 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264607 2565 flags.go:64] FLAG: --reserved-memory="" Jul 02 19:53:35.272481 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264610 2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 02 19:53:35.272481 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264613 2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 02 19:53:35.272481 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264616 2565 flags.go:64] FLAG: --rotate-certificates="false" Jul 02 19:53:35.272481 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264619 2565 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 02 19:53:35.272481 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264623 2565 flags.go:64] FLAG: --runonce="false" Jul 02 19:53:35.272481 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264627 2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 02 19:53:35.272481 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264630 2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 02 19:53:35.272481 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264633 2565 flags.go:64] FLAG: --seccomp-default="false" Jul 02 19:53:35.272481 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264635 2565 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 02 19:53:35.272481 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264638 2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 02 19:53:35.272481 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264642 2565 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 02 19:53:35.272481 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264645 2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 02 19:53:35.272481 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264648 2565 flags.go:64] FLAG: --storage-driver-password="root" Jul 02 19:53:35.272481 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264651 2565 flags.go:64] FLAG: --storage-driver-secure="false" Jul 02 19:53:35.272481 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264654 2565 flags.go:64] FLAG: --storage-driver-table="stats" Jul 02 19:53:35.272481 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264656 2565 flags.go:64] FLAG: --storage-driver-user="root" Jul 02 19:53:35.272481 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264659 2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 02 19:53:35.272481 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264662 2565 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 02 19:53:35.272481 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264666 2565 flags.go:64] FLAG: --system-cgroups="" Jul 02 19:53:35.272481 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264669 2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 02 19:53:35.272481 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264675 2565 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 02 19:53:35.272481 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264677 2565 flags.go:64] FLAG: --tls-cert-file="" Jul 02 19:53:35.273081 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264680 2565 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 02 19:53:35.273081 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264684 2565 flags.go:64] FLAG: --tls-min-version="" Jul 02 19:53:35.273081 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264687 2565 flags.go:64] FLAG: --tls-private-key-file="" Jul 02 19:53:35.273081 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264689 2565 flags.go:64] FLAG: --topology-manager-policy="none" Jul 02 19:53:35.273081 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264692 2565 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 02 19:53:35.273081 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264695 2565 flags.go:64] FLAG: --topology-manager-scope="container" Jul 02 19:53:35.273081 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264698 2565 flags.go:64] FLAG: --v="2" Jul 02 19:53:35.273081 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264702 2565 flags.go:64] FLAG: --version="false" Jul 02 19:53:35.273081 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264705 2565 flags.go:64] FLAG: --vmodule="" Jul 02 19:53:35.273081 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264709 2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 02 19:53:35.273081 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.264712 2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 02 19:53:35.273081 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264824 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 19:53:35.273081 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264828 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 19:53:35.273081 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264831 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 19:53:35.273081 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264835 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 19:53:35.273081 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264839 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 19:53:35.273081 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264842 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 19:53:35.273081 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264845 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 02 19:53:35.273081 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264847 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 19:53:35.273081 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264851 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 19:53:35.273081 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264855 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 19:53:35.273081 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264858 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 19:53:35.273631 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264861 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 19:53:35.273631 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264864 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 19:53:35.273631 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264867 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 19:53:35.273631 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264869 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 19:53:35.273631 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264872 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 19:53:35.273631 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264875 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 19:53:35.273631 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264877 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 19:53:35.273631 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264880 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 19:53:35.273631 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264883 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 19:53:35.273631 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264886 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 19:53:35.273631 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264888 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 19:53:35.273631 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264891 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 19:53:35.273631 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264893 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 19:53:35.273631 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264896 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 19:53:35.273631 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264898 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 19:53:35.273631 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264901 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 19:53:35.273631 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264903 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 19:53:35.273631 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264906 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 19:53:35.273631 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264908 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 19:53:35.273631 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264911 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 19:53:35.274477 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264913 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 19:53:35.274477 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264916 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 19:53:35.274477 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264919 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 19:53:35.274477 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264921 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 19:53:35.274477 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264926 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 19:53:35.274477 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264930 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 19:53:35.274477 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264933 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 19:53:35.274477 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264935 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 19:53:35.274477 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264938 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 19:53:35.274477 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264941 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 19:53:35.274477 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264943 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 19:53:35.274477 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264946 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 19:53:35.274477 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264948 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 19:53:35.274477 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264951 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 19:53:35.274477 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264953 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 19:53:35.274477 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264956 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 19:53:35.274477 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264958 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 19:53:35.274477 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264961 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 19:53:35.274477 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264964 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 19:53:35.274477 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264966 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 19:53:35.275258 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264969 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 19:53:35.275258 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264971 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 19:53:35.275258 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264974 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 19:53:35.275258 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264976 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 19:53:35.275258 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264980 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 19:53:35.275258 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264984 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 19:53:35.275258 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264986 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 19:53:35.275258 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264989 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 19:53:35.275258 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264991 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 19:53:35.275258 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264994 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 19:53:35.275258 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264996 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 19:53:35.275258 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.264999 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 19:53:35.275258 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.265001 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 19:53:35.275258 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.265003 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 19:53:35.275258 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.265006 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 19:53:35.275258 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.265009 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 19:53:35.275258 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.265014 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 19:53:35.275258 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.265019 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 19:53:35.275258 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.265021 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 19:53:35.276261 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.265024 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 19:53:35.276261 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.265027 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 19:53:35.276261 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.265030 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 19:53:35.276261 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.265032 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 19:53:35.276261 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.265035 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 19:53:35.276261 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.265037 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 19:53:35.276261 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.265040 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 19:53:35.276261 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.265042 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 19:53:35.276261 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.265045 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 19:53:35.276261 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.265047 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 19:53:35.276261 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.265050 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 19:53:35.276261 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.265052 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 19:53:35.276261 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.265055 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 19:53:35.276261 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.265058 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 19:53:35.276261 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.265061 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 19:53:35.276261 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.265063 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 19:53:35.276261 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.265066 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 19:53:35.276261 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.265068 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 19:53:35.276261 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.265071 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 19:53:35.276261 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.265073 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 19:53:35.276835 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.265076 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 19:53:35.276835 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.265078 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 19:53:35.276835 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.265081 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 19:53:35.276835 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.265083 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 19:53:35.276835 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.265085 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 19:53:35.276835 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.265088 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 19:53:35.276835 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.265091 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 19:53:35.276835 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.265093 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 19:53:35.276835 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.265096 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 19:53:35.276835 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.265856 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 19:53:35.276835 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.272459 2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 02 19:53:35.276835 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.272475 2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 02 19:53:35.276835 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.273180 2565 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 02 19:53:35.276835 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.273187 2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 02 19:53:35.277211 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273241 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 19:53:35.277211 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273246 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 19:53:35.277211 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273249 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 19:53:35.277211 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273252 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 19:53:35.277211 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273255 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 19:53:35.277211 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273258 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 19:53:35.277211 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273261 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 19:53:35.277211 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273263 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 19:53:35.277211 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273266 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 19:53:35.277211 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273269 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 19:53:35.277211 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273272 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 19:53:35.277211 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273275 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 19:53:35.277211 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273278 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 19:53:35.277211 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273280 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 19:53:35.277211 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273283 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 19:53:35.277211 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273286 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 19:53:35.277211 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273288 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 19:53:35.277211 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273291 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 19:53:35.277211 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273294 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 19:53:35.277211 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273296 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 19:53:35.277698 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273299 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 19:53:35.277698 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273302 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 19:53:35.277698 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273304 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 19:53:35.277698 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273307 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 19:53:35.277698 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273310 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 19:53:35.277698 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273312 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 19:53:35.277698 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273315 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 19:53:35.277698 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273317 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 19:53:35.277698 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273320 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 19:53:35.277698 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273324 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 19:53:35.277698 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273327 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 19:53:35.277698 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273331 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 19:53:35.277698 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273334 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 19:53:35.277698 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273351 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 19:53:35.277698 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273356 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 19:53:35.277698 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273359 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 19:53:35.277698 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273361 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 19:53:35.277698 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273364 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 19:53:35.277698 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273367 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 19:53:35.278162 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273369 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 19:53:35.278162 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273372 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 19:53:35.278162 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273375 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 19:53:35.278162 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273377 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 19:53:35.278162 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273380 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 19:53:35.278162 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273382 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 19:53:35.278162 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273384 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 19:53:35.278162 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273387 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 19:53:35.278162 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273389 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 19:53:35.278162 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273392 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 19:53:35.278162 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273394 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 19:53:35.278162 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273397 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 19:53:35.278162 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273399 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 19:53:35.278162 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273402 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 19:53:35.278162 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273404 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 19:53:35.278162 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273407 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 19:53:35.278162 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273409 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 19:53:35.278162 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273412 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 19:53:35.278162 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273414 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 19:53:35.278162 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273417 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 02 19:53:35.278767 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273420 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 19:53:35.278767 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273423 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 19:53:35.278767 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273427 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 19:53:35.278767 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273432 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 19:53:35.278767 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273435 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 19:53:35.278767 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273438 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 19:53:35.278767 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273441 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 19:53:35.278767 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273443 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 19:53:35.278767 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273446 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 19:53:35.278767 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273449 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 19:53:35.278767 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273451 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 19:53:35.278767 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273454 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 19:53:35.278767 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273456 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 19:53:35.278767 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273458 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 19:53:35.278767 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273461 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 19:53:35.278767 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273463 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 19:53:35.278767 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273466 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 19:53:35.278767 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273469 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 19:53:35.278767 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273471 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 19:53:35.278767 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273474 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 19:53:35.279243 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273476 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 19:53:35.279243 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273479 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 19:53:35.279243 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273481 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 19:53:35.279243 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273484 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 19:53:35.279243 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273486 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 19:53:35.279243 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273489 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 19:53:35.279243 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273492 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 19:53:35.279243 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273494 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 19:53:35.279243 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273497 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 19:53:35.279243 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273499 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 19:53:35.279243 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273502 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 19:53:35.279243 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273504 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 19:53:35.279243 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273507 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 19:53:35.279243 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273510 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 19:53:35.279243 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273514 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 19:53:35.279243 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273518 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 19:53:35.279243 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273521 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 19:53:35.279243 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273524 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 19:53:35.279243 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273527 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 19:53:35.279723 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273529 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 19:53:35.279723 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.273534 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 19:53:35.279723 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273644 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 19:53:35.279723 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273649 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 19:53:35.279723 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273652 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 19:53:35.279723 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273654 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 19:53:35.279723 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273657 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 19:53:35.279723 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273660 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 19:53:35.279723 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273662 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 19:53:35.279723 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273664 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 19:53:35.279723 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273667 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 19:53:35.279723 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273670 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 19:53:35.279723 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273672 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 19:53:35.279723 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273675 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 19:53:35.279723 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273677 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 19:53:35.280085 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273680 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 19:53:35.280085 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273682 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 19:53:35.280085 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273685 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 19:53:35.280085 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273687 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 19:53:35.280085 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273690 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 19:53:35.280085 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273692 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 19:53:35.280085 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273695 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 19:53:35.280085 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273697 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 19:53:35.280085 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273700 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 19:53:35.280085 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273702 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 19:53:35.280085 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273705 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 19:53:35.280085 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273707 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 19:53:35.280085 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273710 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 19:53:35.280085 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273712 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 19:53:35.280085 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273714 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 19:53:35.280085 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273749 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 19:53:35.280085 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273786 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 19:53:35.280085 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273792 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 19:53:35.280085 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273797 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 19:53:35.280085 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273802 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 19:53:35.280579 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273806 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 19:53:35.280579 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273811 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 19:53:35.280579 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273814 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 19:53:35.280579 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273817 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 19:53:35.280579 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273820 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 19:53:35.280579 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273822 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 19:53:35.280579 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273825 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 19:53:35.280579 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273828 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 19:53:35.280579 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273831 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 19:53:35.280579 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273837 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 19:53:35.280579 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273840 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 19:53:35.280579 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273843 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 19:53:35.280579 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273848 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 19:53:35.280579 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273852 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 02 19:53:35.280579 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273857 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 19:53:35.280579 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273861 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 19:53:35.280579 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273866 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 19:53:35.280579 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273946 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 19:53:35.280579 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273951 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 19:53:35.280579 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273956 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 19:53:35.281050 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273963 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 19:53:35.281050 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273974 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 19:53:35.281050 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273979 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 19:53:35.281050 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273984 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 19:53:35.281050 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273990 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 19:53:35.281050 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273994 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 19:53:35.281050 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.273999 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 19:53:35.281050 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.274003 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 19:53:35.281050 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.274018 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 19:53:35.281050 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.274022 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 19:53:35.281050 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.274027 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 19:53:35.281050 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.274031 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 19:53:35.281050 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.274035 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 19:53:35.281050 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.274039 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 19:53:35.281050 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.274049 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 19:53:35.281050 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.274053 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 19:53:35.281050 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.274058 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 19:53:35.281050 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.274062 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 19:53:35.281050 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.274067 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 19:53:35.281524 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.274071 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 19:53:35.281524 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.274076 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 19:53:35.281524 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.274080 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 19:53:35.281524 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.274084 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 19:53:35.281524 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.274088 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 19:53:35.281524 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.274093 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 19:53:35.281524 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.274097 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 19:53:35.281524 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.274106 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 19:53:35.281524 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.274110 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 19:53:35.281524 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.274115 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 19:53:35.281524 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.274119 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 19:53:35.281524 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.274123 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 19:53:35.281524 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.274128 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 19:53:35.281524 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.274132 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 19:53:35.281524 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.274136 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 19:53:35.281524 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.274141 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 19:53:35.281524 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.274145 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 19:53:35.281524 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.274149 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 19:53:35.281524 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.274153 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 19:53:35.281524 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.274157 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 19:53:35.281992 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.274167 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 19:53:35.281992 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.274172 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 19:53:35.281992 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.274177 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 19:53:35.281992 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.274181 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 19:53:35.281992 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.274185 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 19:53:35.281992 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.274190 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 19:53:35.281992 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:35.274196 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 19:53:35.281992 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.274205 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 19:53:35.281992 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.274442 2565 server.go:962] "Client rotation is on, will bootstrap in background" Jul 02 19:53:35.281992 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.276560 2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 02 19:53:35.281992 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.278020 2565 server.go:1019] "Starting client certificate rotation" Jul 02 19:53:35.281992 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.278115 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 19:53:35.281992 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.278143 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 19:53:35.284927 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.284913 2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 19:53:35.286271 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.286254 2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 19:53:35.302064 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.302046 2565 log.go:25] "Validated CRI v1 runtime API" Jul 02 19:53:35.304854 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.304836 2565 log.go:25] "Validated CRI v1 image API" Jul 02 19:53:35.306244 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.306229 2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 02 19:53:35.310405 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.310368 2565 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 97d86113-350b-480a-8038-1e1e77d90ae0:/dev/nvme0n1p4 d4de9e99-7a88-4cef-8bbc-39bd38c70fac:/dev/nvme0n1p3] Jul 02 19:53:35.310464 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.310405 2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 02 19:53:35.313273 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.313255 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 19:53:35.316851 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.316746 2565 manager.go:216] Machine: {Timestamp:2026-07-02 19:53:35.314430306 +0000 UTC m=+0.380488159 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098328 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26c941ab85fc700ce993505e2d50b9 SystemUUID:ec26c941-ab85-fc70-0ce9-93505e2d50b9 BootID:1fecaaa7-0f0c-4407-9c3f-53e89ef8395e Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ce:e2:54:56:9d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ce:e2:54:56:9d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e6:a9:2c:96:b5:c8 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 02 19:53:35.316851 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.316849 2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 02 19:53:35.316950 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.316923 2565 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 02 19:53:35.319011 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.318980 2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 02 19:53:35.319156 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.319014 2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-177.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 02 19:53:35.320239 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.320229 2565 topology_manager.go:138] "Creating topology manager with none policy" Jul 02 19:53:35.320281 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.320242 2565 container_manager_linux.go:309] "Creating device plugin manager" Jul 02 19:53:35.320281 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.320249 2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 19:53:35.320866 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.320855 2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 19:53:35.322238 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.322228 2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 02 19:53:35.325084 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.325073 2565 state_mem.go:36] "Initialized new in-memory state store" Jul 02 19:53:35.325196 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.325187 2565 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 02 19:53:35.325225 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.325215 2565 kubelet.go:486] "Attempting to sync node with API server" Jul 02 19:53:35.325225 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.325225 2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 02 19:53:35.325278 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.325246 2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 02 19:53:35.325278 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.325255 2565 kubelet.go:398] "Adding apiserver pod source" Jul 02 19:53:35.325278 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.325264 2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 02 19:53:35.325660 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.325640 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 19:53:35.325749 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.325676 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 19:53:35.329676 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.329655 2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 02 19:53:35.331355 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.331328 2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 02 19:53:35.331433 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.331379 2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 02 19:53:35.332510 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.332497 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 02 19:53:35.332597 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.332515 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 02 19:53:35.332597 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.332524 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 02 19:53:35.332597 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.332532 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 02 19:53:35.332597 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.332545 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 02 19:53:35.332597 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.332552 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 02 19:53:35.332597 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.332564 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 02 19:53:35.332597 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.332572 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 02 19:53:35.332597 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.332581 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 02 19:53:35.332597 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.332589 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 02 19:53:35.332597 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.332600 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 02 19:53:35.332885 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.332608 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 02 19:53:35.333356 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.333333 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 02 19:53:35.333405 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.333359 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 02 19:53:35.336941 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.336302 2565 server.go:1268] "Started kubelet" Jul 02 19:53:35.336941 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.336387 2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 02 19:53:35.336941 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.336516 2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 02 19:53:35.336941 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.336570 2565 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 02 19:53:35.337090 ip-10-0-128-177 systemd[1]: Started Kubernetes Kubelet. Jul 02 19:53:35.337761 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.337687 2565 server.go:310] "Adding debug handlers to kubelet server" Jul 02 19:53:35.338249 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.338231 2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 02 19:53:35.338748 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:35.338729 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-177.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 02 19:53:35.339051 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:35.339021 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 02 19:53:35.339091 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.339055 2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-177.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 02 19:53:35.343152 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:35.343120 2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 02 19:53:35.344364 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.344322 2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 02 19:53:35.344443 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.344406 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 02 19:53:35.344443 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:35.344414 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-177.ec2.internal\" not found" Jul 02 19:53:35.345020 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.344962 2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 02 19:53:35.345020 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.344963 2565 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 02 19:53:35.345020 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.344985 2565 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 02 19:53:35.345196 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.345151 2565 reconstruct.go:97] "Volume reconstruction finished" Jul 02 19:53:35.345196 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.345159 2565 reconciler.go:29] "Reconciler: start to sync state" Jul 02 19:53:35.346068 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:35.345168 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-177.ec2.internal.18be91137ad1d495 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-177.ec2.internal,UID:ip-10-0-128-177.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-177.ec2.internal,},FirstTimestamp:2026-07-02 19:53:35.336273045 +0000 UTC m=+0.402330899,LastTimestamp:2026-07-02 19:53:35.336273045 +0000 UTC m=+0.402330899,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-177.ec2.internal,}" Jul 02 19:53:35.346152 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.346098 2565 factory.go:55] Registering systemd factory Jul 02 19:53:35.346152 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.346112 2565 factory.go:223] Registration of the systemd container factory successfully Jul 02 19:53:35.346315 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.346298 2565 factory.go:153] Registering CRI-O factory Jul 02 19:53:35.346315 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.346311 2565 factory.go:223] Registration of the crio container factory successfully Jul 02 19:53:35.346458 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.346380 2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 02 19:53:35.346458 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.346402 2565 factory.go:103] Registering Raw factory Jul 02 19:53:35.346458 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.346417 2565 manager.go:1196] Started watching for new ooms in manager Jul 02 19:53:35.347040 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.347023 2565 manager.go:349] Starting recovery of all containers Jul 02 19:53:35.350566 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:35.350533 2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-177.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 02 19:53:35.350712 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:35.350646 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 02 19:53:35.356547 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.356532 2565 manager.go:354] Recovery completed Jul 02 19:53:35.360412 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.360392 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wdccd" Jul 02 19:53:35.361556 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.361545 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 19:53:35.363351 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.363320 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-177.ec2.internal" event="NodeHasSufficientMemory" Jul 02 19:53:35.363417 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.363368 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-177.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 19:53:35.363417 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.363383 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-177.ec2.internal" event="NodeHasSufficientPID" Jul 02 19:53:35.363885 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.363872 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 19:53:35.363948 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.363873 2565 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 02 19:53:35.363948 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.363932 2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 02 19:53:35.364070 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.363951 2565 state_mem.go:36] "Initialized new in-memory state store" Jul 02 19:53:35.364532 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.364520 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-177.ec2.internal" event="NodeHasSufficientMemory" Jul 02 19:53:35.364577 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.364544 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-177.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 19:53:35.364577 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.364558 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-177.ec2.internal" event="NodeHasSufficientPID" Jul 02 19:53:35.365241 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.365229 2565 policy_none.go:49] "None policy: Start" Jul 02 19:53:35.365299 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.365247 2565 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 02 19:53:35.365299 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.365261 2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 02 19:53:35.365581 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:35.365520 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-177.ec2.internal.18be91137c6f084c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-177.ec2.internal,UID:ip-10-0-128-177.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-177.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-177.ec2.internal,},FirstTimestamp:2026-07-02 19:53:35.363352652 +0000 UTC m=+0.429410505,LastTimestamp:2026-07-02 19:53:35.363352652 +0000 UTC m=+0.429410505,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-177.ec2.internal,}" Jul 02 19:53:35.366411 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.366399 2565 policy_none.go:47] "Start" Jul 02 19:53:35.367444 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.367329 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wdccd" Jul 02 19:53:35.403000 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.402983 2565 manager.go:337] "Starting Device Plugin manager" Jul 02 19:53:35.421726 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:35.403017 2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 02 19:53:35.421726 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.403027 2565 server.go:87] "Starting device plugin registration server" Jul 02 19:53:35.421726 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.403233 2565 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 02 19:53:35.421726 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.403243 2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 02 19:53:35.421726 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.403308 2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 02 19:53:35.421726 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.403396 2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 02 19:53:35.421726 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.403405 2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 02 19:53:35.421726 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:35.403870 2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 02 19:53:35.421726 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:35.403911 2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-177.ec2.internal\" not found" Jul 02 19:53:35.503983 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.503923 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 19:53:35.504892 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.504877 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-177.ec2.internal" event="NodeHasSufficientMemory" Jul 02 19:53:35.504943 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.504909 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-177.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 19:53:35.504943 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.504921 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-177.ec2.internal" event="NodeHasSufficientPID" Jul 02 19:53:35.505004 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.504946 2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-177.ec2.internal" Jul 02 19:53:35.512608 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.512582 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 02 19:53:35.513753 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.513732 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 02 19:53:35.513820 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.513774 2565 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 02 19:53:35.513820 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.513797 2565 kubelet.go:2448] "Starting kubelet main sync loop" Jul 02 19:53:35.513945 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:35.513840 2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 02 19:53:35.514086 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.514071 2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-177.ec2.internal" Jul 02 19:53:35.514140 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:35.514093 2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-177.ec2.internal\": node \"ip-10-0-128-177.ec2.internal\" not found" Jul 02 19:53:35.515958 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.515940 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 19:53:35.556171 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:35.556149 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-177.ec2.internal\" not found" Jul 02 19:53:35.614728 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.614695 2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-177.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-177.ec2.internal"] Jul 02 19:53:35.614781 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.614766 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 19:53:35.615527 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.615510 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-177.ec2.internal" event="NodeHasSufficientMemory" Jul 02 19:53:35.615604 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.615536 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-177.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 19:53:35.615604 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.615548 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-177.ec2.internal" event="NodeHasSufficientPID" Jul 02 19:53:35.616723 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.616711 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 19:53:35.616840 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.616827 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-177.ec2.internal" Jul 02 19:53:35.616879 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.616854 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 19:53:35.617369 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.617330 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-177.ec2.internal" event="NodeHasSufficientMemory" Jul 02 19:53:35.617435 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.617383 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-177.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 19:53:35.617435 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.617392 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-177.ec2.internal" event="NodeHasSufficientPID" Jul 02 19:53:35.618532 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.618517 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-177.ec2.internal" event="NodeHasSufficientMemory" Jul 02 19:53:35.618596 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.618550 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-177.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 19:53:35.618596 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.618564 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-177.ec2.internal" event="NodeHasSufficientPID" Jul 02 19:53:35.619887 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.619872 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-177.ec2.internal" Jul 02 19:53:35.619938 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.619897 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 19:53:35.620560 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.620543 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-177.ec2.internal" event="NodeHasSufficientMemory" Jul 02 19:53:35.620655 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.620571 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-177.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 19:53:35.620655 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.620586 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-177.ec2.internal" event="NodeHasSufficientPID" Jul 02 19:53:35.642839 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:35.642813 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-177.ec2.internal\" not found" node="ip-10-0-128-177.ec2.internal" Jul 02 19:53:35.646923 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.646907 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2c3a208bdce47c4450c7ecd763a8b29d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-177.ec2.internal\" (UID: \"2c3a208bdce47c4450c7ecd763a8b29d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-177.ec2.internal" Jul 02 19:53:35.646995 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.646929 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c3a208bdce47c4450c7ecd763a8b29d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-177.ec2.internal\" (UID: \"2c3a208bdce47c4450c7ecd763a8b29d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-177.ec2.internal" Jul 02 19:53:35.646995 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.646946 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ac215e8f2fda4d1193f85f856768dbe3-config\") pod \"kube-apiserver-proxy-ip-10-0-128-177.ec2.internal\" (UID: \"ac215e8f2fda4d1193f85f856768dbe3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-177.ec2.internal" Jul 02 19:53:35.646995 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:35.646955 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-177.ec2.internal\" not found" node="ip-10-0-128-177.ec2.internal" Jul 02 19:53:35.656215 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:35.656196 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-177.ec2.internal\" not found" Jul 02 19:53:35.747020 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.746998 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c3a208bdce47c4450c7ecd763a8b29d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-177.ec2.internal\" (UID: \"2c3a208bdce47c4450c7ecd763a8b29d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-177.ec2.internal" Jul 02 19:53:35.747087 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.747024 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ac215e8f2fda4d1193f85f856768dbe3-config\") pod \"kube-apiserver-proxy-ip-10-0-128-177.ec2.internal\" (UID: \"ac215e8f2fda4d1193f85f856768dbe3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-177.ec2.internal" Jul 02 19:53:35.747087 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.747048 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2c3a208bdce47c4450c7ecd763a8b29d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-177.ec2.internal\" (UID: \"2c3a208bdce47c4450c7ecd763a8b29d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-177.ec2.internal" Jul 02 19:53:35.747159 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.747085 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2c3a208bdce47c4450c7ecd763a8b29d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-177.ec2.internal\" (UID: \"2c3a208bdce47c4450c7ecd763a8b29d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-177.ec2.internal" Jul 02 19:53:35.747159 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.747091 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c3a208bdce47c4450c7ecd763a8b29d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-177.ec2.internal\" (UID: \"2c3a208bdce47c4450c7ecd763a8b29d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-177.ec2.internal" Jul 02 19:53:35.747159 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.747094 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ac215e8f2fda4d1193f85f856768dbe3-config\") pod \"kube-apiserver-proxy-ip-10-0-128-177.ec2.internal\" (UID: \"ac215e8f2fda4d1193f85f856768dbe3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-177.ec2.internal" Jul 02 19:53:35.757143 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:35.757104 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-177.ec2.internal\" not found" Jul 02 19:53:35.857816 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:35.857793 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-177.ec2.internal\" not found" Jul 02 19:53:35.950672 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.950631 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-177.ec2.internal" Jul 02 19:53:35.950769 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:35.950651 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-177.ec2.internal" Jul 02 19:53:35.958275 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:35.958258 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-177.ec2.internal\" not found" Jul 02 19:53:36.058424 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:36.058353 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-177.ec2.internal\" not found" Jul 02 19:53:36.159464 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:36.159435 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-177.ec2.internal\" not found" Jul 02 19:53:36.190124 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.190102 2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 19:53:36.246697 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.246656 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-177.ec2.internal" Jul 02 19:53:36.263914 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.263891 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 19:53:36.266490 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.266472 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-177.ec2.internal" Jul 02 19:53:36.275466 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.275445 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 19:53:36.277754 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.277739 2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 02 19:53:36.277868 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.277852 2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 19:53:36.325651 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.325589 2565 apiserver.go:52] "Watching apiserver" Jul 02 19:53:36.336921 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.336898 2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 02 19:53:36.337308 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.337286 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-pkncj","kube-system/konnectivity-agent-n844d","openshift-image-registry/node-ca-56fgj","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-177.ec2.internal","openshift-multus/network-metrics-daemon-p88nv","openshift-network-diagnostics/network-check-target-l67dn","openshift-network-operator/iptables-alerter-956ts","openshift-ovn-kubernetes/ovnkube-node-5xg6t","kube-system/kube-apiserver-proxy-ip-10-0-128-177.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rsxhh","openshift-cluster-node-tuning-operator/tuned-9dcp2","openshift-dns/node-resolver-kxsct","openshift-multus/multus-additional-cni-plugins-rpsqp","openshift-multus/multus-vshgf"] Jul 02 19:53:36.338920 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.338900 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rsxhh" Jul 02 19:53:36.341792 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.340534 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rpsqp" Jul 02 19:53:36.341792 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.341492 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 02 19:53:36.341792 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.341684 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 02 19:53:36.342031 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.342001 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4glzx\"" Jul 02 19:53:36.342109 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.342092 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 02 19:53:36.342992 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.342969 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-56fgj" Jul 02 19:53:36.343593 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.343567 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 02 19:53:36.343802 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.343775 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8zwb2\"" Jul 02 19:53:36.343878 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.343835 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 02 19:53:36.343878 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.343788 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 02 19:53:36.343993 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.343936 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 02 19:53:36.344242 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.344225 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 02 19:53:36.345137 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.345118 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 02 19:53:36.345137 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.345134 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vshgf" Jul 02 19:53:36.345572 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.345551 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-lv62z\"" Jul 02 19:53:36.346038 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.346015 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 02 19:53:36.346254 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.346211 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 02 19:53:36.346408 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.346392 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p88nv" Jul 02 19:53:36.346481 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.346448 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 02 19:53:36.346481 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:36.346463 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p88nv" podUID="dcc079e4-e2c2-4752-a947-0ec3ce3ccab4" Jul 02 19:53:36.347689 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.347666 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l67dn" Jul 02 19:53:36.347689 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.347687 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 02 19:53:36.347837 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:36.347724 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l67dn" podUID="0edfe493-6e53-42b3-9068-7b80cd51aa5a" Jul 02 19:53:36.347893 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.347839 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-cvnt7\"" Jul 02 19:53:36.349179 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.349158 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:53:36.350492 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.350476 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-956ts" Jul 02 19:53:36.352045 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.352024 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/83f44c56-f3a8-4d12-9adc-c916a2990bf5-multus-daemon-config\") pod \"multus-vshgf\" (UID: \"83f44c56-f3a8-4d12-9adc-c916a2990bf5\") " pod="openshift-multus/multus-vshgf" Jul 02 19:53:36.352127 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.352069 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-n844d" Jul 02 19:53:36.352190 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.352071 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cf3eddde-4aff-4a84-894c-cc18416aaafc-device-dir\") pod \"aws-ebs-csi-driver-node-rsxhh\" (UID: \"cf3eddde-4aff-4a84-894c-cc18416aaafc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rsxhh" Jul 02 19:53:36.352190 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.352162 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1b47afea-97df-4176-b7d1-7f5eeb6c38d6-cnibin\") pod \"multus-additional-cni-plugins-rpsqp\" (UID: \"1b47afea-97df-4176-b7d1-7f5eeb6c38d6\") " pod="openshift-multus/multus-additional-cni-plugins-rpsqp" Jul 02 19:53:36.352294 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.352188 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1b47afea-97df-4176-b7d1-7f5eeb6c38d6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rpsqp\" (UID: \"1b47afea-97df-4176-b7d1-7f5eeb6c38d6\") " pod="openshift-multus/multus-additional-cni-plugins-rpsqp" Jul 02 19:53:36.352294 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.352214 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2bc9\" (UniqueName: \"kubernetes.io/projected/7295278e-a6f2-4725-99e7-7f76ea6da868-kube-api-access-t2bc9\") pod \"node-ca-56fgj\" (UID: \"7295278e-a6f2-4725-99e7-7f76ea6da868\") " pod="openshift-image-registry/node-ca-56fgj" Jul 02 19:53:36.352294 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.352238 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83f44c56-f3a8-4d12-9adc-c916a2990bf5-etc-kubernetes\") pod \"multus-vshgf\" (UID: \"83f44c56-f3a8-4d12-9adc-c916a2990bf5\") " pod="openshift-multus/multus-vshgf" Jul 02 19:53:36.352294 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.352266 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dcc079e4-e2c2-4752-a947-0ec3ce3ccab4-metrics-certs\") pod \"network-metrics-daemon-p88nv\" (UID: \"dcc079e4-e2c2-4752-a947-0ec3ce3ccab4\") " pod="openshift-multus/network-metrics-daemon-p88nv" Jul 02 19:53:36.352504 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.352293 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-666dh\" (UniqueName: \"kubernetes.io/projected/dcc079e4-e2c2-4752-a947-0ec3ce3ccab4-kube-api-access-666dh\") pod \"network-metrics-daemon-p88nv\" (UID: \"dcc079e4-e2c2-4752-a947-0ec3ce3ccab4\") " pod="openshift-multus/network-metrics-daemon-p88nv" Jul 02 19:53:36.352504 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.352321 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/83f44c56-f3a8-4d12-9adc-c916a2990bf5-cni-binary-copy\") pod \"multus-vshgf\" (UID: \"83f44c56-f3a8-4d12-9adc-c916a2990bf5\") " pod="openshift-multus/multus-vshgf" Jul 02 19:53:36.352504 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.352380 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/83f44c56-f3a8-4d12-9adc-c916a2990bf5-host-var-lib-cni-bin\") pod \"multus-vshgf\" (UID: \"83f44c56-f3a8-4d12-9adc-c916a2990bf5\") " pod="openshift-multus/multus-vshgf" Jul 02 19:53:36.352504 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.352419 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/83f44c56-f3a8-4d12-9adc-c916a2990bf5-hostroot\") pod \"multus-vshgf\" (UID: \"83f44c56-f3a8-4d12-9adc-c916a2990bf5\") " pod="openshift-multus/multus-vshgf" Jul 02 19:53:36.352504 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.352475 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qppsz\" (UniqueName: \"kubernetes.io/projected/83f44c56-f3a8-4d12-9adc-c916a2990bf5-kube-api-access-qppsz\") pod \"multus-vshgf\" (UID: \"83f44c56-f3a8-4d12-9adc-c916a2990bf5\") " pod="openshift-multus/multus-vshgf" Jul 02 19:53:36.352751 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.352525 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/83f44c56-f3a8-4d12-9adc-c916a2990bf5-host-run-netns\") pod \"multus-vshgf\" (UID: \"83f44c56-f3a8-4d12-9adc-c916a2990bf5\") " pod="openshift-multus/multus-vshgf" Jul 02 19:53:36.352751 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.352560 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/83f44c56-f3a8-4d12-9adc-c916a2990bf5-host-run-multus-certs\") pod \"multus-vshgf\" (UID: \"83f44c56-f3a8-4d12-9adc-c916a2990bf5\") " pod="openshift-multus/multus-vshgf" Jul 02 19:53:36.352751 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.352587 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/83f44c56-f3a8-4d12-9adc-c916a2990bf5-host-run-k8s-cni-cncf-io\") pod \"multus-vshgf\" (UID: \"83f44c56-f3a8-4d12-9adc-c916a2990bf5\") " pod="openshift-multus/multus-vshgf" Jul 02 19:53:36.352751 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.352612 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1b47afea-97df-4176-b7d1-7f5eeb6c38d6-os-release\") pod \"multus-additional-cni-plugins-rpsqp\" (UID: \"1b47afea-97df-4176-b7d1-7f5eeb6c38d6\") " pod="openshift-multus/multus-additional-cni-plugins-rpsqp" Jul 02 19:53:36.352751 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.352637 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cf3eddde-4aff-4a84-894c-cc18416aaafc-etc-selinux\") pod \"aws-ebs-csi-driver-node-rsxhh\" (UID: \"cf3eddde-4aff-4a84-894c-cc18416aaafc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rsxhh" Jul 02 19:53:36.352751 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.352662 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8lpv\" (UniqueName: \"kubernetes.io/projected/cf3eddde-4aff-4a84-894c-cc18416aaafc-kube-api-access-n8lpv\") pod \"aws-ebs-csi-driver-node-rsxhh\" (UID: \"cf3eddde-4aff-4a84-894c-cc18416aaafc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rsxhh" Jul 02 19:53:36.352751 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.352689 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1b47afea-97df-4176-b7d1-7f5eeb6c38d6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rpsqp\" (UID: \"1b47afea-97df-4176-b7d1-7f5eeb6c38d6\") " pod="openshift-multus/multus-additional-cni-plugins-rpsqp" Jul 02 19:53:36.352751 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.352715 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cf3eddde-4aff-4a84-894c-cc18416aaafc-registration-dir\") pod \"aws-ebs-csi-driver-node-rsxhh\" (UID: \"cf3eddde-4aff-4a84-894c-cc18416aaafc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rsxhh" Jul 02 19:53:36.352751 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.352744 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8smzp\" (UniqueName: \"kubernetes.io/projected/1b47afea-97df-4176-b7d1-7f5eeb6c38d6-kube-api-access-8smzp\") pod \"multus-additional-cni-plugins-rpsqp\" (UID: \"1b47afea-97df-4176-b7d1-7f5eeb6c38d6\") " pod="openshift-multus/multus-additional-cni-plugins-rpsqp" Jul 02 19:53:36.353127 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.352770 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/83f44c56-f3a8-4d12-9adc-c916a2990bf5-multus-cni-dir\") pod \"multus-vshgf\" (UID: \"83f44c56-f3a8-4d12-9adc-c916a2990bf5\") " pod="openshift-multus/multus-vshgf" Jul 02 19:53:36.353127 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.352796 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/83f44c56-f3a8-4d12-9adc-c916a2990bf5-multus-socket-dir-parent\") pod \"multus-vshgf\" (UID: \"83f44c56-f3a8-4d12-9adc-c916a2990bf5\") " pod="openshift-multus/multus-vshgf" Jul 02 19:53:36.353127 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.352821 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/83f44c56-f3a8-4d12-9adc-c916a2990bf5-host-var-lib-kubelet\") pod \"multus-vshgf\" (UID: \"83f44c56-f3a8-4d12-9adc-c916a2990bf5\") " pod="openshift-multus/multus-vshgf" Jul 02 19:53:36.353127 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.352848 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cf3eddde-4aff-4a84-894c-cc18416aaafc-socket-dir\") pod \"aws-ebs-csi-driver-node-rsxhh\" (UID: \"cf3eddde-4aff-4a84-894c-cc18416aaafc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rsxhh" Jul 02 19:53:36.353127 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.352881 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cf3eddde-4aff-4a84-894c-cc18416aaafc-sys-fs\") pod \"aws-ebs-csi-driver-node-rsxhh\" (UID: \"cf3eddde-4aff-4a84-894c-cc18416aaafc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rsxhh" Jul 02 19:53:36.353127 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.352905 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/83f44c56-f3a8-4d12-9adc-c916a2990bf5-cnibin\") pod \"multus-vshgf\" (UID: \"83f44c56-f3a8-4d12-9adc-c916a2990bf5\") " pod="openshift-multus/multus-vshgf" Jul 02 19:53:36.353127 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.352920 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/83f44c56-f3a8-4d12-9adc-c916a2990bf5-multus-conf-dir\") pod \"multus-vshgf\" (UID: \"83f44c56-f3a8-4d12-9adc-c916a2990bf5\") " pod="openshift-multus/multus-vshgf" Jul 02 19:53:36.353127 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.352935 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cf3eddde-4aff-4a84-894c-cc18416aaafc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rsxhh\" (UID: \"cf3eddde-4aff-4a84-894c-cc18416aaafc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rsxhh" Jul 02 19:53:36.353127 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.352959 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1b47afea-97df-4176-b7d1-7f5eeb6c38d6-cni-binary-copy\") pod \"multus-additional-cni-plugins-rpsqp\" (UID: \"1b47afea-97df-4176-b7d1-7f5eeb6c38d6\") " pod="openshift-multus/multus-additional-cni-plugins-rpsqp" Jul 02 19:53:36.353127 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.352982 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1b47afea-97df-4176-b7d1-7f5eeb6c38d6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rpsqp\" (UID: \"1b47afea-97df-4176-b7d1-7f5eeb6c38d6\") " pod="openshift-multus/multus-additional-cni-plugins-rpsqp" Jul 02 19:53:36.353127 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.353002 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7295278e-a6f2-4725-99e7-7f76ea6da868-host\") pod \"node-ca-56fgj\" (UID: \"7295278e-a6f2-4725-99e7-7f76ea6da868\") " pod="openshift-image-registry/node-ca-56fgj" Jul 02 19:53:36.353127 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.353024 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7295278e-a6f2-4725-99e7-7f76ea6da868-serviceca\") pod \"node-ca-56fgj\" (UID: \"7295278e-a6f2-4725-99e7-7f76ea6da868\") " pod="openshift-image-registry/node-ca-56fgj" Jul 02 19:53:36.353127 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.353049 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/83f44c56-f3a8-4d12-9adc-c916a2990bf5-host-var-lib-cni-multus\") pod \"multus-vshgf\" (UID: \"83f44c56-f3a8-4d12-9adc-c916a2990bf5\") " pod="openshift-multus/multus-vshgf" Jul 02 19:53:36.353127 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.353091 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1b47afea-97df-4176-b7d1-7f5eeb6c38d6-system-cni-dir\") pod \"multus-additional-cni-plugins-rpsqp\" (UID: \"1b47afea-97df-4176-b7d1-7f5eeb6c38d6\") " pod="openshift-multus/multus-additional-cni-plugins-rpsqp" Jul 02 19:53:36.353127 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.353126 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/83f44c56-f3a8-4d12-9adc-c916a2990bf5-system-cni-dir\") pod \"multus-vshgf\" (UID: \"83f44c56-f3a8-4d12-9adc-c916a2990bf5\") " pod="openshift-multus/multus-vshgf" Jul 02 19:53:36.353781 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.353149 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/83f44c56-f3a8-4d12-9adc-c916a2990bf5-os-release\") pod \"multus-vshgf\" (UID: \"83f44c56-f3a8-4d12-9adc-c916a2990bf5\") " pod="openshift-multus/multus-vshgf" Jul 02 19:53:36.353781 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.353210 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 02 19:53:36.353781 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.353291 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-smsxd\"" Jul 02 19:53:36.353781 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.353384 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 02 19:53:36.353781 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.353403 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 02 19:53:36.353781 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.353411 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 02 19:53:36.353781 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.353469 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 02 19:53:36.353781 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.353528 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 02 19:53:36.353781 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.353533 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 02 19:53:36.353781 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.353603 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7ffnv\"" Jul 02 19:53:36.353781 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.353646 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 02 19:53:36.354238 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.353847 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 02 19:53:36.354238 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.353864 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pkncj" Jul 02 19:53:36.354238 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:36.353922 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pkncj" podUID="e92927e3-3534-4747-ad6e-e0df14b731d3" Jul 02 19:53:36.354726 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.354704 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 02 19:53:36.354855 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.354757 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 02 19:53:36.354855 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.354761 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-shvgj\"" Jul 02 19:53:36.355518 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.355496 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9dcp2" Jul 02 19:53:36.357277 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.357259 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kxsct" Jul 02 19:53:36.357881 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.357867 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 02 19:53:36.358221 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.358205 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 02 19:53:36.358293 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.358265 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 19:53:36.358353 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.358207 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jwzh8\"" Jul 02 19:53:36.360137 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.360112 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 02 19:53:36.360137 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.360117 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 02 19:53:36.360321 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.360303 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-sgns2\"" Jul 02 19:53:36.369818 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.369779 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-01 19:48:36 +0000 UTC" deadline="2028-04-04 05:46:20.987196602 +0000 UTC" Jul 02 19:53:36.369901 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.369818 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15393h52m44.61738188s" Jul 02 19:53:36.381680 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.381664 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5btvl" Jul 02 19:53:36.390454 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.390175 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5btvl" Jul 02 19:53:36.446031 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.446011 2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 02 19:53:36.453918 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.453889 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cf3eddde-4aff-4a84-894c-cc18416aaafc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rsxhh\" (UID: \"cf3eddde-4aff-4a84-894c-cc18416aaafc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rsxhh" Jul 02 19:53:36.454028 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.453971 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cf3eddde-4aff-4a84-894c-cc18416aaafc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rsxhh\" (UID: \"cf3eddde-4aff-4a84-894c-cc18416aaafc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rsxhh" Jul 02 19:53:36.454028 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.454011 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7295278e-a6f2-4725-99e7-7f76ea6da868-host\") pod \"node-ca-56fgj\" (UID: \"7295278e-a6f2-4725-99e7-7f76ea6da868\") " pod="openshift-image-registry/node-ca-56fgj" Jul 02 19:53:36.454120 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.454029 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7295278e-a6f2-4725-99e7-7f76ea6da868-serviceca\") pod \"node-ca-56fgj\" (UID: \"7295278e-a6f2-4725-99e7-7f76ea6da868\") " pod="openshift-image-registry/node-ca-56fgj" Jul 02 19:53:36.454120 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.454047 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aa025c37-d383-4274-9259-b2a187bcf158-lib-modules\") pod \"tuned-9dcp2\" (UID: \"aa025c37-d383-4274-9259-b2a187bcf158\") " pod="openshift-cluster-node-tuning-operator/tuned-9dcp2" Jul 02 19:53:36.454120 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.454069 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/83f44c56-f3a8-4d12-9adc-c916a2990bf5-os-release\") pod \"multus-vshgf\" (UID: \"83f44c56-f3a8-4d12-9adc-c916a2990bf5\") " pod="openshift-multus/multus-vshgf" Jul 02 19:53:36.454120 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.454085 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/83f44c56-f3a8-4d12-9adc-c916a2990bf5-multus-daemon-config\") pod \"multus-vshgf\" (UID: \"83f44c56-f3a8-4d12-9adc-c916a2990bf5\") " pod="openshift-multus/multus-vshgf" Jul 02 19:53:36.454299 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.454153 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7295278e-a6f2-4725-99e7-7f76ea6da868-host\") pod \"node-ca-56fgj\" (UID: \"7295278e-a6f2-4725-99e7-7f76ea6da868\") " pod="openshift-image-registry/node-ca-56fgj" Jul 02 19:53:36.454299 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.454226 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f78c0ffa-96d5-4c22-8bff-39b81bc11b5a-run-openvswitch\") pod \"ovnkube-node-5xg6t\" (UID: \"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:53:36.454299 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.454264 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cf3eddde-4aff-4a84-894c-cc18416aaafc-device-dir\") pod \"aws-ebs-csi-driver-node-rsxhh\" (UID: \"cf3eddde-4aff-4a84-894c-cc18416aaafc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rsxhh" Jul 02 19:53:36.454299 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.454294 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1b47afea-97df-4176-b7d1-7f5eeb6c38d6-cnibin\") pod \"multus-additional-cni-plugins-rpsqp\" (UID: \"1b47afea-97df-4176-b7d1-7f5eeb6c38d6\") " pod="openshift-multus/multus-additional-cni-plugins-rpsqp" Jul 02 19:53:36.454522 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.454321 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1b47afea-97df-4176-b7d1-7f5eeb6c38d6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rpsqp\" (UID: \"1b47afea-97df-4176-b7d1-7f5eeb6c38d6\") " pod="openshift-multus/multus-additional-cni-plugins-rpsqp" Jul 02 19:53:36.454522 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.454349 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2bc9\" (UniqueName: \"kubernetes.io/projected/7295278e-a6f2-4725-99e7-7f76ea6da868-kube-api-access-t2bc9\") pod \"node-ca-56fgj\" (UID: \"7295278e-a6f2-4725-99e7-7f76ea6da868\") " pod="openshift-image-registry/node-ca-56fgj" Jul 02 19:53:36.454522 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.454372 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cf3eddde-4aff-4a84-894c-cc18416aaafc-device-dir\") pod \"aws-ebs-csi-driver-node-rsxhh\" (UID: \"cf3eddde-4aff-4a84-894c-cc18416aaafc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rsxhh" Jul 02 19:53:36.454522 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.454384 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1b47afea-97df-4176-b7d1-7f5eeb6c38d6-cnibin\") pod \"multus-additional-cni-plugins-rpsqp\" (UID: \"1b47afea-97df-4176-b7d1-7f5eeb6c38d6\") " pod="openshift-multus/multus-additional-cni-plugins-rpsqp" Jul 02 19:53:36.454522 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.454394 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83f44c56-f3a8-4d12-9adc-c916a2990bf5-etc-kubernetes\") pod \"multus-vshgf\" (UID: \"83f44c56-f3a8-4d12-9adc-c916a2990bf5\") " pod="openshift-multus/multus-vshgf" Jul 02 19:53:36.454522 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.454228 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/83f44c56-f3a8-4d12-9adc-c916a2990bf5-os-release\") pod \"multus-vshgf\" (UID: \"83f44c56-f3a8-4d12-9adc-c916a2990bf5\") " pod="openshift-multus/multus-vshgf" Jul 02 19:53:36.454522 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.454421 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa025c37-d383-4274-9259-b2a187bcf158-tmp\") pod \"tuned-9dcp2\" (UID: \"aa025c37-d383-4274-9259-b2a187bcf158\") " pod="openshift-cluster-node-tuning-operator/tuned-9dcp2" Jul 02 19:53:36.454522 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.454463 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61-konnectivity-ca\") pod \"konnectivity-agent-n844d\" (UID: \"1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61\") " pod="kube-system/konnectivity-agent-n844d" Jul 02 19:53:36.454522 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.454489 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/83f44c56-f3a8-4d12-9adc-c916a2990bf5-cni-binary-copy\") pod \"multus-vshgf\" (UID: \"83f44c56-f3a8-4d12-9adc-c916a2990bf5\") " pod="openshift-multus/multus-vshgf" Jul 02 19:53:36.454522 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.454514 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/83f44c56-f3a8-4d12-9adc-c916a2990bf5-host-var-lib-cni-bin\") pod \"multus-vshgf\" (UID: \"83f44c56-f3a8-4d12-9adc-c916a2990bf5\") " pod="openshift-multus/multus-vshgf" Jul 02 19:53:36.454954 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.454540 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/83f44c56-f3a8-4d12-9adc-c916a2990bf5-hostroot\") pod \"multus-vshgf\" (UID: \"83f44c56-f3a8-4d12-9adc-c916a2990bf5\") " pod="openshift-multus/multus-vshgf" Jul 02 19:53:36.454954 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.454567 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qppsz\" (UniqueName: \"kubernetes.io/projected/83f44c56-f3a8-4d12-9adc-c916a2990bf5-kube-api-access-qppsz\") pod \"multus-vshgf\" (UID: \"83f44c56-f3a8-4d12-9adc-c916a2990bf5\") " pod="openshift-multus/multus-vshgf" Jul 02 19:53:36.454954 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.454594 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/aa025c37-d383-4274-9259-b2a187bcf158-etc-modprobe-d\") pod \"tuned-9dcp2\" (UID: \"aa025c37-d383-4274-9259-b2a187bcf158\") " pod="openshift-cluster-node-tuning-operator/tuned-9dcp2" Jul 02 19:53:36.454954 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.454598 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83f44c56-f3a8-4d12-9adc-c916a2990bf5-etc-kubernetes\") pod \"multus-vshgf\" (UID: \"83f44c56-f3a8-4d12-9adc-c916a2990bf5\") " pod="openshift-multus/multus-vshgf" Jul 02 19:53:36.454954 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.454618 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/aa025c37-d383-4274-9259-b2a187bcf158-etc-sysctl-conf\") pod \"tuned-9dcp2\" (UID: \"aa025c37-d383-4274-9259-b2a187bcf158\") " pod="openshift-cluster-node-tuning-operator/tuned-9dcp2" Jul 02 19:53:36.454954 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.454644 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wh77k\" (UniqueName: \"kubernetes.io/projected/0edfe493-6e53-42b3-9068-7b80cd51aa5a-kube-api-access-wh77k\") pod \"network-check-target-l67dn\" (UID: \"0edfe493-6e53-42b3-9068-7b80cd51aa5a\") " pod="openshift-network-diagnostics/network-check-target-l67dn" Jul 02 19:53:36.454954 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.454539 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1b47afea-97df-4176-b7d1-7f5eeb6c38d6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rpsqp\" (UID: \"1b47afea-97df-4176-b7d1-7f5eeb6c38d6\") " pod="openshift-multus/multus-additional-cni-plugins-rpsqp" Jul 02 19:53:36.454954 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.454672 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f78c0ffa-96d5-4c22-8bff-39b81bc11b5a-host-cni-netd\") pod \"ovnkube-node-5xg6t\" (UID: \"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:53:36.454954 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.454688 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/83f44c56-f3a8-4d12-9adc-c916a2990bf5-multus-daemon-config\") pod \"multus-vshgf\" (UID: \"83f44c56-f3a8-4d12-9adc-c916a2990bf5\") " pod="openshift-multus/multus-vshgf" Jul 02 19:53:36.454954 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.454695 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/aa025c37-d383-4274-9259-b2a187bcf158-run\") pod \"tuned-9dcp2\" (UID: \"aa025c37-d383-4274-9259-b2a187bcf158\") " pod="openshift-cluster-node-tuning-operator/tuned-9dcp2" Jul 02 19:53:36.454954 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.454718 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aa025c37-d383-4274-9259-b2a187bcf158-host\") pod \"tuned-9dcp2\" (UID: \"aa025c37-d383-4274-9259-b2a187bcf158\") " pod="openshift-cluster-node-tuning-operator/tuned-9dcp2" Jul 02 19:53:36.454954 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.454720 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/83f44c56-f3a8-4d12-9adc-c916a2990bf5-host-var-lib-cni-bin\") pod \"multus-vshgf\" (UID: \"83f44c56-f3a8-4d12-9adc-c916a2990bf5\") " pod="openshift-multus/multus-vshgf" Jul 02 19:53:36.454954 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.454741 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f78c0ffa-96d5-4c22-8bff-39b81bc11b5a-etc-openvswitch\") pod \"ovnkube-node-5xg6t\" (UID: \"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:53:36.454954 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.454765 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f78c0ffa-96d5-4c22-8bff-39b81bc11b5a-env-overrides\") pod \"ovnkube-node-5xg6t\" (UID: \"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:53:36.454954 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.454673 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/83f44c56-f3a8-4d12-9adc-c916a2990bf5-hostroot\") pod \"multus-vshgf\" (UID: \"83f44c56-f3a8-4d12-9adc-c916a2990bf5\") " pod="openshift-multus/multus-vshgf" Jul 02 19:53:36.454954 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.454793 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f78c0ffa-96d5-4c22-8bff-39b81bc11b5a-ovn-node-metrics-cert\") pod \"ovnkube-node-5xg6t\" (UID: \"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:53:36.454954 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.454826 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/20e92fd6-0a2e-471d-a090-1b96d06600c6-hosts-file\") pod \"node-resolver-kxsct\" (UID: \"20e92fd6-0a2e-471d-a090-1b96d06600c6\") " pod="openshift-dns/node-resolver-kxsct" Jul 02 19:53:36.455713 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.454852 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x67xc\" (UniqueName: \"kubernetes.io/projected/20e92fd6-0a2e-471d-a090-1b96d06600c6-kube-api-access-x67xc\") pod \"node-resolver-kxsct\" (UID: \"20e92fd6-0a2e-471d-a090-1b96d06600c6\") " pod="openshift-dns/node-resolver-kxsct" Jul 02 19:53:36.455713 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.454880 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e92927e3-3534-4747-ad6e-e0df14b731d3-kubelet-config\") pod \"global-pull-secret-syncer-pkncj\" (UID: \"e92927e3-3534-4747-ad6e-e0df14b731d3\") " pod="kube-system/global-pull-secret-syncer-pkncj" Jul 02 19:53:36.455713 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.454910 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/83f44c56-f3a8-4d12-9adc-c916a2990bf5-host-run-k8s-cni-cncf-io\") pod \"multus-vshgf\" (UID: \"83f44c56-f3a8-4d12-9adc-c916a2990bf5\") " pod="openshift-multus/multus-vshgf" Jul 02 19:53:36.455713 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.454936 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1b47afea-97df-4176-b7d1-7f5eeb6c38d6-os-release\") pod \"multus-additional-cni-plugins-rpsqp\" (UID: \"1b47afea-97df-4176-b7d1-7f5eeb6c38d6\") " pod="openshift-multus/multus-additional-cni-plugins-rpsqp" Jul 02 19:53:36.455713 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.454943 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/83f44c56-f3a8-4d12-9adc-c916a2990bf5-host-run-k8s-cni-cncf-io\") pod \"multus-vshgf\" (UID: \"83f44c56-f3a8-4d12-9adc-c916a2990bf5\") " pod="openshift-multus/multus-vshgf" Jul 02 19:53:36.455713 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.454962 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8lpv\" (UniqueName: \"kubernetes.io/projected/cf3eddde-4aff-4a84-894c-cc18416aaafc-kube-api-access-n8lpv\") pod \"aws-ebs-csi-driver-node-rsxhh\" (UID: \"cf3eddde-4aff-4a84-894c-cc18416aaafc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rsxhh" Jul 02 19:53:36.455713 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.454988 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1b47afea-97df-4176-b7d1-7f5eeb6c38d6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rpsqp\" (UID: \"1b47afea-97df-4176-b7d1-7f5eeb6c38d6\") " pod="openshift-multus/multus-additional-cni-plugins-rpsqp" Jul 02 19:53:36.455713 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.455000 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1b47afea-97df-4176-b7d1-7f5eeb6c38d6-os-release\") pod \"multus-additional-cni-plugins-rpsqp\" (UID: \"1b47afea-97df-4176-b7d1-7f5eeb6c38d6\") " pod="openshift-multus/multus-additional-cni-plugins-rpsqp" Jul 02 19:53:36.455713 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.455016 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/aa025c37-d383-4274-9259-b2a187bcf158-etc-sysctl-d\") pod \"tuned-9dcp2\" (UID: \"aa025c37-d383-4274-9259-b2a187bcf158\") " pod="openshift-cluster-node-tuning-operator/tuned-9dcp2" Jul 02 19:53:36.455713 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.455043 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f78c0ffa-96d5-4c22-8bff-39b81bc11b5a-host-slash\") pod \"ovnkube-node-5xg6t\" (UID: \"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:53:36.455713 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.455069 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f78c0ffa-96d5-4c22-8bff-39b81bc11b5a-run-ovn\") pod \"ovnkube-node-5xg6t\" (UID: \"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:53:36.455713 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.455092 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61-agent-certs\") pod \"konnectivity-agent-n844d\" (UID: \"1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61\") " pod="kube-system/konnectivity-agent-n844d" Jul 02 19:53:36.455713 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.455121 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8smzp\" (UniqueName: \"kubernetes.io/projected/1b47afea-97df-4176-b7d1-7f5eeb6c38d6-kube-api-access-8smzp\") pod \"multus-additional-cni-plugins-rpsqp\" (UID: \"1b47afea-97df-4176-b7d1-7f5eeb6c38d6\") " pod="openshift-multus/multus-additional-cni-plugins-rpsqp" Jul 02 19:53:36.455713 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.455148 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/83f44c56-f3a8-4d12-9adc-c916a2990bf5-multus-cni-dir\") pod \"multus-vshgf\" (UID: \"83f44c56-f3a8-4d12-9adc-c916a2990bf5\") " pod="openshift-multus/multus-vshgf" Jul 02 19:53:36.455713 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.455146 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/83f44c56-f3a8-4d12-9adc-c916a2990bf5-cni-binary-copy\") pod \"multus-vshgf\" (UID: \"83f44c56-f3a8-4d12-9adc-c916a2990bf5\") " pod="openshift-multus/multus-vshgf" Jul 02 19:53:36.455713 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.455203 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/83f44c56-f3a8-4d12-9adc-c916a2990bf5-host-var-lib-kubelet\") pod \"multus-vshgf\" (UID: \"83f44c56-f3a8-4d12-9adc-c916a2990bf5\") " pod="openshift-multus/multus-vshgf" Jul 02 19:53:36.455713 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.455263 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/aa025c37-d383-4274-9259-b2a187bcf158-etc-sysconfig\") pod \"tuned-9dcp2\" (UID: \"aa025c37-d383-4274-9259-b2a187bcf158\") " pod="openshift-cluster-node-tuning-operator/tuned-9dcp2" Jul 02 19:53:36.456439 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.455290 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/aa025c37-d383-4274-9259-b2a187bcf158-etc-tuned\") pod \"tuned-9dcp2\" (UID: \"aa025c37-d383-4274-9259-b2a187bcf158\") " pod="openshift-cluster-node-tuning-operator/tuned-9dcp2" Jul 02 19:53:36.456439 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.455316 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/83f44c56-f3a8-4d12-9adc-c916a2990bf5-multus-cni-dir\") pod \"multus-vshgf\" (UID: \"83f44c56-f3a8-4d12-9adc-c916a2990bf5\") " pod="openshift-multus/multus-vshgf" Jul 02 19:53:36.456439 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.455324 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d5e46125-32a8-49af-9a3d-207e26b76074-iptables-alerter-script\") pod \"iptables-alerter-956ts\" (UID: \"d5e46125-32a8-49af-9a3d-207e26b76074\") " pod="openshift-network-operator/iptables-alerter-956ts" Jul 02 19:53:36.456439 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.455355 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d5e46125-32a8-49af-9a3d-207e26b76074-host-slash\") pod \"iptables-alerter-956ts\" (UID: \"d5e46125-32a8-49af-9a3d-207e26b76074\") " pod="openshift-network-operator/iptables-alerter-956ts" Jul 02 19:53:36.456439 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.455359 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/83f44c56-f3a8-4d12-9adc-c916a2990bf5-host-var-lib-kubelet\") pod \"multus-vshgf\" (UID: \"83f44c56-f3a8-4d12-9adc-c916a2990bf5\") " pod="openshift-multus/multus-vshgf" Jul 02 19:53:36.456439 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.455387 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e92927e3-3534-4747-ad6e-e0df14b731d3-dbus\") pod \"global-pull-secret-syncer-pkncj\" (UID: \"e92927e3-3534-4747-ad6e-e0df14b731d3\") " pod="kube-system/global-pull-secret-syncer-pkncj" Jul 02 19:53:36.456439 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.455452 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cf3eddde-4aff-4a84-894c-cc18416aaafc-socket-dir\") pod \"aws-ebs-csi-driver-node-rsxhh\" (UID: \"cf3eddde-4aff-4a84-894c-cc18416aaafc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rsxhh" Jul 02 19:53:36.456439 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.455451 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7295278e-a6f2-4725-99e7-7f76ea6da868-serviceca\") pod \"node-ca-56fgj\" (UID: \"7295278e-a6f2-4725-99e7-7f76ea6da868\") " pod="openshift-image-registry/node-ca-56fgj" Jul 02 19:53:36.456439 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.455483 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cf3eddde-4aff-4a84-894c-cc18416aaafc-sys-fs\") pod \"aws-ebs-csi-driver-node-rsxhh\" (UID: \"cf3eddde-4aff-4a84-894c-cc18416aaafc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rsxhh" Jul 02 19:53:36.456439 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.455510 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/83f44c56-f3a8-4d12-9adc-c916a2990bf5-cnibin\") pod \"multus-vshgf\" (UID: \"83f44c56-f3a8-4d12-9adc-c916a2990bf5\") " pod="openshift-multus/multus-vshgf" Jul 02 19:53:36.456439 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.455550 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cf3eddde-4aff-4a84-894c-cc18416aaafc-sys-fs\") pod \"aws-ebs-csi-driver-node-rsxhh\" (UID: \"cf3eddde-4aff-4a84-894c-cc18416aaafc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rsxhh" Jul 02 19:53:36.456439 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.455571 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cf3eddde-4aff-4a84-894c-cc18416aaafc-socket-dir\") pod \"aws-ebs-csi-driver-node-rsxhh\" (UID: \"cf3eddde-4aff-4a84-894c-cc18416aaafc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rsxhh" Jul 02 19:53:36.456439 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.455601 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/83f44c56-f3a8-4d12-9adc-c916a2990bf5-multus-conf-dir\") pod \"multus-vshgf\" (UID: \"83f44c56-f3a8-4d12-9adc-c916a2990bf5\") " pod="openshift-multus/multus-vshgf" Jul 02 19:53:36.456439 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.455602 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1b47afea-97df-4176-b7d1-7f5eeb6c38d6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rpsqp\" (UID: \"1b47afea-97df-4176-b7d1-7f5eeb6c38d6\") " pod="openshift-multus/multus-additional-cni-plugins-rpsqp" Jul 02 19:53:36.456439 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.455620 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/83f44c56-f3a8-4d12-9adc-c916a2990bf5-cnibin\") pod \"multus-vshgf\" (UID: \"83f44c56-f3a8-4d12-9adc-c916a2990bf5\") " pod="openshift-multus/multus-vshgf" Jul 02 19:53:36.456439 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.455647 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f78c0ffa-96d5-4c22-8bff-39b81bc11b5a-run-systemd\") pod \"ovnkube-node-5xg6t\" (UID: \"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:53:36.456439 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.455667 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/83f44c56-f3a8-4d12-9adc-c916a2990bf5-multus-conf-dir\") pod \"multus-vshgf\" (UID: \"83f44c56-f3a8-4d12-9adc-c916a2990bf5\") " pod="openshift-multus/multus-vshgf" Jul 02 19:53:36.457272 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.455709 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f78c0ffa-96d5-4c22-8bff-39b81bc11b5a-ovnkube-config\") pod \"ovnkube-node-5xg6t\" (UID: \"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:53:36.457272 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.455737 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1b47afea-97df-4176-b7d1-7f5eeb6c38d6-cni-binary-copy\") pod \"multus-additional-cni-plugins-rpsqp\" (UID: \"1b47afea-97df-4176-b7d1-7f5eeb6c38d6\") " pod="openshift-multus/multus-additional-cni-plugins-rpsqp" Jul 02 19:53:36.457272 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.455773 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1b47afea-97df-4176-b7d1-7f5eeb6c38d6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rpsqp\" (UID: \"1b47afea-97df-4176-b7d1-7f5eeb6c38d6\") " pod="openshift-multus/multus-additional-cni-plugins-rpsqp" Jul 02 19:53:36.457272 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.455794 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/83f44c56-f3a8-4d12-9adc-c916a2990bf5-host-var-lib-cni-multus\") pod \"multus-vshgf\" (UID: \"83f44c56-f3a8-4d12-9adc-c916a2990bf5\") " pod="openshift-multus/multus-vshgf" Jul 02 19:53:36.457272 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.455812 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f78c0ffa-96d5-4c22-8bff-39b81bc11b5a-host-kubelet\") pod \"ovnkube-node-5xg6t\" (UID: \"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:53:36.457272 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.455827 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f78c0ffa-96d5-4c22-8bff-39b81bc11b5a-host-run-netns\") pod \"ovnkube-node-5xg6t\" (UID: \"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:53:36.457272 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.455886 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/83f44c56-f3a8-4d12-9adc-c916a2990bf5-host-var-lib-cni-multus\") pod \"multus-vshgf\" (UID: \"83f44c56-f3a8-4d12-9adc-c916a2990bf5\") " pod="openshift-multus/multus-vshgf" Jul 02 19:53:36.457272 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.455922 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f78c0ffa-96d5-4c22-8bff-39b81bc11b5a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5xg6t\" (UID: \"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:53:36.457272 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.455954 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1b47afea-97df-4176-b7d1-7f5eeb6c38d6-system-cni-dir\") pod \"multus-additional-cni-plugins-rpsqp\" (UID: \"1b47afea-97df-4176-b7d1-7f5eeb6c38d6\") " pod="openshift-multus/multus-additional-cni-plugins-rpsqp" Jul 02 19:53:36.457272 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.455981 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/83f44c56-f3a8-4d12-9adc-c916a2990bf5-system-cni-dir\") pod \"multus-vshgf\" (UID: \"83f44c56-f3a8-4d12-9adc-c916a2990bf5\") " pod="openshift-multus/multus-vshgf" Jul 02 19:53:36.457272 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.456007 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f78c0ffa-96d5-4c22-8bff-39b81bc11b5a-systemd-units\") pod \"ovnkube-node-5xg6t\" (UID: \"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:53:36.457272 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.456031 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f78c0ffa-96d5-4c22-8bff-39b81bc11b5a-ovnkube-script-lib\") pod \"ovnkube-node-5xg6t\" (UID: \"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:53:36.457272 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.456057 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhxwb\" (UniqueName: \"kubernetes.io/projected/aa025c37-d383-4274-9259-b2a187bcf158-kube-api-access-zhxwb\") pod \"tuned-9dcp2\" (UID: \"aa025c37-d383-4274-9259-b2a187bcf158\") " pod="openshift-cluster-node-tuning-operator/tuned-9dcp2" Jul 02 19:53:36.457272 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.456087 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dcc079e4-e2c2-4752-a947-0ec3ce3ccab4-metrics-certs\") pod \"network-metrics-daemon-p88nv\" (UID: \"dcc079e4-e2c2-4752-a947-0ec3ce3ccab4\") " pod="openshift-multus/network-metrics-daemon-p88nv" Jul 02 19:53:36.457272 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.456113 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-666dh\" (UniqueName: \"kubernetes.io/projected/dcc079e4-e2c2-4752-a947-0ec3ce3ccab4-kube-api-access-666dh\") pod \"network-metrics-daemon-p88nv\" (UID: \"dcc079e4-e2c2-4752-a947-0ec3ce3ccab4\") " pod="openshift-multus/network-metrics-daemon-p88nv" Jul 02 19:53:36.457272 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.456137 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/aa025c37-d383-4274-9259-b2a187bcf158-etc-systemd\") pod \"tuned-9dcp2\" (UID: \"aa025c37-d383-4274-9259-b2a187bcf158\") " pod="openshift-cluster-node-tuning-operator/tuned-9dcp2" Jul 02 19:53:36.457881 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.456166 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f78c0ffa-96d5-4c22-8bff-39b81bc11b5a-host-run-ovn-kubernetes\") pod \"ovnkube-node-5xg6t\" (UID: \"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:53:36.457881 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.456187 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1b47afea-97df-4176-b7d1-7f5eeb6c38d6-cni-binary-copy\") pod \"multus-additional-cni-plugins-rpsqp\" (UID: \"1b47afea-97df-4176-b7d1-7f5eeb6c38d6\") " pod="openshift-multus/multus-additional-cni-plugins-rpsqp" Jul 02 19:53:36.457881 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.456195 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f78c0ffa-96d5-4c22-8bff-39b81bc11b5a-host-cni-bin\") pod \"ovnkube-node-5xg6t\" (UID: \"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:53:36.457881 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.456225 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e92927e3-3534-4747-ad6e-e0df14b731d3-original-pull-secret\") pod \"global-pull-secret-syncer-pkncj\" (UID: \"e92927e3-3534-4747-ad6e-e0df14b731d3\") " pod="kube-system/global-pull-secret-syncer-pkncj" Jul 02 19:53:36.457881 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.456258 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1b47afea-97df-4176-b7d1-7f5eeb6c38d6-system-cni-dir\") pod \"multus-additional-cni-plugins-rpsqp\" (UID: \"1b47afea-97df-4176-b7d1-7f5eeb6c38d6\") " pod="openshift-multus/multus-additional-cni-plugins-rpsqp" Jul 02 19:53:36.457881 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.456263 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/83f44c56-f3a8-4d12-9adc-c916a2990bf5-system-cni-dir\") pod \"multus-vshgf\" (UID: \"83f44c56-f3a8-4d12-9adc-c916a2990bf5\") " pod="openshift-multus/multus-vshgf" Jul 02 19:53:36.457881 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.456291 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/83f44c56-f3a8-4d12-9adc-c916a2990bf5-host-run-netns\") pod \"multus-vshgf\" (UID: \"83f44c56-f3a8-4d12-9adc-c916a2990bf5\") " pod="openshift-multus/multus-vshgf" Jul 02 19:53:36.457881 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.456317 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1b47afea-97df-4176-b7d1-7f5eeb6c38d6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rpsqp\" (UID: \"1b47afea-97df-4176-b7d1-7f5eeb6c38d6\") " pod="openshift-multus/multus-additional-cni-plugins-rpsqp" Jul 02 19:53:36.457881 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.456321 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/83f44c56-f3a8-4d12-9adc-c916a2990bf5-host-run-multus-certs\") pod \"multus-vshgf\" (UID: \"83f44c56-f3a8-4d12-9adc-c916a2990bf5\") " pod="openshift-multus/multus-vshgf" Jul 02 19:53:36.457881 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.456354 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/83f44c56-f3a8-4d12-9adc-c916a2990bf5-host-run-netns\") pod \"multus-vshgf\" (UID: \"83f44c56-f3a8-4d12-9adc-c916a2990bf5\") " pod="openshift-multus/multus-vshgf" Jul 02 19:53:36.457881 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.456356 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f78c0ffa-96d5-4c22-8bff-39b81bc11b5a-node-log\") pod \"ovnkube-node-5xg6t\" (UID: \"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:53:36.457881 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.456375 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/83f44c56-f3a8-4d12-9adc-c916a2990bf5-host-run-multus-certs\") pod \"multus-vshgf\" (UID: \"83f44c56-f3a8-4d12-9adc-c916a2990bf5\") " pod="openshift-multus/multus-vshgf" Jul 02 19:53:36.457881 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:36.456395 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:53:36.457881 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.456413 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20e92fd6-0a2e-471d-a090-1b96d06600c6-tmp-dir\") pod \"node-resolver-kxsct\" (UID: \"20e92fd6-0a2e-471d-a090-1b96d06600c6\") " pod="openshift-dns/node-resolver-kxsct" Jul 02 19:53:36.457881 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.456443 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dz6wh\" (UniqueName: \"kubernetes.io/projected/d5e46125-32a8-49af-9a3d-207e26b76074-kube-api-access-dz6wh\") pod \"iptables-alerter-956ts\" (UID: \"d5e46125-32a8-49af-9a3d-207e26b76074\") " pod="openshift-network-operator/iptables-alerter-956ts" Jul 02 19:53:36.457881 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.456475 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cf3eddde-4aff-4a84-894c-cc18416aaafc-etc-selinux\") pod \"aws-ebs-csi-driver-node-rsxhh\" (UID: \"cf3eddde-4aff-4a84-894c-cc18416aaafc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rsxhh" Jul 02 19:53:36.457881 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:36.456506 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcc079e4-e2c2-4752-a947-0ec3ce3ccab4-metrics-certs podName:dcc079e4-e2c2-4752-a947-0ec3ce3ccab4 nodeName:}" failed. No retries permitted until 2026-07-02 19:53:36.956484402 +0000 UTC m=+2.022542264 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dcc079e4-e2c2-4752-a947-0ec3ce3ccab4-metrics-certs") pod "network-metrics-daemon-p88nv" (UID: "dcc079e4-e2c2-4752-a947-0ec3ce3ccab4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:53:36.458493 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.456532 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aa025c37-d383-4274-9259-b2a187bcf158-sys\") pod \"tuned-9dcp2\" (UID: \"aa025c37-d383-4274-9259-b2a187bcf158\") " pod="openshift-cluster-node-tuning-operator/tuned-9dcp2" Jul 02 19:53:36.458493 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.456550 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cf3eddde-4aff-4a84-894c-cc18416aaafc-etc-selinux\") pod \"aws-ebs-csi-driver-node-rsxhh\" (UID: \"cf3eddde-4aff-4a84-894c-cc18416aaafc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rsxhh" Jul 02 19:53:36.458493 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.456558 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa025c37-d383-4274-9259-b2a187bcf158-var-lib-kubelet\") pod \"tuned-9dcp2\" (UID: \"aa025c37-d383-4274-9259-b2a187bcf158\") " pod="openshift-cluster-node-tuning-operator/tuned-9dcp2" Jul 02 19:53:36.458493 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.456584 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f78c0ffa-96d5-4c22-8bff-39b81bc11b5a-var-lib-openvswitch\") pod \"ovnkube-node-5xg6t\" (UID: \"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:53:36.458493 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.456614 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cf3eddde-4aff-4a84-894c-cc18416aaafc-registration-dir\") pod \"aws-ebs-csi-driver-node-rsxhh\" (UID: \"cf3eddde-4aff-4a84-894c-cc18416aaafc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rsxhh" Jul 02 19:53:36.458493 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.456642 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/83f44c56-f3a8-4d12-9adc-c916a2990bf5-multus-socket-dir-parent\") pod \"multus-vshgf\" (UID: \"83f44c56-f3a8-4d12-9adc-c916a2990bf5\") " pod="openshift-multus/multus-vshgf" Jul 02 19:53:36.458493 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.456669 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhwcm\" (UniqueName: \"kubernetes.io/projected/f78c0ffa-96d5-4c22-8bff-39b81bc11b5a-kube-api-access-zhwcm\") pod \"ovnkube-node-5xg6t\" (UID: \"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:53:36.458493 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.456699 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa025c37-d383-4274-9259-b2a187bcf158-etc-kubernetes\") pod \"tuned-9dcp2\" (UID: \"aa025c37-d383-4274-9259-b2a187bcf158\") " pod="openshift-cluster-node-tuning-operator/tuned-9dcp2" Jul 02 19:53:36.458493 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.456704 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/83f44c56-f3a8-4d12-9adc-c916a2990bf5-multus-socket-dir-parent\") pod \"multus-vshgf\" (UID: \"83f44c56-f3a8-4d12-9adc-c916a2990bf5\") " pod="openshift-multus/multus-vshgf" Jul 02 19:53:36.458493 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.456705 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cf3eddde-4aff-4a84-894c-cc18416aaafc-registration-dir\") pod \"aws-ebs-csi-driver-node-rsxhh\" (UID: \"cf3eddde-4aff-4a84-894c-cc18416aaafc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rsxhh" Jul 02 19:53:36.458493 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.456736 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f78c0ffa-96d5-4c22-8bff-39b81bc11b5a-log-socket\") pod \"ovnkube-node-5xg6t\" (UID: \"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:53:36.463741 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.463707 2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 02 19:53:36.467173 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.467150 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8smzp\" (UniqueName: \"kubernetes.io/projected/1b47afea-97df-4176-b7d1-7f5eeb6c38d6-kube-api-access-8smzp\") pod \"multus-additional-cni-plugins-rpsqp\" (UID: \"1b47afea-97df-4176-b7d1-7f5eeb6c38d6\") " pod="openshift-multus/multus-additional-cni-plugins-rpsqp" Jul 02 19:53:36.467271 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.467168 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8lpv\" (UniqueName: \"kubernetes.io/projected/cf3eddde-4aff-4a84-894c-cc18416aaafc-kube-api-access-n8lpv\") pod \"aws-ebs-csi-driver-node-rsxhh\" (UID: \"cf3eddde-4aff-4a84-894c-cc18416aaafc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rsxhh" Jul 02 19:53:36.467271 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.467231 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qppsz\" (UniqueName: \"kubernetes.io/projected/83f44c56-f3a8-4d12-9adc-c916a2990bf5-kube-api-access-qppsz\") pod \"multus-vshgf\" (UID: \"83f44c56-f3a8-4d12-9adc-c916a2990bf5\") " pod="openshift-multus/multus-vshgf" Jul 02 19:53:36.467271 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.467244 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2bc9\" (UniqueName: \"kubernetes.io/projected/7295278e-a6f2-4725-99e7-7f76ea6da868-kube-api-access-t2bc9\") pod \"node-ca-56fgj\" (UID: \"7295278e-a6f2-4725-99e7-7f76ea6da868\") " pod="openshift-image-registry/node-ca-56fgj" Jul 02 19:53:36.467496 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.467472 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-666dh\" (UniqueName: \"kubernetes.io/projected/dcc079e4-e2c2-4752-a947-0ec3ce3ccab4-kube-api-access-666dh\") pod \"network-metrics-daemon-p88nv\" (UID: \"dcc079e4-e2c2-4752-a947-0ec3ce3ccab4\") " pod="openshift-multus/network-metrics-daemon-p88nv" Jul 02 19:53:36.557913 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.557119 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f78c0ffa-96d5-4c22-8bff-39b81bc11b5a-ovnkube-script-lib\") pod \"ovnkube-node-5xg6t\" (UID: \"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:53:36.557913 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.557173 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhxwb\" (UniqueName: \"kubernetes.io/projected/aa025c37-d383-4274-9259-b2a187bcf158-kube-api-access-zhxwb\") pod \"tuned-9dcp2\" (UID: \"aa025c37-d383-4274-9259-b2a187bcf158\") " pod="openshift-cluster-node-tuning-operator/tuned-9dcp2" Jul 02 19:53:36.557913 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.557222 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/aa025c37-d383-4274-9259-b2a187bcf158-etc-systemd\") pod \"tuned-9dcp2\" (UID: \"aa025c37-d383-4274-9259-b2a187bcf158\") " pod="openshift-cluster-node-tuning-operator/tuned-9dcp2" Jul 02 19:53:36.557913 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.557256 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f78c0ffa-96d5-4c22-8bff-39b81bc11b5a-host-run-ovn-kubernetes\") pod \"ovnkube-node-5xg6t\" (UID: \"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:53:36.557913 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.557283 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f78c0ffa-96d5-4c22-8bff-39b81bc11b5a-host-cni-bin\") pod \"ovnkube-node-5xg6t\" (UID: \"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:53:36.557913 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.557315 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e92927e3-3534-4747-ad6e-e0df14b731d3-original-pull-secret\") pod \"global-pull-secret-syncer-pkncj\" (UID: \"e92927e3-3534-4747-ad6e-e0df14b731d3\") " pod="kube-system/global-pull-secret-syncer-pkncj" Jul 02 19:53:36.557913 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.557348 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f78c0ffa-96d5-4c22-8bff-39b81bc11b5a-node-log\") pod \"ovnkube-node-5xg6t\" (UID: \"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:53:36.557913 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.557378 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20e92fd6-0a2e-471d-a090-1b96d06600c6-tmp-dir\") pod \"node-resolver-kxsct\" (UID: \"20e92fd6-0a2e-471d-a090-1b96d06600c6\") " pod="openshift-dns/node-resolver-kxsct" Jul 02 19:53:36.557913 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.557408 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dz6wh\" (UniqueName: \"kubernetes.io/projected/d5e46125-32a8-49af-9a3d-207e26b76074-kube-api-access-dz6wh\") pod \"iptables-alerter-956ts\" (UID: \"d5e46125-32a8-49af-9a3d-207e26b76074\") " pod="openshift-network-operator/iptables-alerter-956ts" Jul 02 19:53:36.557913 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.557453 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aa025c37-d383-4274-9259-b2a187bcf158-sys\") pod \"tuned-9dcp2\" (UID: \"aa025c37-d383-4274-9259-b2a187bcf158\") " pod="openshift-cluster-node-tuning-operator/tuned-9dcp2" Jul 02 19:53:36.557913 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.557482 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa025c37-d383-4274-9259-b2a187bcf158-var-lib-kubelet\") pod \"tuned-9dcp2\" (UID: \"aa025c37-d383-4274-9259-b2a187bcf158\") " pod="openshift-cluster-node-tuning-operator/tuned-9dcp2" Jul 02 19:53:36.557913 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.557512 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f78c0ffa-96d5-4c22-8bff-39b81bc11b5a-var-lib-openvswitch\") pod \"ovnkube-node-5xg6t\" (UID: \"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:53:36.557913 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.557544 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhwcm\" (UniqueName: \"kubernetes.io/projected/f78c0ffa-96d5-4c22-8bff-39b81bc11b5a-kube-api-access-zhwcm\") pod \"ovnkube-node-5xg6t\" (UID: \"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:53:36.557913 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.557577 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa025c37-d383-4274-9259-b2a187bcf158-etc-kubernetes\") pod \"tuned-9dcp2\" (UID: \"aa025c37-d383-4274-9259-b2a187bcf158\") " pod="openshift-cluster-node-tuning-operator/tuned-9dcp2" Jul 02 19:53:36.557913 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.557601 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f78c0ffa-96d5-4c22-8bff-39b81bc11b5a-log-socket\") pod \"ovnkube-node-5xg6t\" (UID: \"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:53:36.557913 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.557635 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aa025c37-d383-4274-9259-b2a187bcf158-lib-modules\") pod \"tuned-9dcp2\" (UID: \"aa025c37-d383-4274-9259-b2a187bcf158\") " pod="openshift-cluster-node-tuning-operator/tuned-9dcp2" Jul 02 19:53:36.557913 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.557667 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f78c0ffa-96d5-4c22-8bff-39b81bc11b5a-run-openvswitch\") pod \"ovnkube-node-5xg6t\" (UID: \"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:53:36.558832 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.557701 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa025c37-d383-4274-9259-b2a187bcf158-tmp\") pod \"tuned-9dcp2\" (UID: \"aa025c37-d383-4274-9259-b2a187bcf158\") " pod="openshift-cluster-node-tuning-operator/tuned-9dcp2" Jul 02 19:53:36.558832 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.557725 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61-konnectivity-ca\") pod \"konnectivity-agent-n844d\" (UID: \"1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61\") " pod="kube-system/konnectivity-agent-n844d" Jul 02 19:53:36.558832 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.557760 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/aa025c37-d383-4274-9259-b2a187bcf158-etc-modprobe-d\") pod \"tuned-9dcp2\" (UID: \"aa025c37-d383-4274-9259-b2a187bcf158\") " pod="openshift-cluster-node-tuning-operator/tuned-9dcp2" Jul 02 19:53:36.558832 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.557788 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/aa025c37-d383-4274-9259-b2a187bcf158-etc-sysctl-conf\") pod \"tuned-9dcp2\" (UID: \"aa025c37-d383-4274-9259-b2a187bcf158\") " pod="openshift-cluster-node-tuning-operator/tuned-9dcp2" Jul 02 19:53:36.558832 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.557822 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wh77k\" (UniqueName: \"kubernetes.io/projected/0edfe493-6e53-42b3-9068-7b80cd51aa5a-kube-api-access-wh77k\") pod \"network-check-target-l67dn\" (UID: \"0edfe493-6e53-42b3-9068-7b80cd51aa5a\") " pod="openshift-network-diagnostics/network-check-target-l67dn" Jul 02 19:53:36.558832 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.557853 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f78c0ffa-96d5-4c22-8bff-39b81bc11b5a-host-cni-netd\") pod \"ovnkube-node-5xg6t\" (UID: \"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:53:36.558832 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.557878 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/aa025c37-d383-4274-9259-b2a187bcf158-run\") pod \"tuned-9dcp2\" (UID: \"aa025c37-d383-4274-9259-b2a187bcf158\") " pod="openshift-cluster-node-tuning-operator/tuned-9dcp2" Jul 02 19:53:36.558832 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.558002 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f78c0ffa-96d5-4c22-8bff-39b81bc11b5a-host-cni-netd\") pod \"ovnkube-node-5xg6t\" (UID: \"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:53:36.558832 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.558009 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/aa025c37-d383-4274-9259-b2a187bcf158-run\") pod \"tuned-9dcp2\" (UID: \"aa025c37-d383-4274-9259-b2a187bcf158\") " pod="openshift-cluster-node-tuning-operator/tuned-9dcp2" Jul 02 19:53:36.558832 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.558009 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa025c37-d383-4274-9259-b2a187bcf158-var-lib-kubelet\") pod \"tuned-9dcp2\" (UID: \"aa025c37-d383-4274-9259-b2a187bcf158\") " pod="openshift-cluster-node-tuning-operator/tuned-9dcp2" Jul 02 19:53:36.558832 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.558002 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/aa025c37-d383-4274-9259-b2a187bcf158-etc-sysctl-conf\") pod \"tuned-9dcp2\" (UID: \"aa025c37-d383-4274-9259-b2a187bcf158\") " pod="openshift-cluster-node-tuning-operator/tuned-9dcp2" Jul 02 19:53:36.558832 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.558051 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aa025c37-d383-4274-9259-b2a187bcf158-lib-modules\") pod \"tuned-9dcp2\" (UID: \"aa025c37-d383-4274-9259-b2a187bcf158\") " pod="openshift-cluster-node-tuning-operator/tuned-9dcp2" Jul 02 19:53:36.558832 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.558063 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/aa025c37-d383-4274-9259-b2a187bcf158-etc-systemd\") pod \"tuned-9dcp2\" (UID: \"aa025c37-d383-4274-9259-b2a187bcf158\") " pod="openshift-cluster-node-tuning-operator/tuned-9dcp2" Jul 02 19:53:36.558832 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.558050 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f78c0ffa-96d5-4c22-8bff-39b81bc11b5a-log-socket\") pod \"ovnkube-node-5xg6t\" (UID: \"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:53:36.558832 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.558095 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f78c0ffa-96d5-4c22-8bff-39b81bc11b5a-host-run-ovn-kubernetes\") pod \"ovnkube-node-5xg6t\" (UID: \"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:53:36.558832 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.558140 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/aa025c37-d383-4274-9259-b2a187bcf158-etc-modprobe-d\") pod \"tuned-9dcp2\" (UID: \"aa025c37-d383-4274-9259-b2a187bcf158\") " pod="openshift-cluster-node-tuning-operator/tuned-9dcp2" Jul 02 19:53:36.558832 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.558833 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aa025c37-d383-4274-9259-b2a187bcf158-sys\") pod \"tuned-9dcp2\" (UID: \"aa025c37-d383-4274-9259-b2a187bcf158\") " pod="openshift-cluster-node-tuning-operator/tuned-9dcp2" Jul 02 19:53:36.559674 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.559062 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aa025c37-d383-4274-9259-b2a187bcf158-host\") pod \"tuned-9dcp2\" (UID: \"aa025c37-d383-4274-9259-b2a187bcf158\") " pod="openshift-cluster-node-tuning-operator/tuned-9dcp2" Jul 02 19:53:36.559674 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.559117 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f78c0ffa-96d5-4c22-8bff-39b81bc11b5a-etc-openvswitch\") pod \"ovnkube-node-5xg6t\" (UID: \"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:53:36.559674 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.559140 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aa025c37-d383-4274-9259-b2a187bcf158-host\") pod \"tuned-9dcp2\" (UID: \"aa025c37-d383-4274-9259-b2a187bcf158\") " pod="openshift-cluster-node-tuning-operator/tuned-9dcp2" Jul 02 19:53:36.559674 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.559148 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f78c0ffa-96d5-4c22-8bff-39b81bc11b5a-env-overrides\") pod \"ovnkube-node-5xg6t\" (UID: \"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:53:36.559674 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.559189 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f78c0ffa-96d5-4c22-8bff-39b81bc11b5a-ovn-node-metrics-cert\") pod \"ovnkube-node-5xg6t\" (UID: \"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:53:36.559674 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.559219 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/20e92fd6-0a2e-471d-a090-1b96d06600c6-hosts-file\") pod \"node-resolver-kxsct\" (UID: \"20e92fd6-0a2e-471d-a090-1b96d06600c6\") " pod="openshift-dns/node-resolver-kxsct" Jul 02 19:53:36.559674 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.559246 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x67xc\" (UniqueName: \"kubernetes.io/projected/20e92fd6-0a2e-471d-a090-1b96d06600c6-kube-api-access-x67xc\") pod \"node-resolver-kxsct\" (UID: \"20e92fd6-0a2e-471d-a090-1b96d06600c6\") " pod="openshift-dns/node-resolver-kxsct" Jul 02 19:53:36.559674 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.559273 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e92927e3-3534-4747-ad6e-e0df14b731d3-kubelet-config\") pod \"global-pull-secret-syncer-pkncj\" (UID: \"e92927e3-3534-4747-ad6e-e0df14b731d3\") " pod="kube-system/global-pull-secret-syncer-pkncj" Jul 02 19:53:36.559674 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.559320 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/aa025c37-d383-4274-9259-b2a187bcf158-etc-sysctl-d\") pod \"tuned-9dcp2\" (UID: \"aa025c37-d383-4274-9259-b2a187bcf158\") " pod="openshift-cluster-node-tuning-operator/tuned-9dcp2" Jul 02 19:53:36.559674 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.559360 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f78c0ffa-96d5-4c22-8bff-39b81bc11b5a-host-slash\") pod \"ovnkube-node-5xg6t\" (UID: \"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:53:36.559674 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.559369 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f78c0ffa-96d5-4c22-8bff-39b81bc11b5a-etc-openvswitch\") pod \"ovnkube-node-5xg6t\" (UID: \"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:53:36.559674 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.559384 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f78c0ffa-96d5-4c22-8bff-39b81bc11b5a-run-ovn\") pod \"ovnkube-node-5xg6t\" (UID: \"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:53:36.559674 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.559450 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f78c0ffa-96d5-4c22-8bff-39b81bc11b5a-run-ovn\") pod \"ovnkube-node-5xg6t\" (UID: \"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:53:36.559674 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.559463 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61-agent-certs\") pod \"konnectivity-agent-n844d\" (UID: \"1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61\") " pod="kube-system/konnectivity-agent-n844d" Jul 02 19:53:36.559674 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.559468 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f78c0ffa-96d5-4c22-8bff-39b81bc11b5a-ovnkube-script-lib\") pod \"ovnkube-node-5xg6t\" (UID: \"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:53:36.559674 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.559495 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/aa025c37-d383-4274-9259-b2a187bcf158-etc-sysconfig\") pod \"tuned-9dcp2\" (UID: \"aa025c37-d383-4274-9259-b2a187bcf158\") " pod="openshift-cluster-node-tuning-operator/tuned-9dcp2" Jul 02 19:53:36.559674 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.559524 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/aa025c37-d383-4274-9259-b2a187bcf158-etc-tuned\") pod \"tuned-9dcp2\" (UID: \"aa025c37-d383-4274-9259-b2a187bcf158\") " pod="openshift-cluster-node-tuning-operator/tuned-9dcp2" Jul 02 19:53:36.559674 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.559551 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d5e46125-32a8-49af-9a3d-207e26b76074-iptables-alerter-script\") pod \"iptables-alerter-956ts\" (UID: \"d5e46125-32a8-49af-9a3d-207e26b76074\") " pod="openshift-network-operator/iptables-alerter-956ts" Jul 02 19:53:36.560616 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.559551 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e92927e3-3534-4747-ad6e-e0df14b731d3-kubelet-config\") pod \"global-pull-secret-syncer-pkncj\" (UID: \"e92927e3-3534-4747-ad6e-e0df14b731d3\") " pod="kube-system/global-pull-secret-syncer-pkncj" Jul 02 19:53:36.560616 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.559580 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d5e46125-32a8-49af-9a3d-207e26b76074-host-slash\") pod \"iptables-alerter-956ts\" (UID: \"d5e46125-32a8-49af-9a3d-207e26b76074\") " pod="openshift-network-operator/iptables-alerter-956ts" Jul 02 19:53:36.560616 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.559606 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e92927e3-3534-4747-ad6e-e0df14b731d3-dbus\") pod \"global-pull-secret-syncer-pkncj\" (UID: \"e92927e3-3534-4747-ad6e-e0df14b731d3\") " pod="kube-system/global-pull-secret-syncer-pkncj" Jul 02 19:53:36.560616 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.559119 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f78c0ffa-96d5-4c22-8bff-39b81bc11b5a-run-openvswitch\") pod \"ovnkube-node-5xg6t\" (UID: \"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:53:36.560616 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.559619 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/20e92fd6-0a2e-471d-a090-1b96d06600c6-hosts-file\") pod \"node-resolver-kxsct\" (UID: \"20e92fd6-0a2e-471d-a090-1b96d06600c6\") " pod="openshift-dns/node-resolver-kxsct" Jul 02 19:53:36.560616 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.559641 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f78c0ffa-96d5-4c22-8bff-39b81bc11b5a-run-systemd\") pod \"ovnkube-node-5xg6t\" (UID: \"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:53:36.560616 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.559669 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f78c0ffa-96d5-4c22-8bff-39b81bc11b5a-ovnkube-config\") pod \"ovnkube-node-5xg6t\" (UID: \"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:53:36.560616 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.559698 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f78c0ffa-96d5-4c22-8bff-39b81bc11b5a-host-kubelet\") pod \"ovnkube-node-5xg6t\" (UID: \"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:53:36.560616 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.559724 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f78c0ffa-96d5-4c22-8bff-39b81bc11b5a-host-run-netns\") pod \"ovnkube-node-5xg6t\" (UID: \"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:53:36.560616 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.559746 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/aa025c37-d383-4274-9259-b2a187bcf158-etc-sysctl-d\") pod \"tuned-9dcp2\" (UID: \"aa025c37-d383-4274-9259-b2a187bcf158\") " pod="openshift-cluster-node-tuning-operator/tuned-9dcp2" Jul 02 19:53:36.560616 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.559757 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f78c0ffa-96d5-4c22-8bff-39b81bc11b5a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5xg6t\" (UID: \"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:53:36.560616 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.559779 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f78c0ffa-96d5-4c22-8bff-39b81bc11b5a-host-slash\") pod \"ovnkube-node-5xg6t\" (UID: \"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:53:36.560616 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.559806 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f78c0ffa-96d5-4c22-8bff-39b81bc11b5a-systemd-units\") pod \"ovnkube-node-5xg6t\" (UID: \"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:53:36.560616 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.559836 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f78c0ffa-96d5-4c22-8bff-39b81bc11b5a-node-log\") pod \"ovnkube-node-5xg6t\" (UID: \"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:53:36.560616 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.559866 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e92927e3-3534-4747-ad6e-e0df14b731d3-dbus\") pod \"global-pull-secret-syncer-pkncj\" (UID: \"e92927e3-3534-4747-ad6e-e0df14b731d3\") " pod="kube-system/global-pull-secret-syncer-pkncj" Jul 02 19:53:36.560616 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.559885 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f78c0ffa-96d5-4c22-8bff-39b81bc11b5a-systemd-units\") pod \"ovnkube-node-5xg6t\" (UID: \"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:53:36.560616 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.559918 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/aa025c37-d383-4274-9259-b2a187bcf158-etc-sysconfig\") pod \"tuned-9dcp2\" (UID: \"aa025c37-d383-4274-9259-b2a187bcf158\") " pod="openshift-cluster-node-tuning-operator/tuned-9dcp2" Jul 02 19:53:36.560616 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.559067 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa025c37-d383-4274-9259-b2a187bcf158-etc-kubernetes\") pod \"tuned-9dcp2\" (UID: \"aa025c37-d383-4274-9259-b2a187bcf158\") " pod="openshift-cluster-node-tuning-operator/tuned-9dcp2" Jul 02 19:53:36.561565 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.560066 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f78c0ffa-96d5-4c22-8bff-39b81bc11b5a-var-lib-openvswitch\") pod \"ovnkube-node-5xg6t\" (UID: \"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:53:36.561565 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.559593 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f78c0ffa-96d5-4c22-8bff-39b81bc11b5a-env-overrides\") pod \"ovnkube-node-5xg6t\" (UID: \"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:53:36.561565 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.560138 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f78c0ffa-96d5-4c22-8bff-39b81bc11b5a-host-kubelet\") pod \"ovnkube-node-5xg6t\" (UID: \"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:53:36.561565 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.560153 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20e92fd6-0a2e-471d-a090-1b96d06600c6-tmp-dir\") pod \"node-resolver-kxsct\" (UID: \"20e92fd6-0a2e-471d-a090-1b96d06600c6\") " pod="openshift-dns/node-resolver-kxsct" Jul 02 19:53:36.561565 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.560180 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f78c0ffa-96d5-4c22-8bff-39b81bc11b5a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5xg6t\" (UID: \"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:53:36.561565 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.560226 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f78c0ffa-96d5-4c22-8bff-39b81bc11b5a-run-systemd\") pod \"ovnkube-node-5xg6t\" (UID: \"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:53:36.561565 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.560267 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d5e46125-32a8-49af-9a3d-207e26b76074-host-slash\") pod \"iptables-alerter-956ts\" (UID: \"d5e46125-32a8-49af-9a3d-207e26b76074\") " pod="openshift-network-operator/iptables-alerter-956ts" Jul 02 19:53:36.561565 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.560483 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61-konnectivity-ca\") pod \"konnectivity-agent-n844d\" (UID: \"1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61\") " pod="kube-system/konnectivity-agent-n844d" Jul 02 19:53:36.561565 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.560540 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f78c0ffa-96d5-4c22-8bff-39b81bc11b5a-host-cni-bin\") pod \"ovnkube-node-5xg6t\" (UID: \"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:53:36.561565 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.560586 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f78c0ffa-96d5-4c22-8bff-39b81bc11b5a-host-run-netns\") pod \"ovnkube-node-5xg6t\" (UID: \"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:53:36.561565 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.560658 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f78c0ffa-96d5-4c22-8bff-39b81bc11b5a-ovnkube-config\") pod \"ovnkube-node-5xg6t\" (UID: \"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:53:36.561565 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:36.560711 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 19:53:36.561565 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:36.560774 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e92927e3-3534-4747-ad6e-e0df14b731d3-original-pull-secret podName:e92927e3-3534-4747-ad6e-e0df14b731d3 nodeName:}" failed. No retries permitted until 2026-07-02 19:53:37.060753337 +0000 UTC m=+2.126811193 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e92927e3-3534-4747-ad6e-e0df14b731d3-original-pull-secret") pod "global-pull-secret-syncer-pkncj" (UID: "e92927e3-3534-4747-ad6e-e0df14b731d3") : object "kube-system"/"original-pull-secret" not registered Jul 02 19:53:36.561565 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.560772 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d5e46125-32a8-49af-9a3d-207e26b76074-iptables-alerter-script\") pod \"iptables-alerter-956ts\" (UID: \"d5e46125-32a8-49af-9a3d-207e26b76074\") " pod="openshift-network-operator/iptables-alerter-956ts" Jul 02 19:53:36.562364 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.562291 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f78c0ffa-96d5-4c22-8bff-39b81bc11b5a-ovn-node-metrics-cert\") pod \"ovnkube-node-5xg6t\" (UID: \"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:53:36.562465 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.562446 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/aa025c37-d383-4274-9259-b2a187bcf158-etc-tuned\") pod \"tuned-9dcp2\" (UID: \"aa025c37-d383-4274-9259-b2a187bcf158\") " pod="openshift-cluster-node-tuning-operator/tuned-9dcp2" Jul 02 19:53:36.562742 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.562722 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa025c37-d383-4274-9259-b2a187bcf158-tmp\") pod \"tuned-9dcp2\" (UID: \"aa025c37-d383-4274-9259-b2a187bcf158\") " pod="openshift-cluster-node-tuning-operator/tuned-9dcp2" Jul 02 19:53:36.562815 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.562778 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61-agent-certs\") pod \"konnectivity-agent-n844d\" (UID: \"1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61\") " pod="kube-system/konnectivity-agent-n844d" Jul 02 19:53:36.565118 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:36.565101 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 19:53:36.565118 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:36.565121 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 19:53:36.565290 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:36.565131 2565 projected.go:196] Error preparing data for projected volume kube-api-access-wh77k for pod openshift-network-diagnostics/network-check-target-l67dn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:53:36.565290 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:36.565235 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0edfe493-6e53-42b3-9068-7b80cd51aa5a-kube-api-access-wh77k podName:0edfe493-6e53-42b3-9068-7b80cd51aa5a nodeName:}" failed. No retries permitted until 2026-07-02 19:53:37.065216255 +0000 UTC m=+2.131274112 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wh77k" (UniqueName: "kubernetes.io/projected/0edfe493-6e53-42b3-9068-7b80cd51aa5a-kube-api-access-wh77k") pod "network-check-target-l67dn" (UID: "0edfe493-6e53-42b3-9068-7b80cd51aa5a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:53:36.567138 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.567115 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhxwb\" (UniqueName: \"kubernetes.io/projected/aa025c37-d383-4274-9259-b2a187bcf158-kube-api-access-zhxwb\") pod \"tuned-9dcp2\" (UID: \"aa025c37-d383-4274-9259-b2a187bcf158\") " pod="openshift-cluster-node-tuning-operator/tuned-9dcp2" Jul 02 19:53:36.567611 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.567590 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhwcm\" (UniqueName: \"kubernetes.io/projected/f78c0ffa-96d5-4c22-8bff-39b81bc11b5a-kube-api-access-zhwcm\") pod \"ovnkube-node-5xg6t\" (UID: \"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:53:36.567704 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.567622 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dz6wh\" (UniqueName: \"kubernetes.io/projected/d5e46125-32a8-49af-9a3d-207e26b76074-kube-api-access-dz6wh\") pod \"iptables-alerter-956ts\" (UID: \"d5e46125-32a8-49af-9a3d-207e26b76074\") " pod="openshift-network-operator/iptables-alerter-956ts" Jul 02 19:53:36.567941 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.567887 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x67xc\" (UniqueName: \"kubernetes.io/projected/20e92fd6-0a2e-471d-a090-1b96d06600c6-kube-api-access-x67xc\") pod \"node-resolver-kxsct\" (UID: \"20e92fd6-0a2e-471d-a090-1b96d06600c6\") " pod="openshift-dns/node-resolver-kxsct" Jul 02 19:53:36.580133 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:36.580079 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac215e8f2fda4d1193f85f856768dbe3.slice/crio-d35b5aceabdb86d430249e1edfd84eb3d9c2b22f7b5ece0d96fe287e5c526561 WatchSource:0}: Error finding container d35b5aceabdb86d430249e1edfd84eb3d9c2b22f7b5ece0d96fe287e5c526561: Status 404 returned error can't find the container with id d35b5aceabdb86d430249e1edfd84eb3d9c2b22f7b5ece0d96fe287e5c526561 Jul 02 19:53:36.581303 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:36.581288 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c3a208bdce47c4450c7ecd763a8b29d.slice/crio-53ca7487dd6bc0c8072aa7d62c4f62d3e17f6a873ee1bf5dbce3a7a3c7a119fd WatchSource:0}: Error finding container 53ca7487dd6bc0c8072aa7d62c4f62d3e17f6a873ee1bf5dbce3a7a3c7a119fd: Status 404 returned error can't find the container with id 53ca7487dd6bc0c8072aa7d62c4f62d3e17f6a873ee1bf5dbce3a7a3c7a119fd Jul 02 19:53:36.585855 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.585840 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 19:53:36.660926 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.660881 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rsxhh" Jul 02 19:53:36.669636 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:36.669613 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf3eddde_4aff_4a84_894c_cc18416aaafc.slice/crio-c33062a2aed25d4a142efe7a398537814c47303699867f046270ef1581d3ac9d WatchSource:0}: Error finding container c33062a2aed25d4a142efe7a398537814c47303699867f046270ef1581d3ac9d: Status 404 returned error can't find the container with id c33062a2aed25d4a142efe7a398537814c47303699867f046270ef1581d3ac9d Jul 02 19:53:36.672815 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.672799 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rpsqp" Jul 02 19:53:36.679638 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.679620 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-56fgj" Jul 02 19:53:36.680308 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:36.680288 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b47afea_97df_4176_b7d1_7f5eeb6c38d6.slice/crio-77694b3e43c28fed08364fc34cb9a326f79e2ebb127df4d7a1c3be543231722f WatchSource:0}: Error finding container 77694b3e43c28fed08364fc34cb9a326f79e2ebb127df4d7a1c3be543231722f: Status 404 returned error can't find the container with id 77694b3e43c28fed08364fc34cb9a326f79e2ebb127df4d7a1c3be543231722f Jul 02 19:53:36.687196 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:36.687168 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7295278e_a6f2_4725_99e7_7f76ea6da868.slice/crio-9534d11745a80f725037267dc0f7608681aa8007429c846e7f17d6da252ed9ee WatchSource:0}: Error finding container 9534d11745a80f725037267dc0f7608681aa8007429c846e7f17d6da252ed9ee: Status 404 returned error can't find the container with id 9534d11745a80f725037267dc0f7608681aa8007429c846e7f17d6da252ed9ee Jul 02 19:53:36.698194 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.698177 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vshgf" Jul 02 19:53:36.705444 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:36.705397 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83f44c56_f3a8_4d12_9adc_c916a2990bf5.slice/crio-d1bcfb9520c1b64a0df13209c87369e69db69eaef01ba304d29f74ccff658162 WatchSource:0}: Error finding container d1bcfb9520c1b64a0df13209c87369e69db69eaef01ba304d29f74ccff658162: Status 404 returned error can't find the container with id d1bcfb9520c1b64a0df13209c87369e69db69eaef01ba304d29f74ccff658162 Jul 02 19:53:36.713832 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.713818 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:53:36.720741 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:36.720721 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf78c0ffa_96d5_4c22_8bff_39b81bc11b5a.slice/crio-fe29110d8cac0bcc35c2022ad10abfdb47f074b9661f4f6c6a107ae30165b8ab WatchSource:0}: Error finding container fe29110d8cac0bcc35c2022ad10abfdb47f074b9661f4f6c6a107ae30165b8ab: Status 404 returned error can't find the container with id fe29110d8cac0bcc35c2022ad10abfdb47f074b9661f4f6c6a107ae30165b8ab Jul 02 19:53:36.728993 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.728973 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-956ts" Jul 02 19:53:36.735529 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:36.735502 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5e46125_32a8_49af_9a3d_207e26b76074.slice/crio-d7496cc207536e6b89a8840ab1434bec623608216472856b22eae45850b988ff WatchSource:0}: Error finding container d7496cc207536e6b89a8840ab1434bec623608216472856b22eae45850b988ff: Status 404 returned error can't find the container with id d7496cc207536e6b89a8840ab1434bec623608216472856b22eae45850b988ff Jul 02 19:53:36.743517 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.743501 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-n844d" Jul 02 19:53:36.750153 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:36.750134 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a07d0dc_9f29_40ae_af8e_0cbacaa4bd61.slice/crio-ce83580f8c81589c45e376cb45904b618bb82d88e4aa6259a37f9541440ce491 WatchSource:0}: Error finding container ce83580f8c81589c45e376cb45904b618bb82d88e4aa6259a37f9541440ce491: Status 404 returned error can't find the container with id ce83580f8c81589c45e376cb45904b618bb82d88e4aa6259a37f9541440ce491 Jul 02 19:53:36.757102 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.757074 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9dcp2" Jul 02 19:53:36.763763 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:36.763743 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa025c37_d383_4274_9259_b2a187bcf158.slice/crio-78371ea8cc8e46d60b3238da23ef297d75798a091948884981e031933fdb52a9 WatchSource:0}: Error finding container 78371ea8cc8e46d60b3238da23ef297d75798a091948884981e031933fdb52a9: Status 404 returned error can't find the container with id 78371ea8cc8e46d60b3238da23ef297d75798a091948884981e031933fdb52a9 Jul 02 19:53:36.766782 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.766757 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kxsct" Jul 02 19:53:36.774065 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:53:36.774046 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20e92fd6_0a2e_471d_a090_1b96d06600c6.slice/crio-5036b518b69d09a49a9349c2ad5053a0a6581154381a932fae559661f017eb28 WatchSource:0}: Error finding container 5036b518b69d09a49a9349c2ad5053a0a6581154381a932fae559661f017eb28: Status 404 returned error can't find the container with id 5036b518b69d09a49a9349c2ad5053a0a6581154381a932fae559661f017eb28 Jul 02 19:53:36.775668 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:36.775645 2565 kuberuntime_manager.go:1459] "Unhandled Error" err="container dns-node-resolver start failed in pod node-resolver-kxsct_openshift-dns(20e92fd6-0a2e-471d-a090-1b96d06600c6): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Jul 02 19:53:36.775752 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:36.775686 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dns-node-resolver\" with ErrImagePull: \"pull QPS exceeded\"" pod="openshift-dns/node-resolver-kxsct" podUID="20e92fd6-0a2e-471d-a090-1b96d06600c6" Jul 02 19:53:36.810639 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.810612 2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 19:53:36.943866 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.943791 2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 19:53:36.964166 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:36.964139 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dcc079e4-e2c2-4752-a947-0ec3ce3ccab4-metrics-certs\") pod \"network-metrics-daemon-p88nv\" (UID: \"dcc079e4-e2c2-4752-a947-0ec3ce3ccab4\") " pod="openshift-multus/network-metrics-daemon-p88nv" Jul 02 19:53:36.964303 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:36.964285 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:53:36.964350 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:36.964344 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcc079e4-e2c2-4752-a947-0ec3ce3ccab4-metrics-certs podName:dcc079e4-e2c2-4752-a947-0ec3ce3ccab4 nodeName:}" failed. No retries permitted until 2026-07-02 19:53:37.964329039 +0000 UTC m=+3.030386883 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dcc079e4-e2c2-4752-a947-0ec3ce3ccab4-metrics-certs") pod "network-metrics-daemon-p88nv" (UID: "dcc079e4-e2c2-4752-a947-0ec3ce3ccab4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:53:37.065166 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:37.065139 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e92927e3-3534-4747-ad6e-e0df14b731d3-original-pull-secret\") pod \"global-pull-secret-syncer-pkncj\" (UID: \"e92927e3-3534-4747-ad6e-e0df14b731d3\") " pod="kube-system/global-pull-secret-syncer-pkncj" Jul 02 19:53:37.065313 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:37.065244 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 19:53:37.065313 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:37.065294 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e92927e3-3534-4747-ad6e-e0df14b731d3-original-pull-secret podName:e92927e3-3534-4747-ad6e-e0df14b731d3 nodeName:}" failed. No retries permitted until 2026-07-02 19:53:38.065281008 +0000 UTC m=+3.131338848 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e92927e3-3534-4747-ad6e-e0df14b731d3-original-pull-secret") pod "global-pull-secret-syncer-pkncj" (UID: "e92927e3-3534-4747-ad6e-e0df14b731d3") : object "kube-system"/"original-pull-secret" not registered Jul 02 19:53:37.165963 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:37.165927 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wh77k\" (UniqueName: \"kubernetes.io/projected/0edfe493-6e53-42b3-9068-7b80cd51aa5a-kube-api-access-wh77k\") pod \"network-check-target-l67dn\" (UID: \"0edfe493-6e53-42b3-9068-7b80cd51aa5a\") " pod="openshift-network-diagnostics/network-check-target-l67dn" Jul 02 19:53:37.166125 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:37.166097 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 19:53:37.166125 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:37.166117 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 19:53:37.166194 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:37.166128 2565 projected.go:196] Error preparing data for projected volume kube-api-access-wh77k for pod openshift-network-diagnostics/network-check-target-l67dn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:53:37.166194 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:37.166181 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0edfe493-6e53-42b3-9068-7b80cd51aa5a-kube-api-access-wh77k podName:0edfe493-6e53-42b3-9068-7b80cd51aa5a nodeName:}" failed. No retries permitted until 2026-07-02 19:53:38.166166358 +0000 UTC m=+3.232224200 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wh77k" (UniqueName: "kubernetes.io/projected/0edfe493-6e53-42b3-9068-7b80cd51aa5a-kube-api-access-wh77k") pod "network-check-target-l67dn" (UID: "0edfe493-6e53-42b3-9068-7b80cd51aa5a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:53:37.393270 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:37.393175 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 19:48:37 +0000 UTC" deadline="2028-02-08 05:24:10.410799691 +0000 UTC" Jul 02 19:53:37.393270 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:37.393217 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14049h30m33.017587544s" Jul 02 19:53:37.518006 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:37.517975 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pkncj" Jul 02 19:53:37.518178 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:37.518130 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pkncj" podUID="e92927e3-3534-4747-ad6e-e0df14b731d3" Jul 02 19:53:37.528086 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:37.527928 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kxsct" event={"ID":"20e92fd6-0a2e-471d-a090-1b96d06600c6","Type":"ContainerStarted","Data":"5036b518b69d09a49a9349c2ad5053a0a6581154381a932fae559661f017eb28"} Jul 02 19:53:37.533564 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:37.533333 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dns-node-resolver\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:28389dd118629aa9d7c2525202f3ad6359afb98b6a3bf7672cb1ecfae2418e23\\\": ErrImagePull: pull QPS exceeded\"" pod="openshift-dns/node-resolver-kxsct" podUID="20e92fd6-0a2e-471d-a090-1b96d06600c6" Jul 02 19:53:37.536383 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:37.536310 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9dcp2" event={"ID":"aa025c37-d383-4274-9259-b2a187bcf158","Type":"ContainerStarted","Data":"78371ea8cc8e46d60b3238da23ef297d75798a091948884981e031933fdb52a9"} Jul 02 19:53:37.539722 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:37.539653 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-n844d" event={"ID":"1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61","Type":"ContainerStarted","Data":"ce83580f8c81589c45e376cb45904b618bb82d88e4aa6259a37f9541440ce491"} Jul 02 19:53:37.542306 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:37.542278 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-956ts" event={"ID":"d5e46125-32a8-49af-9a3d-207e26b76074","Type":"ContainerStarted","Data":"d7496cc207536e6b89a8840ab1434bec623608216472856b22eae45850b988ff"} Jul 02 19:53:37.544631 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:37.544425 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rsxhh" event={"ID":"cf3eddde-4aff-4a84-894c-cc18416aaafc","Type":"ContainerStarted","Data":"c33062a2aed25d4a142efe7a398537814c47303699867f046270ef1581d3ac9d"} Jul 02 19:53:37.550864 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:37.550832 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-177.ec2.internal" event={"ID":"ac215e8f2fda4d1193f85f856768dbe3","Type":"ContainerStarted","Data":"d35b5aceabdb86d430249e1edfd84eb3d9c2b22f7b5ece0d96fe287e5c526561"} Jul 02 19:53:37.554873 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:37.554849 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-177.ec2.internal" event={"ID":"2c3a208bdce47c4450c7ecd763a8b29d","Type":"ContainerStarted","Data":"53ca7487dd6bc0c8072aa7d62c4f62d3e17f6a873ee1bf5dbce3a7a3c7a119fd"} Jul 02 19:53:37.562084 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:37.562033 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" event={"ID":"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a","Type":"ContainerStarted","Data":"fe29110d8cac0bcc35c2022ad10abfdb47f074b9661f4f6c6a107ae30165b8ab"} Jul 02 19:53:37.566120 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:37.566060 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vshgf" event={"ID":"83f44c56-f3a8-4d12-9adc-c916a2990bf5","Type":"ContainerStarted","Data":"d1bcfb9520c1b64a0df13209c87369e69db69eaef01ba304d29f74ccff658162"} Jul 02 19:53:37.580587 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:37.580484 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-56fgj" event={"ID":"7295278e-a6f2-4725-99e7-7f76ea6da868","Type":"ContainerStarted","Data":"9534d11745a80f725037267dc0f7608681aa8007429c846e7f17d6da252ed9ee"} Jul 02 19:53:37.601232 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:37.601155 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rpsqp" event={"ID":"1b47afea-97df-4176-b7d1-7f5eeb6c38d6","Type":"ContainerStarted","Data":"77694b3e43c28fed08364fc34cb9a326f79e2ebb127df4d7a1c3be543231722f"} Jul 02 19:53:37.855830 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:37.855745 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 19:53:37.975059 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:37.975020 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dcc079e4-e2c2-4752-a947-0ec3ce3ccab4-metrics-certs\") pod \"network-metrics-daemon-p88nv\" (UID: \"dcc079e4-e2c2-4752-a947-0ec3ce3ccab4\") " pod="openshift-multus/network-metrics-daemon-p88nv" Jul 02 19:53:37.975246 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:37.975231 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:53:37.975315 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:37.975300 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcc079e4-e2c2-4752-a947-0ec3ce3ccab4-metrics-certs podName:dcc079e4-e2c2-4752-a947-0ec3ce3ccab4 nodeName:}" failed. No retries permitted until 2026-07-02 19:53:39.975277509 +0000 UTC m=+5.041335355 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dcc079e4-e2c2-4752-a947-0ec3ce3ccab4-metrics-certs") pod "network-metrics-daemon-p88nv" (UID: "dcc079e4-e2c2-4752-a947-0ec3ce3ccab4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:53:38.077163 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:38.077123 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e92927e3-3534-4747-ad6e-e0df14b731d3-original-pull-secret\") pod \"global-pull-secret-syncer-pkncj\" (UID: \"e92927e3-3534-4747-ad6e-e0df14b731d3\") " pod="kube-system/global-pull-secret-syncer-pkncj" Jul 02 19:53:38.077343 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:38.077316 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 19:53:38.077409 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:38.077379 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e92927e3-3534-4747-ad6e-e0df14b731d3-original-pull-secret podName:e92927e3-3534-4747-ad6e-e0df14b731d3 nodeName:}" failed. No retries permitted until 2026-07-02 19:53:40.077357222 +0000 UTC m=+5.143415064 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e92927e3-3534-4747-ad6e-e0df14b731d3-original-pull-secret") pod "global-pull-secret-syncer-pkncj" (UID: "e92927e3-3534-4747-ad6e-e0df14b731d3") : object "kube-system"/"original-pull-secret" not registered Jul 02 19:53:38.177834 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:38.177743 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wh77k\" (UniqueName: \"kubernetes.io/projected/0edfe493-6e53-42b3-9068-7b80cd51aa5a-kube-api-access-wh77k\") pod \"network-check-target-l67dn\" (UID: \"0edfe493-6e53-42b3-9068-7b80cd51aa5a\") " pod="openshift-network-diagnostics/network-check-target-l67dn" Jul 02 19:53:38.178008 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:38.177915 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 19:53:38.178008 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:38.177936 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 19:53:38.178008 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:38.177949 2565 projected.go:196] Error preparing data for projected volume kube-api-access-wh77k for pod openshift-network-diagnostics/network-check-target-l67dn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:53:38.178008 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:38.178007 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0edfe493-6e53-42b3-9068-7b80cd51aa5a-kube-api-access-wh77k podName:0edfe493-6e53-42b3-9068-7b80cd51aa5a nodeName:}" failed. No retries permitted until 2026-07-02 19:53:40.177987707 +0000 UTC m=+5.244045570 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wh77k" (UniqueName: "kubernetes.io/projected/0edfe493-6e53-42b3-9068-7b80cd51aa5a-kube-api-access-wh77k") pod "network-check-target-l67dn" (UID: "0edfe493-6e53-42b3-9068-7b80cd51aa5a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:53:38.393932 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:38.393855 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 19:48:37 +0000 UTC" deadline="2027-12-10 07:45:25.341134455 +0000 UTC" Jul 02 19:53:38.393932 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:38.393929 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12611h51m46.947210323s" Jul 02 19:53:38.515186 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:38.515063 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l67dn" Jul 02 19:53:38.515369 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:38.515192 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l67dn" podUID="0edfe493-6e53-42b3-9068-7b80cd51aa5a" Jul 02 19:53:38.515584 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:38.515560 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p88nv" Jul 02 19:53:38.515726 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:38.515697 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p88nv" podUID="dcc079e4-e2c2-4752-a947-0ec3ce3ccab4" Jul 02 19:53:39.514014 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:39.513983 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pkncj" Jul 02 19:53:39.514507 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:39.514101 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pkncj" podUID="e92927e3-3534-4747-ad6e-e0df14b731d3" Jul 02 19:53:39.995820 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:39.995781 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dcc079e4-e2c2-4752-a947-0ec3ce3ccab4-metrics-certs\") pod \"network-metrics-daemon-p88nv\" (UID: \"dcc079e4-e2c2-4752-a947-0ec3ce3ccab4\") " pod="openshift-multus/network-metrics-daemon-p88nv" Jul 02 19:53:39.996003 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:39.995953 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:53:39.996070 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:39.996020 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcc079e4-e2c2-4752-a947-0ec3ce3ccab4-metrics-certs podName:dcc079e4-e2c2-4752-a947-0ec3ce3ccab4 nodeName:}" failed. No retries permitted until 2026-07-02 19:53:43.996001011 +0000 UTC m=+9.062058850 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dcc079e4-e2c2-4752-a947-0ec3ce3ccab4-metrics-certs") pod "network-metrics-daemon-p88nv" (UID: "dcc079e4-e2c2-4752-a947-0ec3ce3ccab4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:53:40.097457 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:40.096675 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e92927e3-3534-4747-ad6e-e0df14b731d3-original-pull-secret\") pod \"global-pull-secret-syncer-pkncj\" (UID: \"e92927e3-3534-4747-ad6e-e0df14b731d3\") " pod="kube-system/global-pull-secret-syncer-pkncj" Jul 02 19:53:40.097457 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:40.096836 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 19:53:40.097457 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:40.096904 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e92927e3-3534-4747-ad6e-e0df14b731d3-original-pull-secret podName:e92927e3-3534-4747-ad6e-e0df14b731d3 nodeName:}" failed. No retries permitted until 2026-07-02 19:53:44.096885142 +0000 UTC m=+9.162942998 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e92927e3-3534-4747-ad6e-e0df14b731d3-original-pull-secret") pod "global-pull-secret-syncer-pkncj" (UID: "e92927e3-3534-4747-ad6e-e0df14b731d3") : object "kube-system"/"original-pull-secret" not registered Jul 02 19:53:40.197875 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:40.197728 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wh77k\" (UniqueName: \"kubernetes.io/projected/0edfe493-6e53-42b3-9068-7b80cd51aa5a-kube-api-access-wh77k\") pod \"network-check-target-l67dn\" (UID: \"0edfe493-6e53-42b3-9068-7b80cd51aa5a\") " pod="openshift-network-diagnostics/network-check-target-l67dn" Jul 02 19:53:40.198048 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:40.197884 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 19:53:40.198048 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:40.197911 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 19:53:40.198048 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:40.197927 2565 projected.go:196] Error preparing data for projected volume kube-api-access-wh77k for pod openshift-network-diagnostics/network-check-target-l67dn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:53:40.198048 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:40.197993 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0edfe493-6e53-42b3-9068-7b80cd51aa5a-kube-api-access-wh77k podName:0edfe493-6e53-42b3-9068-7b80cd51aa5a nodeName:}" failed. No retries permitted until 2026-07-02 19:53:44.197973471 +0000 UTC m=+9.264031327 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wh77k" (UniqueName: "kubernetes.io/projected/0edfe493-6e53-42b3-9068-7b80cd51aa5a-kube-api-access-wh77k") pod "network-check-target-l67dn" (UID: "0edfe493-6e53-42b3-9068-7b80cd51aa5a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:53:40.515098 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:40.515002 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l67dn" Jul 02 19:53:40.515098 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:40.515042 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p88nv" Jul 02 19:53:40.515649 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:40.515157 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l67dn" podUID="0edfe493-6e53-42b3-9068-7b80cd51aa5a" Jul 02 19:53:40.515649 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:40.515318 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p88nv" podUID="dcc079e4-e2c2-4752-a947-0ec3ce3ccab4" Jul 02 19:53:41.514662 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:41.514628 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pkncj" Jul 02 19:53:41.514862 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:41.514774 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pkncj" podUID="e92927e3-3534-4747-ad6e-e0df14b731d3" Jul 02 19:53:42.514776 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:42.514638 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l67dn" Jul 02 19:53:42.515292 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:42.514782 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l67dn" podUID="0edfe493-6e53-42b3-9068-7b80cd51aa5a" Jul 02 19:53:42.515292 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:42.514833 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p88nv" Jul 02 19:53:42.515292 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:42.514982 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p88nv" podUID="dcc079e4-e2c2-4752-a947-0ec3ce3ccab4" Jul 02 19:53:43.514692 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:43.514654 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pkncj" Jul 02 19:53:43.514908 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:43.514798 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pkncj" podUID="e92927e3-3534-4747-ad6e-e0df14b731d3" Jul 02 19:53:44.035707 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:44.035622 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dcc079e4-e2c2-4752-a947-0ec3ce3ccab4-metrics-certs\") pod \"network-metrics-daemon-p88nv\" (UID: \"dcc079e4-e2c2-4752-a947-0ec3ce3ccab4\") " pod="openshift-multus/network-metrics-daemon-p88nv" Jul 02 19:53:44.035874 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:44.035819 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:53:44.035935 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:44.035899 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcc079e4-e2c2-4752-a947-0ec3ce3ccab4-metrics-certs podName:dcc079e4-e2c2-4752-a947-0ec3ce3ccab4 nodeName:}" failed. No retries permitted until 2026-07-02 19:53:52.035877697 +0000 UTC m=+17.101935538 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dcc079e4-e2c2-4752-a947-0ec3ce3ccab4-metrics-certs") pod "network-metrics-daemon-p88nv" (UID: "dcc079e4-e2c2-4752-a947-0ec3ce3ccab4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:53:44.136849 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:44.136813 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e92927e3-3534-4747-ad6e-e0df14b731d3-original-pull-secret\") pod \"global-pull-secret-syncer-pkncj\" (UID: \"e92927e3-3534-4747-ad6e-e0df14b731d3\") " pod="kube-system/global-pull-secret-syncer-pkncj" Jul 02 19:53:44.137043 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:44.136940 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 19:53:44.137043 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:44.137008 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e92927e3-3534-4747-ad6e-e0df14b731d3-original-pull-secret podName:e92927e3-3534-4747-ad6e-e0df14b731d3 nodeName:}" failed. No retries permitted until 2026-07-02 19:53:52.136990589 +0000 UTC m=+17.203048431 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e92927e3-3534-4747-ad6e-e0df14b731d3-original-pull-secret") pod "global-pull-secret-syncer-pkncj" (UID: "e92927e3-3534-4747-ad6e-e0df14b731d3") : object "kube-system"/"original-pull-secret" not registered Jul 02 19:53:44.237647 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:44.237612 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wh77k\" (UniqueName: \"kubernetes.io/projected/0edfe493-6e53-42b3-9068-7b80cd51aa5a-kube-api-access-wh77k\") pod \"network-check-target-l67dn\" (UID: \"0edfe493-6e53-42b3-9068-7b80cd51aa5a\") " pod="openshift-network-diagnostics/network-check-target-l67dn" Jul 02 19:53:44.237855 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:44.237831 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 19:53:44.237855 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:44.237854 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 19:53:44.237969 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:44.237868 2565 projected.go:196] Error preparing data for projected volume kube-api-access-wh77k for pod openshift-network-diagnostics/network-check-target-l67dn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:53:44.237969 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:44.237927 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0edfe493-6e53-42b3-9068-7b80cd51aa5a-kube-api-access-wh77k podName:0edfe493-6e53-42b3-9068-7b80cd51aa5a nodeName:}" failed. No retries permitted until 2026-07-02 19:53:52.237907624 +0000 UTC m=+17.303965480 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wh77k" (UniqueName: "kubernetes.io/projected/0edfe493-6e53-42b3-9068-7b80cd51aa5a-kube-api-access-wh77k") pod "network-check-target-l67dn" (UID: "0edfe493-6e53-42b3-9068-7b80cd51aa5a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:53:44.515021 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:44.514925 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l67dn" Jul 02 19:53:44.515021 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:44.514954 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p88nv" Jul 02 19:53:44.515596 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:44.515075 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l67dn" podUID="0edfe493-6e53-42b3-9068-7b80cd51aa5a" Jul 02 19:53:44.515596 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:44.515232 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p88nv" podUID="dcc079e4-e2c2-4752-a947-0ec3ce3ccab4" Jul 02 19:53:45.515459 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:45.515408 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pkncj" Jul 02 19:53:45.515939 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:45.515549 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pkncj" podUID="e92927e3-3534-4747-ad6e-e0df14b731d3" Jul 02 19:53:46.514405 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:46.514374 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l67dn" Jul 02 19:53:46.514607 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:46.514372 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p88nv" Jul 02 19:53:46.514607 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:46.514515 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l67dn" podUID="0edfe493-6e53-42b3-9068-7b80cd51aa5a" Jul 02 19:53:46.514607 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:46.514558 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p88nv" podUID="dcc079e4-e2c2-4752-a947-0ec3ce3ccab4" Jul 02 19:53:47.514734 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:47.514681 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pkncj" Jul 02 19:53:47.515178 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:47.514813 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pkncj" podUID="e92927e3-3534-4747-ad6e-e0df14b731d3" Jul 02 19:53:48.514279 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:48.514248 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p88nv" Jul 02 19:53:48.514443 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:48.514261 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l67dn" Jul 02 19:53:48.514443 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:48.514420 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p88nv" podUID="dcc079e4-e2c2-4752-a947-0ec3ce3ccab4" Jul 02 19:53:48.514540 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:48.514463 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l67dn" podUID="0edfe493-6e53-42b3-9068-7b80cd51aa5a" Jul 02 19:53:49.514793 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:49.514701 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pkncj" Jul 02 19:53:49.515231 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:49.514814 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pkncj" podUID="e92927e3-3534-4747-ad6e-e0df14b731d3" Jul 02 19:53:50.514266 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:50.514232 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l67dn" Jul 02 19:53:50.514463 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:50.514373 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l67dn" podUID="0edfe493-6e53-42b3-9068-7b80cd51aa5a" Jul 02 19:53:50.514463 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:50.514438 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p88nv" Jul 02 19:53:50.514584 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:50.514542 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p88nv" podUID="dcc079e4-e2c2-4752-a947-0ec3ce3ccab4" Jul 02 19:53:51.514352 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:51.514305 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pkncj" Jul 02 19:53:51.514800 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:51.514454 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pkncj" podUID="e92927e3-3534-4747-ad6e-e0df14b731d3" Jul 02 19:53:52.102159 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:52.102124 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dcc079e4-e2c2-4752-a947-0ec3ce3ccab4-metrics-certs\") pod \"network-metrics-daemon-p88nv\" (UID: \"dcc079e4-e2c2-4752-a947-0ec3ce3ccab4\") " pod="openshift-multus/network-metrics-daemon-p88nv" Jul 02 19:53:52.102354 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:52.102293 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:53:52.102437 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:52.102374 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcc079e4-e2c2-4752-a947-0ec3ce3ccab4-metrics-certs podName:dcc079e4-e2c2-4752-a947-0ec3ce3ccab4 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:08.102357316 +0000 UTC m=+33.168415172 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dcc079e4-e2c2-4752-a947-0ec3ce3ccab4-metrics-certs") pod "network-metrics-daemon-p88nv" (UID: "dcc079e4-e2c2-4752-a947-0ec3ce3ccab4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:53:52.203469 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:52.203437 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e92927e3-3534-4747-ad6e-e0df14b731d3-original-pull-secret\") pod \"global-pull-secret-syncer-pkncj\" (UID: \"e92927e3-3534-4747-ad6e-e0df14b731d3\") " pod="kube-system/global-pull-secret-syncer-pkncj" Jul 02 19:53:52.203649 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:52.203601 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 19:53:52.203704 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:52.203677 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e92927e3-3534-4747-ad6e-e0df14b731d3-original-pull-secret podName:e92927e3-3534-4747-ad6e-e0df14b731d3 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:08.203653719 +0000 UTC m=+33.269711558 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e92927e3-3534-4747-ad6e-e0df14b731d3-original-pull-secret") pod "global-pull-secret-syncer-pkncj" (UID: "e92927e3-3534-4747-ad6e-e0df14b731d3") : object "kube-system"/"original-pull-secret" not registered Jul 02 19:53:52.304064 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:52.304023 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wh77k\" (UniqueName: \"kubernetes.io/projected/0edfe493-6e53-42b3-9068-7b80cd51aa5a-kube-api-access-wh77k\") pod \"network-check-target-l67dn\" (UID: \"0edfe493-6e53-42b3-9068-7b80cd51aa5a\") " pod="openshift-network-diagnostics/network-check-target-l67dn" Jul 02 19:53:52.304248 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:52.304186 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 19:53:52.304248 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:52.304204 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 19:53:52.304248 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:52.304215 2565 projected.go:196] Error preparing data for projected volume kube-api-access-wh77k for pod openshift-network-diagnostics/network-check-target-l67dn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:53:52.304428 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:52.304276 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0edfe493-6e53-42b3-9068-7b80cd51aa5a-kube-api-access-wh77k podName:0edfe493-6e53-42b3-9068-7b80cd51aa5a nodeName:}" failed. No retries permitted until 2026-07-02 19:54:08.304258527 +0000 UTC m=+33.370316366 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wh77k" (UniqueName: "kubernetes.io/projected/0edfe493-6e53-42b3-9068-7b80cd51aa5a-kube-api-access-wh77k") pod "network-check-target-l67dn" (UID: "0edfe493-6e53-42b3-9068-7b80cd51aa5a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:53:52.514629 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:52.514548 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l67dn" Jul 02 19:53:52.515011 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:52.514548 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p88nv" Jul 02 19:53:52.515011 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:52.514657 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l67dn" podUID="0edfe493-6e53-42b3-9068-7b80cd51aa5a" Jul 02 19:53:52.515011 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:52.514772 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p88nv" podUID="dcc079e4-e2c2-4752-a947-0ec3ce3ccab4" Jul 02 19:53:53.514464 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:53.514391 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pkncj" Jul 02 19:53:53.514600 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:53.514514 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pkncj" podUID="e92927e3-3534-4747-ad6e-e0df14b731d3" Jul 02 19:53:54.514353 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:54.514311 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l67dn" Jul 02 19:53:54.514773 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:54.514317 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p88nv" Jul 02 19:53:54.514773 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:54.514418 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l67dn" podUID="0edfe493-6e53-42b3-9068-7b80cd51aa5a" Jul 02 19:53:54.514773 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:54.514546 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p88nv" podUID="dcc079e4-e2c2-4752-a947-0ec3ce3ccab4" Jul 02 19:53:55.515124 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:55.515092 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pkncj" Jul 02 19:53:55.515595 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:55.515201 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pkncj" podUID="e92927e3-3534-4747-ad6e-e0df14b731d3" Jul 02 19:53:56.514792 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:56.514756 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l67dn" Jul 02 19:53:56.514792 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:56.514783 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p88nv" Jul 02 19:53:56.515046 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:56.514870 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l67dn" podUID="0edfe493-6e53-42b3-9068-7b80cd51aa5a" Jul 02 19:53:56.515046 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:56.514941 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p88nv" podUID="dcc079e4-e2c2-4752-a947-0ec3ce3ccab4" Jul 02 19:53:57.514460 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:57.514286 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pkncj" Jul 02 19:53:57.515031 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:57.514542 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pkncj" podUID="e92927e3-3534-4747-ad6e-e0df14b731d3" Jul 02 19:53:57.648034 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:57.648001 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9dcp2" event={"ID":"aa025c37-d383-4274-9259-b2a187bcf158","Type":"ContainerStarted","Data":"e052607c6451a252322442b29c0464af98739c6388b70555b42459a65b3fdffb"} Jul 02 19:53:57.649621 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:57.649598 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-n844d" event={"ID":"1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61","Type":"ContainerStarted","Data":"2674a1f3aeb86448d6134fe39ac0a34c30c04d1ac01356b412a9af115af47af4"} Jul 02 19:53:57.652296 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:57.652258 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rsxhh" event={"ID":"cf3eddde-4aff-4a84-894c-cc18416aaafc","Type":"ContainerStarted","Data":"6fe82c270d557eafca4a79c8203d8e1051e79a2fc4076e5efc282f21529c78bd"} Jul 02 19:53:57.653965 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:57.653940 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-177.ec2.internal" event={"ID":"ac215e8f2fda4d1193f85f856768dbe3","Type":"ContainerStarted","Data":"dee00af3b1a1d38f2c6865b3b1a86b8e72c06a13b788426ddbe17309b3e971f7"} Jul 02 19:53:57.655674 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:57.655627 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-177.ec2.internal" event={"ID":"2c3a208bdce47c4450c7ecd763a8b29d","Type":"ContainerStarted","Data":"140cb787c02f2d1fc5cdccdfe67e876bbc89fec510ca7324cd5d4684fff8d0d4"} Jul 02 19:53:57.659087 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:57.659049 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" event={"ID":"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a","Type":"ContainerStarted","Data":"751f40c844f2d5a5e1ad7b9a4f0471afc3fa800a7ea2ec035ba571389f8b18cf"} Jul 02 19:53:57.659166 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:57.659126 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" event={"ID":"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a","Type":"ContainerStarted","Data":"b515f010dbe0ff17ea3702181eacc76e7f624c199b46b73742a1ff0215247555"} Jul 02 19:53:57.659203 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:57.659174 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" event={"ID":"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a","Type":"ContainerStarted","Data":"e841bebde1755e2ca00fa8606f9aa7a1abe89f07a8692acd687606fe325b3aa9"} Jul 02 19:53:57.659372 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:57.659220 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" event={"ID":"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a","Type":"ContainerStarted","Data":"a5978a70e21fda80bb31abb20e5cc7972bcbc79e89d9deafa78f14bbe176f263"} Jul 02 19:53:57.659372 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:57.659290 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" event={"ID":"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a","Type":"ContainerStarted","Data":"adcaa3809bd7ba48c618094de0b3bf186e65dfd24887ca077c8421fa8ab4d6a6"} Jul 02 19:53:57.659372 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:57.659357 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" event={"ID":"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a","Type":"ContainerStarted","Data":"f441927b960ac2f30b5558afca87ab09d922debabe5075ae545a59528109add6"} Jul 02 19:53:57.660880 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:57.660859 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vshgf" event={"ID":"83f44c56-f3a8-4d12-9adc-c916a2990bf5","Type":"ContainerStarted","Data":"f7b743d87c0fa8eae14435462566a94f4c7eda32f38d7de143897eddb7c49f65"} Jul 02 19:53:57.662913 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:57.662799 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-56fgj" event={"ID":"7295278e-a6f2-4725-99e7-7f76ea6da868","Type":"ContainerStarted","Data":"8ab159723ea042b892f688f5fe519d8d630ae33eff2e855c67bec083b364554c"} Jul 02 19:53:57.664363 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:57.664323 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rpsqp" event={"ID":"1b47afea-97df-4176-b7d1-7f5eeb6c38d6","Type":"ContainerStarted","Data":"48e0a16e8e815d4597146a2377df3444668b3d17b1e334ec4125d90592a0cd8a"} Jul 02 19:53:57.665570 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:57.665543 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kxsct" event={"ID":"20e92fd6-0a2e-471d-a090-1b96d06600c6","Type":"ContainerStarted","Data":"c496352ac4f929a974f9d0837971eafd9e72c4e6dde08f213ca887ca2a4359a6"} Jul 02 19:53:57.668456 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:57.668390 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9dcp2" podStartSLOduration=1.545531556 podStartE2EDuration="21.668372769s" totalImagesPullingTime="20.122841213s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:53:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:53:57.668169322 +0000 UTC m=+22.734227194" watchObservedRunningTime="2026-07-02 19:53:57.668372769 +0000 UTC m=+22.734430633" Jul 02 19:53:57.701082 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:57.701035 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-56fgj" podStartSLOduration=1.499818409 podStartE2EDuration="21.701016231s" totalImagesPullingTime="20.201197822s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:53:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:53:57.684638622 +0000 UTC m=+22.750696483" watchObservedRunningTime="2026-07-02 19:53:57.701016231 +0000 UTC m=+22.767074093" Jul 02 19:53:57.726551 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:57.726508 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-kxsct" podStartSLOduration=21.726492962000002 podStartE2EDuration="21.726492962s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:53:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-02 19:53:57.726193273 +0000 UTC m=+22.792251134" watchObservedRunningTime="2026-07-02 19:53:57.726492962 +0000 UTC m=+22.792550822" Jul 02 19:53:57.726724 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:57.726704 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-n844d" podStartSLOduration=1.590430031 podStartE2EDuration="21.72670028s" totalImagesPullingTime="20.136270249s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:53:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:53:57.701110188 +0000 UTC m=+22.767168049" watchObservedRunningTime="2026-07-02 19:53:57.72670028 +0000 UTC m=+22.792758141" Jul 02 19:53:57.755358 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:57.755305 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-177.ec2.internal" podStartSLOduration=20.755291334 podStartE2EDuration="20.755291334s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:53:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:53:57.755035965 +0000 UTC m=+22.821093820" watchObservedRunningTime="2026-07-02 19:53:57.755291334 +0000 UTC m=+22.821349195" Jul 02 19:53:57.796759 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:57.796718 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-vshgf" podStartSLOduration=1.562246478 podStartE2EDuration="21.796705178s" totalImagesPullingTime="20.2344587s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:53:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:53:57.796298804 +0000 UTC m=+22.862356662" watchObservedRunningTime="2026-07-02 19:53:57.796705178 +0000 UTC m=+22.862763039" Jul 02 19:53:58.514499 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:58.514313 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l67dn" Jul 02 19:53:58.515000 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:58.514319 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p88nv" Jul 02 19:53:58.515000 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:58.514565 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l67dn" podUID="0edfe493-6e53-42b3-9068-7b80cd51aa5a" Jul 02 19:53:58.515000 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:58.514662 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p88nv" podUID="dcc079e4-e2c2-4752-a947-0ec3ce3ccab4" Jul 02 19:53:58.669862 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:58.669784 2565 generic.go:356] "Generic (PLEG): container finished" podID="1b47afea-97df-4176-b7d1-7f5eeb6c38d6" containerID="48e0a16e8e815d4597146a2377df3444668b3d17b1e334ec4125d90592a0cd8a" exitCode=0 Jul 02 19:53:58.669862 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:58.669818 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rpsqp" event={"ID":"1b47afea-97df-4176-b7d1-7f5eeb6c38d6","Type":"ContainerDied","Data":"48e0a16e8e815d4597146a2377df3444668b3d17b1e334ec4125d90592a0cd8a"} Jul 02 19:53:58.671559 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:58.671534 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-956ts" event={"ID":"d5e46125-32a8-49af-9a3d-207e26b76074","Type":"ContainerStarted","Data":"0b75710184a21340f49d098f1bda1386a79279c30b58b6ee70199aba59172470"} Jul 02 19:53:58.673067 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:58.673040 2565 generic.go:356] "Generic (PLEG): container finished" podID="2c3a208bdce47c4450c7ecd763a8b29d" containerID="140cb787c02f2d1fc5cdccdfe67e876bbc89fec510ca7324cd5d4684fff8d0d4" exitCode=0 Jul 02 19:53:58.673204 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:58.673162 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-177.ec2.internal" event={"ID":"2c3a208bdce47c4450c7ecd763a8b29d","Type":"ContainerDied","Data":"140cb787c02f2d1fc5cdccdfe67e876bbc89fec510ca7324cd5d4684fff8d0d4"} Jul 02 19:53:58.711856 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:58.711799 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-956ts" podStartSLOduration=2.557385294 podStartE2EDuration="22.711778721s" totalImagesPullingTime="20.154393427s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:53:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:53:58.711440596 +0000 UTC m=+23.777498457" watchObservedRunningTime="2026-07-02 19:53:58.711778721 +0000 UTC m=+23.777836583" Jul 02 19:53:59.121727 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:59.121705 2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 02 19:53:59.417673 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:59.417476 2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-02T19:53:59.121722082Z","UUID":"6ddeeb80-a5e0-47d9-850e-2074a7448139","Handler":null,"Name":"","Endpoint":""} Jul 02 19:53:59.419291 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:59.419259 2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 02 19:53:59.419291 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:59.419293 2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 02 19:53:59.514305 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:59.514276 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pkncj" Jul 02 19:53:59.514524 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:53:59.514397 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pkncj" podUID="e92927e3-3534-4747-ad6e-e0df14b731d3" Jul 02 19:53:59.680787 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:59.680754 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rsxhh" event={"ID":"cf3eddde-4aff-4a84-894c-cc18416aaafc","Type":"ContainerStarted","Data":"59ce37596de908dc6b09993d6d6564a052201489074ca13ee9ad91ad765bdc1e"} Jul 02 19:53:59.683201 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:59.683171 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-177.ec2.internal" event={"ID":"2c3a208bdce47c4450c7ecd763a8b29d","Type":"ContainerStarted","Data":"1c7b7f2d278a0f7fb00fc5382844519675bffdc38b99928aa50054ba0310c292"} Jul 02 19:53:59.697966 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:53:59.697838 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-177.ec2.internal" podStartSLOduration=22.697819617 podStartE2EDuration="22.697819617s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:53:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:53:59.697697483 +0000 UTC m=+24.763755344" watchObservedRunningTime="2026-07-02 19:53:59.697819617 +0000 UTC m=+24.763877479" Jul 02 19:54:00.514717 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:00.514690 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p88nv" Jul 02 19:54:00.515101 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:00.514695 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l67dn" Jul 02 19:54:00.515101 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:00.514790 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p88nv" podUID="dcc079e4-e2c2-4752-a947-0ec3ce3ccab4" Jul 02 19:54:00.515101 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:00.514899 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l67dn" podUID="0edfe493-6e53-42b3-9068-7b80cd51aa5a" Jul 02 19:54:00.575065 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:00.575031 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-n844d" Jul 02 19:54:00.575599 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:00.575579 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-n844d" Jul 02 19:54:00.687660 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:00.687579 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rsxhh" event={"ID":"cf3eddde-4aff-4a84-894c-cc18416aaafc","Type":"ContainerStarted","Data":"c1f97fdf3f2afa765640a207613d3cc10b684658bd6084527babbfba1617049a"} Jul 02 19:54:00.690642 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:00.690620 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" event={"ID":"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a","Type":"ContainerStarted","Data":"d1a46245cb86f2a92fd26ba58fdac5d730703a1521507dd2d07ebba7c4a67d9f"} Jul 02 19:54:00.690912 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:00.690896 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-n844d" Jul 02 19:54:00.691278 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:00.691264 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-n844d" Jul 02 19:54:00.708868 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:00.708811 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rsxhh" podStartSLOduration=1.90212603 podStartE2EDuration="24.708798535s" totalImagesPullingTime="22.806672505s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:53:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:54:00.708589266 +0000 UTC m=+25.774647127" watchObservedRunningTime="2026-07-02 19:54:00.708798535 +0000 UTC m=+25.774856392" Jul 02 19:54:01.514680 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:01.514640 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pkncj" Jul 02 19:54:01.514853 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:01.514775 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pkncj" podUID="e92927e3-3534-4747-ad6e-e0df14b731d3" Jul 02 19:54:02.515082 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:02.514910 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l67dn" Jul 02 19:54:02.515775 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:02.514969 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p88nv" Jul 02 19:54:02.515775 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:02.515159 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l67dn" podUID="0edfe493-6e53-42b3-9068-7b80cd51aa5a" Jul 02 19:54:02.515775 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:02.515241 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p88nv" podUID="dcc079e4-e2c2-4752-a947-0ec3ce3ccab4" Jul 02 19:54:02.699051 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:02.699019 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" event={"ID":"f78c0ffa-96d5-4c22-8bff-39b81bc11b5a","Type":"ContainerStarted","Data":"1c0ad0ee5308953d9087839a54fb3d8fdf6be844940b17e0de8a6d97f9a21bc4"} Jul 02 19:54:02.743317 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:02.743262 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" podStartSLOduration=6.509293002 podStartE2EDuration="26.74324213s" totalImagesPullingTime="20.233949128s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:53:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:54:02.74258346 +0000 UTC m=+27.808641321" watchObservedRunningTime="2026-07-02 19:54:02.74324213 +0000 UTC m=+27.809299990" Jul 02 19:54:03.514231 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:03.514203 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pkncj" Jul 02 19:54:03.514420 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:03.514356 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pkncj" podUID="e92927e3-3534-4747-ad6e-e0df14b731d3" Jul 02 19:54:03.702939 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:03.702858 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:54:03.703539 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:03.702951 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:54:03.703539 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:03.702998 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:54:03.720971 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:03.720918 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:54:03.721653 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:03.721631 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:54:04.129947 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:04.129913 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-p88nv"] Jul 02 19:54:04.130106 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:04.130056 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p88nv" Jul 02 19:54:04.130192 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:04.130168 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p88nv" podUID="dcc079e4-e2c2-4752-a947-0ec3ce3ccab4" Jul 02 19:54:04.132375 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:04.132335 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pkncj"] Jul 02 19:54:04.132488 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:04.132437 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pkncj" Jul 02 19:54:04.132547 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:04.132528 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pkncj" podUID="e92927e3-3534-4747-ad6e-e0df14b731d3" Jul 02 19:54:04.139709 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:04.139641 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-l67dn"] Jul 02 19:54:04.139824 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:04.139747 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l67dn" Jul 02 19:54:04.139879 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:04.139830 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l67dn" podUID="0edfe493-6e53-42b3-9068-7b80cd51aa5a" Jul 02 19:54:05.515056 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:05.514885 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l67dn" Jul 02 19:54:05.515573 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:05.515106 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l67dn" podUID="0edfe493-6e53-42b3-9068-7b80cd51aa5a" Jul 02 19:54:05.515573 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:05.514960 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pkncj" Jul 02 19:54:05.515573 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:05.515230 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pkncj" podUID="e92927e3-3534-4747-ad6e-e0df14b731d3" Jul 02 19:54:05.707917 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:05.707879 2565 generic.go:356] "Generic (PLEG): container finished" podID="1b47afea-97df-4176-b7d1-7f5eeb6c38d6" containerID="b1dd08343f2d1ce36bb177c077620a7d23041ac1d8b0344218ef951b29e8430f" exitCode=0 Jul 02 19:54:05.708079 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:05.707966 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rpsqp" event={"ID":"1b47afea-97df-4176-b7d1-7f5eeb6c38d6","Type":"ContainerDied","Data":"b1dd08343f2d1ce36bb177c077620a7d23041ac1d8b0344218ef951b29e8430f"} Jul 02 19:54:06.514235 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:06.514206 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p88nv" Jul 02 19:54:06.514483 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:06.514364 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p88nv" podUID="dcc079e4-e2c2-4752-a947-0ec3ce3ccab4" Jul 02 19:54:07.514984 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:07.514940 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l67dn" Jul 02 19:54:07.515463 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:07.514945 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pkncj" Jul 02 19:54:07.515463 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:07.515069 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l67dn" podUID="0edfe493-6e53-42b3-9068-7b80cd51aa5a" Jul 02 19:54:07.515463 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:07.515137 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pkncj" podUID="e92927e3-3534-4747-ad6e-e0df14b731d3" Jul 02 19:54:07.714063 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:07.714031 2565 generic.go:356] "Generic (PLEG): container finished" podID="1b47afea-97df-4176-b7d1-7f5eeb6c38d6" containerID="70ca448d0830b91996a9927e872806a03b60171054df8751794b50353d33a183" exitCode=0 Jul 02 19:54:07.714063 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:07.714070 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rpsqp" event={"ID":"1b47afea-97df-4176-b7d1-7f5eeb6c38d6","Type":"ContainerDied","Data":"70ca448d0830b91996a9927e872806a03b60171054df8751794b50353d33a183"} Jul 02 19:54:08.120130 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:08.120095 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dcc079e4-e2c2-4752-a947-0ec3ce3ccab4-metrics-certs\") pod \"network-metrics-daemon-p88nv\" (UID: \"dcc079e4-e2c2-4752-a947-0ec3ce3ccab4\") " pod="openshift-multus/network-metrics-daemon-p88nv" Jul 02 19:54:08.120279 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:08.120208 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:54:08.120279 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:08.120256 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcc079e4-e2c2-4752-a947-0ec3ce3ccab4-metrics-certs podName:dcc079e4-e2c2-4752-a947-0ec3ce3ccab4 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:40.120242072 +0000 UTC m=+65.186299911 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dcc079e4-e2c2-4752-a947-0ec3ce3ccab4-metrics-certs") pod "network-metrics-daemon-p88nv" (UID: "dcc079e4-e2c2-4752-a947-0ec3ce3ccab4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:54:08.220653 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:08.220621 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e92927e3-3534-4747-ad6e-e0df14b731d3-original-pull-secret\") pod \"global-pull-secret-syncer-pkncj\" (UID: \"e92927e3-3534-4747-ad6e-e0df14b731d3\") " pod="kube-system/global-pull-secret-syncer-pkncj" Jul 02 19:54:08.220802 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:08.220773 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 19:54:08.220844 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:08.220831 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e92927e3-3534-4747-ad6e-e0df14b731d3-original-pull-secret podName:e92927e3-3534-4747-ad6e-e0df14b731d3 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:40.220818397 +0000 UTC m=+65.286876236 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e92927e3-3534-4747-ad6e-e0df14b731d3-original-pull-secret") pod "global-pull-secret-syncer-pkncj" (UID: "e92927e3-3534-4747-ad6e-e0df14b731d3") : object "kube-system"/"original-pull-secret" not registered Jul 02 19:54:08.321006 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:08.320974 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wh77k\" (UniqueName: \"kubernetes.io/projected/0edfe493-6e53-42b3-9068-7b80cd51aa5a-kube-api-access-wh77k\") pod \"network-check-target-l67dn\" (UID: \"0edfe493-6e53-42b3-9068-7b80cd51aa5a\") " pod="openshift-network-diagnostics/network-check-target-l67dn" Jul 02 19:54:08.321149 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:08.321093 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 19:54:08.321149 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:08.321112 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 19:54:08.321149 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:08.321120 2565 projected.go:196] Error preparing data for projected volume kube-api-access-wh77k for pod openshift-network-diagnostics/network-check-target-l67dn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:54:08.321263 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:08.321170 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0edfe493-6e53-42b3-9068-7b80cd51aa5a-kube-api-access-wh77k podName:0edfe493-6e53-42b3-9068-7b80cd51aa5a nodeName:}" failed. No retries permitted until 2026-07-02 19:54:40.321155303 +0000 UTC m=+65.387213141 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wh77k" (UniqueName: "kubernetes.io/projected/0edfe493-6e53-42b3-9068-7b80cd51aa5a-kube-api-access-wh77k") pod "network-check-target-l67dn" (UID: "0edfe493-6e53-42b3-9068-7b80cd51aa5a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:54:08.514558 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:08.514484 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p88nv" Jul 02 19:54:08.514706 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:08.514584 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p88nv" podUID="dcc079e4-e2c2-4752-a947-0ec3ce3ccab4" Jul 02 19:54:09.514588 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.514553 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pkncj" Jul 02 19:54:09.514588 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.514567 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l67dn" Jul 02 19:54:09.514963 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:09.514664 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pkncj" podUID="e92927e3-3534-4747-ad6e-e0df14b731d3" Jul 02 19:54:09.514963 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:09.514790 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l67dn" podUID="0edfe493-6e53-42b3-9068-7b80cd51aa5a" Jul 02 19:54:09.719727 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.719628 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-177.ec2.internal" event="NodeReady" Jul 02 19:54:09.719873 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.719837 2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 02 19:54:09.721441 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.721412 2565 generic.go:356] "Generic (PLEG): container finished" podID="1b47afea-97df-4176-b7d1-7f5eeb6c38d6" containerID="4a15859547e6ca66353ab5242925080ac0110d2145ec83434256b313a0e390f2" exitCode=0 Jul 02 19:54:09.721541 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.721445 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rpsqp" event={"ID":"1b47afea-97df-4176-b7d1-7f5eeb6c38d6","Type":"ContainerDied","Data":"4a15859547e6ca66353ab5242925080ac0110d2145ec83434256b313a0e390f2"} Jul 02 19:54:09.753157 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.753130 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-dd6df"] Jul 02 19:54:09.754858 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.754845 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-dd6df" Jul 02 19:54:09.756400 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.756273 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-c794c79b8-mzm4h"] Jul 02 19:54:09.757591 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.757572 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-tdqcd\"" Jul 02 19:54:09.757668 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.757572 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 02 19:54:09.757720 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.757663 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 02 19:54:09.757926 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.757911 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c794c79b8-mzm4h" Jul 02 19:54:09.760290 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.760272 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 02 19:54:09.760575 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.760553 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-hfqbh\"" Jul 02 19:54:09.760654 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.760633 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 02 19:54:09.760790 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.760739 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 02 19:54:09.768528 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.768509 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 02 19:54:09.772362 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.772267 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-dd6df"] Jul 02 19:54:09.772970 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.772944 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fmdh8"] Jul 02 19:54:09.774630 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.774614 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-drhbp"] Jul 02 19:54:09.774798 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.774780 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fmdh8" Jul 02 19:54:09.776732 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.776711 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-crtx8"] Jul 02 19:54:09.776867 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.776835 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-drhbp" Jul 02 19:54:09.778566 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.778545 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-jcrll\"" Jul 02 19:54:09.778895 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.778877 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 02 19:54:09.779003 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.778983 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 02 19:54:09.779082 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.779006 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 02 19:54:09.779599 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.779581 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 02 19:54:09.779709 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.779665 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 02 19:54:09.779771 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.779756 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8265f"] Jul 02 19:54:09.779882 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.779867 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-crtx8" Jul 02 19:54:09.779949 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.779905 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-gg9gb\"" Jul 02 19:54:09.780541 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.780511 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 02 19:54:09.780651 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.780513 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 02 19:54:09.781595 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.781520 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-6n2jb"] Jul 02 19:54:09.781682 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.781672 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8265f" Jul 02 19:54:09.786908 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.786887 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-597bb6b665-89gn9"] Jul 02 19:54:09.787107 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.787092 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-6n2jb" Jul 02 19:54:09.787803 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.787402 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-228xx\"" Jul 02 19:54:09.787803 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.787429 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 02 19:54:09.787803 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.787364 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 02 19:54:09.787983 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.787922 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 02 19:54:09.788164 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.788148 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 02 19:54:09.788513 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.788470 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-6snsl\"" Jul 02 19:54:09.788513 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.788488 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 02 19:54:09.788644 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.788520 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 02 19:54:09.788644 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.788488 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 02 19:54:09.788644 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.788491 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 02 19:54:09.788854 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.788839 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 02 19:54:09.789319 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.789300 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c794c79b8-mzm4h"] Jul 02 19:54:09.789446 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.789326 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-597bb6b665-89gn9" Jul 02 19:54:09.790780 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.790620 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 02 19:54:09.790871 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.790806 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-crtx8"] Jul 02 19:54:09.791012 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.790987 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 02 19:54:09.791069 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.791042 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 02 19:54:09.791069 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.790993 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 02 19:54:09.791889 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.791542 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fmdh8"] Jul 02 19:54:09.792325 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.792284 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-6sdsc\"" Jul 02 19:54:09.792429 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.792328 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 02 19:54:09.792642 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.792621 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8265f"] Jul 02 19:54:09.792711 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.792679 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 02 19:54:09.793004 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.792987 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-c2vfc\"" Jul 02 19:54:09.793068 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.793041 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 02 19:54:09.794505 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.794487 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 02 19:54:09.794879 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.794863 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 02 19:54:09.795263 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.795118 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 02 19:54:09.798193 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.798174 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 02 19:54:09.799374 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.799357 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-drhbp"] Jul 02 19:54:09.801614 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.801555 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-88qmn"] Jul 02 19:54:09.803889 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.803874 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-p9t9k"] Jul 02 19:54:09.804088 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.803957 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-88qmn" Jul 02 19:54:09.805794 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.805775 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-6n2jb"] Jul 02 19:54:09.805897 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.805816 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-j6rjf"] Jul 02 19:54:09.806123 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.806106 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-p9t9k" Jul 02 19:54:09.807859 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.807843 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 02 19:54:09.807956 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.807878 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-kxdpx\"" Jul 02 19:54:09.807956 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.807884 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 02 19:54:09.808059 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.808028 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-krlc4"] Jul 02 19:54:09.808198 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.808180 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-j6rjf" Jul 02 19:54:09.808902 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.808883 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 02 19:54:09.808902 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.808895 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 02 19:54:09.809096 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.809024 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-tbwtl\"" Jul 02 19:54:09.809145 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.809112 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 02 19:54:09.809352 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.809316 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 02 19:54:09.809889 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.809872 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-cxzsr"] Jul 02 19:54:09.809952 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.809933 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-krlc4" Jul 02 19:54:09.811698 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.811678 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 02 19:54:09.811782 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.811743 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nzdvh\"" Jul 02 19:54:09.812517 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.812499 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 02 19:54:09.812764 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.812728 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 02 19:54:09.813000 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.812984 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 02 19:54:09.813285 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.812996 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-tjpqs\"" Jul 02 19:54:09.813556 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.813069 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 02 19:54:09.816308 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.816281 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-597bb6b665-89gn9"] Jul 02 19:54:09.816423 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.816391 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-cxzsr" Jul 02 19:54:09.816905 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.816886 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-88qmn"] Jul 02 19:54:09.819774 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.819753 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 19:54:09.820375 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.820357 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-dtbd7\"" Jul 02 19:54:09.820557 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.820538 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 19:54:09.821667 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.821647 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-cxzsr"] Jul 02 19:54:09.822545 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.822514 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-j6rjf"] Jul 02 19:54:09.823269 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.823194 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-krlc4"] Jul 02 19:54:09.825096 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.825076 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-p9t9k"] Jul 02 19:54:09.932942 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.932909 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dq6n4\" (UniqueName: \"kubernetes.io/projected/e2878a16-7611-42fd-8bf4-4e30b6da7b82-kube-api-access-dq6n4\") pod \"cluster-monitoring-operator-64786d9cbb-8265f\" (UID: \"e2878a16-7611-42fd-8bf4-4e30b6da7b82\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8265f" Jul 02 19:54:09.932942 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.932945 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e50ef735-52fb-4047-8c8e-9378a771bbd3-serving-cert\") pod \"console-operator-68b757fb67-6n2jb\" (UID: \"e50ef735-52fb-4047-8c8e-9378a771bbd3\") " pod="openshift-console-operator/console-operator-68b757fb67-6n2jb" Jul 02 19:54:09.933110 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.932966 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6fzl\" (UniqueName: \"kubernetes.io/projected/47815432-32de-40c8-bba7-01fbb22ead7c-kube-api-access-n6fzl\") pod \"cluster-samples-operator-56fcf86bf-fmdh8\" (UID: \"47815432-32de-40c8-bba7-01fbb22ead7c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fmdh8" Jul 02 19:54:09.933110 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.932988 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f0b96d67-4596-4666-897d-00a2e725a3e5-config\") pod \"service-ca-operator-5d46d9ffd4-crtx8\" (UID: \"f0b96d67-4596-4666-897d-00a2e725a3e5\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-crtx8" Jul 02 19:54:09.933110 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.933032 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4d54c\" (UniqueName: \"kubernetes.io/projected/bb9a81bb-c236-45e6-8f38-130eac986587-kube-api-access-4d54c\") pod \"router-default-597bb6b665-89gn9\" (UID: \"bb9a81bb-c236-45e6-8f38-130eac986587\") " pod="openshift-ingress/router-default-597bb6b665-89gn9" Jul 02 19:54:09.933110 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.933064 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e024d650-c674-4717-a482-4bb3ca0a4a60-image-registry-private-configuration\") pod \"image-registry-c794c79b8-mzm4h\" (UID: \"e024d650-c674-4717-a482-4bb3ca0a4a60\") " pod="openshift-image-registry/image-registry-c794c79b8-mzm4h" Jul 02 19:54:09.933110 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.933089 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/bb9a81bb-c236-45e6-8f38-130eac986587-stats-auth\") pod \"router-default-597bb6b665-89gn9\" (UID: \"bb9a81bb-c236-45e6-8f38-130eac986587\") " pod="openshift-ingress/router-default-597bb6b665-89gn9" Jul 02 19:54:09.933110 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.933109 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e50ef735-52fb-4047-8c8e-9378a771bbd3-config\") pod \"console-operator-68b757fb67-6n2jb\" (UID: \"e50ef735-52fb-4047-8c8e-9378a771bbd3\") " pod="openshift-console-operator/console-operator-68b757fb67-6n2jb" Jul 02 19:54:09.933270 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.933143 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e024d650-c674-4717-a482-4bb3ca0a4a60-trusted-ca\") pod \"image-registry-c794c79b8-mzm4h\" (UID: \"e024d650-c674-4717-a482-4bb3ca0a4a60\") " pod="openshift-image-registry/image-registry-c794c79b8-mzm4h" Jul 02 19:54:09.933270 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.933161 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d0d49ed6-ee77-432c-ab59-a83758e51a48-config-volume\") pod \"dns-default-j6rjf\" (UID: \"d0d49ed6-ee77-432c-ab59-a83758e51a48\") " pod="openshift-dns/dns-default-j6rjf" Jul 02 19:54:09.933270 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.933180 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d54gk\" (UniqueName: \"kubernetes.io/projected/37501a0b-36db-40db-bf27-c4cee6bcb6fd-kube-api-access-d54gk\") pod \"volume-data-source-validator-5d456fdbcd-dd6df\" (UID: \"37501a0b-36db-40db-bf27-c4cee6bcb6fd\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-dd6df" Jul 02 19:54:09.933270 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.933212 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e50ef735-52fb-4047-8c8e-9378a771bbd3-trusted-ca\") pod \"console-operator-68b757fb67-6n2jb\" (UID: \"e50ef735-52fb-4047-8c8e-9378a771bbd3\") " pod="openshift-console-operator/console-operator-68b757fb67-6n2jb" Jul 02 19:54:09.933270 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.933235 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6d5bada9-0dfe-4f19-b549-3395492c6f5a-snapshots\") pod \"insights-operator-5c847dcfc4-drhbp\" (UID: \"6d5bada9-0dfe-4f19-b549-3395492c6f5a\") " pod="openshift-insights/insights-operator-5c847dcfc4-drhbp" Jul 02 19:54:09.933270 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.933252 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d5bada9-0dfe-4f19-b549-3395492c6f5a-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-drhbp\" (UID: \"6d5bada9-0dfe-4f19-b549-3395492c6f5a\") " pod="openshift-insights/insights-operator-5c847dcfc4-drhbp" Jul 02 19:54:09.933270 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.933267 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e024d650-c674-4717-a482-4bb3ca0a4a60-ca-trust-extracted\") pod \"image-registry-c794c79b8-mzm4h\" (UID: \"e024d650-c674-4717-a482-4bb3ca0a4a60\") " pod="openshift-image-registry/image-registry-c794c79b8-mzm4h" Jul 02 19:54:09.933539 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.933287 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4cf90fa7-f624-4043-8ecc-b27547b6a98b-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-p9t9k\" (UID: \"4cf90fa7-f624-4043-8ecc-b27547b6a98b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-p9t9k" Jul 02 19:54:09.933539 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.933327 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/195ee027-26f0-4912-84c7-5bce84da9e51-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-88qmn\" (UID: \"195ee027-26f0-4912-84c7-5bce84da9e51\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-88qmn" Jul 02 19:54:09.933539 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.933359 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5c5v\" (UniqueName: \"kubernetes.io/projected/b85e6f64-6fa0-4722-a51d-72e2b1bc200b-kube-api-access-n5c5v\") pod \"ingress-canary-krlc4\" (UID: \"b85e6f64-6fa0-4722-a51d-72e2b1bc200b\") " pod="openshift-ingress-canary/ingress-canary-krlc4" Jul 02 19:54:09.933539 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.933376 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9q5h\" (UniqueName: \"kubernetes.io/projected/d0d49ed6-ee77-432c-ab59-a83758e51a48-kube-api-access-h9q5h\") pod \"dns-default-j6rjf\" (UID: \"d0d49ed6-ee77-432c-ab59-a83758e51a48\") " pod="openshift-dns/dns-default-j6rjf" Jul 02 19:54:09.933539 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.933403 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e024d650-c674-4717-a482-4bb3ca0a4a60-registry-certificates\") pod \"image-registry-c794c79b8-mzm4h\" (UID: \"e024d650-c674-4717-a482-4bb3ca0a4a60\") " pod="openshift-image-registry/image-registry-c794c79b8-mzm4h" Jul 02 19:54:09.933539 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.933423 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwvvl\" (UniqueName: \"kubernetes.io/projected/4cf90fa7-f624-4043-8ecc-b27547b6a98b-kube-api-access-qwvvl\") pod \"kube-storage-version-migrator-operator-846bf668f7-p9t9k\" (UID: \"4cf90fa7-f624-4043-8ecc-b27547b6a98b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-p9t9k" Jul 02 19:54:09.933539 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.933439 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/195ee027-26f0-4912-84c7-5bce84da9e51-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-88qmn\" (UID: \"195ee027-26f0-4912-84c7-5bce84da9e51\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-88qmn" Jul 02 19:54:09.933539 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.933457 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e024d650-c674-4717-a482-4bb3ca0a4a60-installation-pull-secrets\") pod \"image-registry-c794c79b8-mzm4h\" (UID: \"e024d650-c674-4717-a482-4bb3ca0a4a60\") " pod="openshift-image-registry/image-registry-c794c79b8-mzm4h" Jul 02 19:54:09.933539 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.933499 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0d49ed6-ee77-432c-ab59-a83758e51a48-tmp-dir\") pod \"dns-default-j6rjf\" (UID: \"d0d49ed6-ee77-432c-ab59-a83758e51a48\") " pod="openshift-dns/dns-default-j6rjf" Jul 02 19:54:09.933849 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.933578 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e024d650-c674-4717-a482-4bb3ca0a4a60-bound-sa-token\") pod \"image-registry-c794c79b8-mzm4h\" (UID: \"e024d650-c674-4717-a482-4bb3ca0a4a60\") " pod="openshift-image-registry/image-registry-c794c79b8-mzm4h" Jul 02 19:54:09.933849 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.933611 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d5bada9-0dfe-4f19-b549-3395492c6f5a-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-drhbp\" (UID: \"6d5bada9-0dfe-4f19-b549-3395492c6f5a\") " pod="openshift-insights/insights-operator-5c847dcfc4-drhbp" Jul 02 19:54:09.933849 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.933628 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e024d650-c674-4717-a482-4bb3ca0a4a60-registry-tls\") pod \"image-registry-c794c79b8-mzm4h\" (UID: \"e024d650-c674-4717-a482-4bb3ca0a4a60\") " pod="openshift-image-registry/image-registry-c794c79b8-mzm4h" Jul 02 19:54:09.933849 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.933649 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2v85t\" (UniqueName: \"kubernetes.io/projected/b23eefd1-80d4-4b0a-9592-6195746cd52a-kube-api-access-2v85t\") pod \"network-check-source-989f8b8dc-cxzsr\" (UID: \"b23eefd1-80d4-4b0a-9592-6195746cd52a\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-cxzsr" Jul 02 19:54:09.933849 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.933693 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9sjl\" (UniqueName: \"kubernetes.io/projected/f0b96d67-4596-4666-897d-00a2e725a3e5-kube-api-access-n9sjl\") pod \"service-ca-operator-5d46d9ffd4-crtx8\" (UID: \"f0b96d67-4596-4666-897d-00a2e725a3e5\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-crtx8" Jul 02 19:54:09.933849 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.933735 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e2878a16-7611-42fd-8bf4-4e30b6da7b82-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-8265f\" (UID: \"e2878a16-7611-42fd-8bf4-4e30b6da7b82\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8265f" Jul 02 19:54:09.933849 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.933751 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6d5bada9-0dfe-4f19-b549-3395492c6f5a-serving-cert\") pod \"insights-operator-5c847dcfc4-drhbp\" (UID: \"6d5bada9-0dfe-4f19-b549-3395492c6f5a\") " pod="openshift-insights/insights-operator-5c847dcfc4-drhbp" Jul 02 19:54:09.933849 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.933766 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/47815432-32de-40c8-bba7-01fbb22ead7c-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-fmdh8\" (UID: \"47815432-32de-40c8-bba7-01fbb22ead7c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fmdh8" Jul 02 19:54:09.933849 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.933785 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb9a81bb-c236-45e6-8f38-130eac986587-service-ca-bundle\") pod \"router-default-597bb6b665-89gn9\" (UID: \"bb9a81bb-c236-45e6-8f38-130eac986587\") " pod="openshift-ingress/router-default-597bb6b665-89gn9" Jul 02 19:54:09.933849 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.933811 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4cf90fa7-f624-4043-8ecc-b27547b6a98b-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-p9t9k\" (UID: \"4cf90fa7-f624-4043-8ecc-b27547b6a98b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-p9t9k" Jul 02 19:54:09.933849 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.933836 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d0d49ed6-ee77-432c-ab59-a83758e51a48-metrics-tls\") pod \"dns-default-j6rjf\" (UID: \"d0d49ed6-ee77-432c-ab59-a83758e51a48\") " pod="openshift-dns/dns-default-j6rjf" Jul 02 19:54:09.933849 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.933853 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/bb9a81bb-c236-45e6-8f38-130eac986587-default-certificate\") pod \"router-default-597bb6b665-89gn9\" (UID: \"bb9a81bb-c236-45e6-8f38-130eac986587\") " pod="openshift-ingress/router-default-597bb6b665-89gn9" Jul 02 19:54:09.934189 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.933867 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f0b96d67-4596-4666-897d-00a2e725a3e5-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-crtx8\" (UID: \"f0b96d67-4596-4666-897d-00a2e725a3e5\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-crtx8" Jul 02 19:54:09.934189 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.933892 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8t7t\" (UniqueName: \"kubernetes.io/projected/6d5bada9-0dfe-4f19-b549-3395492c6f5a-kube-api-access-c8t7t\") pod \"insights-operator-5c847dcfc4-drhbp\" (UID: \"6d5bada9-0dfe-4f19-b549-3395492c6f5a\") " pod="openshift-insights/insights-operator-5c847dcfc4-drhbp" Jul 02 19:54:09.934189 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.933910 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4ptl\" (UniqueName: \"kubernetes.io/projected/e024d650-c674-4717-a482-4bb3ca0a4a60-kube-api-access-m4ptl\") pod \"image-registry-c794c79b8-mzm4h\" (UID: \"e024d650-c674-4717-a482-4bb3ca0a4a60\") " pod="openshift-image-registry/image-registry-c794c79b8-mzm4h" Jul 02 19:54:09.934189 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.933923 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b85e6f64-6fa0-4722-a51d-72e2b1bc200b-cert\") pod \"ingress-canary-krlc4\" (UID: \"b85e6f64-6fa0-4722-a51d-72e2b1bc200b\") " pod="openshift-ingress-canary/ingress-canary-krlc4" Jul 02 19:54:09.934189 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.933939 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e2878a16-7611-42fd-8bf4-4e30b6da7b82-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-8265f\" (UID: \"e2878a16-7611-42fd-8bf4-4e30b6da7b82\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8265f" Jul 02 19:54:09.934189 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.933953 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6d5bada9-0dfe-4f19-b549-3395492c6f5a-tmp\") pod \"insights-operator-5c847dcfc4-drhbp\" (UID: \"6d5bada9-0dfe-4f19-b549-3395492c6f5a\") " pod="openshift-insights/insights-operator-5c847dcfc4-drhbp" Jul 02 19:54:09.934189 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.933980 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6flk\" (UniqueName: \"kubernetes.io/projected/e50ef735-52fb-4047-8c8e-9378a771bbd3-kube-api-access-g6flk\") pod \"console-operator-68b757fb67-6n2jb\" (UID: \"e50ef735-52fb-4047-8c8e-9378a771bbd3\") " pod="openshift-console-operator/console-operator-68b757fb67-6n2jb" Jul 02 19:54:09.934189 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:09.934001 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb9a81bb-c236-45e6-8f38-130eac986587-metrics-certs\") pod \"router-default-597bb6b665-89gn9\" (UID: \"bb9a81bb-c236-45e6-8f38-130eac986587\") " pod="openshift-ingress/router-default-597bb6b665-89gn9" Jul 02 19:54:10.035215 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.035180 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d5bada9-0dfe-4f19-b549-3395492c6f5a-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-drhbp\" (UID: \"6d5bada9-0dfe-4f19-b549-3395492c6f5a\") " pod="openshift-insights/insights-operator-5c847dcfc4-drhbp" Jul 02 19:54:10.035215 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.035220 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e024d650-c674-4717-a482-4bb3ca0a4a60-ca-trust-extracted\") pod \"image-registry-c794c79b8-mzm4h\" (UID: \"e024d650-c674-4717-a482-4bb3ca0a4a60\") " pod="openshift-image-registry/image-registry-c794c79b8-mzm4h" Jul 02 19:54:10.035414 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.035237 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4cf90fa7-f624-4043-8ecc-b27547b6a98b-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-p9t9k\" (UID: \"4cf90fa7-f624-4043-8ecc-b27547b6a98b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-p9t9k" Jul 02 19:54:10.035549 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.035529 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/195ee027-26f0-4912-84c7-5bce84da9e51-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-88qmn\" (UID: \"195ee027-26f0-4912-84c7-5bce84da9e51\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-88qmn" Jul 02 19:54:10.035603 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.035566 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5c5v\" (UniqueName: \"kubernetes.io/projected/b85e6f64-6fa0-4722-a51d-72e2b1bc200b-kube-api-access-n5c5v\") pod \"ingress-canary-krlc4\" (UID: \"b85e6f64-6fa0-4722-a51d-72e2b1bc200b\") " pod="openshift-ingress-canary/ingress-canary-krlc4" Jul 02 19:54:10.035603 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.035592 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9q5h\" (UniqueName: \"kubernetes.io/projected/d0d49ed6-ee77-432c-ab59-a83758e51a48-kube-api-access-h9q5h\") pod \"dns-default-j6rjf\" (UID: \"d0d49ed6-ee77-432c-ab59-a83758e51a48\") " pod="openshift-dns/dns-default-j6rjf" Jul 02 19:54:10.035712 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.035618 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e024d650-c674-4717-a482-4bb3ca0a4a60-registry-certificates\") pod \"image-registry-c794c79b8-mzm4h\" (UID: \"e024d650-c674-4717-a482-4bb3ca0a4a60\") " pod="openshift-image-registry/image-registry-c794c79b8-mzm4h" Jul 02 19:54:10.035712 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.035652 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwvvl\" (UniqueName: \"kubernetes.io/projected/4cf90fa7-f624-4043-8ecc-b27547b6a98b-kube-api-access-qwvvl\") pod \"kube-storage-version-migrator-operator-846bf668f7-p9t9k\" (UID: \"4cf90fa7-f624-4043-8ecc-b27547b6a98b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-p9t9k" Jul 02 19:54:10.035712 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:10.035668 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 19:54:10.035712 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.035680 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/195ee027-26f0-4912-84c7-5bce84da9e51-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-88qmn\" (UID: \"195ee027-26f0-4912-84c7-5bce84da9e51\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-88qmn" Jul 02 19:54:10.035712 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.035708 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e024d650-c674-4717-a482-4bb3ca0a4a60-installation-pull-secrets\") pod \"image-registry-c794c79b8-mzm4h\" (UID: \"e024d650-c674-4717-a482-4bb3ca0a4a60\") " pod="openshift-image-registry/image-registry-c794c79b8-mzm4h" Jul 02 19:54:10.035910 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:10.035741 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/195ee027-26f0-4912-84c7-5bce84da9e51-networking-console-plugin-cert podName:195ee027-26f0-4912-84c7-5bce84da9e51 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:10.535722119 +0000 UTC m=+35.601779972 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/195ee027-26f0-4912-84c7-5bce84da9e51-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-88qmn" (UID: "195ee027-26f0-4912-84c7-5bce84da9e51") : secret "networking-console-plugin-cert" not found Jul 02 19:54:10.035910 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.035760 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0d49ed6-ee77-432c-ab59-a83758e51a48-tmp-dir\") pod \"dns-default-j6rjf\" (UID: \"d0d49ed6-ee77-432c-ab59-a83758e51a48\") " pod="openshift-dns/dns-default-j6rjf" Jul 02 19:54:10.035910 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.035795 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e024d650-c674-4717-a482-4bb3ca0a4a60-bound-sa-token\") pod \"image-registry-c794c79b8-mzm4h\" (UID: \"e024d650-c674-4717-a482-4bb3ca0a4a60\") " pod="openshift-image-registry/image-registry-c794c79b8-mzm4h" Jul 02 19:54:10.035910 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.035842 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d5bada9-0dfe-4f19-b549-3395492c6f5a-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-drhbp\" (UID: \"6d5bada9-0dfe-4f19-b549-3395492c6f5a\") " pod="openshift-insights/insights-operator-5c847dcfc4-drhbp" Jul 02 19:54:10.035910 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.035870 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e024d650-c674-4717-a482-4bb3ca0a4a60-registry-tls\") pod \"image-registry-c794c79b8-mzm4h\" (UID: \"e024d650-c674-4717-a482-4bb3ca0a4a60\") " pod="openshift-image-registry/image-registry-c794c79b8-mzm4h" Jul 02 19:54:10.036143 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:10.035959 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 19:54:10.036143 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:10.035972 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c794c79b8-mzm4h: secret "image-registry-tls" not found Jul 02 19:54:10.036143 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:10.036009 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e024d650-c674-4717-a482-4bb3ca0a4a60-registry-tls podName:e024d650-c674-4717-a482-4bb3ca0a4a60 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:10.535996705 +0000 UTC m=+35.602054557 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e024d650-c674-4717-a482-4bb3ca0a4a60-registry-tls") pod "image-registry-c794c79b8-mzm4h" (UID: "e024d650-c674-4717-a482-4bb3ca0a4a60") : secret "image-registry-tls" not found Jul 02 19:54:10.036143 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.036131 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0d49ed6-ee77-432c-ab59-a83758e51a48-tmp-dir\") pod \"dns-default-j6rjf\" (UID: \"d0d49ed6-ee77-432c-ab59-a83758e51a48\") " pod="openshift-dns/dns-default-j6rjf" Jul 02 19:54:10.036331 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.036181 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2v85t\" (UniqueName: \"kubernetes.io/projected/b23eefd1-80d4-4b0a-9592-6195746cd52a-kube-api-access-2v85t\") pod \"network-check-source-989f8b8dc-cxzsr\" (UID: \"b23eefd1-80d4-4b0a-9592-6195746cd52a\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-cxzsr" Jul 02 19:54:10.036331 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.036217 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9sjl\" (UniqueName: \"kubernetes.io/projected/f0b96d67-4596-4666-897d-00a2e725a3e5-kube-api-access-n9sjl\") pod \"service-ca-operator-5d46d9ffd4-crtx8\" (UID: \"f0b96d67-4596-4666-897d-00a2e725a3e5\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-crtx8" Jul 02 19:54:10.036331 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.036256 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e2878a16-7611-42fd-8bf4-4e30b6da7b82-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-8265f\" (UID: \"e2878a16-7611-42fd-8bf4-4e30b6da7b82\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8265f" Jul 02 19:54:10.036331 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.036284 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6d5bada9-0dfe-4f19-b549-3395492c6f5a-serving-cert\") pod \"insights-operator-5c847dcfc4-drhbp\" (UID: \"6d5bada9-0dfe-4f19-b549-3395492c6f5a\") " pod="openshift-insights/insights-operator-5c847dcfc4-drhbp" Jul 02 19:54:10.036331 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.036291 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d5bada9-0dfe-4f19-b549-3395492c6f5a-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-drhbp\" (UID: \"6d5bada9-0dfe-4f19-b549-3395492c6f5a\") " pod="openshift-insights/insights-operator-5c847dcfc4-drhbp" Jul 02 19:54:10.036331 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.036309 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/47815432-32de-40c8-bba7-01fbb22ead7c-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-fmdh8\" (UID: \"47815432-32de-40c8-bba7-01fbb22ead7c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fmdh8" Jul 02 19:54:10.036630 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.036362 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb9a81bb-c236-45e6-8f38-130eac986587-service-ca-bundle\") pod \"router-default-597bb6b665-89gn9\" (UID: \"bb9a81bb-c236-45e6-8f38-130eac986587\") " pod="openshift-ingress/router-default-597bb6b665-89gn9" Jul 02 19:54:10.036630 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.036383 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4cf90fa7-f624-4043-8ecc-b27547b6a98b-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-p9t9k\" (UID: \"4cf90fa7-f624-4043-8ecc-b27547b6a98b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-p9t9k" Jul 02 19:54:10.036630 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.036402 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d0d49ed6-ee77-432c-ab59-a83758e51a48-metrics-tls\") pod \"dns-default-j6rjf\" (UID: \"d0d49ed6-ee77-432c-ab59-a83758e51a48\") " pod="openshift-dns/dns-default-j6rjf" Jul 02 19:54:10.036630 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.036424 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/bb9a81bb-c236-45e6-8f38-130eac986587-default-certificate\") pod \"router-default-597bb6b665-89gn9\" (UID: \"bb9a81bb-c236-45e6-8f38-130eac986587\") " pod="openshift-ingress/router-default-597bb6b665-89gn9" Jul 02 19:54:10.036630 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.036444 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f0b96d67-4596-4666-897d-00a2e725a3e5-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-crtx8\" (UID: \"f0b96d67-4596-4666-897d-00a2e725a3e5\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-crtx8" Jul 02 19:54:10.036630 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.036472 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8t7t\" (UniqueName: \"kubernetes.io/projected/6d5bada9-0dfe-4f19-b549-3395492c6f5a-kube-api-access-c8t7t\") pod \"insights-operator-5c847dcfc4-drhbp\" (UID: \"6d5bada9-0dfe-4f19-b549-3395492c6f5a\") " pod="openshift-insights/insights-operator-5c847dcfc4-drhbp" Jul 02 19:54:10.036630 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.036496 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4ptl\" (UniqueName: \"kubernetes.io/projected/e024d650-c674-4717-a482-4bb3ca0a4a60-kube-api-access-m4ptl\") pod \"image-registry-c794c79b8-mzm4h\" (UID: \"e024d650-c674-4717-a482-4bb3ca0a4a60\") " pod="openshift-image-registry/image-registry-c794c79b8-mzm4h" Jul 02 19:54:10.036630 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.036516 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b85e6f64-6fa0-4722-a51d-72e2b1bc200b-cert\") pod \"ingress-canary-krlc4\" (UID: \"b85e6f64-6fa0-4722-a51d-72e2b1bc200b\") " pod="openshift-ingress-canary/ingress-canary-krlc4" Jul 02 19:54:10.036630 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.036538 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e2878a16-7611-42fd-8bf4-4e30b6da7b82-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-8265f\" (UID: \"e2878a16-7611-42fd-8bf4-4e30b6da7b82\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8265f" Jul 02 19:54:10.036630 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.036560 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6d5bada9-0dfe-4f19-b549-3395492c6f5a-tmp\") pod \"insights-operator-5c847dcfc4-drhbp\" (UID: \"6d5bada9-0dfe-4f19-b549-3395492c6f5a\") " pod="openshift-insights/insights-operator-5c847dcfc4-drhbp" Jul 02 19:54:10.036630 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.036582 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6flk\" (UniqueName: \"kubernetes.io/projected/e50ef735-52fb-4047-8c8e-9378a771bbd3-kube-api-access-g6flk\") pod \"console-operator-68b757fb67-6n2jb\" (UID: \"e50ef735-52fb-4047-8c8e-9378a771bbd3\") " pod="openshift-console-operator/console-operator-68b757fb67-6n2jb" Jul 02 19:54:10.037132 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.036602 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb9a81bb-c236-45e6-8f38-130eac986587-metrics-certs\") pod \"router-default-597bb6b665-89gn9\" (UID: \"bb9a81bb-c236-45e6-8f38-130eac986587\") " pod="openshift-ingress/router-default-597bb6b665-89gn9" Jul 02 19:54:10.037132 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.036777 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq6n4\" (UniqueName: \"kubernetes.io/projected/e2878a16-7611-42fd-8bf4-4e30b6da7b82-kube-api-access-dq6n4\") pod \"cluster-monitoring-operator-64786d9cbb-8265f\" (UID: \"e2878a16-7611-42fd-8bf4-4e30b6da7b82\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8265f" Jul 02 19:54:10.037132 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.036800 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e50ef735-52fb-4047-8c8e-9378a771bbd3-serving-cert\") pod \"console-operator-68b757fb67-6n2jb\" (UID: \"e50ef735-52fb-4047-8c8e-9378a771bbd3\") " pod="openshift-console-operator/console-operator-68b757fb67-6n2jb" Jul 02 19:54:10.037132 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:10.036811 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 19:54:10.037132 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.036825 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6fzl\" (UniqueName: \"kubernetes.io/projected/47815432-32de-40c8-bba7-01fbb22ead7c-kube-api-access-n6fzl\") pod \"cluster-samples-operator-56fcf86bf-fmdh8\" (UID: \"47815432-32de-40c8-bba7-01fbb22ead7c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fmdh8" Jul 02 19:54:10.037132 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.036846 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f0b96d67-4596-4666-897d-00a2e725a3e5-config\") pod \"service-ca-operator-5d46d9ffd4-crtx8\" (UID: \"f0b96d67-4596-4666-897d-00a2e725a3e5\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-crtx8" Jul 02 19:54:10.037132 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:10.036872 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47815432-32de-40c8-bba7-01fbb22ead7c-samples-operator-tls podName:47815432-32de-40c8-bba7-01fbb22ead7c nodeName:}" failed. No retries permitted until 2026-07-02 19:54:10.536856536 +0000 UTC m=+35.602914398 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/47815432-32de-40c8-bba7-01fbb22ead7c-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-fmdh8" (UID: "47815432-32de-40c8-bba7-01fbb22ead7c") : secret "samples-operator-tls" not found Jul 02 19:54:10.037132 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.036919 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4d54c\" (UniqueName: \"kubernetes.io/projected/bb9a81bb-c236-45e6-8f38-130eac986587-kube-api-access-4d54c\") pod \"router-default-597bb6b665-89gn9\" (UID: \"bb9a81bb-c236-45e6-8f38-130eac986587\") " pod="openshift-ingress/router-default-597bb6b665-89gn9" Jul 02 19:54:10.037132 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.036919 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/195ee027-26f0-4912-84c7-5bce84da9e51-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-88qmn\" (UID: \"195ee027-26f0-4912-84c7-5bce84da9e51\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-88qmn" Jul 02 19:54:10.037581 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.037310 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f0b96d67-4596-4666-897d-00a2e725a3e5-config\") pod \"service-ca-operator-5d46d9ffd4-crtx8\" (UID: \"f0b96d67-4596-4666-897d-00a2e725a3e5\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-crtx8" Jul 02 19:54:10.037581 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:10.037409 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 19:54:10.037581 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:10.037448 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2878a16-7611-42fd-8bf4-4e30b6da7b82-cluster-monitoring-operator-tls podName:e2878a16-7611-42fd-8bf4-4e30b6da7b82 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:10.537436203 +0000 UTC m=+35.603494043 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e2878a16-7611-42fd-8bf4-4e30b6da7b82-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-8265f" (UID: "e2878a16-7611-42fd-8bf4-4e30b6da7b82") : secret "cluster-monitoring-operator-tls" not found Jul 02 19:54:10.037730 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:10.037600 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bb9a81bb-c236-45e6-8f38-130eac986587-service-ca-bundle podName:bb9a81bb-c236-45e6-8f38-130eac986587 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:10.537585521 +0000 UTC m=+35.603643380 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bb9a81bb-c236-45e6-8f38-130eac986587-service-ca-bundle") pod "router-default-597bb6b665-89gn9" (UID: "bb9a81bb-c236-45e6-8f38-130eac986587") : configmap references non-existent config key: service-ca.crt Jul 02 19:54:10.037730 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.037690 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e2878a16-7611-42fd-8bf4-4e30b6da7b82-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-8265f\" (UID: \"e2878a16-7611-42fd-8bf4-4e30b6da7b82\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8265f" Jul 02 19:54:10.037834 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.037741 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e024d650-c674-4717-a482-4bb3ca0a4a60-image-registry-private-configuration\") pod \"image-registry-c794c79b8-mzm4h\" (UID: \"e024d650-c674-4717-a482-4bb3ca0a4a60\") " pod="openshift-image-registry/image-registry-c794c79b8-mzm4h" Jul 02 19:54:10.037834 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.037762 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6d5bada9-0dfe-4f19-b549-3395492c6f5a-tmp\") pod \"insights-operator-5c847dcfc4-drhbp\" (UID: \"6d5bada9-0dfe-4f19-b549-3395492c6f5a\") " pod="openshift-insights/insights-operator-5c847dcfc4-drhbp" Jul 02 19:54:10.037834 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.037777 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/bb9a81bb-c236-45e6-8f38-130eac986587-stats-auth\") pod \"router-default-597bb6b665-89gn9\" (UID: \"bb9a81bb-c236-45e6-8f38-130eac986587\") " pod="openshift-ingress/router-default-597bb6b665-89gn9" Jul 02 19:54:10.037834 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.037813 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e50ef735-52fb-4047-8c8e-9378a771bbd3-config\") pod \"console-operator-68b757fb67-6n2jb\" (UID: \"e50ef735-52fb-4047-8c8e-9378a771bbd3\") " pod="openshift-console-operator/console-operator-68b757fb67-6n2jb" Jul 02 19:54:10.038011 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.037877 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e024d650-c674-4717-a482-4bb3ca0a4a60-trusted-ca\") pod \"image-registry-c794c79b8-mzm4h\" (UID: \"e024d650-c674-4717-a482-4bb3ca0a4a60\") " pod="openshift-image-registry/image-registry-c794c79b8-mzm4h" Jul 02 19:54:10.038011 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.037906 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d0d49ed6-ee77-432c-ab59-a83758e51a48-config-volume\") pod \"dns-default-j6rjf\" (UID: \"d0d49ed6-ee77-432c-ab59-a83758e51a48\") " pod="openshift-dns/dns-default-j6rjf" Jul 02 19:54:10.038011 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.037937 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d54gk\" (UniqueName: \"kubernetes.io/projected/37501a0b-36db-40db-bf27-c4cee6bcb6fd-kube-api-access-d54gk\") pod \"volume-data-source-validator-5d456fdbcd-dd6df\" (UID: \"37501a0b-36db-40db-bf27-c4cee6bcb6fd\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-dd6df" Jul 02 19:54:10.038011 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.037963 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e50ef735-52fb-4047-8c8e-9378a771bbd3-trusted-ca\") pod \"console-operator-68b757fb67-6n2jb\" (UID: \"e50ef735-52fb-4047-8c8e-9378a771bbd3\") " pod="openshift-console-operator/console-operator-68b757fb67-6n2jb" Jul 02 19:54:10.038011 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.037989 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6d5bada9-0dfe-4f19-b549-3395492c6f5a-snapshots\") pod \"insights-operator-5c847dcfc4-drhbp\" (UID: \"6d5bada9-0dfe-4f19-b549-3395492c6f5a\") " pod="openshift-insights/insights-operator-5c847dcfc4-drhbp" Jul 02 19:54:10.038268 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:10.038082 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 19:54:10.038268 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.038092 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4cf90fa7-f624-4043-8ecc-b27547b6a98b-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-p9t9k\" (UID: \"4cf90fa7-f624-4043-8ecc-b27547b6a98b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-p9t9k" Jul 02 19:54:10.038268 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:10.038124 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb9a81bb-c236-45e6-8f38-130eac986587-metrics-certs podName:bb9a81bb-c236-45e6-8f38-130eac986587 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:10.538110656 +0000 UTC m=+35.604168497 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb9a81bb-c236-45e6-8f38-130eac986587-metrics-certs") pod "router-default-597bb6b665-89gn9" (UID: "bb9a81bb-c236-45e6-8f38-130eac986587") : secret "router-metrics-certs-default" not found Jul 02 19:54:10.038268 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.036674 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d5bada9-0dfe-4f19-b549-3395492c6f5a-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-drhbp\" (UID: \"6d5bada9-0dfe-4f19-b549-3395492c6f5a\") " pod="openshift-insights/insights-operator-5c847dcfc4-drhbp" Jul 02 19:54:10.038268 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:10.038170 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 19:54:10.038268 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:10.038204 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0d49ed6-ee77-432c-ab59-a83758e51a48-metrics-tls podName:d0d49ed6-ee77-432c-ab59-a83758e51a48 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:10.538193469 +0000 UTC m=+35.604251311 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d0d49ed6-ee77-432c-ab59-a83758e51a48-metrics-tls") pod "dns-default-j6rjf" (UID: "d0d49ed6-ee77-432c-ab59-a83758e51a48") : secret "dns-default-metrics-tls" not found Jul 02 19:54:10.038560 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.038479 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6d5bada9-0dfe-4f19-b549-3395492c6f5a-snapshots\") pod \"insights-operator-5c847dcfc4-drhbp\" (UID: \"6d5bada9-0dfe-4f19-b549-3395492c6f5a\") " pod="openshift-insights/insights-operator-5c847dcfc4-drhbp" Jul 02 19:54:10.038560 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.036681 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e024d650-c674-4717-a482-4bb3ca0a4a60-registry-certificates\") pod \"image-registry-c794c79b8-mzm4h\" (UID: \"e024d650-c674-4717-a482-4bb3ca0a4a60\") " pod="openshift-image-registry/image-registry-c794c79b8-mzm4h" Jul 02 19:54:10.038868 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.038709 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e024d650-c674-4717-a482-4bb3ca0a4a60-ca-trust-extracted\") pod \"image-registry-c794c79b8-mzm4h\" (UID: \"e024d650-c674-4717-a482-4bb3ca0a4a60\") " pod="openshift-image-registry/image-registry-c794c79b8-mzm4h" Jul 02 19:54:10.040615 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.040058 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d0d49ed6-ee77-432c-ab59-a83758e51a48-config-volume\") pod \"dns-default-j6rjf\" (UID: \"d0d49ed6-ee77-432c-ab59-a83758e51a48\") " pod="openshift-dns/dns-default-j6rjf" Jul 02 19:54:10.040615 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.040368 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e024d650-c674-4717-a482-4bb3ca0a4a60-trusted-ca\") pod \"image-registry-c794c79b8-mzm4h\" (UID: \"e024d650-c674-4717-a482-4bb3ca0a4a60\") " pod="openshift-image-registry/image-registry-c794c79b8-mzm4h" Jul 02 19:54:10.041187 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.041158 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e50ef735-52fb-4047-8c8e-9378a771bbd3-config\") pod \"console-operator-68b757fb67-6n2jb\" (UID: \"e50ef735-52fb-4047-8c8e-9378a771bbd3\") " pod="openshift-console-operator/console-operator-68b757fb67-6n2jb" Jul 02 19:54:10.041285 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.041194 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/bb9a81bb-c236-45e6-8f38-130eac986587-default-certificate\") pod \"router-default-597bb6b665-89gn9\" (UID: \"bb9a81bb-c236-45e6-8f38-130eac986587\") " pod="openshift-ingress/router-default-597bb6b665-89gn9" Jul 02 19:54:10.041365 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.041316 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/bb9a81bb-c236-45e6-8f38-130eac986587-stats-auth\") pod \"router-default-597bb6b665-89gn9\" (UID: \"bb9a81bb-c236-45e6-8f38-130eac986587\") " pod="openshift-ingress/router-default-597bb6b665-89gn9" Jul 02 19:54:10.041501 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.041481 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e50ef735-52fb-4047-8c8e-9378a771bbd3-trusted-ca\") pod \"console-operator-68b757fb67-6n2jb\" (UID: \"e50ef735-52fb-4047-8c8e-9378a771bbd3\") " pod="openshift-console-operator/console-operator-68b757fb67-6n2jb" Jul 02 19:54:10.041591 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.041510 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6d5bada9-0dfe-4f19-b549-3395492c6f5a-serving-cert\") pod \"insights-operator-5c847dcfc4-drhbp\" (UID: \"6d5bada9-0dfe-4f19-b549-3395492c6f5a\") " pod="openshift-insights/insights-operator-5c847dcfc4-drhbp" Jul 02 19:54:10.041591 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.041573 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e024d650-c674-4717-a482-4bb3ca0a4a60-installation-pull-secrets\") pod \"image-registry-c794c79b8-mzm4h\" (UID: \"e024d650-c674-4717-a482-4bb3ca0a4a60\") " pod="openshift-image-registry/image-registry-c794c79b8-mzm4h" Jul 02 19:54:10.041685 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.041671 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b85e6f64-6fa0-4722-a51d-72e2b1bc200b-cert\") pod \"ingress-canary-krlc4\" (UID: \"b85e6f64-6fa0-4722-a51d-72e2b1bc200b\") " pod="openshift-ingress-canary/ingress-canary-krlc4" Jul 02 19:54:10.041769 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.041747 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f0b96d67-4596-4666-897d-00a2e725a3e5-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-crtx8\" (UID: \"f0b96d67-4596-4666-897d-00a2e725a3e5\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-crtx8" Jul 02 19:54:10.042819 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.042745 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e50ef735-52fb-4047-8c8e-9378a771bbd3-serving-cert\") pod \"console-operator-68b757fb67-6n2jb\" (UID: \"e50ef735-52fb-4047-8c8e-9378a771bbd3\") " pod="openshift-console-operator/console-operator-68b757fb67-6n2jb" Jul 02 19:54:10.042996 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.042973 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e024d650-c674-4717-a482-4bb3ca0a4a60-image-registry-private-configuration\") pod \"image-registry-c794c79b8-mzm4h\" (UID: \"e024d650-c674-4717-a482-4bb3ca0a4a60\") " pod="openshift-image-registry/image-registry-c794c79b8-mzm4h" Jul 02 19:54:10.043070 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.043002 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4cf90fa7-f624-4043-8ecc-b27547b6a98b-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-p9t9k\" (UID: \"4cf90fa7-f624-4043-8ecc-b27547b6a98b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-p9t9k" Jul 02 19:54:10.048276 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.044910 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9q5h\" (UniqueName: \"kubernetes.io/projected/d0d49ed6-ee77-432c-ab59-a83758e51a48-kube-api-access-h9q5h\") pod \"dns-default-j6rjf\" (UID: \"d0d49ed6-ee77-432c-ab59-a83758e51a48\") " pod="openshift-dns/dns-default-j6rjf" Jul 02 19:54:10.048276 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.045057 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e024d650-c674-4717-a482-4bb3ca0a4a60-bound-sa-token\") pod \"image-registry-c794c79b8-mzm4h\" (UID: \"e024d650-c674-4717-a482-4bb3ca0a4a60\") " pod="openshift-image-registry/image-registry-c794c79b8-mzm4h" Jul 02 19:54:10.049023 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.048998 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwvvl\" (UniqueName: \"kubernetes.io/projected/4cf90fa7-f624-4043-8ecc-b27547b6a98b-kube-api-access-qwvvl\") pod \"kube-storage-version-migrator-operator-846bf668f7-p9t9k\" (UID: \"4cf90fa7-f624-4043-8ecc-b27547b6a98b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-p9t9k" Jul 02 19:54:10.049103 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.049001 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9sjl\" (UniqueName: \"kubernetes.io/projected/f0b96d67-4596-4666-897d-00a2e725a3e5-kube-api-access-n9sjl\") pod \"service-ca-operator-5d46d9ffd4-crtx8\" (UID: \"f0b96d67-4596-4666-897d-00a2e725a3e5\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-crtx8" Jul 02 19:54:10.049176 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.049154 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5c5v\" (UniqueName: \"kubernetes.io/projected/b85e6f64-6fa0-4722-a51d-72e2b1bc200b-kube-api-access-n5c5v\") pod \"ingress-canary-krlc4\" (UID: \"b85e6f64-6fa0-4722-a51d-72e2b1bc200b\") " pod="openshift-ingress-canary/ingress-canary-krlc4" Jul 02 19:54:10.051741 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.051719 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8t7t\" (UniqueName: \"kubernetes.io/projected/6d5bada9-0dfe-4f19-b549-3395492c6f5a-kube-api-access-c8t7t\") pod \"insights-operator-5c847dcfc4-drhbp\" (UID: \"6d5bada9-0dfe-4f19-b549-3395492c6f5a\") " pod="openshift-insights/insights-operator-5c847dcfc4-drhbp" Jul 02 19:54:10.052293 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.052201 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6fzl\" (UniqueName: \"kubernetes.io/projected/47815432-32de-40c8-bba7-01fbb22ead7c-kube-api-access-n6fzl\") pod \"cluster-samples-operator-56fcf86bf-fmdh8\" (UID: \"47815432-32de-40c8-bba7-01fbb22ead7c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fmdh8" Jul 02 19:54:10.052293 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.052283 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4d54c\" (UniqueName: \"kubernetes.io/projected/bb9a81bb-c236-45e6-8f38-130eac986587-kube-api-access-4d54c\") pod \"router-default-597bb6b665-89gn9\" (UID: \"bb9a81bb-c236-45e6-8f38-130eac986587\") " pod="openshift-ingress/router-default-597bb6b665-89gn9" Jul 02 19:54:10.052667 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.052389 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2v85t\" (UniqueName: \"kubernetes.io/projected/b23eefd1-80d4-4b0a-9592-6195746cd52a-kube-api-access-2v85t\") pod \"network-check-source-989f8b8dc-cxzsr\" (UID: \"b23eefd1-80d4-4b0a-9592-6195746cd52a\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-cxzsr" Jul 02 19:54:10.052667 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.052536 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6flk\" (UniqueName: \"kubernetes.io/projected/e50ef735-52fb-4047-8c8e-9378a771bbd3-kube-api-access-g6flk\") pod \"console-operator-68b757fb67-6n2jb\" (UID: \"e50ef735-52fb-4047-8c8e-9378a771bbd3\") " pod="openshift-console-operator/console-operator-68b757fb67-6n2jb" Jul 02 19:54:10.052864 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.052841 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dq6n4\" (UniqueName: \"kubernetes.io/projected/e2878a16-7611-42fd-8bf4-4e30b6da7b82-kube-api-access-dq6n4\") pod \"cluster-monitoring-operator-64786d9cbb-8265f\" (UID: \"e2878a16-7611-42fd-8bf4-4e30b6da7b82\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8265f" Jul 02 19:54:10.052960 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.052899 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4ptl\" (UniqueName: \"kubernetes.io/projected/e024d650-c674-4717-a482-4bb3ca0a4a60-kube-api-access-m4ptl\") pod \"image-registry-c794c79b8-mzm4h\" (UID: \"e024d650-c674-4717-a482-4bb3ca0a4a60\") " pod="openshift-image-registry/image-registry-c794c79b8-mzm4h" Jul 02 19:54:10.053892 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.053874 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d54gk\" (UniqueName: \"kubernetes.io/projected/37501a0b-36db-40db-bf27-c4cee6bcb6fd-kube-api-access-d54gk\") pod \"volume-data-source-validator-5d456fdbcd-dd6df\" (UID: \"37501a0b-36db-40db-bf27-c4cee6bcb6fd\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-dd6df" Jul 02 19:54:10.065572 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.065556 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-dd6df" Jul 02 19:54:10.096217 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.096191 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-drhbp" Jul 02 19:54:10.104177 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.104154 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-crtx8" Jul 02 19:54:10.119332 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.119290 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-6n2jb" Jul 02 19:54:10.144836 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.144612 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-p9t9k" Jul 02 19:54:10.150516 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.150448 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-krlc4" Jul 02 19:54:10.158447 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.158360 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-cxzsr" Jul 02 19:54:10.302435 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.302266 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-dd6df"] Jul 02 19:54:10.310282 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:54:10.308869 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37501a0b_36db_40db_bf27_c4cee6bcb6fd.slice/crio-39d965023f6df55c5d172409a477cb646ed955eebf068ac7bb0f325a0f314925 WatchSource:0}: Error finding container 39d965023f6df55c5d172409a477cb646ed955eebf068ac7bb0f325a0f314925: Status 404 returned error can't find the container with id 39d965023f6df55c5d172409a477cb646ed955eebf068ac7bb0f325a0f314925 Jul 02 19:54:10.314896 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.314820 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-drhbp"] Jul 02 19:54:10.320683 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:54:10.320634 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d5bada9_0dfe_4f19_b549_3395492c6f5a.slice/crio-05368bb6e4e08ef6d1340f033397cc4147f15a44d4b7c59066dc40e2b205df3f WatchSource:0}: Error finding container 05368bb6e4e08ef6d1340f033397cc4147f15a44d4b7c59066dc40e2b205df3f: Status 404 returned error can't find the container with id 05368bb6e4e08ef6d1340f033397cc4147f15a44d4b7c59066dc40e2b205df3f Jul 02 19:54:10.341507 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.341467 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-crtx8"] Jul 02 19:54:10.345279 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:54:10.345249 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0b96d67_4596_4666_897d_00a2e725a3e5.slice/crio-48e6200c1b89dbc57ac9e110154f4dc0cecdc9e394b3e78d850c9da6bac347a3 WatchSource:0}: Error finding container 48e6200c1b89dbc57ac9e110154f4dc0cecdc9e394b3e78d850c9da6bac347a3: Status 404 returned error can't find the container with id 48e6200c1b89dbc57ac9e110154f4dc0cecdc9e394b3e78d850c9da6bac347a3 Jul 02 19:54:10.366253 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.366220 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-6n2jb"] Jul 02 19:54:10.368973 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.368950 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-p9t9k"] Jul 02 19:54:10.369277 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:54:10.369222 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode50ef735_52fb_4047_8c8e_9378a771bbd3.slice/crio-809d4eb0ecf8513d50ca322755f432b6c34899f92f1e94b6375384a2225c1610 WatchSource:0}: Error finding container 809d4eb0ecf8513d50ca322755f432b6c34899f92f1e94b6375384a2225c1610: Status 404 returned error can't find the container with id 809d4eb0ecf8513d50ca322755f432b6c34899f92f1e94b6375384a2225c1610 Jul 02 19:54:10.371121 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:54:10.371102 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cf90fa7_f624_4043_8ecc_b27547b6a98b.slice/crio-1a222496482b416cf98c094f429d282b2bf176379f2cb43318121b2fd9e3ffb5 WatchSource:0}: Error finding container 1a222496482b416cf98c094f429d282b2bf176379f2cb43318121b2fd9e3ffb5: Status 404 returned error can't find the container with id 1a222496482b416cf98c094f429d282b2bf176379f2cb43318121b2fd9e3ffb5 Jul 02 19:54:10.378231 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.378204 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-krlc4"] Jul 02 19:54:10.381875 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:54:10.381851 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb85e6f64_6fa0_4722_a51d_72e2b1bc200b.slice/crio-6166cef6bd245036e2fc8d63b1f953d28f1dc547fa5731003e3816a584c409ec WatchSource:0}: Error finding container 6166cef6bd245036e2fc8d63b1f953d28f1dc547fa5731003e3816a584c409ec: Status 404 returned error can't find the container with id 6166cef6bd245036e2fc8d63b1f953d28f1dc547fa5731003e3816a584c409ec Jul 02 19:54:10.384976 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.384958 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-cxzsr"] Jul 02 19:54:10.387722 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:54:10.387700 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb23eefd1_80d4_4b0a_9592_6195746cd52a.slice/crio-0e2d5e8bafaa51953bfd7f0564e1d78cdcede70a456ceb3b537d13b3037a71b4 WatchSource:0}: Error finding container 0e2d5e8bafaa51953bfd7f0564e1d78cdcede70a456ceb3b537d13b3037a71b4: Status 404 returned error can't find the container with id 0e2d5e8bafaa51953bfd7f0564e1d78cdcede70a456ceb3b537d13b3037a71b4 Jul 02 19:54:10.452529 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.452490 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:10.514511 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.514438 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p88nv" Jul 02 19:54:10.517143 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.517123 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 19:54:10.517816 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.517292 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pdnmq\"" Jul 02 19:54:10.544631 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.544607 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/195ee027-26f0-4912-84c7-5bce84da9e51-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-88qmn\" (UID: \"195ee027-26f0-4912-84c7-5bce84da9e51\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-88qmn" Jul 02 19:54:10.544748 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.544653 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e024d650-c674-4717-a482-4bb3ca0a4a60-registry-tls\") pod \"image-registry-c794c79b8-mzm4h\" (UID: \"e024d650-c674-4717-a482-4bb3ca0a4a60\") " pod="openshift-image-registry/image-registry-c794c79b8-mzm4h" Jul 02 19:54:10.544748 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.544681 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/47815432-32de-40c8-bba7-01fbb22ead7c-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-fmdh8\" (UID: \"47815432-32de-40c8-bba7-01fbb22ead7c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fmdh8" Jul 02 19:54:10.544748 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.544716 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb9a81bb-c236-45e6-8f38-130eac986587-service-ca-bundle\") pod \"router-default-597bb6b665-89gn9\" (UID: \"bb9a81bb-c236-45e6-8f38-130eac986587\") " pod="openshift-ingress/router-default-597bb6b665-89gn9" Jul 02 19:54:10.544748 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.544732 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d0d49ed6-ee77-432c-ab59-a83758e51a48-metrics-tls\") pod \"dns-default-j6rjf\" (UID: \"d0d49ed6-ee77-432c-ab59-a83758e51a48\") " pod="openshift-dns/dns-default-j6rjf" Jul 02 19:54:10.544940 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.544756 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e2878a16-7611-42fd-8bf4-4e30b6da7b82-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-8265f\" (UID: \"e2878a16-7611-42fd-8bf4-4e30b6da7b82\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8265f" Jul 02 19:54:10.544940 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.544773 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb9a81bb-c236-45e6-8f38-130eac986587-metrics-certs\") pod \"router-default-597bb6b665-89gn9\" (UID: \"bb9a81bb-c236-45e6-8f38-130eac986587\") " pod="openshift-ingress/router-default-597bb6b665-89gn9" Jul 02 19:54:10.544940 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:10.544831 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 19:54:10.544940 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:10.544861 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bb9a81bb-c236-45e6-8f38-130eac986587-service-ca-bundle podName:bb9a81bb-c236-45e6-8f38-130eac986587 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:11.544839455 +0000 UTC m=+36.610897300 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bb9a81bb-c236-45e6-8f38-130eac986587-service-ca-bundle") pod "router-default-597bb6b665-89gn9" (UID: "bb9a81bb-c236-45e6-8f38-130eac986587") : configmap references non-existent config key: service-ca.crt Jul 02 19:54:10.544940 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:10.544870 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 19:54:10.544940 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:10.544878 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 19:54:10.544940 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:10.544862 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 19:54:10.544940 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:10.544885 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47815432-32de-40c8-bba7-01fbb22ead7c-samples-operator-tls podName:47815432-32de-40c8-bba7-01fbb22ead7c nodeName:}" failed. No retries permitted until 2026-07-02 19:54:11.544876584 +0000 UTC m=+36.610934423 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/47815432-32de-40c8-bba7-01fbb22ead7c-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-fmdh8" (UID: "47815432-32de-40c8-bba7-01fbb22ead7c") : secret "samples-operator-tls" not found Jul 02 19:54:10.544940 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:10.544864 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 19:54:10.544940 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:10.544938 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/195ee027-26f0-4912-84c7-5bce84da9e51-networking-console-plugin-cert podName:195ee027-26f0-4912-84c7-5bce84da9e51 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:11.544926668 +0000 UTC m=+36.610984514 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/195ee027-26f0-4912-84c7-5bce84da9e51-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-88qmn" (UID: "195ee027-26f0-4912-84c7-5bce84da9e51") : secret "networking-console-plugin-cert" not found Jul 02 19:54:10.545244 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:10.544952 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0d49ed6-ee77-432c-ab59-a83758e51a48-metrics-tls podName:d0d49ed6-ee77-432c-ab59-a83758e51a48 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:11.544946116 +0000 UTC m=+36.611003955 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d0d49ed6-ee77-432c-ab59-a83758e51a48-metrics-tls") pod "dns-default-j6rjf" (UID: "d0d49ed6-ee77-432c-ab59-a83758e51a48") : secret "dns-default-metrics-tls" not found Jul 02 19:54:10.545244 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:10.544834 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 19:54:10.545244 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:10.544962 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb9a81bb-c236-45e6-8f38-130eac986587-metrics-certs podName:bb9a81bb-c236-45e6-8f38-130eac986587 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:11.544956747 +0000 UTC m=+36.611014585 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb9a81bb-c236-45e6-8f38-130eac986587-metrics-certs") pod "router-default-597bb6b665-89gn9" (UID: "bb9a81bb-c236-45e6-8f38-130eac986587") : secret "router-metrics-certs-default" not found Jul 02 19:54:10.545244 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:10.544971 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c794c79b8-mzm4h: secret "image-registry-tls" not found Jul 02 19:54:10.545244 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:10.544978 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2878a16-7611-42fd-8bf4-4e30b6da7b82-cluster-monitoring-operator-tls podName:e2878a16-7611-42fd-8bf4-4e30b6da7b82 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:11.544970206 +0000 UTC m=+36.611028049 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e2878a16-7611-42fd-8bf4-4e30b6da7b82-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-8265f" (UID: "e2878a16-7611-42fd-8bf4-4e30b6da7b82") : secret "cluster-monitoring-operator-tls" not found Jul 02 19:54:10.545244 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:10.545004 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e024d650-c674-4717-a482-4bb3ca0a4a60-registry-tls podName:e024d650-c674-4717-a482-4bb3ca0a4a60 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:11.54499417 +0000 UTC m=+36.611052008 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e024d650-c674-4717-a482-4bb3ca0a4a60-registry-tls") pod "image-registry-c794c79b8-mzm4h" (UID: "e024d650-c674-4717-a482-4bb3ca0a4a60") : secret "image-registry-tls" not found Jul 02 19:54:10.560294 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.560272 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:10.661662 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.661633 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:10.725584 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.725518 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-6n2jb" event={"ID":"e50ef735-52fb-4047-8c8e-9378a771bbd3","Type":"ContainerStarted","Data":"809d4eb0ecf8513d50ca322755f432b6c34899f92f1e94b6375384a2225c1610"} Jul 02 19:54:10.726917 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.726884 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-drhbp" event={"ID":"6d5bada9-0dfe-4f19-b549-3395492c6f5a","Type":"ContainerStarted","Data":"05368bb6e4e08ef6d1340f033397cc4147f15a44d4b7c59066dc40e2b205df3f"} Jul 02 19:54:10.728318 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.728273 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-p9t9k" event={"ID":"4cf90fa7-f624-4043-8ecc-b27547b6a98b","Type":"ContainerStarted","Data":"1a222496482b416cf98c094f429d282b2bf176379f2cb43318121b2fd9e3ffb5"} Jul 02 19:54:10.729448 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.729426 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-crtx8" event={"ID":"f0b96d67-4596-4666-897d-00a2e725a3e5","Type":"ContainerStarted","Data":"48e6200c1b89dbc57ac9e110154f4dc0cecdc9e394b3e78d850c9da6bac347a3"} Jul 02 19:54:10.730573 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.730550 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-dd6df" event={"ID":"37501a0b-36db-40db-bf27-c4cee6bcb6fd","Type":"ContainerStarted","Data":"39d965023f6df55c5d172409a477cb646ed955eebf068ac7bb0f325a0f314925"} Jul 02 19:54:10.731764 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.731745 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-cxzsr" event={"ID":"b23eefd1-80d4-4b0a-9592-6195746cd52a","Type":"ContainerStarted","Data":"0e2d5e8bafaa51953bfd7f0564e1d78cdcede70a456ceb3b537d13b3037a71b4"} Jul 02 19:54:10.732979 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:10.732956 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-krlc4" event={"ID":"b85e6f64-6fa0-4722-a51d-72e2b1bc200b","Type":"ContainerStarted","Data":"6166cef6bd245036e2fc8d63b1f953d28f1dc547fa5731003e3816a584c409ec"} Jul 02 19:54:11.475862 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:11.475563 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:11.515446 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:11.514837 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l67dn" Jul 02 19:54:11.516290 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:11.515703 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pkncj" Jul 02 19:54:11.518317 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:11.518048 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-k665n\"" Jul 02 19:54:11.519652 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:11.519312 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 19:54:11.547326 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:11.547270 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:11.560150 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:11.558522 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb9a81bb-c236-45e6-8f38-130eac986587-metrics-certs\") pod \"router-default-597bb6b665-89gn9\" (UID: \"bb9a81bb-c236-45e6-8f38-130eac986587\") " pod="openshift-ingress/router-default-597bb6b665-89gn9" Jul 02 19:54:11.560150 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:11.558612 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/195ee027-26f0-4912-84c7-5bce84da9e51-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-88qmn\" (UID: \"195ee027-26f0-4912-84c7-5bce84da9e51\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-88qmn" Jul 02 19:54:11.560150 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:11.558685 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e024d650-c674-4717-a482-4bb3ca0a4a60-registry-tls\") pod \"image-registry-c794c79b8-mzm4h\" (UID: \"e024d650-c674-4717-a482-4bb3ca0a4a60\") " pod="openshift-image-registry/image-registry-c794c79b8-mzm4h" Jul 02 19:54:11.560150 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:11.558722 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/47815432-32de-40c8-bba7-01fbb22ead7c-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-fmdh8\" (UID: \"47815432-32de-40c8-bba7-01fbb22ead7c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fmdh8" Jul 02 19:54:11.560150 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:11.558755 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb9a81bb-c236-45e6-8f38-130eac986587-service-ca-bundle\") pod \"router-default-597bb6b665-89gn9\" (UID: \"bb9a81bb-c236-45e6-8f38-130eac986587\") " pod="openshift-ingress/router-default-597bb6b665-89gn9" Jul 02 19:54:11.560150 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:11.558782 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d0d49ed6-ee77-432c-ab59-a83758e51a48-metrics-tls\") pod \"dns-default-j6rjf\" (UID: \"d0d49ed6-ee77-432c-ab59-a83758e51a48\") " pod="openshift-dns/dns-default-j6rjf" Jul 02 19:54:11.560150 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:11.558821 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e2878a16-7611-42fd-8bf4-4e30b6da7b82-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-8265f\" (UID: \"e2878a16-7611-42fd-8bf4-4e30b6da7b82\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8265f" Jul 02 19:54:11.560150 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:11.558956 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 19:54:11.560150 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:11.559012 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2878a16-7611-42fd-8bf4-4e30b6da7b82-cluster-monitoring-operator-tls podName:e2878a16-7611-42fd-8bf4-4e30b6da7b82 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:13.558994684 +0000 UTC m=+38.625052528 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e2878a16-7611-42fd-8bf4-4e30b6da7b82-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-8265f" (UID: "e2878a16-7611-42fd-8bf4-4e30b6da7b82") : secret "cluster-monitoring-operator-tls" not found Jul 02 19:54:11.560150 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:11.559396 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 19:54:11.560150 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:11.559441 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb9a81bb-c236-45e6-8f38-130eac986587-metrics-certs podName:bb9a81bb-c236-45e6-8f38-130eac986587 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:13.55942718 +0000 UTC m=+38.625485018 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb9a81bb-c236-45e6-8f38-130eac986587-metrics-certs") pod "router-default-597bb6b665-89gn9" (UID: "bb9a81bb-c236-45e6-8f38-130eac986587") : secret "router-metrics-certs-default" not found Jul 02 19:54:11.560150 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:11.559498 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 19:54:11.560150 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:11.559534 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/195ee027-26f0-4912-84c7-5bce84da9e51-networking-console-plugin-cert podName:195ee027-26f0-4912-84c7-5bce84da9e51 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:13.559522515 +0000 UTC m=+38.625580357 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/195ee027-26f0-4912-84c7-5bce84da9e51-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-88qmn" (UID: "195ee027-26f0-4912-84c7-5bce84da9e51") : secret "networking-console-plugin-cert" not found Jul 02 19:54:11.560150 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:11.559595 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 19:54:11.560150 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:11.559606 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c794c79b8-mzm4h: secret "image-registry-tls" not found Jul 02 19:54:11.560150 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:11.559844 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e024d650-c674-4717-a482-4bb3ca0a4a60-registry-tls podName:e024d650-c674-4717-a482-4bb3ca0a4a60 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:13.559829687 +0000 UTC m=+38.625887527 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e024d650-c674-4717-a482-4bb3ca0a4a60-registry-tls") pod "image-registry-c794c79b8-mzm4h" (UID: "e024d650-c674-4717-a482-4bb3ca0a4a60") : secret "image-registry-tls" not found Jul 02 19:54:11.561321 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:11.559909 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 19:54:11.561321 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:11.559953 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47815432-32de-40c8-bba7-01fbb22ead7c-samples-operator-tls podName:47815432-32de-40c8-bba7-01fbb22ead7c nodeName:}" failed. No retries permitted until 2026-07-02 19:54:13.559933003 +0000 UTC m=+38.625990847 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/47815432-32de-40c8-bba7-01fbb22ead7c-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-fmdh8" (UID: "47815432-32de-40c8-bba7-01fbb22ead7c") : secret "samples-operator-tls" not found Jul 02 19:54:11.561321 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:11.560016 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bb9a81bb-c236-45e6-8f38-130eac986587-service-ca-bundle podName:bb9a81bb-c236-45e6-8f38-130eac986587 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:13.560004274 +0000 UTC m=+38.626062117 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bb9a81bb-c236-45e6-8f38-130eac986587-service-ca-bundle") pod "router-default-597bb6b665-89gn9" (UID: "bb9a81bb-c236-45e6-8f38-130eac986587") : configmap references non-existent config key: service-ca.crt Jul 02 19:54:11.561321 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:11.560084 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 19:54:11.561321 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:11.560114 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0d49ed6-ee77-432c-ab59-a83758e51a48-metrics-tls podName:d0d49ed6-ee77-432c-ab59-a83758e51a48 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:13.560103968 +0000 UTC m=+38.626161811 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d0d49ed6-ee77-432c-ab59-a83758e51a48-metrics-tls") pod "dns-default-j6rjf" (UID: "d0d49ed6-ee77-432c-ab59-a83758e51a48") : secret "dns-default-metrics-tls" not found Jul 02 19:54:13.412922 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:13.412884 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:13.464661 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:13.464619 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:13.581474 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:13.581414 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e2878a16-7611-42fd-8bf4-4e30b6da7b82-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-8265f\" (UID: \"e2878a16-7611-42fd-8bf4-4e30b6da7b82\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8265f" Jul 02 19:54:13.581474 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:13.581475 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb9a81bb-c236-45e6-8f38-130eac986587-metrics-certs\") pod \"router-default-597bb6b665-89gn9\" (UID: \"bb9a81bb-c236-45e6-8f38-130eac986587\") " pod="openshift-ingress/router-default-597bb6b665-89gn9" Jul 02 19:54:13.581712 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:13.581566 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/195ee027-26f0-4912-84c7-5bce84da9e51-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-88qmn\" (UID: \"195ee027-26f0-4912-84c7-5bce84da9e51\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-88qmn" Jul 02 19:54:13.581773 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:13.581722 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 19:54:13.581827 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:13.581771 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 19:54:13.581827 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:13.581812 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2878a16-7611-42fd-8bf4-4e30b6da7b82-cluster-monitoring-operator-tls podName:e2878a16-7611-42fd-8bf4-4e30b6da7b82 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:17.581788987 +0000 UTC m=+42.647846831 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e2878a16-7611-42fd-8bf4-4e30b6da7b82-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-8265f" (UID: "e2878a16-7611-42fd-8bf4-4e30b6da7b82") : secret "cluster-monitoring-operator-tls" not found Jul 02 19:54:13.581931 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:13.581835 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb9a81bb-c236-45e6-8f38-130eac986587-metrics-certs podName:bb9a81bb-c236-45e6-8f38-130eac986587 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:17.581824404 +0000 UTC m=+42.647882246 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb9a81bb-c236-45e6-8f38-130eac986587-metrics-certs") pod "router-default-597bb6b665-89gn9" (UID: "bb9a81bb-c236-45e6-8f38-130eac986587") : secret "router-metrics-certs-default" not found Jul 02 19:54:13.581931 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:13.581842 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 19:54:13.581931 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:13.581870 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/195ee027-26f0-4912-84c7-5bce84da9e51-networking-console-plugin-cert podName:195ee027-26f0-4912-84c7-5bce84da9e51 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:17.581858895 +0000 UTC m=+42.647916734 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/195ee027-26f0-4912-84c7-5bce84da9e51-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-88qmn" (UID: "195ee027-26f0-4912-84c7-5bce84da9e51") : secret "networking-console-plugin-cert" not found Jul 02 19:54:13.581931 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:13.581893 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e024d650-c674-4717-a482-4bb3ca0a4a60-registry-tls\") pod \"image-registry-c794c79b8-mzm4h\" (UID: \"e024d650-c674-4717-a482-4bb3ca0a4a60\") " pod="openshift-image-registry/image-registry-c794c79b8-mzm4h" Jul 02 19:54:13.582131 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:13.581952 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/47815432-32de-40c8-bba7-01fbb22ead7c-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-fmdh8\" (UID: \"47815432-32de-40c8-bba7-01fbb22ead7c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fmdh8" Jul 02 19:54:13.582131 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:13.581991 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb9a81bb-c236-45e6-8f38-130eac986587-service-ca-bundle\") pod \"router-default-597bb6b665-89gn9\" (UID: \"bb9a81bb-c236-45e6-8f38-130eac986587\") " pod="openshift-ingress/router-default-597bb6b665-89gn9" Jul 02 19:54:13.582131 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:13.582018 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 19:54:13.582131 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:13.582035 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c794c79b8-mzm4h: secret "image-registry-tls" not found Jul 02 19:54:13.582131 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:13.582065 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 19:54:13.582131 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:13.582074 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e024d650-c674-4717-a482-4bb3ca0a4a60-registry-tls podName:e024d650-c674-4717-a482-4bb3ca0a4a60 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:17.582061498 +0000 UTC m=+42.648119355 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e024d650-c674-4717-a482-4bb3ca0a4a60-registry-tls") pod "image-registry-c794c79b8-mzm4h" (UID: "e024d650-c674-4717-a482-4bb3ca0a4a60") : secret "image-registry-tls" not found Jul 02 19:54:13.582131 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:13.582019 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d0d49ed6-ee77-432c-ab59-a83758e51a48-metrics-tls\") pod \"dns-default-j6rjf\" (UID: \"d0d49ed6-ee77-432c-ab59-a83758e51a48\") " pod="openshift-dns/dns-default-j6rjf" Jul 02 19:54:13.582131 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:13.582098 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47815432-32de-40c8-bba7-01fbb22ead7c-samples-operator-tls podName:47815432-32de-40c8-bba7-01fbb22ead7c nodeName:}" failed. No retries permitted until 2026-07-02 19:54:17.582086735 +0000 UTC m=+42.648144574 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/47815432-32de-40c8-bba7-01fbb22ead7c-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-fmdh8" (UID: "47815432-32de-40c8-bba7-01fbb22ead7c") : secret "samples-operator-tls" not found Jul 02 19:54:13.582131 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:13.582117 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bb9a81bb-c236-45e6-8f38-130eac986587-service-ca-bundle podName:bb9a81bb-c236-45e6-8f38-130eac986587 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:17.582109373 +0000 UTC m=+42.648167211 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bb9a81bb-c236-45e6-8f38-130eac986587-service-ca-bundle") pod "router-default-597bb6b665-89gn9" (UID: "bb9a81bb-c236-45e6-8f38-130eac986587") : configmap references non-existent config key: service-ca.crt Jul 02 19:54:13.582714 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:13.582147 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 19:54:13.582714 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:13.582182 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0d49ed6-ee77-432c-ab59-a83758e51a48-metrics-tls podName:d0d49ed6-ee77-432c-ab59-a83758e51a48 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:17.582165612 +0000 UTC m=+42.648223478 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d0d49ed6-ee77-432c-ab59-a83758e51a48-metrics-tls") pod "dns-default-j6rjf" (UID: "d0d49ed6-ee77-432c-ab59-a83758e51a48") : secret "dns-default-metrics-tls" not found Jul 02 19:54:15.034616 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:15.034583 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:15.087788 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:15.087754 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:16.497465 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:16.497415 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:16.612060 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:16.612028 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:17.616035 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:17.615998 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e2878a16-7611-42fd-8bf4-4e30b6da7b82-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-8265f\" (UID: \"e2878a16-7611-42fd-8bf4-4e30b6da7b82\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8265f" Jul 02 19:54:17.616035 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:17.616041 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb9a81bb-c236-45e6-8f38-130eac986587-metrics-certs\") pod \"router-default-597bb6b665-89gn9\" (UID: \"bb9a81bb-c236-45e6-8f38-130eac986587\") " pod="openshift-ingress/router-default-597bb6b665-89gn9" Jul 02 19:54:17.616566 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:17.616126 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/195ee027-26f0-4912-84c7-5bce84da9e51-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-88qmn\" (UID: \"195ee027-26f0-4912-84c7-5bce84da9e51\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-88qmn" Jul 02 19:54:17.616566 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:17.616174 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 19:54:17.616566 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:17.616190 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e024d650-c674-4717-a482-4bb3ca0a4a60-registry-tls\") pod \"image-registry-c794c79b8-mzm4h\" (UID: \"e024d650-c674-4717-a482-4bb3ca0a4a60\") " pod="openshift-image-registry/image-registry-c794c79b8-mzm4h" Jul 02 19:54:17.616566 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:17.616225 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/47815432-32de-40c8-bba7-01fbb22ead7c-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-fmdh8\" (UID: \"47815432-32de-40c8-bba7-01fbb22ead7c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fmdh8" Jul 02 19:54:17.616566 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:17.616232 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 19:54:17.616566 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:17.616262 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2878a16-7611-42fd-8bf4-4e30b6da7b82-cluster-monitoring-operator-tls podName:e2878a16-7611-42fd-8bf4-4e30b6da7b82 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:25.616240024 +0000 UTC m=+50.682297870 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e2878a16-7611-42fd-8bf4-4e30b6da7b82-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-8265f" (UID: "e2878a16-7611-42fd-8bf4-4e30b6da7b82") : secret "cluster-monitoring-operator-tls" not found Jul 02 19:54:17.616566 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:17.616288 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb9a81bb-c236-45e6-8f38-130eac986587-service-ca-bundle\") pod \"router-default-597bb6b665-89gn9\" (UID: \"bb9a81bb-c236-45e6-8f38-130eac986587\") " pod="openshift-ingress/router-default-597bb6b665-89gn9" Jul 02 19:54:17.616566 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:17.616306 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 19:54:17.616566 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:17.616313 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 19:54:17.616566 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:17.616322 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d0d49ed6-ee77-432c-ab59-a83758e51a48-metrics-tls\") pod \"dns-default-j6rjf\" (UID: \"d0d49ed6-ee77-432c-ab59-a83758e51a48\") " pod="openshift-dns/dns-default-j6rjf" Jul 02 19:54:17.616566 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:17.616357 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/195ee027-26f0-4912-84c7-5bce84da9e51-networking-console-plugin-cert podName:195ee027-26f0-4912-84c7-5bce84da9e51 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:25.616326405 +0000 UTC m=+50.682384250 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/195ee027-26f0-4912-84c7-5bce84da9e51-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-88qmn" (UID: "195ee027-26f0-4912-84c7-5bce84da9e51") : secret "networking-console-plugin-cert" not found Jul 02 19:54:17.616566 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:17.616378 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47815432-32de-40c8-bba7-01fbb22ead7c-samples-operator-tls podName:47815432-32de-40c8-bba7-01fbb22ead7c nodeName:}" failed. No retries permitted until 2026-07-02 19:54:25.616367884 +0000 UTC m=+50.682425725 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/47815432-32de-40c8-bba7-01fbb22ead7c-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-fmdh8" (UID: "47815432-32de-40c8-bba7-01fbb22ead7c") : secret "samples-operator-tls" not found Jul 02 19:54:17.616566 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:17.616398 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 19:54:17.616566 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:17.616427 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0d49ed6-ee77-432c-ab59-a83758e51a48-metrics-tls podName:d0d49ed6-ee77-432c-ab59-a83758e51a48 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:25.616417893 +0000 UTC m=+50.682475745 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d0d49ed6-ee77-432c-ab59-a83758e51a48-metrics-tls") pod "dns-default-j6rjf" (UID: "d0d49ed6-ee77-432c-ab59-a83758e51a48") : secret "dns-default-metrics-tls" not found Jul 02 19:54:17.616566 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:17.616431 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 19:54:17.616566 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:17.616440 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb9a81bb-c236-45e6-8f38-130eac986587-metrics-certs podName:bb9a81bb-c236-45e6-8f38-130eac986587 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:25.616432757 +0000 UTC m=+50.682490596 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb9a81bb-c236-45e6-8f38-130eac986587-metrics-certs") pod "router-default-597bb6b665-89gn9" (UID: "bb9a81bb-c236-45e6-8f38-130eac986587") : secret "router-metrics-certs-default" not found Jul 02 19:54:17.617414 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:17.616444 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c794c79b8-mzm4h: secret "image-registry-tls" not found Jul 02 19:54:17.617414 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:17.616475 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e024d650-c674-4717-a482-4bb3ca0a4a60-registry-tls podName:e024d650-c674-4717-a482-4bb3ca0a4a60 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:25.616464171 +0000 UTC m=+50.682522009 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e024d650-c674-4717-a482-4bb3ca0a4a60-registry-tls") pod "image-registry-c794c79b8-mzm4h" (UID: "e024d650-c674-4717-a482-4bb3ca0a4a60") : secret "image-registry-tls" not found Jul 02 19:54:17.617414 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:17.616493 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bb9a81bb-c236-45e6-8f38-130eac986587-service-ca-bundle podName:bb9a81bb-c236-45e6-8f38-130eac986587 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:25.616484071 +0000 UTC m=+50.682541912 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bb9a81bb-c236-45e6-8f38-130eac986587-service-ca-bundle") pod "router-default-597bb6b665-89gn9" (UID: "bb9a81bb-c236-45e6-8f38-130eac986587") : configmap references non-existent config key: service-ca.crt Jul 02 19:54:19.389133 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:19.389087 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:19.451956 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:19.451919 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:20.766045 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:20.766011 2565 generic.go:356] "Generic (PLEG): container finished" podID="1b47afea-97df-4176-b7d1-7f5eeb6c38d6" containerID="aa94de6523de640629fd586d8eec88f2463a4c75a145ed400048057eaa0bda82" exitCode=0 Jul 02 19:54:20.766478 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:20.766105 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rpsqp" event={"ID":"1b47afea-97df-4176-b7d1-7f5eeb6c38d6","Type":"ContainerDied","Data":"aa94de6523de640629fd586d8eec88f2463a4c75a145ed400048057eaa0bda82"} Jul 02 19:54:20.776188 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:20.776164 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-6n2jb_e50ef735-52fb-4047-8c8e-9378a771bbd3/console-operator/0.log" Jul 02 19:54:20.776439 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:20.776421 2565 generic.go:356] "Generic (PLEG): container finished" podID="e50ef735-52fb-4047-8c8e-9378a771bbd3" containerID="79e3bab27fd549fbb5be9c53713c5b9d21aa71ff8f37e7c8fe5cd2b80ed825aa" exitCode=255 Jul 02 19:54:20.776664 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:20.776624 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-6n2jb" event={"ID":"e50ef735-52fb-4047-8c8e-9378a771bbd3","Type":"ContainerDied","Data":"79e3bab27fd549fbb5be9c53713c5b9d21aa71ff8f37e7c8fe5cd2b80ed825aa"} Jul 02 19:54:20.776995 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:20.776858 2565 scope.go:117] "RemoveContainer" containerID="79e3bab27fd549fbb5be9c53713c5b9d21aa71ff8f37e7c8fe5cd2b80ed825aa" Jul 02 19:54:20.780232 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:20.780212 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-drhbp" event={"ID":"6d5bada9-0dfe-4f19-b549-3395492c6f5a","Type":"ContainerStarted","Data":"d5c4bab2265feb2678bd641ba2367aec4edffd94ed84c7f706c2929fadda5530"} Jul 02 19:54:20.781964 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:20.781941 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-p9t9k" event={"ID":"4cf90fa7-f624-4043-8ecc-b27547b6a98b","Type":"ContainerStarted","Data":"e36c4aac25b4d16463218d3494970dc6e159a88d4068816797d5738545f00425"} Jul 02 19:54:20.783382 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:20.783331 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-crtx8" event={"ID":"f0b96d67-4596-4666-897d-00a2e725a3e5","Type":"ContainerStarted","Data":"3ba2eaf05865511f9515770fb97ebed3b1f79d0da9b16542955a075f3679b3ec"} Jul 02 19:54:20.784793 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:20.784774 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-dd6df" event={"ID":"37501a0b-36db-40db-bf27-c4cee6bcb6fd","Type":"ContainerStarted","Data":"7a9ba14803b7f863ff7527368a54f10510ef9d1c196926e478e3ef8addf54bca"} Jul 02 19:54:20.786354 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:20.786321 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-cxzsr" event={"ID":"b23eefd1-80d4-4b0a-9592-6195746cd52a","Type":"ContainerStarted","Data":"5d44c4b57cb11d901bd3624afe29dd329e8f9e8a2db458a76498af7315fbc719"} Jul 02 19:54:20.787741 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:20.787697 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-krlc4" event={"ID":"b85e6f64-6fa0-4722-a51d-72e2b1bc200b","Type":"ContainerStarted","Data":"7abb042d6e8542d5a0d66eb61982771053d88550398c8d5b5f44acb10f235f88"} Jul 02 19:54:20.813862 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:20.813809 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-drhbp" podStartSLOduration=24.316410212 podStartE2EDuration="33.813788724s" totalImagesPullingTime="9.497378512s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:53:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:54:20.812072348 +0000 UTC m=+45.878130212" watchObservedRunningTime="2026-07-02 19:54:20.813788724 +0000 UTC m=+45.879846586" Jul 02 19:54:20.885217 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:20.885117 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-dd6df" podStartSLOduration=26.403750435 podStartE2EDuration="33.885094015s" totalImagesPullingTime="7.48134358s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:53:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:54:20.884167462 +0000 UTC m=+45.950225324" watchObservedRunningTime="2026-07-02 19:54:20.885094015 +0000 UTC m=+45.951151876" Jul 02 19:54:20.904265 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:20.904213 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-crtx8" podStartSLOduration=24.430126144 podStartE2EDuration="33.904192331s" totalImagesPullingTime="9.474066187s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:53:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:54:20.90359584 +0000 UTC m=+45.969653698" watchObservedRunningTime="2026-07-02 19:54:20.904192331 +0000 UTC m=+45.970250195" Jul 02 19:54:20.945966 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:20.945890 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-cxzsr" podStartSLOduration=24.499460917 podStartE2EDuration="33.945861983s" totalImagesPullingTime="9.446401066s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:53:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:54:20.922828001 +0000 UTC m=+45.988885857" watchObservedRunningTime="2026-07-02 19:54:20.945861983 +0000 UTC m=+46.011919846" Jul 02 19:54:20.966669 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:20.965540 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-p9t9k" podStartSLOduration=24.516610661 podStartE2EDuration="33.965519392s" totalImagesPullingTime="9.448908731s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:53:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:54:20.946234168 +0000 UTC m=+46.012292029" watchObservedRunningTime="2026-07-02 19:54:20.965519392 +0000 UTC m=+46.031577255" Jul 02 19:54:20.966669 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:20.966486 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-krlc4" podStartSLOduration=2.5287946420000003 podStartE2EDuration="11.966467838s" totalImagesPullingTime="9.437673196s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:54:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:54:20.964651577 +0000 UTC m=+46.030709440" watchObservedRunningTime="2026-07-02 19:54:20.966467838 +0000 UTC m=+46.032525700" Jul 02 19:54:20.995391 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:20.995261 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:21.050957 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:21.050877 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:21.133641 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:21.133607 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:21.194631 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:21.194591 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:21.742403 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:21.742373 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-scmht"] Jul 02 19:54:21.759706 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:21.759675 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-scmht"] Jul 02 19:54:21.759965 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:21.759935 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-scmht" Jul 02 19:54:21.763006 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:21.762779 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hs5xt\"" Jul 02 19:54:21.763132 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:21.763041 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 02 19:54:21.763199 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:21.763041 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 02 19:54:21.786946 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:21.786912 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:21.795498 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:21.795474 2565 generic.go:356] "Generic (PLEG): container finished" podID="1b47afea-97df-4176-b7d1-7f5eeb6c38d6" containerID="cb1f7f65c738f5ae2c7bc9a2439ee6a2facb872b32e6aca236039240810075f0" exitCode=0 Jul 02 19:54:21.795653 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:21.795560 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rpsqp" event={"ID":"1b47afea-97df-4176-b7d1-7f5eeb6c38d6","Type":"ContainerDied","Data":"cb1f7f65c738f5ae2c7bc9a2439ee6a2facb872b32e6aca236039240810075f0"} Jul 02 19:54:21.797153 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:21.797134 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-6n2jb_e50ef735-52fb-4047-8c8e-9378a771bbd3/console-operator/1.log" Jul 02 19:54:21.797551 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:21.797535 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-6n2jb_e50ef735-52fb-4047-8c8e-9378a771bbd3/console-operator/0.log" Jul 02 19:54:21.797638 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:21.797567 2565 generic.go:356] "Generic (PLEG): container finished" podID="e50ef735-52fb-4047-8c8e-9378a771bbd3" containerID="af620e2506915124a76b80ceaf1686e7c3c78ce666c7e47cb2a0d9a2df0d8bc7" exitCode=255 Jul 02 19:54:21.797699 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:21.797648 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-6n2jb" event={"ID":"e50ef735-52fb-4047-8c8e-9378a771bbd3","Type":"ContainerDied","Data":"af620e2506915124a76b80ceaf1686e7c3c78ce666c7e47cb2a0d9a2df0d8bc7"} Jul 02 19:54:21.797699 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:21.797691 2565 scope.go:117] "RemoveContainer" containerID="79e3bab27fd549fbb5be9c53713c5b9d21aa71ff8f37e7c8fe5cd2b80ed825aa" Jul 02 19:54:21.797984 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:21.797960 2565 scope.go:117] "RemoveContainer" containerID="af620e2506915124a76b80ceaf1686e7c3c78ce666c7e47cb2a0d9a2df0d8bc7" Jul 02 19:54:21.798167 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:21.798103 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-6n2jb_openshift-console-operator(e50ef735-52fb-4047-8c8e-9378a771bbd3)\"" pod="openshift-console-operator/console-operator-68b757fb67-6n2jb" podUID="e50ef735-52fb-4047-8c8e-9378a771bbd3" Jul 02 19:54:21.857387 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:21.857249 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/746e97fe-6921-499b-87af-2a8474c0a5e6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-scmht\" (UID: \"746e97fe-6921-499b-87af-2a8474c0a5e6\") " pod="openshift-insights/insights-runtime-extractor-scmht" Jul 02 19:54:21.857387 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:21.857332 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/746e97fe-6921-499b-87af-2a8474c0a5e6-crio-socket\") pod \"insights-runtime-extractor-scmht\" (UID: \"746e97fe-6921-499b-87af-2a8474c0a5e6\") " pod="openshift-insights/insights-runtime-extractor-scmht" Jul 02 19:54:21.857735 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:21.857608 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/746e97fe-6921-499b-87af-2a8474c0a5e6-data-volume\") pod \"insights-runtime-extractor-scmht\" (UID: \"746e97fe-6921-499b-87af-2a8474c0a5e6\") " pod="openshift-insights/insights-runtime-extractor-scmht" Jul 02 19:54:21.857735 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:21.857722 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/746e97fe-6921-499b-87af-2a8474c0a5e6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-scmht\" (UID: \"746e97fe-6921-499b-87af-2a8474c0a5e6\") " pod="openshift-insights/insights-runtime-extractor-scmht" Jul 02 19:54:21.858422 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:21.857831 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzqlr\" (UniqueName: \"kubernetes.io/projected/746e97fe-6921-499b-87af-2a8474c0a5e6-kube-api-access-mzqlr\") pod \"insights-runtime-extractor-scmht\" (UID: \"746e97fe-6921-499b-87af-2a8474c0a5e6\") " pod="openshift-insights/insights-runtime-extractor-scmht" Jul 02 19:54:21.860565 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:21.860407 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:21.918788 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:21.918759 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:21.959242 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:21.959216 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzqlr\" (UniqueName: \"kubernetes.io/projected/746e97fe-6921-499b-87af-2a8474c0a5e6-kube-api-access-mzqlr\") pod \"insights-runtime-extractor-scmht\" (UID: \"746e97fe-6921-499b-87af-2a8474c0a5e6\") " pod="openshift-insights/insights-runtime-extractor-scmht" Jul 02 19:54:21.959392 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:21.959320 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/746e97fe-6921-499b-87af-2a8474c0a5e6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-scmht\" (UID: \"746e97fe-6921-499b-87af-2a8474c0a5e6\") " pod="openshift-insights/insights-runtime-extractor-scmht" Jul 02 19:54:21.959392 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:21.959374 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/746e97fe-6921-499b-87af-2a8474c0a5e6-crio-socket\") pod \"insights-runtime-extractor-scmht\" (UID: \"746e97fe-6921-499b-87af-2a8474c0a5e6\") " pod="openshift-insights/insights-runtime-extractor-scmht" Jul 02 19:54:21.959502 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:21.959483 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 19:54:21.959555 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:21.959500 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/746e97fe-6921-499b-87af-2a8474c0a5e6-data-volume\") pod \"insights-runtime-extractor-scmht\" (UID: \"746e97fe-6921-499b-87af-2a8474c0a5e6\") " pod="openshift-insights/insights-runtime-extractor-scmht" Jul 02 19:54:21.959555 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:21.959516 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/746e97fe-6921-499b-87af-2a8474c0a5e6-crio-socket\") pod \"insights-runtime-extractor-scmht\" (UID: \"746e97fe-6921-499b-87af-2a8474c0a5e6\") " pod="openshift-insights/insights-runtime-extractor-scmht" Jul 02 19:54:21.959555 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:21.959551 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/746e97fe-6921-499b-87af-2a8474c0a5e6-insights-runtime-extractor-tls podName:746e97fe-6921-499b-87af-2a8474c0a5e6 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:22.459531111 +0000 UTC m=+47.525588952 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/746e97fe-6921-499b-87af-2a8474c0a5e6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-scmht" (UID: "746e97fe-6921-499b-87af-2a8474c0a5e6") : secret "insights-runtime-extractor-tls" not found Jul 02 19:54:21.959716 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:21.959611 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/746e97fe-6921-499b-87af-2a8474c0a5e6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-scmht\" (UID: \"746e97fe-6921-499b-87af-2a8474c0a5e6\") " pod="openshift-insights/insights-runtime-extractor-scmht" Jul 02 19:54:21.959754 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:21.959713 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 19:54:21.959790 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:21.959764 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/746e97fe-6921-499b-87af-2a8474c0a5e6-kube-rbac-proxy-cm podName:746e97fe-6921-499b-87af-2a8474c0a5e6 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:22.459748586 +0000 UTC m=+47.525806441 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/746e97fe-6921-499b-87af-2a8474c0a5e6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-scmht" (UID: "746e97fe-6921-499b-87af-2a8474c0a5e6") : configmap "kube-rbac-proxy" not found Jul 02 19:54:21.959838 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:21.959798 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/746e97fe-6921-499b-87af-2a8474c0a5e6-data-volume\") pod \"insights-runtime-extractor-scmht\" (UID: \"746e97fe-6921-499b-87af-2a8474c0a5e6\") " pod="openshift-insights/insights-runtime-extractor-scmht" Jul 02 19:54:21.970215 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:21.970193 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzqlr\" (UniqueName: \"kubernetes.io/projected/746e97fe-6921-499b-87af-2a8474c0a5e6-kube-api-access-mzqlr\") pod \"insights-runtime-extractor-scmht\" (UID: \"746e97fe-6921-499b-87af-2a8474c0a5e6\") " pod="openshift-insights/insights-runtime-extractor-scmht" Jul 02 19:54:22.019058 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:22.018980 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:22.150556 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:22.150520 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:22.247677 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:22.247636 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:22.303516 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:22.303423 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:22.465122 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:22.465082 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/746e97fe-6921-499b-87af-2a8474c0a5e6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-scmht\" (UID: \"746e97fe-6921-499b-87af-2a8474c0a5e6\") " pod="openshift-insights/insights-runtime-extractor-scmht" Jul 02 19:54:22.465274 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:22.465227 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 19:54:22.465372 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:22.465273 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/746e97fe-6921-499b-87af-2a8474c0a5e6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-scmht\" (UID: \"746e97fe-6921-499b-87af-2a8474c0a5e6\") " pod="openshift-insights/insights-runtime-extractor-scmht" Jul 02 19:54:22.465372 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:22.465286 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/746e97fe-6921-499b-87af-2a8474c0a5e6-insights-runtime-extractor-tls podName:746e97fe-6921-499b-87af-2a8474c0a5e6 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:23.465271746 +0000 UTC m=+48.531329585 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/746e97fe-6921-499b-87af-2a8474c0a5e6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-scmht" (UID: "746e97fe-6921-499b-87af-2a8474c0a5e6") : secret "insights-runtime-extractor-tls" not found Jul 02 19:54:22.465372 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:22.465329 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 19:54:22.465495 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:22.465402 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/746e97fe-6921-499b-87af-2a8474c0a5e6-kube-rbac-proxy-cm podName:746e97fe-6921-499b-87af-2a8474c0a5e6 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:23.465390347 +0000 UTC m=+48.531448185 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/746e97fe-6921-499b-87af-2a8474c0a5e6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-scmht" (UID: "746e97fe-6921-499b-87af-2a8474c0a5e6") : configmap "kube-rbac-proxy" not found Jul 02 19:54:22.630546 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:22.630429 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:22.731731 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:22.731694 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:22.802475 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:22.802449 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-6n2jb_e50ef735-52fb-4047-8c8e-9378a771bbd3/console-operator/1.log" Jul 02 19:54:22.802867 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:22.802794 2565 scope.go:117] "RemoveContainer" containerID="af620e2506915124a76b80ceaf1686e7c3c78ce666c7e47cb2a0d9a2df0d8bc7" Jul 02 19:54:22.803001 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:22.802977 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-6n2jb_openshift-console-operator(e50ef735-52fb-4047-8c8e-9378a771bbd3)\"" pod="openshift-console-operator/console-operator-68b757fb67-6n2jb" podUID="e50ef735-52fb-4047-8c8e-9378a771bbd3" Jul 02 19:54:22.806011 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:22.805987 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rpsqp" event={"ID":"1b47afea-97df-4176-b7d1-7f5eeb6c38d6","Type":"ContainerStarted","Data":"e70318b367c2c9a0736db8d6ff527ade00afdbf78523cb28c141a3f2db6c92b7"} Jul 02 19:54:22.841001 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:22.840955 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-rpsqp" podStartSLOduration=8.068925005 podStartE2EDuration="46.840939882s" totalImagesPullingTime="38.772014877s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:53:36 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:54:22.838895756 +0000 UTC m=+47.904953628" watchObservedRunningTime="2026-07-02 19:54:22.840939882 +0000 UTC m=+47.906997746" Jul 02 19:54:23.085442 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:23.085403 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:23.151466 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:23.151435 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:23.213129 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:23.213084 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:23.345432 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:23.345363 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kxsct_20e92fd6-0a2e-471d-a090-1b96d06600c6/dns-node-resolver/0.log" Jul 02 19:54:23.473546 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:23.473515 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/746e97fe-6921-499b-87af-2a8474c0a5e6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-scmht\" (UID: \"746e97fe-6921-499b-87af-2a8474c0a5e6\") " pod="openshift-insights/insights-runtime-extractor-scmht" Jul 02 19:54:23.473692 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:23.473589 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/746e97fe-6921-499b-87af-2a8474c0a5e6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-scmht\" (UID: \"746e97fe-6921-499b-87af-2a8474c0a5e6\") " pod="openshift-insights/insights-runtime-extractor-scmht" Jul 02 19:54:23.473692 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:23.473658 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 19:54:23.473692 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:23.473669 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 19:54:23.473836 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:23.473739 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/746e97fe-6921-499b-87af-2a8474c0a5e6-insights-runtime-extractor-tls podName:746e97fe-6921-499b-87af-2a8474c0a5e6 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:25.473718248 +0000 UTC m=+50.539776089 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/746e97fe-6921-499b-87af-2a8474c0a5e6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-scmht" (UID: "746e97fe-6921-499b-87af-2a8474c0a5e6") : secret "insights-runtime-extractor-tls" not found Jul 02 19:54:23.473836 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:23.473755 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/746e97fe-6921-499b-87af-2a8474c0a5e6-kube-rbac-proxy-cm podName:746e97fe-6921-499b-87af-2a8474c0a5e6 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:25.473747824 +0000 UTC m=+50.539805663 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/746e97fe-6921-499b-87af-2a8474c0a5e6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-scmht" (UID: "746e97fe-6921-499b-87af-2a8474c0a5e6") : configmap "kube-rbac-proxy" not found Jul 02 19:54:24.145513 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:24.145476 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-56fgj_7295278e-a6f2-4725-99e7-7f76ea6da868/node-ca/0.log" Jul 02 19:54:24.265103 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:24.265065 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:24.324592 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:24.324564 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:25.004233 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:25.004193 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:25.145872 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:25.145840 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-krlc4_b85e6f64-6fa0-4722-a51d-72e2b1bc200b/serve-healthcheck-canary/0.log" Jul 02 19:54:25.492573 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:25.492541 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/746e97fe-6921-499b-87af-2a8474c0a5e6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-scmht\" (UID: \"746e97fe-6921-499b-87af-2a8474c0a5e6\") " pod="openshift-insights/insights-runtime-extractor-scmht" Jul 02 19:54:25.492764 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:25.492663 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 19:54:25.492764 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:25.492692 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/746e97fe-6921-499b-87af-2a8474c0a5e6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-scmht\" (UID: \"746e97fe-6921-499b-87af-2a8474c0a5e6\") " pod="openshift-insights/insights-runtime-extractor-scmht" Jul 02 19:54:25.492764 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:25.492723 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/746e97fe-6921-499b-87af-2a8474c0a5e6-kube-rbac-proxy-cm podName:746e97fe-6921-499b-87af-2a8474c0a5e6 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:29.492707799 +0000 UTC m=+54.558765638 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/746e97fe-6921-499b-87af-2a8474c0a5e6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-scmht" (UID: "746e97fe-6921-499b-87af-2a8474c0a5e6") : configmap "kube-rbac-proxy" not found Jul 02 19:54:25.492915 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:25.492791 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 19:54:25.492915 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:25.492846 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/746e97fe-6921-499b-87af-2a8474c0a5e6-insights-runtime-extractor-tls podName:746e97fe-6921-499b-87af-2a8474c0a5e6 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:29.4928309 +0000 UTC m=+54.558888739 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/746e97fe-6921-499b-87af-2a8474c0a5e6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-scmht" (UID: "746e97fe-6921-499b-87af-2a8474c0a5e6") : secret "insights-runtime-extractor-tls" not found Jul 02 19:54:25.694530 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:25.694497 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e024d650-c674-4717-a482-4bb3ca0a4a60-registry-tls\") pod \"image-registry-c794c79b8-mzm4h\" (UID: \"e024d650-c674-4717-a482-4bb3ca0a4a60\") " pod="openshift-image-registry/image-registry-c794c79b8-mzm4h" Jul 02 19:54:25.694736 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:25.694539 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/47815432-32de-40c8-bba7-01fbb22ead7c-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-fmdh8\" (UID: \"47815432-32de-40c8-bba7-01fbb22ead7c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fmdh8" Jul 02 19:54:25.694736 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:25.694561 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb9a81bb-c236-45e6-8f38-130eac986587-service-ca-bundle\") pod \"router-default-597bb6b665-89gn9\" (UID: \"bb9a81bb-c236-45e6-8f38-130eac986587\") " pod="openshift-ingress/router-default-597bb6b665-89gn9" Jul 02 19:54:25.694736 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:25.694663 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bb9a81bb-c236-45e6-8f38-130eac986587-service-ca-bundle podName:bb9a81bb-c236-45e6-8f38-130eac986587 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:41.694646736 +0000 UTC m=+66.760704575 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bb9a81bb-c236-45e6-8f38-130eac986587-service-ca-bundle") pod "router-default-597bb6b665-89gn9" (UID: "bb9a81bb-c236-45e6-8f38-130eac986587") : configmap references non-existent config key: service-ca.crt Jul 02 19:54:25.694736 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:25.694660 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 19:54:25.694736 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:25.694674 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 19:54:25.694736 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:25.694688 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d0d49ed6-ee77-432c-ab59-a83758e51a48-metrics-tls\") pod \"dns-default-j6rjf\" (UID: \"d0d49ed6-ee77-432c-ab59-a83758e51a48\") " pod="openshift-dns/dns-default-j6rjf" Jul 02 19:54:25.695007 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:25.694750 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47815432-32de-40c8-bba7-01fbb22ead7c-samples-operator-tls podName:47815432-32de-40c8-bba7-01fbb22ead7c nodeName:}" failed. No retries permitted until 2026-07-02 19:54:41.694732188 +0000 UTC m=+66.760790029 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/47815432-32de-40c8-bba7-01fbb22ead7c-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-fmdh8" (UID: "47815432-32de-40c8-bba7-01fbb22ead7c") : secret "samples-operator-tls" not found Jul 02 19:54:25.695007 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:25.694745 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e2878a16-7611-42fd-8bf4-4e30b6da7b82-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-8265f\" (UID: \"e2878a16-7611-42fd-8bf4-4e30b6da7b82\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8265f" Jul 02 19:54:25.695007 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:25.694685 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c794c79b8-mzm4h: secret "image-registry-tls" not found Jul 02 19:54:25.695007 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:25.694778 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 19:54:25.695007 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:25.694798 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 19:54:25.695007 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:25.694827 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0d49ed6-ee77-432c-ab59-a83758e51a48-metrics-tls podName:d0d49ed6-ee77-432c-ab59-a83758e51a48 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:41.694816046 +0000 UTC m=+66.760873884 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d0d49ed6-ee77-432c-ab59-a83758e51a48-metrics-tls") pod "dns-default-j6rjf" (UID: "d0d49ed6-ee77-432c-ab59-a83758e51a48") : secret "dns-default-metrics-tls" not found Jul 02 19:54:25.695007 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:25.694792 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb9a81bb-c236-45e6-8f38-130eac986587-metrics-certs\") pod \"router-default-597bb6b665-89gn9\" (UID: \"bb9a81bb-c236-45e6-8f38-130eac986587\") " pod="openshift-ingress/router-default-597bb6b665-89gn9" Jul 02 19:54:25.695007 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:25.694851 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e024d650-c674-4717-a482-4bb3ca0a4a60-registry-tls podName:e024d650-c674-4717-a482-4bb3ca0a4a60 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:41.694832831 +0000 UTC m=+66.760890670 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e024d650-c674-4717-a482-4bb3ca0a4a60-registry-tls") pod "image-registry-c794c79b8-mzm4h" (UID: "e024d650-c674-4717-a482-4bb3ca0a4a60") : secret "image-registry-tls" not found Jul 02 19:54:25.695007 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:25.694853 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 19:54:25.695007 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:25.694891 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2878a16-7611-42fd-8bf4-4e30b6da7b82-cluster-monitoring-operator-tls podName:e2878a16-7611-42fd-8bf4-4e30b6da7b82 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:41.694882225 +0000 UTC m=+66.760940068 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e2878a16-7611-42fd-8bf4-4e30b6da7b82-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-8265f" (UID: "e2878a16-7611-42fd-8bf4-4e30b6da7b82") : secret "cluster-monitoring-operator-tls" not found Jul 02 19:54:25.695007 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:25.694906 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb9a81bb-c236-45e6-8f38-130eac986587-metrics-certs podName:bb9a81bb-c236-45e6-8f38-130eac986587 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:41.694900072 +0000 UTC m=+66.760957911 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb9a81bb-c236-45e6-8f38-130eac986587-metrics-certs") pod "router-default-597bb6b665-89gn9" (UID: "bb9a81bb-c236-45e6-8f38-130eac986587") : secret "router-metrics-certs-default" not found Jul 02 19:54:25.695007 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:25.694964 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/195ee027-26f0-4912-84c7-5bce84da9e51-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-88qmn\" (UID: \"195ee027-26f0-4912-84c7-5bce84da9e51\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-88qmn" Jul 02 19:54:25.695392 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:25.695033 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 19:54:25.695392 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:25.695058 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/195ee027-26f0-4912-84c7-5bce84da9e51-networking-console-plugin-cert podName:195ee027-26f0-4912-84c7-5bce84da9e51 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:41.695050451 +0000 UTC m=+66.761108290 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/195ee027-26f0-4912-84c7-5bce84da9e51-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-88qmn" (UID: "195ee027-26f0-4912-84c7-5bce84da9e51") : secret "networking-console-plugin-cert" not found Jul 02 19:54:26.329269 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:26.329231 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:27.464319 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:27.464279 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:27.539429 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:27.539389 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:27.921656 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:27.921580 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:28.901053 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:28.901025 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:29.019960 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:29.019924 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:29.121291 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:29.121265 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:29.225885 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:29.225850 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:29.372354 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:29.372319 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:29.528657 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:29.528576 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/746e97fe-6921-499b-87af-2a8474c0a5e6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-scmht\" (UID: \"746e97fe-6921-499b-87af-2a8474c0a5e6\") " pod="openshift-insights/insights-runtime-extractor-scmht" Jul 02 19:54:29.528832 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:29.528809 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/746e97fe-6921-499b-87af-2a8474c0a5e6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-scmht\" (UID: \"746e97fe-6921-499b-87af-2a8474c0a5e6\") " pod="openshift-insights/insights-runtime-extractor-scmht" Jul 02 19:54:29.528944 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:29.528930 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 19:54:29.528995 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:29.528986 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/746e97fe-6921-499b-87af-2a8474c0a5e6-insights-runtime-extractor-tls podName:746e97fe-6921-499b-87af-2a8474c0a5e6 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:37.52897471 +0000 UTC m=+62.595032549 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/746e97fe-6921-499b-87af-2a8474c0a5e6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-scmht" (UID: "746e97fe-6921-499b-87af-2a8474c0a5e6") : secret "insights-runtime-extractor-tls" not found Jul 02 19:54:29.529098 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:29.529083 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/746e97fe-6921-499b-87af-2a8474c0a5e6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-scmht\" (UID: \"746e97fe-6921-499b-87af-2a8474c0a5e6\") " pod="openshift-insights/insights-runtime-extractor-scmht" Jul 02 19:54:29.775941 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:29.775906 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:30.119623 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:30.119595 2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-6n2jb" Jul 02 19:54:30.120000 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:30.119646 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-6n2jb" Jul 02 19:54:30.120043 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:30.120020 2565 scope.go:117] "RemoveContainer" containerID="af620e2506915124a76b80ceaf1686e7c3c78ce666c7e47cb2a0d9a2df0d8bc7" Jul 02 19:54:30.120186 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:30.120166 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-6n2jb_openshift-console-operator(e50ef735-52fb-4047-8c8e-9378a771bbd3)\"" pod="openshift-console-operator/console-operator-68b757fb67-6n2jb" podUID="e50ef735-52fb-4047-8c8e-9378a771bbd3" Jul 02 19:54:30.380282 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:30.380193 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:30.785633 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:30.785603 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:31.171963 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:31.171877 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:31.377623 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:31.377594 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:31.509772 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:31.509742 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:31.609707 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:31.609672 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:31.973781 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:31.973749 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:32.379615 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:32.379538 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:32.577905 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:32.577876 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:32.780020 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:32.779990 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:32.837886 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:32.837851 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:33.176290 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:33.176260 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:33.575823 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:33.575748 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:33.628436 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:33.628402 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:33.776020 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:33.775986 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:34.177057 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:34.177023 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:34.975219 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:34.975181 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:35.076021 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:35.075989 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:35.176850 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:35.176818 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:35.591583 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:35.591554 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:35.725763 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:35.725740 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5xg6t" Jul 02 19:54:35.778620 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:35.778591 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:36.182985 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:36.182950 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:36.237056 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:36.237032 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:37.000451 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:37.000422 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:37.378510 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:37.378428 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:37.573363 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:37.573312 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:37.594635 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:37.594609 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/746e97fe-6921-499b-87af-2a8474c0a5e6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-scmht\" (UID: \"746e97fe-6921-499b-87af-2a8474c0a5e6\") " pod="openshift-insights/insights-runtime-extractor-scmht" Jul 02 19:54:37.596862 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:37.596843 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/746e97fe-6921-499b-87af-2a8474c0a5e6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-scmht\" (UID: \"746e97fe-6921-499b-87af-2a8474c0a5e6\") " pod="openshift-insights/insights-runtime-extractor-scmht" Jul 02 19:54:37.676209 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:37.676187 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hs5xt\"" Jul 02 19:54:37.684371 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:37.684331 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-scmht" Jul 02 19:54:37.781905 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:37.781873 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:37.807257 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:37.807230 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-scmht"] Jul 02 19:54:37.811137 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:54:37.811103 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod746e97fe_6921_499b_87af_2a8474c0a5e6.slice/crio-c5016678a54afe86627895d18f91da6d8178553d046d1ff0e54ed01faa49a9ec WatchSource:0}: Error finding container c5016678a54afe86627895d18f91da6d8178553d046d1ff0e54ed01faa49a9ec: Status 404 returned error can't find the container with id c5016678a54afe86627895d18f91da6d8178553d046d1ff0e54ed01faa49a9ec Jul 02 19:54:37.858244 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:37.858212 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-scmht" event={"ID":"746e97fe-6921-499b-87af-2a8474c0a5e6","Type":"ContainerStarted","Data":"c5016678a54afe86627895d18f91da6d8178553d046d1ff0e54ed01faa49a9ec"} Jul 02 19:54:37.979529 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:37.979443 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:38.978602 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:38.978564 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:39.172982 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:39.172948 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:39.389416 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:39.389324 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:39.595097 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:39.595045 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:40.221170 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:40.221133 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dcc079e4-e2c2-4752-a947-0ec3ce3ccab4-metrics-certs\") pod \"network-metrics-daemon-p88nv\" (UID: \"dcc079e4-e2c2-4752-a947-0ec3ce3ccab4\") " pod="openshift-multus/network-metrics-daemon-p88nv" Jul 02 19:54:40.221170 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:40.221174 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e92927e3-3534-4747-ad6e-e0df14b731d3-original-pull-secret\") pod \"global-pull-secret-syncer-pkncj\" (UID: \"e92927e3-3534-4747-ad6e-e0df14b731d3\") " pod="kube-system/global-pull-secret-syncer-pkncj" Jul 02 19:54:40.223680 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:40.223647 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 19:54:40.224615 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:40.224598 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 19:54:40.234471 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:40.234446 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e92927e3-3534-4747-ad6e-e0df14b731d3-original-pull-secret\") pod \"global-pull-secret-syncer-pkncj\" (UID: \"e92927e3-3534-4747-ad6e-e0df14b731d3\") " pod="kube-system/global-pull-secret-syncer-pkncj" Jul 02 19:54:40.234592 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:40.234511 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dcc079e4-e2c2-4752-a947-0ec3ce3ccab4-metrics-certs\") pod \"network-metrics-daemon-p88nv\" (UID: \"dcc079e4-e2c2-4752-a947-0ec3ce3ccab4\") " pod="openshift-multus/network-metrics-daemon-p88nv" Jul 02 19:54:40.322627 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:40.322582 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wh77k\" (UniqueName: \"kubernetes.io/projected/0edfe493-6e53-42b3-9068-7b80cd51aa5a-kube-api-access-wh77k\") pod \"network-check-target-l67dn\" (UID: \"0edfe493-6e53-42b3-9068-7b80cd51aa5a\") " pod="openshift-network-diagnostics/network-check-target-l67dn" Jul 02 19:54:40.325543 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:40.325505 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wh77k\" (UniqueName: \"kubernetes.io/projected/0edfe493-6e53-42b3-9068-7b80cd51aa5a-kube-api-access-wh77k\") pod \"network-check-target-l67dn\" (UID: \"0edfe493-6e53-42b3-9068-7b80cd51aa5a\") " pod="openshift-network-diagnostics/network-check-target-l67dn" Jul 02 19:54:40.335771 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:40.335744 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-k665n\"" Jul 02 19:54:40.342776 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:40.342752 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pkncj" Jul 02 19:54:40.343821 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:40.343799 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l67dn" Jul 02 19:54:40.528993 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:40.528918 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pdnmq\"" Jul 02 19:54:40.536941 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:40.536919 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p88nv" Jul 02 19:54:41.535598 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:41.535544 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-l67dn"] Jul 02 19:54:41.539329 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:54:41.539275 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0edfe493_6e53_42b3_9068_7b80cd51aa5a.slice/crio-36efcc63e574badb53631724fba932528c752788c9d1c11cf8a396ee0873784e WatchSource:0}: Error finding container 36efcc63e574badb53631724fba932528c752788c9d1c11cf8a396ee0873784e: Status 404 returned error can't find the container with id 36efcc63e574badb53631724fba932528c752788c9d1c11cf8a396ee0873784e Jul 02 19:54:41.735110 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:41.735074 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e024d650-c674-4717-a482-4bb3ca0a4a60-registry-tls\") pod \"image-registry-c794c79b8-mzm4h\" (UID: \"e024d650-c674-4717-a482-4bb3ca0a4a60\") " pod="openshift-image-registry/image-registry-c794c79b8-mzm4h" Jul 02 19:54:41.735300 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:41.735130 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/47815432-32de-40c8-bba7-01fbb22ead7c-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-fmdh8\" (UID: \"47815432-32de-40c8-bba7-01fbb22ead7c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fmdh8" Jul 02 19:54:41.735300 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:41.735160 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb9a81bb-c236-45e6-8f38-130eac986587-service-ca-bundle\") pod \"router-default-597bb6b665-89gn9\" (UID: \"bb9a81bb-c236-45e6-8f38-130eac986587\") " pod="openshift-ingress/router-default-597bb6b665-89gn9" Jul 02 19:54:41.735300 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:41.735179 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d0d49ed6-ee77-432c-ab59-a83758e51a48-metrics-tls\") pod \"dns-default-j6rjf\" (UID: \"d0d49ed6-ee77-432c-ab59-a83758e51a48\") " pod="openshift-dns/dns-default-j6rjf" Jul 02 19:54:41.735300 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:41.735216 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e2878a16-7611-42fd-8bf4-4e30b6da7b82-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-8265f\" (UID: \"e2878a16-7611-42fd-8bf4-4e30b6da7b82\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8265f" Jul 02 19:54:41.735300 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:41.735276 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb9a81bb-c236-45e6-8f38-130eac986587-metrics-certs\") pod \"router-default-597bb6b665-89gn9\" (UID: \"bb9a81bb-c236-45e6-8f38-130eac986587\") " pod="openshift-ingress/router-default-597bb6b665-89gn9" Jul 02 19:54:41.735597 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:41.735374 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/195ee027-26f0-4912-84c7-5bce84da9e51-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-88qmn\" (UID: \"195ee027-26f0-4912-84c7-5bce84da9e51\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-88qmn" Jul 02 19:54:41.737037 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:41.737005 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb9a81bb-c236-45e6-8f38-130eac986587-service-ca-bundle\") pod \"router-default-597bb6b665-89gn9\" (UID: \"bb9a81bb-c236-45e6-8f38-130eac986587\") " pod="openshift-ingress/router-default-597bb6b665-89gn9" Jul 02 19:54:41.738152 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:41.738130 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/195ee027-26f0-4912-84c7-5bce84da9e51-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-88qmn\" (UID: \"195ee027-26f0-4912-84c7-5bce84da9e51\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-88qmn" Jul 02 19:54:41.738423 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:41.738223 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e2878a16-7611-42fd-8bf4-4e30b6da7b82-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-8265f\" (UID: \"e2878a16-7611-42fd-8bf4-4e30b6da7b82\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8265f" Jul 02 19:54:41.738423 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:41.738223 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e024d650-c674-4717-a482-4bb3ca0a4a60-registry-tls\") pod \"image-registry-c794c79b8-mzm4h\" (UID: \"e024d650-c674-4717-a482-4bb3ca0a4a60\") " pod="openshift-image-registry/image-registry-c794c79b8-mzm4h" Jul 02 19:54:41.738423 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:41.738257 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d0d49ed6-ee77-432c-ab59-a83758e51a48-metrics-tls\") pod \"dns-default-j6rjf\" (UID: \"d0d49ed6-ee77-432c-ab59-a83758e51a48\") " pod="openshift-dns/dns-default-j6rjf" Jul 02 19:54:41.738643 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:41.738623 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/47815432-32de-40c8-bba7-01fbb22ead7c-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-fmdh8\" (UID: \"47815432-32de-40c8-bba7-01fbb22ead7c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fmdh8" Jul 02 19:54:41.739435 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:41.739414 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb9a81bb-c236-45e6-8f38-130eac986587-metrics-certs\") pod \"router-default-597bb6b665-89gn9\" (UID: \"bb9a81bb-c236-45e6-8f38-130eac986587\") " pod="openshift-ingress/router-default-597bb6b665-89gn9" Jul 02 19:54:41.753751 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:41.753730 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pkncj"] Jul 02 19:54:41.756387 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:54:41.756301 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode92927e3_3534_4747_ad6e_e0df14b731d3.slice/crio-4308ac7a9c9341e434e494bca808d59211e6463c3c4b1fbb0a3a3be5a7a20e7b WatchSource:0}: Error finding container 4308ac7a9c9341e434e494bca808d59211e6463c3c4b1fbb0a3a3be5a7a20e7b: Status 404 returned error can't find the container with id 4308ac7a9c9341e434e494bca808d59211e6463c3c4b1fbb0a3a3be5a7a20e7b Jul 02 19:54:41.756387 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:41.756328 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-p88nv"] Jul 02 19:54:41.758640 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:54:41.758622 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcc079e4_e2c2_4752_a947_0ec3ce3ccab4.slice/crio-010bc7998215755264b43d116f469ca3349e9e733485b7e7843f976e78f719d4 WatchSource:0}: Error finding container 010bc7998215755264b43d116f469ca3349e9e733485b7e7843f976e78f719d4: Status 404 returned error can't find the container with id 010bc7998215755264b43d116f469ca3349e9e733485b7e7843f976e78f719d4 Jul 02 19:54:41.872625 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:41.872585 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-hfqbh\"" Jul 02 19:54:41.873284 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:41.873202 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-scmht" event={"ID":"746e97fe-6921-499b-87af-2a8474c0a5e6","Type":"ContainerStarted","Data":"1aac2eb8a0264bc5f408000c1ec27d7f274f9cc43a5c20b86be1bcec5ef264d1"} Jul 02 19:54:41.874540 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:41.874508 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p88nv" event={"ID":"dcc079e4-e2c2-4752-a947-0ec3ce3ccab4","Type":"ContainerStarted","Data":"010bc7998215755264b43d116f469ca3349e9e733485b7e7843f976e78f719d4"} Jul 02 19:54:41.875900 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:41.875874 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pkncj" event={"ID":"e92927e3-3534-4747-ad6e-e0df14b731d3","Type":"ContainerStarted","Data":"4308ac7a9c9341e434e494bca808d59211e6463c3c4b1fbb0a3a3be5a7a20e7b"} Jul 02 19:54:41.877430 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:41.877408 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-l67dn" event={"ID":"0edfe493-6e53-42b3-9068-7b80cd51aa5a","Type":"ContainerStarted","Data":"2553b2f70dc9ff097bf82486e03e8f3a855bf4530e6ebc9c152377391065399f"} Jul 02 19:54:41.877522 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:41.877445 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-l67dn" event={"ID":"0edfe493-6e53-42b3-9068-7b80cd51aa5a","Type":"ContainerStarted","Data":"36efcc63e574badb53631724fba932528c752788c9d1c11cf8a396ee0873784e"} Jul 02 19:54:41.877693 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:41.877670 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-l67dn" Jul 02 19:54:41.880775 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:41.880753 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c794c79b8-mzm4h" Jul 02 19:54:41.891118 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:41.891063 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-jcrll\"" Jul 02 19:54:41.899479 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:41.899458 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fmdh8" Jul 02 19:54:41.914931 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:41.914906 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-6snsl\"" Jul 02 19:54:41.923030 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:41.923007 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8265f" Jul 02 19:54:41.932297 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:41.932279 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-c2vfc\"" Jul 02 19:54:41.936851 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:41.936721 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-kxdpx\"" Jul 02 19:54:41.939758 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:41.939722 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-597bb6b665-89gn9" Jul 02 19:54:41.945426 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:41.945403 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-88qmn" Jul 02 19:54:41.947795 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:41.947775 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nzdvh\"" Jul 02 19:54:41.956057 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:41.956035 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-j6rjf" Jul 02 19:54:42.030019 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:42.029960 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-l67dn" podStartSLOduration=66.029937711 podStartE2EDuration="1m6.029937711s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:53:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:54:41.893496921 +0000 UTC m=+66.959554783" watchObservedRunningTime="2026-07-02 19:54:42.029937711 +0000 UTC m=+67.095995573" Jul 02 19:54:42.030880 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:42.030723 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c794c79b8-mzm4h"] Jul 02 19:54:42.034569 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:54:42.034534 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode024d650_c674_4717_a482_4bb3ca0a4a60.slice/crio-45171eece8f7731cc91c27162c6f5b534390dca891fcdc5c59524f295e5d1c88 WatchSource:0}: Error finding container 45171eece8f7731cc91c27162c6f5b534390dca891fcdc5c59524f295e5d1c88: Status 404 returned error can't find the container with id 45171eece8f7731cc91c27162c6f5b534390dca891fcdc5c59524f295e5d1c88 Jul 02 19:54:42.203806 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:42.203708 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-88qmn"] Jul 02 19:54:42.212177 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:54:42.212151 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod195ee027_26f0_4912_84c7_5bce84da9e51.slice/crio-91914e7e153736184c7b0efa4a2325fd6eed2aa54335be5d61e9a015e5f577c4 WatchSource:0}: Error finding container 91914e7e153736184c7b0efa4a2325fd6eed2aa54335be5d61e9a015e5f577c4: Status 404 returned error can't find the container with id 91914e7e153736184c7b0efa4a2325fd6eed2aa54335be5d61e9a015e5f577c4 Jul 02 19:54:42.224084 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:42.224057 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:42.323562 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:42.323475 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:42.439469 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:42.439436 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fmdh8"] Jul 02 19:54:42.442729 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:42.442703 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8265f"] Jul 02 19:54:42.446334 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:42.446312 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-j6rjf"] Jul 02 19:54:42.447722 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:42.447645 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-597bb6b665-89gn9"] Jul 02 19:54:42.451681 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:54:42.451646 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0d49ed6_ee77_432c_ab59_a83758e51a48.slice/crio-88129e062e56156cc89759220aca425243119d9bde51a99c7853522e8ce8c17a WatchSource:0}: Error finding container 88129e062e56156cc89759220aca425243119d9bde51a99c7853522e8ce8c17a: Status 404 returned error can't find the container with id 88129e062e56156cc89759220aca425243119d9bde51a99c7853522e8ce8c17a Jul 02 19:54:42.454943 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:54:42.453725 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb9a81bb_c236_45e6_8f38_130eac986587.slice/crio-8062f42fd7ac3d530354db4c54911fc02f109a1812a3baec65e79d0da0d20f55 WatchSource:0}: Error finding container 8062f42fd7ac3d530354db4c54911fc02f109a1812a3baec65e79d0da0d20f55: Status 404 returned error can't find the container with id 8062f42fd7ac3d530354db4c54911fc02f109a1812a3baec65e79d0da0d20f55 Jul 02 19:54:42.882710 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:42.882650 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fmdh8" event={"ID":"47815432-32de-40c8-bba7-01fbb22ead7c","Type":"ContainerStarted","Data":"fe40cf60f053a96483a9ef0ef228eba8885e5d460493a78d324759c95352745c"} Jul 02 19:54:42.884315 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:42.884281 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-88qmn" event={"ID":"195ee027-26f0-4912-84c7-5bce84da9e51","Type":"ContainerStarted","Data":"91914e7e153736184c7b0efa4a2325fd6eed2aa54335be5d61e9a015e5f577c4"} Jul 02 19:54:42.886637 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:42.886024 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c794c79b8-mzm4h" event={"ID":"e024d650-c674-4717-a482-4bb3ca0a4a60","Type":"ContainerStarted","Data":"c490815f32dd5f3c9143cd9447289ed70a0eddeb45e80a9e99916615434186ef"} Jul 02 19:54:42.886637 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:42.886069 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c794c79b8-mzm4h" event={"ID":"e024d650-c674-4717-a482-4bb3ca0a4a60","Type":"ContainerStarted","Data":"45171eece8f7731cc91c27162c6f5b534390dca891fcdc5c59524f295e5d1c88"} Jul 02 19:54:42.886637 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:42.886486 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-c794c79b8-mzm4h" Jul 02 19:54:42.888834 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:42.888411 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-597bb6b665-89gn9" event={"ID":"bb9a81bb-c236-45e6-8f38-130eac986587","Type":"ContainerStarted","Data":"d3fcfe0bbedc3be37ad208657d72e8df7a5a02dff9f2c367782d0cce9be2a847"} Jul 02 19:54:42.888834 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:42.888449 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-597bb6b665-89gn9" event={"ID":"bb9a81bb-c236-45e6-8f38-130eac986587","Type":"ContainerStarted","Data":"8062f42fd7ac3d530354db4c54911fc02f109a1812a3baec65e79d0da0d20f55"} Jul 02 19:54:42.890293 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:42.890237 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8265f" event={"ID":"e2878a16-7611-42fd-8bf4-4e30b6da7b82","Type":"ContainerStarted","Data":"1a25aa2141884197c1603a0d5ca0a32bf2ab6cda96eec492f60c5dc2d3f19c58"} Jul 02 19:54:42.893858 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:42.893832 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-scmht" event={"ID":"746e97fe-6921-499b-87af-2a8474c0a5e6","Type":"ContainerStarted","Data":"ed6cd2f303733f5670f9b6ad652e51378b2cb4a98c7f8cd66201fde4e9622db9"} Jul 02 19:54:42.895234 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:42.895169 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-j6rjf" event={"ID":"d0d49ed6-ee77-432c-ab59-a83758e51a48","Type":"ContainerStarted","Data":"88129e062e56156cc89759220aca425243119d9bde51a99c7853522e8ce8c17a"} Jul 02 19:54:42.908514 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:42.907122 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-c794c79b8-mzm4h" podStartSLOduration=66.907101836 podStartE2EDuration="1m6.907101836s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:53:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:54:42.905516859 +0000 UTC m=+67.971574722" watchObservedRunningTime="2026-07-02 19:54:42.907101836 +0000 UTC m=+67.973159699" Jul 02 19:54:42.929494 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:42.929433 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-597bb6b665-89gn9" podStartSLOduration=55.929410568 podStartE2EDuration="55.929410568s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:53:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:54:42.928964105 +0000 UTC m=+67.995021965" watchObservedRunningTime="2026-07-02 19:54:42.929410568 +0000 UTC m=+67.995468431" Jul 02 19:54:42.940462 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:42.940225 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-597bb6b665-89gn9" Jul 02 19:54:42.943318 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:42.943293 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-597bb6b665-89gn9" Jul 02 19:54:43.909206 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:43.909114 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-597bb6b665-89gn9" Jul 02 19:54:43.911760 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:43.911476 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-597bb6b665-89gn9" Jul 02 19:54:44.515457 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:44.515424 2565 scope.go:117] "RemoveContainer" containerID="af620e2506915124a76b80ceaf1686e7c3c78ce666c7e47cb2a0d9a2df0d8bc7" Jul 02 19:54:44.914356 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:44.914310 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p88nv" event={"ID":"dcc079e4-e2c2-4752-a947-0ec3ce3ccab4","Type":"ContainerStarted","Data":"b10fb206f250a23358253a258674f9a58fa9f5c8d64a7d504f2025e063e6a89a"} Jul 02 19:54:44.916358 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:44.916316 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-88qmn" event={"ID":"195ee027-26f0-4912-84c7-5bce84da9e51","Type":"ContainerStarted","Data":"1a5630b7be6d5761ae9ac1b0f66d4e22328639fdb4e1fd685cd95ac36feab51d"} Jul 02 19:54:44.937532 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:44.937433 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-88qmn" podStartSLOduration=39.233969424 podStartE2EDuration="40.937410804s" totalImagesPullingTime="1.70344138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:54:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:54:44.935746674 +0000 UTC m=+70.001804536" watchObservedRunningTime="2026-07-02 19:54:44.937410804 +0000 UTC m=+70.003468668" Jul 02 19:54:45.240911 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:45.240863 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:45.330958 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:45.330901 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:45.429651 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:45.429607 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:45.530673 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:45.530641 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:47.513925 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:47.513884 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:47.580702 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:47.580666 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:48.934159 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:48.934118 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pkncj" event={"ID":"e92927e3-3534-4747-ad6e-e0df14b731d3","Type":"ContainerStarted","Data":"e623c64dbadd538bc1188ac37c8d92be72e3ef0a2b949b8c6b9b0f944dc7ffe0"} Jul 02 19:54:48.936182 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:48.936108 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fmdh8" event={"ID":"47815432-32de-40c8-bba7-01fbb22ead7c","Type":"ContainerStarted","Data":"13d1134f7606d41cf4c3ca53ff650ab1a48d3434582e962777cd5bf6ba794932"} Jul 02 19:54:48.936182 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:48.936158 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fmdh8" event={"ID":"47815432-32de-40c8-bba7-01fbb22ead7c","Type":"ContainerStarted","Data":"d8d7ae74ef6eab2408ac83df1a88c6c8429e1bdb28c9b7ffbe44b69837a4970e"} Jul 02 19:54:48.938184 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:48.938166 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-6n2jb_e50ef735-52fb-4047-8c8e-9378a771bbd3/console-operator/1.log" Jul 02 19:54:48.938303 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:48.938264 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-6n2jb" event={"ID":"e50ef735-52fb-4047-8c8e-9378a771bbd3","Type":"ContainerStarted","Data":"e9828e165817ee18d537b4dc469d46d9680fad26c0e9f19499f09e3c5593dc86"} Jul 02 19:54:48.938664 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:48.938628 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-6n2jb" Jul 02 19:54:48.940425 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:48.940222 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8265f" event={"ID":"e2878a16-7611-42fd-8bf4-4e30b6da7b82","Type":"ContainerStarted","Data":"c85eae1ce56118da1a0ac7a40f679c54bb9b7dd540602fff1218179aea86887e"} Jul 02 19:54:48.942531 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:48.942503 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-scmht" event={"ID":"746e97fe-6921-499b-87af-2a8474c0a5e6","Type":"ContainerStarted","Data":"271e33af9a596d4ca29476c16a62037fd61cb77be767f743a787b63002e2a5fc"} Jul 02 19:54:48.944532 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:48.944505 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-j6rjf" event={"ID":"d0d49ed6-ee77-432c-ab59-a83758e51a48","Type":"ContainerStarted","Data":"26cb48145d61458201e0780b308857bb543c7614d8f7c3a05aeaa78b1c188f88"} Jul 02 19:54:48.944633 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:48.944563 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-j6rjf" Jul 02 19:54:48.944633 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:48.944589 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-j6rjf" event={"ID":"d0d49ed6-ee77-432c-ab59-a83758e51a48","Type":"ContainerStarted","Data":"391dcd600afa54d609fdb2506130ca0a3e0d11dec902078ceb38096ec4bf2f6a"} Jul 02 19:54:48.946395 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:48.946376 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p88nv" event={"ID":"dcc079e4-e2c2-4752-a947-0ec3ce3ccab4","Type":"ContainerStarted","Data":"b8d328d6379c683d0561ff3e68abc82125c1498ed4a406355739e37863ef85b0"} Jul 02 19:54:48.952259 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:48.952222 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-pkncj" podStartSLOduration=66.180542029 podStartE2EDuration="1m12.952211181s" totalImagesPullingTime="6.771669152s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:53:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:54:48.951033196 +0000 UTC m=+74.017091092" watchObservedRunningTime="2026-07-02 19:54:48.952211181 +0000 UTC m=+74.018269033" Jul 02 19:54:48.954996 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:48.954929 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:48.968992 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:48.968944 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fmdh8" podStartSLOduration=55.973144785 podStartE2EDuration="1m1.968925558s" totalImagesPullingTime="5.995780773s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:53:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:54:48.967763474 +0000 UTC m=+74.033821336" watchObservedRunningTime="2026-07-02 19:54:48.968925558 +0000 UTC m=+74.034983420" Jul 02 19:54:48.984293 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:48.984244 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-j6rjf" podStartSLOduration=33.924638619 podStartE2EDuration="39.984233681s" totalImagesPullingTime="6.059595062s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:54:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:54:48.983669469 +0000 UTC m=+74.049727331" watchObservedRunningTime="2026-07-02 19:54:48.984233681 +0000 UTC m=+74.050291546" Jul 02 19:54:49.007163 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:49.007124 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-6n2jb" podStartSLOduration=52.605641454 podStartE2EDuration="1m2.007112537s" totalImagesPullingTime="9.401471083s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:53:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:54:49.006025967 +0000 UTC m=+74.072083852" watchObservedRunningTime="2026-07-02 19:54:49.007112537 +0000 UTC m=+74.073170398" Jul 02 19:54:49.024512 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:49.024465 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-p88nv" podStartSLOduration=70.867014891 podStartE2EDuration="1m13.024448149s" totalImagesPullingTime="2.157433258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:53:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:54:49.023180645 +0000 UTC m=+74.089238508" watchObservedRunningTime="2026-07-02 19:54:49.024448149 +0000 UTC m=+74.090506012" Jul 02 19:54:49.028146 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:49.028123 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:49.040267 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:49.040223 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-8265f" podStartSLOduration=55.977434719 podStartE2EDuration="1m2.040208705s" totalImagesPullingTime="6.062773986s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:53:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:54:49.039844754 +0000 UTC m=+74.105902620" watchObservedRunningTime="2026-07-02 19:54:49.040208705 +0000 UTC m=+74.106266567" Jul 02 19:54:49.061568 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:49.061532 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-scmht" podStartSLOduration=17.522639205 podStartE2EDuration="28.061518917s" totalImagesPullingTime="10.538879712s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:54:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:54:49.060718549 +0000 UTC m=+74.126776411" watchObservedRunningTime="2026-07-02 19:54:49.061518917 +0000 UTC m=+74.127576778" Jul 02 19:54:49.105857 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:49.105783 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:49.203255 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:49.203220 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:49.308468 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:49.308429 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:49.709997 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:49.709970 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-6n2jb" Jul 02 19:54:49.893209 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:49.893172 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-8z7k7"] Jul 02 19:54:49.909979 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:49.909940 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:49.918990 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:49.918964 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-8z7k7"] Jul 02 19:54:49.919136 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:49.919064 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-8z7k7" Jul 02 19:54:49.921921 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:49.921898 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-sqqxq\"" Jul 02 19:54:49.922205 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:49.922185 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 02 19:54:49.922287 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:49.922218 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 02 19:54:50.010684 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:50.010604 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:50.068123 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:50.068094 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:50.107452 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:50.107417 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ktkg\" (UniqueName: \"kubernetes.io/projected/2a48c92c-2c90-4c0b-82c5-9ef29c22c17a-kube-api-access-6ktkg\") pod \"downloads-685bfb5f64-8z7k7\" (UID: \"2a48c92c-2c90-4c0b-82c5-9ef29c22c17a\") " pod="openshift-console/downloads-685bfb5f64-8z7k7" Jul 02 19:54:50.188276 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:50.188234 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:50.208273 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:50.208248 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ktkg\" (UniqueName: \"kubernetes.io/projected/2a48c92c-2c90-4c0b-82c5-9ef29c22c17a-kube-api-access-6ktkg\") pod \"downloads-685bfb5f64-8z7k7\" (UID: \"2a48c92c-2c90-4c0b-82c5-9ef29c22c17a\") " pod="openshift-console/downloads-685bfb5f64-8z7k7" Jul 02 19:54:50.217206 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:50.217171 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ktkg\" (UniqueName: \"kubernetes.io/projected/2a48c92c-2c90-4c0b-82c5-9ef29c22c17a-kube-api-access-6ktkg\") pod \"downloads-685bfb5f64-8z7k7\" (UID: \"2a48c92c-2c90-4c0b-82c5-9ef29c22c17a\") " pod="openshift-console/downloads-685bfb5f64-8z7k7" Jul 02 19:54:50.229083 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:50.229065 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-8z7k7" Jul 02 19:54:50.376748 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:50.376719 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-8z7k7"] Jul 02 19:54:50.379950 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:54:50.379919 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a48c92c_2c90_4c0b_82c5_9ef29c22c17a.slice/crio-518c92ffe7a7004222d3060d3ed337b048a4e138b2041c5b9f1985b5f0000224 WatchSource:0}: Error finding container 518c92ffe7a7004222d3060d3ed337b048a4e138b2041c5b9f1985b5f0000224: Status 404 returned error can't find the container with id 518c92ffe7a7004222d3060d3ed337b048a4e138b2041c5b9f1985b5f0000224 Jul 02 19:54:50.381976 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:50.381926 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:50.570777 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:50.570673 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:50.632220 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:50.632183 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:50.773596 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:50.773564 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:50.831782 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:50.831698 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:50.954591 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:50.954562 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-8z7k7" event={"ID":"2a48c92c-2c90-4c0b-82c5-9ef29c22c17a","Type":"ContainerStarted","Data":"518c92ffe7a7004222d3060d3ed337b048a4e138b2041c5b9f1985b5f0000224"} Jul 02 19:54:51.785039 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:51.785006 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:51.977094 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:51.977066 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:52.122846 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:52.122758 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:52.601058 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:52.601016 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:52.660349 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:52.660314 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:53.089436 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:53.089380 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:53.167165 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:53.167128 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:53.373514 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:53.373433 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:53.498424 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:53.498385 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:53.561960 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:53.561915 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:53.618724 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:53.618689 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:53.776886 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:53.776852 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:53.879155 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:53.879119 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:53.935557 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:53.935510 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:55.638822 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:55.638782 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:55.696360 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:55.696313 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:56.038591 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:56.038555 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:58.250606 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:58.250463 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:58.364038 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:58.363992 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:58.468695 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:58.468657 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:58.492632 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:58.492600 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-r86rw"] Jul 02 19:54:58.495603 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:58.495587 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-r86rw" Jul 02 19:54:58.498657 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:58.498627 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 02 19:54:58.498751 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:58.498667 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 02 19:54:58.498751 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:58.498635 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 02 19:54:58.499606 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:58.499592 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-2xz9n\"" Jul 02 19:54:58.506723 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:58.506701 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-r86rw"] Jul 02 19:54:58.528586 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:58.528557 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-tlvh7"] Jul 02 19:54:58.530884 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:58.530868 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tlvh7" Jul 02 19:54:58.533554 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:58.533529 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-56bzk\"" Jul 02 19:54:58.533674 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:58.533528 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 02 19:54:58.533674 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:58.533653 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 02 19:54:58.533827 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:58.533811 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 02 19:54:58.568413 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:58.568377 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:58.568854 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:58.568819 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b26c314e-3e90-40ff-a7fd-175eb7f61a7c-node-exporter-textfile\") pod \"node-exporter-tlvh7\" (UID: \"b26c314e-3e90-40ff-a7fd-175eb7f61a7c\") " pod="openshift-monitoring/node-exporter-tlvh7" Jul 02 19:54:58.568980 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:58.568864 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b26c314e-3e90-40ff-a7fd-175eb7f61a7c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tlvh7\" (UID: \"b26c314e-3e90-40ff-a7fd-175eb7f61a7c\") " pod="openshift-monitoring/node-exporter-tlvh7" Jul 02 19:54:58.568980 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:58.568892 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxlkz\" (UniqueName: \"kubernetes.io/projected/b26c314e-3e90-40ff-a7fd-175eb7f61a7c-kube-api-access-sxlkz\") pod \"node-exporter-tlvh7\" (UID: \"b26c314e-3e90-40ff-a7fd-175eb7f61a7c\") " pod="openshift-monitoring/node-exporter-tlvh7" Jul 02 19:54:58.568980 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:58.568941 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6z4dt\" (UniqueName: \"kubernetes.io/projected/b895e2b1-32b3-4000-a791-fd8dfcd82d5c-kube-api-access-6z4dt\") pod \"openshift-state-metrics-54cf96dfcf-r86rw\" (UID: \"b895e2b1-32b3-4000-a791-fd8dfcd82d5c\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-r86rw" Jul 02 19:54:58.569140 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:58.568977 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b895e2b1-32b3-4000-a791-fd8dfcd82d5c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-r86rw\" (UID: \"b895e2b1-32b3-4000-a791-fd8dfcd82d5c\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-r86rw" Jul 02 19:54:58.569140 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:58.569047 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b26c314e-3e90-40ff-a7fd-175eb7f61a7c-metrics-client-ca\") pod \"node-exporter-tlvh7\" (UID: \"b26c314e-3e90-40ff-a7fd-175eb7f61a7c\") " pod="openshift-monitoring/node-exporter-tlvh7" Jul 02 19:54:58.569140 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:58.569086 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b26c314e-3e90-40ff-a7fd-175eb7f61a7c-node-exporter-wtmp\") pod \"node-exporter-tlvh7\" (UID: \"b26c314e-3e90-40ff-a7fd-175eb7f61a7c\") " pod="openshift-monitoring/node-exporter-tlvh7" Jul 02 19:54:58.569140 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:58.569116 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b895e2b1-32b3-4000-a791-fd8dfcd82d5c-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-r86rw\" (UID: \"b895e2b1-32b3-4000-a791-fd8dfcd82d5c\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-r86rw" Jul 02 19:54:58.569334 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:58.569148 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b895e2b1-32b3-4000-a791-fd8dfcd82d5c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-r86rw\" (UID: \"b895e2b1-32b3-4000-a791-fd8dfcd82d5c\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-r86rw" Jul 02 19:54:58.569334 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:58.569183 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b26c314e-3e90-40ff-a7fd-175eb7f61a7c-node-exporter-tls\") pod \"node-exporter-tlvh7\" (UID: \"b26c314e-3e90-40ff-a7fd-175eb7f61a7c\") " pod="openshift-monitoring/node-exporter-tlvh7" Jul 02 19:54:58.569334 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:58.569226 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b26c314e-3e90-40ff-a7fd-175eb7f61a7c-node-exporter-accelerators-collector-config\") pod \"node-exporter-tlvh7\" (UID: \"b26c314e-3e90-40ff-a7fd-175eb7f61a7c\") " pod="openshift-monitoring/node-exporter-tlvh7" Jul 02 19:54:58.569334 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:58.569267 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b26c314e-3e90-40ff-a7fd-175eb7f61a7c-sys\") pod \"node-exporter-tlvh7\" (UID: \"b26c314e-3e90-40ff-a7fd-175eb7f61a7c\") " pod="openshift-monitoring/node-exporter-tlvh7" Jul 02 19:54:58.569334 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:58.569300 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b26c314e-3e90-40ff-a7fd-175eb7f61a7c-root\") pod \"node-exporter-tlvh7\" (UID: \"b26c314e-3e90-40ff-a7fd-175eb7f61a7c\") " pod="openshift-monitoring/node-exporter-tlvh7" Jul 02 19:54:58.633545 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:58.633505 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:58.670541 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:58.670510 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b26c314e-3e90-40ff-a7fd-175eb7f61a7c-node-exporter-tls\") pod \"node-exporter-tlvh7\" (UID: \"b26c314e-3e90-40ff-a7fd-175eb7f61a7c\") " pod="openshift-monitoring/node-exporter-tlvh7" Jul 02 19:54:58.670541 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:58.670557 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b26c314e-3e90-40ff-a7fd-175eb7f61a7c-node-exporter-accelerators-collector-config\") pod \"node-exporter-tlvh7\" (UID: \"b26c314e-3e90-40ff-a7fd-175eb7f61a7c\") " pod="openshift-monitoring/node-exporter-tlvh7" Jul 02 19:54:58.670792 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:58.670593 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b26c314e-3e90-40ff-a7fd-175eb7f61a7c-sys\") pod \"node-exporter-tlvh7\" (UID: \"b26c314e-3e90-40ff-a7fd-175eb7f61a7c\") " pod="openshift-monitoring/node-exporter-tlvh7" Jul 02 19:54:58.670792 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:58.670624 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b26c314e-3e90-40ff-a7fd-175eb7f61a7c-root\") pod \"node-exporter-tlvh7\" (UID: \"b26c314e-3e90-40ff-a7fd-175eb7f61a7c\") " pod="openshift-monitoring/node-exporter-tlvh7" Jul 02 19:54:58.670792 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:58.670651 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b26c314e-3e90-40ff-a7fd-175eb7f61a7c-node-exporter-textfile\") pod \"node-exporter-tlvh7\" (UID: \"b26c314e-3e90-40ff-a7fd-175eb7f61a7c\") " pod="openshift-monitoring/node-exporter-tlvh7" Jul 02 19:54:58.670792 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:58.670659 2565 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 02 19:54:58.670792 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:58.670698 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b26c314e-3e90-40ff-a7fd-175eb7f61a7c-sys\") pod \"node-exporter-tlvh7\" (UID: \"b26c314e-3e90-40ff-a7fd-175eb7f61a7c\") " pod="openshift-monitoring/node-exporter-tlvh7" Jul 02 19:54:58.670792 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:58.670716 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b26c314e-3e90-40ff-a7fd-175eb7f61a7c-root\") pod \"node-exporter-tlvh7\" (UID: \"b26c314e-3e90-40ff-a7fd-175eb7f61a7c\") " pod="openshift-monitoring/node-exporter-tlvh7" Jul 02 19:54:58.670792 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:58.670734 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b26c314e-3e90-40ff-a7fd-175eb7f61a7c-node-exporter-tls podName:b26c314e-3e90-40ff-a7fd-175eb7f61a7c nodeName:}" failed. No retries permitted until 2026-07-02 19:54:59.170712385 +0000 UTC m=+84.236770240 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/b26c314e-3e90-40ff-a7fd-175eb7f61a7c-node-exporter-tls") pod "node-exporter-tlvh7" (UID: "b26c314e-3e90-40ff-a7fd-175eb7f61a7c") : secret "node-exporter-tls" not found Jul 02 19:54:58.670792 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:58.670773 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b26c314e-3e90-40ff-a7fd-175eb7f61a7c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tlvh7\" (UID: \"b26c314e-3e90-40ff-a7fd-175eb7f61a7c\") " pod="openshift-monitoring/node-exporter-tlvh7" Jul 02 19:54:58.671241 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:58.670805 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxlkz\" (UniqueName: \"kubernetes.io/projected/b26c314e-3e90-40ff-a7fd-175eb7f61a7c-kube-api-access-sxlkz\") pod \"node-exporter-tlvh7\" (UID: \"b26c314e-3e90-40ff-a7fd-175eb7f61a7c\") " pod="openshift-monitoring/node-exporter-tlvh7" Jul 02 19:54:58.671241 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:58.670833 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6z4dt\" (UniqueName: \"kubernetes.io/projected/b895e2b1-32b3-4000-a791-fd8dfcd82d5c-kube-api-access-6z4dt\") pod \"openshift-state-metrics-54cf96dfcf-r86rw\" (UID: \"b895e2b1-32b3-4000-a791-fd8dfcd82d5c\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-r86rw" Jul 02 19:54:58.671241 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:58.670860 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b895e2b1-32b3-4000-a791-fd8dfcd82d5c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-r86rw\" (UID: \"b895e2b1-32b3-4000-a791-fd8dfcd82d5c\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-r86rw" Jul 02 19:54:58.671241 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:58.670931 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b26c314e-3e90-40ff-a7fd-175eb7f61a7c-metrics-client-ca\") pod \"node-exporter-tlvh7\" (UID: \"b26c314e-3e90-40ff-a7fd-175eb7f61a7c\") " pod="openshift-monitoring/node-exporter-tlvh7" Jul 02 19:54:58.671241 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:58.670972 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b26c314e-3e90-40ff-a7fd-175eb7f61a7c-node-exporter-wtmp\") pod \"node-exporter-tlvh7\" (UID: \"b26c314e-3e90-40ff-a7fd-175eb7f61a7c\") " pod="openshift-monitoring/node-exporter-tlvh7" Jul 02 19:54:58.671241 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:58.671001 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b895e2b1-32b3-4000-a791-fd8dfcd82d5c-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-r86rw\" (UID: \"b895e2b1-32b3-4000-a791-fd8dfcd82d5c\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-r86rw" Jul 02 19:54:58.671241 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:58.671021 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b26c314e-3e90-40ff-a7fd-175eb7f61a7c-node-exporter-textfile\") pod \"node-exporter-tlvh7\" (UID: \"b26c314e-3e90-40ff-a7fd-175eb7f61a7c\") " pod="openshift-monitoring/node-exporter-tlvh7" Jul 02 19:54:58.671241 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:58.671034 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b895e2b1-32b3-4000-a791-fd8dfcd82d5c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-r86rw\" (UID: \"b895e2b1-32b3-4000-a791-fd8dfcd82d5c\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-r86rw" Jul 02 19:54:58.671241 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:58.671093 2565 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 02 19:54:58.671241 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:58.671139 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b895e2b1-32b3-4000-a791-fd8dfcd82d5c-openshift-state-metrics-tls podName:b895e2b1-32b3-4000-a791-fd8dfcd82d5c nodeName:}" failed. No retries permitted until 2026-07-02 19:54:59.17112594 +0000 UTC m=+84.237183781 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/b895e2b1-32b3-4000-a791-fd8dfcd82d5c-openshift-state-metrics-tls") pod "openshift-state-metrics-54cf96dfcf-r86rw" (UID: "b895e2b1-32b3-4000-a791-fd8dfcd82d5c") : secret "openshift-state-metrics-tls" not found Jul 02 19:54:58.671723 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:58.671253 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b26c314e-3e90-40ff-a7fd-175eb7f61a7c-node-exporter-wtmp\") pod \"node-exporter-tlvh7\" (UID: \"b26c314e-3e90-40ff-a7fd-175eb7f61a7c\") " pod="openshift-monitoring/node-exporter-tlvh7" Jul 02 19:54:58.671723 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:58.671314 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b26c314e-3e90-40ff-a7fd-175eb7f61a7c-node-exporter-accelerators-collector-config\") pod \"node-exporter-tlvh7\" (UID: \"b26c314e-3e90-40ff-a7fd-175eb7f61a7c\") " pod="openshift-monitoring/node-exporter-tlvh7" Jul 02 19:54:58.671723 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:58.671589 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b26c314e-3e90-40ff-a7fd-175eb7f61a7c-metrics-client-ca\") pod \"node-exporter-tlvh7\" (UID: \"b26c314e-3e90-40ff-a7fd-175eb7f61a7c\") " pod="openshift-monitoring/node-exporter-tlvh7" Jul 02 19:54:58.671819 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:58.671777 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b895e2b1-32b3-4000-a791-fd8dfcd82d5c-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-r86rw\" (UID: \"b895e2b1-32b3-4000-a791-fd8dfcd82d5c\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-r86rw" Jul 02 19:54:58.673108 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:58.673089 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b26c314e-3e90-40ff-a7fd-175eb7f61a7c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tlvh7\" (UID: \"b26c314e-3e90-40ff-a7fd-175eb7f61a7c\") " pod="openshift-monitoring/node-exporter-tlvh7" Jul 02 19:54:58.673216 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:58.673198 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b895e2b1-32b3-4000-a791-fd8dfcd82d5c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-r86rw\" (UID: \"b895e2b1-32b3-4000-a791-fd8dfcd82d5c\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-r86rw" Jul 02 19:54:58.681700 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:58.681670 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxlkz\" (UniqueName: \"kubernetes.io/projected/b26c314e-3e90-40ff-a7fd-175eb7f61a7c-kube-api-access-sxlkz\") pod \"node-exporter-tlvh7\" (UID: \"b26c314e-3e90-40ff-a7fd-175eb7f61a7c\") " pod="openshift-monitoring/node-exporter-tlvh7" Jul 02 19:54:58.682048 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:58.682029 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6z4dt\" (UniqueName: \"kubernetes.io/projected/b895e2b1-32b3-4000-a791-fd8dfcd82d5c-kube-api-access-6z4dt\") pod \"openshift-state-metrics-54cf96dfcf-r86rw\" (UID: \"b895e2b1-32b3-4000-a791-fd8dfcd82d5c\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-r86rw" Jul 02 19:54:58.734863 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:58.734821 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:58.835884 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:58.835790 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:58.952917 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:58.952885 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-j6rjf" Jul 02 19:54:59.020700 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:59.020653 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:59.176084 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:59.176051 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b895e2b1-32b3-4000-a791-fd8dfcd82d5c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-r86rw\" (UID: \"b895e2b1-32b3-4000-a791-fd8dfcd82d5c\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-r86rw" Jul 02 19:54:59.176248 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:59.176128 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b26c314e-3e90-40ff-a7fd-175eb7f61a7c-node-exporter-tls\") pod \"node-exporter-tlvh7\" (UID: \"b26c314e-3e90-40ff-a7fd-175eb7f61a7c\") " pod="openshift-monitoring/node-exporter-tlvh7" Jul 02 19:54:59.176248 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:59.176219 2565 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 02 19:54:59.176384 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:54:59.176283 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b895e2b1-32b3-4000-a791-fd8dfcd82d5c-openshift-state-metrics-tls podName:b895e2b1-32b3-4000-a791-fd8dfcd82d5c nodeName:}" failed. No retries permitted until 2026-07-02 19:55:00.176267771 +0000 UTC m=+85.242325610 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/b895e2b1-32b3-4000-a791-fd8dfcd82d5c-openshift-state-metrics-tls") pod "openshift-state-metrics-54cf96dfcf-r86rw" (UID: "b895e2b1-32b3-4000-a791-fd8dfcd82d5c") : secret "openshift-state-metrics-tls" not found Jul 02 19:54:59.178658 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:59.178636 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b26c314e-3e90-40ff-a7fd-175eb7f61a7c-node-exporter-tls\") pod \"node-exporter-tlvh7\" (UID: \"b26c314e-3e90-40ff-a7fd-175eb7f61a7c\") " pod="openshift-monitoring/node-exporter-tlvh7" Jul 02 19:54:59.252188 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:59.252152 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:59.352204 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:59.352162 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:59.441094 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:59.441021 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tlvh7" Jul 02 19:54:59.462728 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:59.462699 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:59.528181 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:59.528149 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:59.727677 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:59.727591 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:54:59.992251 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:54:59.992164 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tlvh7" event={"ID":"b26c314e-3e90-40ff-a7fd-175eb7f61a7c","Type":"ContainerStarted","Data":"f18a53815106f3b328928c8b64ee64c37c75e09fe7f8d7ede7e37f14b01eb0e8"} Jul 02 19:55:00.060497 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:00.060451 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:55:00.183913 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:00.183863 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b895e2b1-32b3-4000-a791-fd8dfcd82d5c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-r86rw\" (UID: \"b895e2b1-32b3-4000-a791-fd8dfcd82d5c\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-r86rw" Jul 02 19:55:00.186592 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:00.186568 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b895e2b1-32b3-4000-a791-fd8dfcd82d5c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-r86rw\" (UID: \"b895e2b1-32b3-4000-a791-fd8dfcd82d5c\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-r86rw" Jul 02 19:55:00.305190 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:00.305113 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-r86rw" Jul 02 19:55:01.475285 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:01.475245 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:55:01.581770 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:01.581735 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:55:01.681009 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:01.680975 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:55:01.801156 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:01.801071 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:55:01.885679 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:01.885636 2565 patch_prober.go:28] interesting pod/image-registry-c794c79b8-mzm4h container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 02 19:55:01.885853 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:01.885704 2565 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-c794c79b8-mzm4h" podUID="e024d650-c674-4717-a482-4bb3ca0a4a60" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 19:55:01.887725 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:01.887690 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:55:02.599679 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:02.599639 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:55:02.911618 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:02.911517 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:55:03.262745 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:03.262706 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:55:03.358927 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:03.358891 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:55:03.462006 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:03.461966 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:55:03.704919 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:03.704880 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-656f7f4d4b-pjwmg"] Jul 02 19:55:03.707386 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:03.707363 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-656f7f4d4b-pjwmg" Jul 02 19:55:03.709913 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:03.709867 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 02 19:55:03.710070 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:03.710047 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 02 19:55:03.710287 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:03.710149 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-ssh7v\"" Jul 02 19:55:03.710610 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:03.710588 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 02 19:55:03.711006 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:03.710827 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 02 19:55:03.711006 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:03.710907 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 02 19:55:03.717986 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:03.717102 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 02 19:55:03.721647 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:03.721624 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-656f7f4d4b-pjwmg"] Jul 02 19:55:03.812329 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:03.812292 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5169d1e8-28ce-4265-ade6-5001e840a37d-federate-client-tls\") pod \"telemeter-client-656f7f4d4b-pjwmg\" (UID: \"5169d1e8-28ce-4265-ade6-5001e840a37d\") " pod="openshift-monitoring/telemeter-client-656f7f4d4b-pjwmg" Jul 02 19:55:03.812543 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:03.812359 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5169d1e8-28ce-4265-ade6-5001e840a37d-serving-certs-ca-bundle\") pod \"telemeter-client-656f7f4d4b-pjwmg\" (UID: \"5169d1e8-28ce-4265-ade6-5001e840a37d\") " pod="openshift-monitoring/telemeter-client-656f7f4d4b-pjwmg" Jul 02 19:55:03.812543 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:03.812450 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5169d1e8-28ce-4265-ade6-5001e840a37d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-656f7f4d4b-pjwmg\" (UID: \"5169d1e8-28ce-4265-ade6-5001e840a37d\") " pod="openshift-monitoring/telemeter-client-656f7f4d4b-pjwmg" Jul 02 19:55:03.812543 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:03.812492 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5169d1e8-28ce-4265-ade6-5001e840a37d-secret-telemeter-client\") pod \"telemeter-client-656f7f4d4b-pjwmg\" (UID: \"5169d1e8-28ce-4265-ade6-5001e840a37d\") " pod="openshift-monitoring/telemeter-client-656f7f4d4b-pjwmg" Jul 02 19:55:03.812543 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:03.812527 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5169d1e8-28ce-4265-ade6-5001e840a37d-telemeter-client-tls\") pod \"telemeter-client-656f7f4d4b-pjwmg\" (UID: \"5169d1e8-28ce-4265-ade6-5001e840a37d\") " pod="openshift-monitoring/telemeter-client-656f7f4d4b-pjwmg" Jul 02 19:55:03.812756 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:03.812548 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5169d1e8-28ce-4265-ade6-5001e840a37d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-656f7f4d4b-pjwmg\" (UID: \"5169d1e8-28ce-4265-ade6-5001e840a37d\") " pod="openshift-monitoring/telemeter-client-656f7f4d4b-pjwmg" Jul 02 19:55:03.812756 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:03.812591 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-228pz\" (UniqueName: \"kubernetes.io/projected/5169d1e8-28ce-4265-ade6-5001e840a37d-kube-api-access-228pz\") pod \"telemeter-client-656f7f4d4b-pjwmg\" (UID: \"5169d1e8-28ce-4265-ade6-5001e840a37d\") " pod="openshift-monitoring/telemeter-client-656f7f4d4b-pjwmg" Jul 02 19:55:03.812756 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:03.812630 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5169d1e8-28ce-4265-ade6-5001e840a37d-metrics-client-ca\") pod \"telemeter-client-656f7f4d4b-pjwmg\" (UID: \"5169d1e8-28ce-4265-ade6-5001e840a37d\") " pod="openshift-monitoring/telemeter-client-656f7f4d4b-pjwmg" Jul 02 19:55:03.913134 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:03.913101 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-228pz\" (UniqueName: \"kubernetes.io/projected/5169d1e8-28ce-4265-ade6-5001e840a37d-kube-api-access-228pz\") pod \"telemeter-client-656f7f4d4b-pjwmg\" (UID: \"5169d1e8-28ce-4265-ade6-5001e840a37d\") " pod="openshift-monitoring/telemeter-client-656f7f4d4b-pjwmg" Jul 02 19:55:03.913315 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:03.913154 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5169d1e8-28ce-4265-ade6-5001e840a37d-metrics-client-ca\") pod \"telemeter-client-656f7f4d4b-pjwmg\" (UID: \"5169d1e8-28ce-4265-ade6-5001e840a37d\") " pod="openshift-monitoring/telemeter-client-656f7f4d4b-pjwmg" Jul 02 19:55:03.913315 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:03.913210 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5169d1e8-28ce-4265-ade6-5001e840a37d-federate-client-tls\") pod \"telemeter-client-656f7f4d4b-pjwmg\" (UID: \"5169d1e8-28ce-4265-ade6-5001e840a37d\") " pod="openshift-monitoring/telemeter-client-656f7f4d4b-pjwmg" Jul 02 19:55:03.913315 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:03.913245 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5169d1e8-28ce-4265-ade6-5001e840a37d-serving-certs-ca-bundle\") pod \"telemeter-client-656f7f4d4b-pjwmg\" (UID: \"5169d1e8-28ce-4265-ade6-5001e840a37d\") " pod="openshift-monitoring/telemeter-client-656f7f4d4b-pjwmg" Jul 02 19:55:03.913315 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:03.913289 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5169d1e8-28ce-4265-ade6-5001e840a37d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-656f7f4d4b-pjwmg\" (UID: \"5169d1e8-28ce-4265-ade6-5001e840a37d\") " pod="openshift-monitoring/telemeter-client-656f7f4d4b-pjwmg" Jul 02 19:55:03.913558 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:03.913321 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5169d1e8-28ce-4265-ade6-5001e840a37d-secret-telemeter-client\") pod \"telemeter-client-656f7f4d4b-pjwmg\" (UID: \"5169d1e8-28ce-4265-ade6-5001e840a37d\") " pod="openshift-monitoring/telemeter-client-656f7f4d4b-pjwmg" Jul 02 19:55:03.913558 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:03.913364 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5169d1e8-28ce-4265-ade6-5001e840a37d-telemeter-client-tls\") pod \"telemeter-client-656f7f4d4b-pjwmg\" (UID: \"5169d1e8-28ce-4265-ade6-5001e840a37d\") " pod="openshift-monitoring/telemeter-client-656f7f4d4b-pjwmg" Jul 02 19:55:03.913558 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:03.913389 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5169d1e8-28ce-4265-ade6-5001e840a37d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-656f7f4d4b-pjwmg\" (UID: \"5169d1e8-28ce-4265-ade6-5001e840a37d\") " pod="openshift-monitoring/telemeter-client-656f7f4d4b-pjwmg" Jul 02 19:55:03.914319 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:03.914000 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5169d1e8-28ce-4265-ade6-5001e840a37d-metrics-client-ca\") pod \"telemeter-client-656f7f4d4b-pjwmg\" (UID: \"5169d1e8-28ce-4265-ade6-5001e840a37d\") " pod="openshift-monitoring/telemeter-client-656f7f4d4b-pjwmg" Jul 02 19:55:03.914450 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:03.914328 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5169d1e8-28ce-4265-ade6-5001e840a37d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-656f7f4d4b-pjwmg\" (UID: \"5169d1e8-28ce-4265-ade6-5001e840a37d\") " pod="openshift-monitoring/telemeter-client-656f7f4d4b-pjwmg" Jul 02 19:55:03.914658 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:03.914635 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5169d1e8-28ce-4265-ade6-5001e840a37d-serving-certs-ca-bundle\") pod \"telemeter-client-656f7f4d4b-pjwmg\" (UID: \"5169d1e8-28ce-4265-ade6-5001e840a37d\") " pod="openshift-monitoring/telemeter-client-656f7f4d4b-pjwmg" Jul 02 19:55:03.915242 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:03.915195 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-c794c79b8-mzm4h" Jul 02 19:55:03.916319 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:03.916293 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5169d1e8-28ce-4265-ade6-5001e840a37d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-656f7f4d4b-pjwmg\" (UID: \"5169d1e8-28ce-4265-ade6-5001e840a37d\") " pod="openshift-monitoring/telemeter-client-656f7f4d4b-pjwmg" Jul 02 19:55:03.916414 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:03.916322 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5169d1e8-28ce-4265-ade6-5001e840a37d-federate-client-tls\") pod \"telemeter-client-656f7f4d4b-pjwmg\" (UID: \"5169d1e8-28ce-4265-ade6-5001e840a37d\") " pod="openshift-monitoring/telemeter-client-656f7f4d4b-pjwmg" Jul 02 19:55:03.916824 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:03.916804 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5169d1e8-28ce-4265-ade6-5001e840a37d-telemeter-client-tls\") pod \"telemeter-client-656f7f4d4b-pjwmg\" (UID: \"5169d1e8-28ce-4265-ade6-5001e840a37d\") " pod="openshift-monitoring/telemeter-client-656f7f4d4b-pjwmg" Jul 02 19:55:03.917278 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:03.917261 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5169d1e8-28ce-4265-ade6-5001e840a37d-secret-telemeter-client\") pod \"telemeter-client-656f7f4d4b-pjwmg\" (UID: \"5169d1e8-28ce-4265-ade6-5001e840a37d\") " pod="openshift-monitoring/telemeter-client-656f7f4d4b-pjwmg" Jul 02 19:55:03.923587 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:03.923564 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-228pz\" (UniqueName: \"kubernetes.io/projected/5169d1e8-28ce-4265-ade6-5001e840a37d-kube-api-access-228pz\") pod \"telemeter-client-656f7f4d4b-pjwmg\" (UID: \"5169d1e8-28ce-4265-ade6-5001e840a37d\") " pod="openshift-monitoring/telemeter-client-656f7f4d4b-pjwmg" Jul 02 19:55:04.021579 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:04.021505 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-656f7f4d4b-pjwmg" Jul 02 19:55:04.244666 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:04.244629 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:55:04.296523 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:04.296431 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:55:04.792219 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:04.792180 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:55:06.600333 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:06.600295 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:55:07.089525 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:07.089493 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-r86rw"] Jul 02 19:55:07.109821 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:07.109797 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-656f7f4d4b-pjwmg"] Jul 02 19:55:07.238829 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:55:07.238653 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb895e2b1_32b3_4000_a791_fd8dfcd82d5c.slice/crio-a8dc5e3a8cbe6812caebaadb9da432a1fb5e44da87c1874e9acc6dc3dfc43f0e WatchSource:0}: Error finding container a8dc5e3a8cbe6812caebaadb9da432a1fb5e44da87c1874e9acc6dc3dfc43f0e: Status 404 returned error can't find the container with id a8dc5e3a8cbe6812caebaadb9da432a1fb5e44da87c1874e9acc6dc3dfc43f0e Jul 02 19:55:07.239874 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:55:07.239846 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5169d1e8_28ce_4265_ade6_5001e840a37d.slice/crio-903de6fbfa3426748d30aca14f223f24ba211d24c7f5408f02942716532fb2fe WatchSource:0}: Error finding container 903de6fbfa3426748d30aca14f223f24ba211d24c7f5408f02942716532fb2fe: Status 404 returned error can't find the container with id 903de6fbfa3426748d30aca14f223f24ba211d24c7f5408f02942716532fb2fe Jul 02 19:55:07.389508 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:07.388875 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-c794c79b8-mzm4h"] Jul 02 19:55:07.468800 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:07.468774 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:55:07.569077 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:07.569026 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:55:07.635020 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:07.634980 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:55:08.039227 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:08.039139 2565 generic.go:356] "Generic (PLEG): container finished" podID="b26c314e-3e90-40ff-a7fd-175eb7f61a7c" containerID="456eba4f9b016a4816d8924a8c8c799051f6d0352449abf49d6290efa45fd11f" exitCode=0 Jul 02 19:55:08.039424 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:08.039222 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tlvh7" event={"ID":"b26c314e-3e90-40ff-a7fd-175eb7f61a7c","Type":"ContainerDied","Data":"456eba4f9b016a4816d8924a8c8c799051f6d0352449abf49d6290efa45fd11f"} Jul 02 19:55:08.041215 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:08.041183 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-656f7f4d4b-pjwmg" event={"ID":"5169d1e8-28ce-4265-ade6-5001e840a37d","Type":"ContainerStarted","Data":"903de6fbfa3426748d30aca14f223f24ba211d24c7f5408f02942716532fb2fe"} Jul 02 19:55:08.043171 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:08.043147 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-8z7k7" event={"ID":"2a48c92c-2c90-4c0b-82c5-9ef29c22c17a","Type":"ContainerStarted","Data":"bb65ab04adb22ec3678c6dd6c62fb051e79e74b1ecc11f41fc2123fb18e3ead3"} Jul 02 19:55:08.043411 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:08.043366 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-8z7k7" Jul 02 19:55:08.045980 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:08.045953 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-r86rw" event={"ID":"b895e2b1-32b3-4000-a791-fd8dfcd82d5c","Type":"ContainerStarted","Data":"8569271dc588127dc854aeebd96f0f9eb625c6d403159cef1ba837accf484316"} Jul 02 19:55:08.046081 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:08.046009 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-r86rw" event={"ID":"b895e2b1-32b3-4000-a791-fd8dfcd82d5c","Type":"ContainerStarted","Data":"06f5a75fb0f47adc24e52bba56a9bbc3809667c8910dab2db7ef6a8b60ccf693"} Jul 02 19:55:08.046081 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:08.046038 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-r86rw" event={"ID":"b895e2b1-32b3-4000-a791-fd8dfcd82d5c","Type":"ContainerStarted","Data":"a8dc5e3a8cbe6812caebaadb9da432a1fb5e44da87c1874e9acc6dc3dfc43f0e"} Jul 02 19:55:08.061730 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:08.061711 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-8z7k7" Jul 02 19:55:08.079174 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:08.079100 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-8z7k7" podStartSLOduration=2.136283333 podStartE2EDuration="19.07907963s" totalImagesPullingTime="16.942796297s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:54:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:55:08.076908199 +0000 UTC m=+93.142966060" watchObservedRunningTime="2026-07-02 19:55:08.07907963 +0000 UTC m=+93.145137492" Jul 02 19:55:09.058454 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:09.058288 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tlvh7" event={"ID":"b26c314e-3e90-40ff-a7fd-175eb7f61a7c","Type":"ContainerStarted","Data":"5cbe270ba547d1c00f7d4f9c3d08f0ea5886f069c6480eec9beb687a548bf606"} Jul 02 19:55:09.058454 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:09.058393 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tlvh7" event={"ID":"b26c314e-3e90-40ff-a7fd-175eb7f61a7c","Type":"ContainerStarted","Data":"fbc276241ec86e53a1c43bac9d6e864e26e40470226ec769abdac532027adf6e"} Jul 02 19:55:09.083202 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:09.083159 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-tlvh7" podStartSLOduration=2.716098264 podStartE2EDuration="11.083143972s" totalImagesPullingTime="8.287833196s" totalInitContainerRuntime="79.212512ms" isStatefulPod=true podCreationTimestamp="2026-07-02 19:54:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:55:09.081831902 +0000 UTC m=+94.147889764" watchObservedRunningTime="2026-07-02 19:55:09.083143972 +0000 UTC m=+94.149201832" Jul 02 19:55:10.064819 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:10.064782 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-r86rw" event={"ID":"b895e2b1-32b3-4000-a791-fd8dfcd82d5c","Type":"ContainerStarted","Data":"7823cc63fab8ba783b4f8398d3ccdc69d100e97eb019c50f61b39f59733251fb"} Jul 02 19:55:10.087534 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:10.087428 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-r86rw" podStartSLOduration=10.395852462 podStartE2EDuration="12.087403313s" totalImagesPullingTime="1.691550851s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:54:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:55:10.085042746 +0000 UTC m=+95.151100607" watchObservedRunningTime="2026-07-02 19:55:10.087403313 +0000 UTC m=+95.153461176" Jul 02 19:55:10.817952 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:10.817914 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6bbb5f5b56-sbztf"] Jul 02 19:55:10.838858 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:10.838827 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bbb5f5b56-sbztf"] Jul 02 19:55:10.839060 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:10.838964 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bbb5f5b56-sbztf" Jul 02 19:55:10.841726 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:10.841699 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 02 19:55:10.841863 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:10.841701 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-rzpxd\"" Jul 02 19:55:10.841863 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:10.841855 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 02 19:55:10.842047 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:10.841926 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 02 19:55:10.842174 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:10.842146 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 02 19:55:10.842924 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:10.842877 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 02 19:55:10.846833 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:10.846812 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 02 19:55:10.875532 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:10.875492 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhhd9\" (UniqueName: \"kubernetes.io/projected/43d5b4cb-775e-4043-afa4-60aa31bcbe7c-kube-api-access-dhhd9\") pod \"console-6bbb5f5b56-sbztf\" (UID: \"43d5b4cb-775e-4043-afa4-60aa31bcbe7c\") " pod="openshift-console/console-6bbb5f5b56-sbztf" Jul 02 19:55:10.875532 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:10.875528 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/43d5b4cb-775e-4043-afa4-60aa31bcbe7c-oauth-serving-cert\") pod \"console-6bbb5f5b56-sbztf\" (UID: \"43d5b4cb-775e-4043-afa4-60aa31bcbe7c\") " pod="openshift-console/console-6bbb5f5b56-sbztf" Jul 02 19:55:10.875903 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:10.875566 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/43d5b4cb-775e-4043-afa4-60aa31bcbe7c-console-config\") pod \"console-6bbb5f5b56-sbztf\" (UID: \"43d5b4cb-775e-4043-afa4-60aa31bcbe7c\") " pod="openshift-console/console-6bbb5f5b56-sbztf" Jul 02 19:55:10.875903 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:10.875616 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43d5b4cb-775e-4043-afa4-60aa31bcbe7c-trusted-ca-bundle\") pod \"console-6bbb5f5b56-sbztf\" (UID: \"43d5b4cb-775e-4043-afa4-60aa31bcbe7c\") " pod="openshift-console/console-6bbb5f5b56-sbztf" Jul 02 19:55:10.875903 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:10.875645 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/43d5b4cb-775e-4043-afa4-60aa31bcbe7c-console-oauth-config\") pod \"console-6bbb5f5b56-sbztf\" (UID: \"43d5b4cb-775e-4043-afa4-60aa31bcbe7c\") " pod="openshift-console/console-6bbb5f5b56-sbztf" Jul 02 19:55:10.875903 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:10.875671 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/43d5b4cb-775e-4043-afa4-60aa31bcbe7c-console-serving-cert\") pod \"console-6bbb5f5b56-sbztf\" (UID: \"43d5b4cb-775e-4043-afa4-60aa31bcbe7c\") " pod="openshift-console/console-6bbb5f5b56-sbztf" Jul 02 19:55:10.875903 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:10.875692 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/43d5b4cb-775e-4043-afa4-60aa31bcbe7c-service-ca\") pod \"console-6bbb5f5b56-sbztf\" (UID: \"43d5b4cb-775e-4043-afa4-60aa31bcbe7c\") " pod="openshift-console/console-6bbb5f5b56-sbztf" Jul 02 19:55:10.976981 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:10.976941 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhhd9\" (UniqueName: \"kubernetes.io/projected/43d5b4cb-775e-4043-afa4-60aa31bcbe7c-kube-api-access-dhhd9\") pod \"console-6bbb5f5b56-sbztf\" (UID: \"43d5b4cb-775e-4043-afa4-60aa31bcbe7c\") " pod="openshift-console/console-6bbb5f5b56-sbztf" Jul 02 19:55:10.977145 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:10.976995 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/43d5b4cb-775e-4043-afa4-60aa31bcbe7c-oauth-serving-cert\") pod \"console-6bbb5f5b56-sbztf\" (UID: \"43d5b4cb-775e-4043-afa4-60aa31bcbe7c\") " pod="openshift-console/console-6bbb5f5b56-sbztf" Jul 02 19:55:10.977145 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:10.977033 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/43d5b4cb-775e-4043-afa4-60aa31bcbe7c-console-config\") pod \"console-6bbb5f5b56-sbztf\" (UID: \"43d5b4cb-775e-4043-afa4-60aa31bcbe7c\") " pod="openshift-console/console-6bbb5f5b56-sbztf" Jul 02 19:55:10.977145 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:10.977069 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43d5b4cb-775e-4043-afa4-60aa31bcbe7c-trusted-ca-bundle\") pod \"console-6bbb5f5b56-sbztf\" (UID: \"43d5b4cb-775e-4043-afa4-60aa31bcbe7c\") " pod="openshift-console/console-6bbb5f5b56-sbztf" Jul 02 19:55:10.977145 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:10.977096 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/43d5b4cb-775e-4043-afa4-60aa31bcbe7c-console-oauth-config\") pod \"console-6bbb5f5b56-sbztf\" (UID: \"43d5b4cb-775e-4043-afa4-60aa31bcbe7c\") " pod="openshift-console/console-6bbb5f5b56-sbztf" Jul 02 19:55:10.977145 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:10.977124 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/43d5b4cb-775e-4043-afa4-60aa31bcbe7c-console-serving-cert\") pod \"console-6bbb5f5b56-sbztf\" (UID: \"43d5b4cb-775e-4043-afa4-60aa31bcbe7c\") " pod="openshift-console/console-6bbb5f5b56-sbztf" Jul 02 19:55:10.977145 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:10.977147 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/43d5b4cb-775e-4043-afa4-60aa31bcbe7c-service-ca\") pod \"console-6bbb5f5b56-sbztf\" (UID: \"43d5b4cb-775e-4043-afa4-60aa31bcbe7c\") " pod="openshift-console/console-6bbb5f5b56-sbztf" Jul 02 19:55:10.977902 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:10.977869 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/43d5b4cb-775e-4043-afa4-60aa31bcbe7c-console-config\") pod \"console-6bbb5f5b56-sbztf\" (UID: \"43d5b4cb-775e-4043-afa4-60aa31bcbe7c\") " pod="openshift-console/console-6bbb5f5b56-sbztf" Jul 02 19:55:10.978179 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:10.978100 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/43d5b4cb-775e-4043-afa4-60aa31bcbe7c-service-ca\") pod \"console-6bbb5f5b56-sbztf\" (UID: \"43d5b4cb-775e-4043-afa4-60aa31bcbe7c\") " pod="openshift-console/console-6bbb5f5b56-sbztf" Jul 02 19:55:10.978382 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:10.978324 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/43d5b4cb-775e-4043-afa4-60aa31bcbe7c-oauth-serving-cert\") pod \"console-6bbb5f5b56-sbztf\" (UID: \"43d5b4cb-775e-4043-afa4-60aa31bcbe7c\") " pod="openshift-console/console-6bbb5f5b56-sbztf" Jul 02 19:55:10.978808 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:10.978766 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43d5b4cb-775e-4043-afa4-60aa31bcbe7c-trusted-ca-bundle\") pod \"console-6bbb5f5b56-sbztf\" (UID: \"43d5b4cb-775e-4043-afa4-60aa31bcbe7c\") " pod="openshift-console/console-6bbb5f5b56-sbztf" Jul 02 19:55:10.980033 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:10.980011 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/43d5b4cb-775e-4043-afa4-60aa31bcbe7c-console-oauth-config\") pod \"console-6bbb5f5b56-sbztf\" (UID: \"43d5b4cb-775e-4043-afa4-60aa31bcbe7c\") " pod="openshift-console/console-6bbb5f5b56-sbztf" Jul 02 19:55:10.980205 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:10.980182 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/43d5b4cb-775e-4043-afa4-60aa31bcbe7c-console-serving-cert\") pod \"console-6bbb5f5b56-sbztf\" (UID: \"43d5b4cb-775e-4043-afa4-60aa31bcbe7c\") " pod="openshift-console/console-6bbb5f5b56-sbztf" Jul 02 19:55:10.986592 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:10.986572 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhhd9\" (UniqueName: \"kubernetes.io/projected/43d5b4cb-775e-4043-afa4-60aa31bcbe7c-kube-api-access-dhhd9\") pod \"console-6bbb5f5b56-sbztf\" (UID: \"43d5b4cb-775e-4043-afa4-60aa31bcbe7c\") " pod="openshift-console/console-6bbb5f5b56-sbztf" Jul 02 19:55:11.071395 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:11.071231 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-656f7f4d4b-pjwmg" event={"ID":"5169d1e8-28ce-4265-ade6-5001e840a37d","Type":"ContainerStarted","Data":"ca755b5b6c3b9ff27a84430b12026bbb65935d710ec56af9587443c94b267aa1"} Jul 02 19:55:11.151966 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:11.151751 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bbb5f5b56-sbztf" Jul 02 19:55:11.205389 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:11.205293 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:55:11.258281 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:11.258197 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:55:11.540554 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:11.540519 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bbb5f5b56-sbztf"] Jul 02 19:55:11.547139 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:55:11.547105 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43d5b4cb_775e_4043_afa4_60aa31bcbe7c.slice/crio-5688b2205b51c3c23024266c10abb1f14b0589e5b1c09b89f266d35f4425c2dd WatchSource:0}: Error finding container 5688b2205b51c3c23024266c10abb1f14b0589e5b1c09b89f266d35f4425c2dd: Status 404 returned error can't find the container with id 5688b2205b51c3c23024266c10abb1f14b0589e5b1c09b89f266d35f4425c2dd Jul 02 19:55:11.611543 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:11.611509 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:55:11.711809 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:11.711778 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:55:12.040076 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:12.040022 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:55:12.080786 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:12.080739 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bbb5f5b56-sbztf" event={"ID":"43d5b4cb-775e-4043-afa4-60aa31bcbe7c","Type":"ContainerStarted","Data":"5688b2205b51c3c23024266c10abb1f14b0589e5b1c09b89f266d35f4425c2dd"} Jul 02 19:55:12.083443 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:12.083383 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-656f7f4d4b-pjwmg" event={"ID":"5169d1e8-28ce-4265-ade6-5001e840a37d","Type":"ContainerStarted","Data":"b10c06a8af735bad00f4bdc0412ee4595b7f5db829808800ce810fc9b185f26b"} Jul 02 19:55:12.091546 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:12.091199 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:55:12.898452 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:12.898415 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-l67dn" Jul 02 19:55:13.091124 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:13.091084 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-656f7f4d4b-pjwmg" event={"ID":"5169d1e8-28ce-4265-ade6-5001e840a37d","Type":"ContainerStarted","Data":"e802a87ade84d90d9899c4bae4b72c52349ae213e0b3699b9f30d09c288778f5"} Jul 02 19:55:13.115539 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:13.115479 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-656f7f4d4b-pjwmg" podStartSLOduration=5.646666042 podStartE2EDuration="10.115457646s" totalImagesPullingTime="4.468791604s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:55:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:55:13.112707411 +0000 UTC m=+98.178765271" watchObservedRunningTime="2026-07-02 19:55:13.115457646 +0000 UTC m=+98.181515507" Jul 02 19:55:13.117505 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:13.117409 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:55:13.217454 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:13.217415 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:55:16.106840 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:16.106798 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bbb5f5b56-sbztf" event={"ID":"43d5b4cb-775e-4043-afa4-60aa31bcbe7c","Type":"ContainerStarted","Data":"c6fe4cbdfe7f8375629126448ccd82afca861ba505bbb0994e3fc8c603e8cf3b"} Jul 02 19:55:16.125088 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:16.125019 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6bbb5f5b56-sbztf" podStartSLOduration=2.251559227 podStartE2EDuration="6.125003129s" totalImagesPullingTime="3.873443902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:55:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:55:16.123541353 +0000 UTC m=+101.189599215" watchObservedRunningTime="2026-07-02 19:55:16.125003129 +0000 UTC m=+101.191060990" Jul 02 19:55:16.505300 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:16.505249 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:55:16.606699 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:16.606649 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:55:18.830565 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:18.830529 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:55:19.335996 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:19.335954 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6bbb5f5b56-sbztf"] Jul 02 19:55:20.617090 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:20.617055 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:55:20.718924 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:20.718887 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:55:21.124460 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:21.124418 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:55:21.152944 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:21.152910 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6bbb5f5b56-sbztf" Jul 02 19:55:21.220990 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:21.220951 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:55:22.407918 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:22.407880 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:55:22.462496 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:22.462464 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:55:26.149999 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:26.149967 2565 generic.go:356] "Generic (PLEG): container finished" podID="f0b96d67-4596-4666-897d-00a2e725a3e5" containerID="3ba2eaf05865511f9515770fb97ebed3b1f79d0da9b16542955a075f3679b3ec" exitCode=0 Jul 02 19:55:26.150432 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:26.150041 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-crtx8" event={"ID":"f0b96d67-4596-4666-897d-00a2e725a3e5","Type":"ContainerDied","Data":"3ba2eaf05865511f9515770fb97ebed3b1f79d0da9b16542955a075f3679b3ec"} Jul 02 19:55:26.150432 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:26.150426 2565 scope.go:117] "RemoveContainer" containerID="3ba2eaf05865511f9515770fb97ebed3b1f79d0da9b16542955a075f3679b3ec" Jul 02 19:55:27.156994 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:27.156956 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-crtx8" event={"ID":"f0b96d67-4596-4666-897d-00a2e725a3e5","Type":"ContainerStarted","Data":"e4fcc043dfdd53189f3c0b0cc178b7c1e691a432def02da9f240a748b752cc4b"} Jul 02 19:55:30.933019 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:30.932978 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:55:31.029576 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:31.029535 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:55:31.511888 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:31.511850 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:55:31.572178 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:31.572142 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:55:32.177270 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:32.177238 2565 generic.go:356] "Generic (PLEG): container finished" podID="6d5bada9-0dfe-4f19-b549-3395492c6f5a" containerID="d5c4bab2265feb2678bd641ba2367aec4edffd94ed84c7f706c2929fadda5530" exitCode=0 Jul 02 19:55:32.177763 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:32.177314 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-drhbp" event={"ID":"6d5bada9-0dfe-4f19-b549-3395492c6f5a","Type":"ContainerDied","Data":"d5c4bab2265feb2678bd641ba2367aec4edffd94ed84c7f706c2929fadda5530"} Jul 02 19:55:32.177763 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:32.177674 2565 scope.go:117] "RemoveContainer" containerID="d5c4bab2265feb2678bd641ba2367aec4edffd94ed84c7f706c2929fadda5530" Jul 02 19:55:32.413226 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:32.413179 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-c794c79b8-mzm4h" podUID="e024d650-c674-4717-a482-4bb3ca0a4a60" containerName="registry" containerID="cri-o://c490815f32dd5f3c9143cd9447289ed70a0eddeb45e80a9e99916615434186ef" gracePeriod=30 Jul 02 19:55:32.700458 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:32.700374 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c794c79b8-mzm4h" Jul 02 19:55:32.763332 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:32.763297 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e024d650-c674-4717-a482-4bb3ca0a4a60-bound-sa-token\") pod \"e024d650-c674-4717-a482-4bb3ca0a4a60\" (UID: \"e024d650-c674-4717-a482-4bb3ca0a4a60\") " Jul 02 19:55:32.763538 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:32.763357 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e024d650-c674-4717-a482-4bb3ca0a4a60-installation-pull-secrets\") pod \"e024d650-c674-4717-a482-4bb3ca0a4a60\" (UID: \"e024d650-c674-4717-a482-4bb3ca0a4a60\") " Jul 02 19:55:32.763538 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:32.763409 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e024d650-c674-4717-a482-4bb3ca0a4a60-registry-certificates\") pod \"e024d650-c674-4717-a482-4bb3ca0a4a60\" (UID: \"e024d650-c674-4717-a482-4bb3ca0a4a60\") " Jul 02 19:55:32.763538 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:32.763475 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e024d650-c674-4717-a482-4bb3ca0a4a60-ca-trust-extracted\") pod \"e024d650-c674-4717-a482-4bb3ca0a4a60\" (UID: \"e024d650-c674-4717-a482-4bb3ca0a4a60\") " Jul 02 19:55:32.763538 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:32.763511 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e024d650-c674-4717-a482-4bb3ca0a4a60-image-registry-private-configuration\") pod \"e024d650-c674-4717-a482-4bb3ca0a4a60\" (UID: \"e024d650-c674-4717-a482-4bb3ca0a4a60\") " Jul 02 19:55:32.763765 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:32.763552 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e024d650-c674-4717-a482-4bb3ca0a4a60-trusted-ca\") pod \"e024d650-c674-4717-a482-4bb3ca0a4a60\" (UID: \"e024d650-c674-4717-a482-4bb3ca0a4a60\") " Jul 02 19:55:32.763765 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:32.763585 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e024d650-c674-4717-a482-4bb3ca0a4a60-registry-tls\") pod \"e024d650-c674-4717-a482-4bb3ca0a4a60\" (UID: \"e024d650-c674-4717-a482-4bb3ca0a4a60\") " Jul 02 19:55:32.763765 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:32.763608 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m4ptl\" (UniqueName: \"kubernetes.io/projected/e024d650-c674-4717-a482-4bb3ca0a4a60-kube-api-access-m4ptl\") pod \"e024d650-c674-4717-a482-4bb3ca0a4a60\" (UID: \"e024d650-c674-4717-a482-4bb3ca0a4a60\") " Jul 02 19:55:32.763917 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:32.763866 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e024d650-c674-4717-a482-4bb3ca0a4a60-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e024d650-c674-4717-a482-4bb3ca0a4a60" (UID: "e024d650-c674-4717-a482-4bb3ca0a4a60"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:55:32.764262 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:32.764234 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e024d650-c674-4717-a482-4bb3ca0a4a60-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e024d650-c674-4717-a482-4bb3ca0a4a60" (UID: "e024d650-c674-4717-a482-4bb3ca0a4a60"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:55:32.766518 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:32.766466 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e024d650-c674-4717-a482-4bb3ca0a4a60-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e024d650-c674-4717-a482-4bb3ca0a4a60" (UID: "e024d650-c674-4717-a482-4bb3ca0a4a60"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 19:55:32.766886 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:32.766829 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e024d650-c674-4717-a482-4bb3ca0a4a60-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e024d650-c674-4717-a482-4bb3ca0a4a60" (UID: "e024d650-c674-4717-a482-4bb3ca0a4a60"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:55:32.766983 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:32.766942 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e024d650-c674-4717-a482-4bb3ca0a4a60-kube-api-access-m4ptl" (OuterVolumeSpecName: "kube-api-access-m4ptl") pod "e024d650-c674-4717-a482-4bb3ca0a4a60" (UID: "e024d650-c674-4717-a482-4bb3ca0a4a60"). InnerVolumeSpecName "kube-api-access-m4ptl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:55:32.766983 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:32.766944 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e024d650-c674-4717-a482-4bb3ca0a4a60-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e024d650-c674-4717-a482-4bb3ca0a4a60" (UID: "e024d650-c674-4717-a482-4bb3ca0a4a60"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 19:55:32.767098 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:32.767028 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e024d650-c674-4717-a482-4bb3ca0a4a60-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e024d650-c674-4717-a482-4bb3ca0a4a60" (UID: "e024d650-c674-4717-a482-4bb3ca0a4a60"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:55:32.772919 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:32.772889 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e024d650-c674-4717-a482-4bb3ca0a4a60-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e024d650-c674-4717-a482-4bb3ca0a4a60" (UID: "e024d650-c674-4717-a482-4bb3ca0a4a60"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:55:32.864658 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:32.864624 2565 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e024d650-c674-4717-a482-4bb3ca0a4a60-image-registry-private-configuration\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 19:55:32.864658 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:32.864654 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e024d650-c674-4717-a482-4bb3ca0a4a60-trusted-ca\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 19:55:32.864658 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:32.864664 2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e024d650-c674-4717-a482-4bb3ca0a4a60-registry-tls\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 19:55:32.864884 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:32.864674 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m4ptl\" (UniqueName: \"kubernetes.io/projected/e024d650-c674-4717-a482-4bb3ca0a4a60-kube-api-access-m4ptl\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 19:55:32.864884 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:32.864683 2565 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e024d650-c674-4717-a482-4bb3ca0a4a60-bound-sa-token\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 19:55:32.864884 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:32.864692 2565 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e024d650-c674-4717-a482-4bb3ca0a4a60-installation-pull-secrets\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 19:55:32.864884 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:32.864700 2565 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e024d650-c674-4717-a482-4bb3ca0a4a60-registry-certificates\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 19:55:32.864884 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:32.864708 2565 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e024d650-c674-4717-a482-4bb3ca0a4a60-ca-trust-extracted\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 19:55:33.183037 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:33.182998 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-drhbp" event={"ID":"6d5bada9-0dfe-4f19-b549-3395492c6f5a","Type":"ContainerStarted","Data":"20d4c42f8ee11ce443db64d56aa988075384e6c30c5da3dbf1159da9d8a252ba"} Jul 02 19:55:33.184318 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:33.184289 2565 generic.go:356] "Generic (PLEG): container finished" podID="e024d650-c674-4717-a482-4bb3ca0a4a60" containerID="c490815f32dd5f3c9143cd9447289ed70a0eddeb45e80a9e99916615434186ef" exitCode=0 Jul 02 19:55:33.184454 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:33.184334 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c794c79b8-mzm4h" Jul 02 19:55:33.184454 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:33.184374 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c794c79b8-mzm4h" event={"ID":"e024d650-c674-4717-a482-4bb3ca0a4a60","Type":"ContainerDied","Data":"c490815f32dd5f3c9143cd9447289ed70a0eddeb45e80a9e99916615434186ef"} Jul 02 19:55:33.184454 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:33.184428 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c794c79b8-mzm4h" event={"ID":"e024d650-c674-4717-a482-4bb3ca0a4a60","Type":"ContainerDied","Data":"45171eece8f7731cc91c27162c6f5b534390dca891fcdc5c59524f295e5d1c88"} Jul 02 19:55:33.184609 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:33.184454 2565 scope.go:117] "RemoveContainer" containerID="c490815f32dd5f3c9143cd9447289ed70a0eddeb45e80a9e99916615434186ef" Jul 02 19:55:33.193330 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:33.193314 2565 scope.go:117] "RemoveContainer" containerID="c490815f32dd5f3c9143cd9447289ed70a0eddeb45e80a9e99916615434186ef" Jul 02 19:55:33.193616 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:55:33.193596 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c490815f32dd5f3c9143cd9447289ed70a0eddeb45e80a9e99916615434186ef\": container with ID starting with c490815f32dd5f3c9143cd9447289ed70a0eddeb45e80a9e99916615434186ef not found: ID does not exist" containerID="c490815f32dd5f3c9143cd9447289ed70a0eddeb45e80a9e99916615434186ef" Jul 02 19:55:33.193687 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:33.193624 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c490815f32dd5f3c9143cd9447289ed70a0eddeb45e80a9e99916615434186ef"} err="failed to get container status \"c490815f32dd5f3c9143cd9447289ed70a0eddeb45e80a9e99916615434186ef\": rpc error: code = NotFound desc = could not find container \"c490815f32dd5f3c9143cd9447289ed70a0eddeb45e80a9e99916615434186ef\": container with ID starting with c490815f32dd5f3c9143cd9447289ed70a0eddeb45e80a9e99916615434186ef not found: ID does not exist" Jul 02 19:55:33.214631 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:33.214603 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-c794c79b8-mzm4h"] Jul 02 19:55:33.219052 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:33.219027 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-c794c79b8-mzm4h"] Jul 02 19:55:33.519889 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:33.519810 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e024d650-c674-4717-a482-4bb3ca0a4a60" path="/var/lib/kubelet/pods/e024d650-c674-4717-a482-4bb3ca0a4a60/volumes" Jul 02 19:55:37.202078 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:37.202042 2565 generic.go:356] "Generic (PLEG): container finished" podID="4cf90fa7-f624-4043-8ecc-b27547b6a98b" containerID="e36c4aac25b4d16463218d3494970dc6e159a88d4068816797d5738545f00425" exitCode=0 Jul 02 19:55:37.202078 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:37.202087 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-p9t9k" event={"ID":"4cf90fa7-f624-4043-8ecc-b27547b6a98b","Type":"ContainerDied","Data":"e36c4aac25b4d16463218d3494970dc6e159a88d4068816797d5738545f00425"} Jul 02 19:55:37.202523 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:37.202406 2565 scope.go:117] "RemoveContainer" containerID="e36c4aac25b4d16463218d3494970dc6e159a88d4068816797d5738545f00425" Jul 02 19:55:38.208998 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:38.208962 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-p9t9k" event={"ID":"4cf90fa7-f624-4043-8ecc-b27547b6a98b","Type":"ContainerStarted","Data":"24e4631c527db57bd7642cfd4d42cab870b1faf6cd1ed3bb770211a849945d1d"} Jul 02 19:55:44.355985 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:44.355947 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6bbb5f5b56-sbztf" podUID="43d5b4cb-775e-4043-afa4-60aa31bcbe7c" containerName="console" containerID="cri-o://c6fe4cbdfe7f8375629126448ccd82afca861ba505bbb0994e3fc8c603e8cf3b" gracePeriod=15 Jul 02 19:55:44.626461 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:44.626402 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bbb5f5b56-sbztf" Jul 02 19:55:44.763432 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:44.763401 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/43d5b4cb-775e-4043-afa4-60aa31bcbe7c-console-config\") pod \"43d5b4cb-775e-4043-afa4-60aa31bcbe7c\" (UID: \"43d5b4cb-775e-4043-afa4-60aa31bcbe7c\") " Jul 02 19:55:44.763432 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:44.763432 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/43d5b4cb-775e-4043-afa4-60aa31bcbe7c-console-oauth-config\") pod \"43d5b4cb-775e-4043-afa4-60aa31bcbe7c\" (UID: \"43d5b4cb-775e-4043-afa4-60aa31bcbe7c\") " Jul 02 19:55:44.763647 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:44.763460 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dhhd9\" (UniqueName: \"kubernetes.io/projected/43d5b4cb-775e-4043-afa4-60aa31bcbe7c-kube-api-access-dhhd9\") pod \"43d5b4cb-775e-4043-afa4-60aa31bcbe7c\" (UID: \"43d5b4cb-775e-4043-afa4-60aa31bcbe7c\") " Jul 02 19:55:44.763647 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:44.763517 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43d5b4cb-775e-4043-afa4-60aa31bcbe7c-trusted-ca-bundle\") pod \"43d5b4cb-775e-4043-afa4-60aa31bcbe7c\" (UID: \"43d5b4cb-775e-4043-afa4-60aa31bcbe7c\") " Jul 02 19:55:44.763647 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:44.763545 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/43d5b4cb-775e-4043-afa4-60aa31bcbe7c-console-serving-cert\") pod \"43d5b4cb-775e-4043-afa4-60aa31bcbe7c\" (UID: \"43d5b4cb-775e-4043-afa4-60aa31bcbe7c\") " Jul 02 19:55:44.763647 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:44.763571 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/43d5b4cb-775e-4043-afa4-60aa31bcbe7c-service-ca\") pod \"43d5b4cb-775e-4043-afa4-60aa31bcbe7c\" (UID: \"43d5b4cb-775e-4043-afa4-60aa31bcbe7c\") " Jul 02 19:55:44.763647 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:44.763624 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/43d5b4cb-775e-4043-afa4-60aa31bcbe7c-oauth-serving-cert\") pod \"43d5b4cb-775e-4043-afa4-60aa31bcbe7c\" (UID: \"43d5b4cb-775e-4043-afa4-60aa31bcbe7c\") " Jul 02 19:55:44.763919 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:44.763798 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43d5b4cb-775e-4043-afa4-60aa31bcbe7c-console-config" (OuterVolumeSpecName: "console-config") pod "43d5b4cb-775e-4043-afa4-60aa31bcbe7c" (UID: "43d5b4cb-775e-4043-afa4-60aa31bcbe7c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:55:44.764084 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:44.764055 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43d5b4cb-775e-4043-afa4-60aa31bcbe7c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "43d5b4cb-775e-4043-afa4-60aa31bcbe7c" (UID: "43d5b4cb-775e-4043-afa4-60aa31bcbe7c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:55:44.764158 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:44.764075 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43d5b4cb-775e-4043-afa4-60aa31bcbe7c-service-ca" (OuterVolumeSpecName: "service-ca") pod "43d5b4cb-775e-4043-afa4-60aa31bcbe7c" (UID: "43d5b4cb-775e-4043-afa4-60aa31bcbe7c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:55:44.764218 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:44.764176 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43d5b4cb-775e-4043-afa4-60aa31bcbe7c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "43d5b4cb-775e-4043-afa4-60aa31bcbe7c" (UID: "43d5b4cb-775e-4043-afa4-60aa31bcbe7c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:55:44.765793 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:44.765770 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43d5b4cb-775e-4043-afa4-60aa31bcbe7c-kube-api-access-dhhd9" (OuterVolumeSpecName: "kube-api-access-dhhd9") pod "43d5b4cb-775e-4043-afa4-60aa31bcbe7c" (UID: "43d5b4cb-775e-4043-afa4-60aa31bcbe7c"). InnerVolumeSpecName "kube-api-access-dhhd9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:55:44.765973 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:44.765960 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43d5b4cb-775e-4043-afa4-60aa31bcbe7c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "43d5b4cb-775e-4043-afa4-60aa31bcbe7c" (UID: "43d5b4cb-775e-4043-afa4-60aa31bcbe7c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 19:55:44.766076 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:44.766050 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43d5b4cb-775e-4043-afa4-60aa31bcbe7c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "43d5b4cb-775e-4043-afa4-60aa31bcbe7c" (UID: "43d5b4cb-775e-4043-afa4-60aa31bcbe7c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 19:55:44.864766 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:44.864733 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/43d5b4cb-775e-4043-afa4-60aa31bcbe7c-console-config\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 19:55:44.864766 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:44.864760 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/43d5b4cb-775e-4043-afa4-60aa31bcbe7c-console-oauth-config\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 19:55:44.864766 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:44.864771 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dhhd9\" (UniqueName: \"kubernetes.io/projected/43d5b4cb-775e-4043-afa4-60aa31bcbe7c-kube-api-access-dhhd9\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 19:55:44.864959 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:44.864780 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43d5b4cb-775e-4043-afa4-60aa31bcbe7c-trusted-ca-bundle\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 19:55:44.864959 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:44.864789 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/43d5b4cb-775e-4043-afa4-60aa31bcbe7c-console-serving-cert\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 19:55:44.864959 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:44.864797 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/43d5b4cb-775e-4043-afa4-60aa31bcbe7c-service-ca\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 19:55:44.864959 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:44.864805 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/43d5b4cb-775e-4043-afa4-60aa31bcbe7c-oauth-serving-cert\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 19:55:45.237831 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:45.237790 2565 generic.go:356] "Generic (PLEG): container finished" podID="43d5b4cb-775e-4043-afa4-60aa31bcbe7c" containerID="c6fe4cbdfe7f8375629126448ccd82afca861ba505bbb0994e3fc8c603e8cf3b" exitCode=0 Jul 02 19:55:45.238025 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:45.237841 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bbb5f5b56-sbztf" Jul 02 19:55:45.238025 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:45.237883 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bbb5f5b56-sbztf" event={"ID":"43d5b4cb-775e-4043-afa4-60aa31bcbe7c","Type":"ContainerDied","Data":"c6fe4cbdfe7f8375629126448ccd82afca861ba505bbb0994e3fc8c603e8cf3b"} Jul 02 19:55:45.238025 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:45.237940 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bbb5f5b56-sbztf" event={"ID":"43d5b4cb-775e-4043-afa4-60aa31bcbe7c","Type":"ContainerDied","Data":"5688b2205b51c3c23024266c10abb1f14b0589e5b1c09b89f266d35f4425c2dd"} Jul 02 19:55:45.238025 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:45.237962 2565 scope.go:117] "RemoveContainer" containerID="c6fe4cbdfe7f8375629126448ccd82afca861ba505bbb0994e3fc8c603e8cf3b" Jul 02 19:55:45.246669 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:45.246651 2565 scope.go:117] "RemoveContainer" containerID="c6fe4cbdfe7f8375629126448ccd82afca861ba505bbb0994e3fc8c603e8cf3b" Jul 02 19:55:45.246923 ip-10-0-128-177 kubenswrapper[2565]: E0702 19:55:45.246903 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6fe4cbdfe7f8375629126448ccd82afca861ba505bbb0994e3fc8c603e8cf3b\": container with ID starting with c6fe4cbdfe7f8375629126448ccd82afca861ba505bbb0994e3fc8c603e8cf3b not found: ID does not exist" containerID="c6fe4cbdfe7f8375629126448ccd82afca861ba505bbb0994e3fc8c603e8cf3b" Jul 02 19:55:45.246964 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:45.246931 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6fe4cbdfe7f8375629126448ccd82afca861ba505bbb0994e3fc8c603e8cf3b"} err="failed to get container status \"c6fe4cbdfe7f8375629126448ccd82afca861ba505bbb0994e3fc8c603e8cf3b\": rpc error: code = NotFound desc = could not find container \"c6fe4cbdfe7f8375629126448ccd82afca861ba505bbb0994e3fc8c603e8cf3b\": container with ID starting with c6fe4cbdfe7f8375629126448ccd82afca861ba505bbb0994e3fc8c603e8cf3b not found: ID does not exist" Jul 02 19:55:45.259193 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:45.259167 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6bbb5f5b56-sbztf"] Jul 02 19:55:45.262846 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:45.262827 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6bbb5f5b56-sbztf"] Jul 02 19:55:45.519652 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:55:45.519581 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43d5b4cb-775e-4043-afa4-60aa31bcbe7c" path="/var/lib/kubelet/pods/43d5b4cb-775e-4043-afa4-60aa31bcbe7c/volumes" Jul 02 19:56:14.615757 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:14.615718 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:56:14.684530 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:14.684499 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:56:20.828450 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:20.826241 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 19:56:20.828450 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:20.826714 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e024d650-c674-4717-a482-4bb3ca0a4a60" containerName="registry" Jul 02 19:56:20.828450 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:20.826731 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e024d650-c674-4717-a482-4bb3ca0a4a60" containerName="registry" Jul 02 19:56:20.828450 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:20.826758 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43d5b4cb-775e-4043-afa4-60aa31bcbe7c" containerName="console" Jul 02 19:56:20.828450 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:20.826767 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="43d5b4cb-775e-4043-afa4-60aa31bcbe7c" containerName="console" Jul 02 19:56:20.828450 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:20.826839 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="43d5b4cb-775e-4043-afa4-60aa31bcbe7c" containerName="console" Jul 02 19:56:20.828450 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:20.826850 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e024d650-c674-4717-a482-4bb3ca0a4a60" containerName="registry" Jul 02 19:56:20.830780 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:20.830758 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:56:20.834300 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:20.834279 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 02 19:56:20.834427 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:20.834280 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 02 19:56:20.834427 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:20.834288 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 02 19:56:20.834604 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:20.834587 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 02 19:56:20.835037 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:20.835020 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 02 19:56:20.835121 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:20.835079 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 02 19:56:20.835578 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:20.835555 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 02 19:56:20.835686 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:20.835578 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 02 19:56:20.835758 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:20.835708 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-k7jz5\"" Jul 02 19:56:20.841143 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:20.841125 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 02 19:56:20.844133 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:20.844111 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 19:56:20.932633 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:20.932605 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:56:20.932786 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:20.932642 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6-config-volume\") pod \"alertmanager-main-0\" (UID: \"3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:56:20.932786 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:20.932676 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6-web-config\") pod \"alertmanager-main-0\" (UID: \"3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:56:20.932786 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:20.932735 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:56:20.932949 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:20.932797 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:56:20.932949 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:20.932831 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mbpm\" (UniqueName: \"kubernetes.io/projected/3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6-kube-api-access-6mbpm\") pod \"alertmanager-main-0\" (UID: \"3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:56:20.932949 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:20.932869 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:56:20.932949 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:20.932897 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:56:20.932949 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:20.932926 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:56:20.933139 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:20.932955 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6-config-out\") pod \"alertmanager-main-0\" (UID: \"3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:56:20.933139 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:20.932982 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:56:20.933139 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:20.933023 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:56:20.933139 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:20.933058 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:56:21.034051 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:21.034005 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6-config-out\") pod \"alertmanager-main-0\" (UID: \"3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:56:21.034051 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:21.034054 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:56:21.034245 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:21.034176 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:56:21.034245 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:21.034230 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:56:21.034399 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:21.034375 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:56:21.034465 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:21.034438 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6-config-volume\") pod \"alertmanager-main-0\" (UID: \"3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:56:21.034523 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:21.034482 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6-web-config\") pod \"alertmanager-main-0\" (UID: \"3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:56:21.034523 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:21.034507 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:56:21.034647 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:21.034547 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:56:21.034647 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:21.034579 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mbpm\" (UniqueName: \"kubernetes.io/projected/3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6-kube-api-access-6mbpm\") pod \"alertmanager-main-0\" (UID: \"3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:56:21.034647 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:21.034619 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:56:21.034647 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:21.034646 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:56:21.034844 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:21.034674 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:56:21.035105 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:21.035077 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:56:21.035536 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:21.035311 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:56:21.035998 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:21.035798 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:56:21.037191 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:21.037107 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6-config-out\") pod \"alertmanager-main-0\" (UID: \"3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:56:21.037191 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:21.037116 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6-web-config\") pod \"alertmanager-main-0\" (UID: \"3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:56:21.037365 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:21.037282 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:56:21.037365 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:21.037294 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:56:21.037857 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:21.037838 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:56:21.038098 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:21.038069 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6-config-volume\") pod \"alertmanager-main-0\" (UID: \"3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:56:21.038203 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:21.038186 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:56:21.038276 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:21.038255 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:56:21.039114 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:21.039096 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:56:21.044273 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:21.044253 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mbpm\" (UniqueName: \"kubernetes.io/projected/3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6-kube-api-access-6mbpm\") pod \"alertmanager-main-0\" (UID: \"3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:56:21.140525 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:21.140439 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:56:21.276647 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:21.276627 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 19:56:21.278919 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:56:21.278891 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c1dc8a9_cb25_440f_bcd1_5312f8f4d8c6.slice/crio-85ef8a47e6ce3f8f56d5a4f481f919db6ed06c8b98f4f45c7835c13eef52c3c5 WatchSource:0}: Error finding container 85ef8a47e6ce3f8f56d5a4f481f919db6ed06c8b98f4f45c7835c13eef52c3c5: Status 404 returned error can't find the container with id 85ef8a47e6ce3f8f56d5a4f481f919db6ed06c8b98f4f45c7835c13eef52c3c5 Jul 02 19:56:21.375122 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:21.375094 2565 generic.go:356] "Generic (PLEG): container finished" podID="3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6" containerID="b8c5e04627b46b5f9920ffee7a9a19d947d1e3d0206acd0ee9d78935acc79a51" exitCode=0 Jul 02 19:56:21.375239 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:21.375174 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6","Type":"ContainerDied","Data":"b8c5e04627b46b5f9920ffee7a9a19d947d1e3d0206acd0ee9d78935acc79a51"} Jul 02 19:56:21.375290 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:21.375256 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6","Type":"ContainerStarted","Data":"85ef8a47e6ce3f8f56d5a4f481f919db6ed06c8b98f4f45c7835c13eef52c3c5"} Jul 02 19:56:23.385805 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:23.385770 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6","Type":"ContainerStarted","Data":"a43ded6287acfbbf72f5ded73b3339eafff16f8a295e27ef79a621ec648e8784"} Jul 02 19:56:23.386148 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:23.385859 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6","Type":"ContainerStarted","Data":"fe513f6dc1d5286c1febba64bb506e0444f9de670d9ba78713867838a8594b03"} Jul 02 19:56:23.386148 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:23.385886 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6","Type":"ContainerStarted","Data":"68309027c86947b098500854b7f6d0e55a381ed1928c21cac78acae4b72324c2"} Jul 02 19:56:23.386148 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:23.385911 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6","Type":"ContainerStarted","Data":"2c1f4ea2805fa1ee4809083459fffdb70153d2b01640f07adedc0db1e5638feb"} Jul 02 19:56:23.386148 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:23.385934 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6","Type":"ContainerStarted","Data":"c895c2fe75d5c442cfdf6a5d3eeb5dedbc883162207888dfd7202e5afc974713"} Jul 02 19:56:24.393477 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:24.393443 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6","Type":"ContainerStarted","Data":"f608426d85ca38cb7593636817333560b95eaf1d4797029882e3611665641fa6"} Jul 02 19:56:24.421308 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:24.421259 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.861259244 podStartE2EDuration="4.421243769s" totalImagesPullingTime="2.545185187s" totalInitContainerRuntime="14.799338ms" isStatefulPod=false podCreationTimestamp="2026-07-02 19:56:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:56:24.419993847 +0000 UTC m=+169.486051733" watchObservedRunningTime="2026-07-02 19:56:24.421243769 +0000 UTC m=+169.487301629" Jul 02 19:56:26.590043 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:26.590005 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:56:26.645877 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:26.645845 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:56:31.517408 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:31.517312 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:56:31.617895 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:31.617866 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:56:38.575793 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:38.575753 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:56:38.637102 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:38.637067 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:56:44.535748 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:44.535710 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:56:49.149261 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:49.149220 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:56:49.249653 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:49.249617 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:56:49.349352 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:56:49.349314 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:12.577242 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:12.577209 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:12.672913 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:12.672878 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:13.302751 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:13.302723 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jlfxb"] Jul 02 19:57:13.305317 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:13.305301 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jlfxb" Jul 02 19:57:13.308046 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:13.308020 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zjwmg\"" Jul 02 19:57:13.308165 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:13.308020 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 02 19:57:13.309093 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:13.309077 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 02 19:57:13.314239 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:13.314217 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jlfxb"] Jul 02 19:57:13.359439 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:13.359408 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a903ab50-1121-4714-af68-4635ca73c002-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jlfxb\" (UID: \"a903ab50-1121-4714-af68-4635ca73c002\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jlfxb" Jul 02 19:57:13.359574 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:13.359456 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a903ab50-1121-4714-af68-4635ca73c002-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jlfxb\" (UID: \"a903ab50-1121-4714-af68-4635ca73c002\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jlfxb" Jul 02 19:57:13.359574 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:13.359479 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26nbk\" (UniqueName: \"kubernetes.io/projected/a903ab50-1121-4714-af68-4635ca73c002-kube-api-access-26nbk\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jlfxb\" (UID: \"a903ab50-1121-4714-af68-4635ca73c002\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jlfxb" Jul 02 19:57:13.460807 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:13.460778 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a903ab50-1121-4714-af68-4635ca73c002-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jlfxb\" (UID: \"a903ab50-1121-4714-af68-4635ca73c002\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jlfxb" Jul 02 19:57:13.460896 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:13.460816 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26nbk\" (UniqueName: \"kubernetes.io/projected/a903ab50-1121-4714-af68-4635ca73c002-kube-api-access-26nbk\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jlfxb\" (UID: \"a903ab50-1121-4714-af68-4635ca73c002\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jlfxb" Jul 02 19:57:13.460896 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:13.460872 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a903ab50-1121-4714-af68-4635ca73c002-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jlfxb\" (UID: \"a903ab50-1121-4714-af68-4635ca73c002\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jlfxb" Jul 02 19:57:13.461225 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:13.461210 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a903ab50-1121-4714-af68-4635ca73c002-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jlfxb\" (UID: \"a903ab50-1121-4714-af68-4635ca73c002\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jlfxb" Jul 02 19:57:13.461271 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:13.461206 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a903ab50-1121-4714-af68-4635ca73c002-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jlfxb\" (UID: \"a903ab50-1121-4714-af68-4635ca73c002\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jlfxb" Jul 02 19:57:13.469241 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:13.469214 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-26nbk\" (UniqueName: \"kubernetes.io/projected/a903ab50-1121-4714-af68-4635ca73c002-kube-api-access-26nbk\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jlfxb\" (UID: \"a903ab50-1121-4714-af68-4635ca73c002\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jlfxb" Jul 02 19:57:13.615389 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:13.615305 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jlfxb" Jul 02 19:57:13.745632 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:13.745603 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jlfxb"] Jul 02 19:57:13.748954 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:57:13.748924 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda903ab50_1121_4714_af68_4635ca73c002.slice/crio-685f8f7c58705fe0458e0af0529b457f2fba400ceabc87ec6cb320ba0eb9c4d8 WatchSource:0}: Error finding container 685f8f7c58705fe0458e0af0529b457f2fba400ceabc87ec6cb320ba0eb9c4d8: Status 404 returned error can't find the container with id 685f8f7c58705fe0458e0af0529b457f2fba400ceabc87ec6cb320ba0eb9c4d8 Jul 02 19:57:14.583102 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:14.583061 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jlfxb" event={"ID":"a903ab50-1121-4714-af68-4635ca73c002","Type":"ContainerStarted","Data":"685f8f7c58705fe0458e0af0529b457f2fba400ceabc87ec6cb320ba0eb9c4d8"} Jul 02 19:57:20.611104 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:20.611065 2565 generic.go:356] "Generic (PLEG): container finished" podID="a903ab50-1121-4714-af68-4635ca73c002" containerID="2d0cb5fe6d511a12e3d37a0cdd60c89655472a35ac3b02e716a11debe9c9253a" exitCode=0 Jul 02 19:57:20.611514 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:20.611144 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jlfxb" event={"ID":"a903ab50-1121-4714-af68-4635ca73c002","Type":"ContainerDied","Data":"2d0cb5fe6d511a12e3d37a0cdd60c89655472a35ac3b02e716a11debe9c9253a"} Jul 02 19:57:22.621390 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:22.621336 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jlfxb" event={"ID":"a903ab50-1121-4714-af68-4635ca73c002","Type":"ContainerStarted","Data":"f4fcff2432b31cf244fafca24198a9d54b2b69c81e74c296d54f0e4181efd183"} Jul 02 19:57:23.627319 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:23.627283 2565 generic.go:356] "Generic (PLEG): container finished" podID="a903ab50-1121-4714-af68-4635ca73c002" containerID="f4fcff2432b31cf244fafca24198a9d54b2b69c81e74c296d54f0e4181efd183" exitCode=0 Jul 02 19:57:23.627740 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:23.627361 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jlfxb" event={"ID":"a903ab50-1121-4714-af68-4635ca73c002","Type":"ContainerDied","Data":"f4fcff2432b31cf244fafca24198a9d54b2b69c81e74c296d54f0e4181efd183"} Jul 02 19:57:28.189017 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:28.188971 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:28.245531 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:28.245495 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:30.661900 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:30.661875 2565 generic.go:356] "Generic (PLEG): container finished" podID="a903ab50-1121-4714-af68-4635ca73c002" containerID="3dbf74888603af99673f2ee8c2ba1133a3d1f0303d178cda3da84a5295cd43cd" exitCode=0 Jul 02 19:57:30.662254 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:30.661958 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jlfxb" event={"ID":"a903ab50-1121-4714-af68-4635ca73c002","Type":"ContainerDied","Data":"3dbf74888603af99673f2ee8c2ba1133a3d1f0303d178cda3da84a5295cd43cd"} Jul 02 19:57:31.796010 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:31.795987 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jlfxb" Jul 02 19:57:31.925544 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:31.925521 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a903ab50-1121-4714-af68-4635ca73c002-bundle\") pod \"a903ab50-1121-4714-af68-4635ca73c002\" (UID: \"a903ab50-1121-4714-af68-4635ca73c002\") " Jul 02 19:57:31.925710 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:31.925581 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a903ab50-1121-4714-af68-4635ca73c002-util\") pod \"a903ab50-1121-4714-af68-4635ca73c002\" (UID: \"a903ab50-1121-4714-af68-4635ca73c002\") " Jul 02 19:57:31.925710 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:31.925620 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-26nbk\" (UniqueName: \"kubernetes.io/projected/a903ab50-1121-4714-af68-4635ca73c002-kube-api-access-26nbk\") pod \"a903ab50-1121-4714-af68-4635ca73c002\" (UID: \"a903ab50-1121-4714-af68-4635ca73c002\") " Jul 02 19:57:31.926184 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:31.926160 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a903ab50-1121-4714-af68-4635ca73c002-bundle" (OuterVolumeSpecName: "bundle") pod "a903ab50-1121-4714-af68-4635ca73c002" (UID: "a903ab50-1121-4714-af68-4635ca73c002"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:57:31.927712 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:31.927691 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a903ab50-1121-4714-af68-4635ca73c002-kube-api-access-26nbk" (OuterVolumeSpecName: "kube-api-access-26nbk") pod "a903ab50-1121-4714-af68-4635ca73c002" (UID: "a903ab50-1121-4714-af68-4635ca73c002"). InnerVolumeSpecName "kube-api-access-26nbk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:57:31.930514 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:31.930494 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a903ab50-1121-4714-af68-4635ca73c002-util" (OuterVolumeSpecName: "util") pod "a903ab50-1121-4714-af68-4635ca73c002" (UID: "a903ab50-1121-4714-af68-4635ca73c002"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:57:32.026274 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:32.026233 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a903ab50-1121-4714-af68-4635ca73c002-util\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 19:57:32.026274 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:32.026267 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-26nbk\" (UniqueName: \"kubernetes.io/projected/a903ab50-1121-4714-af68-4635ca73c002-kube-api-access-26nbk\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 19:57:32.026274 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:32.026277 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a903ab50-1121-4714-af68-4635ca73c002-bundle\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 19:57:32.676770 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:32.676741 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jlfxb" Jul 02 19:57:32.676938 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:32.676746 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jlfxb" event={"ID":"a903ab50-1121-4714-af68-4635ca73c002","Type":"ContainerDied","Data":"685f8f7c58705fe0458e0af0529b457f2fba400ceabc87ec6cb320ba0eb9c4d8"} Jul 02 19:57:32.676938 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:32.676874 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="685f8f7c58705fe0458e0af0529b457f2fba400ceabc87ec6cb320ba0eb9c4d8" Jul 02 19:57:34.320020 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:34.319970 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:35.359210 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:35.359172 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:37.926854 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:37.926797 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:38.026544 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:38.026492 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:40.323751 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:40.323701 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:40.420904 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:40.420868 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:40.441204 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:40.441173 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-47wq4"] Jul 02 19:57:40.441523 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:40.441509 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a903ab50-1121-4714-af68-4635ca73c002" containerName="extract" Jul 02 19:57:40.441571 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:40.441525 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a903ab50-1121-4714-af68-4635ca73c002" containerName="extract" Jul 02 19:57:40.441571 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:40.441536 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a903ab50-1121-4714-af68-4635ca73c002" containerName="pull" Jul 02 19:57:40.441571 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:40.441541 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a903ab50-1121-4714-af68-4635ca73c002" containerName="pull" Jul 02 19:57:40.441571 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:40.441552 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a903ab50-1121-4714-af68-4635ca73c002" containerName="util" Jul 02 19:57:40.441571 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:40.441557 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a903ab50-1121-4714-af68-4635ca73c002" containerName="util" Jul 02 19:57:40.441764 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:40.441609 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a903ab50-1121-4714-af68-4635ca73c002" containerName="extract" Jul 02 19:57:40.444892 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:40.444874 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-47wq4" Jul 02 19:57:40.450624 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:40.450604 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 02 19:57:40.451798 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:40.451776 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-5q424\"" Jul 02 19:57:40.451891 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:40.451776 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 02 19:57:40.464129 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:40.464099 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-47wq4"] Jul 02 19:57:40.499585 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:40.499548 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ec336d19-f03d-438f-a513-cce675eea89d-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-47wq4\" (UID: \"ec336d19-f03d-438f-a513-cce675eea89d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-47wq4" Jul 02 19:57:40.499757 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:40.499596 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g499k\" (UniqueName: \"kubernetes.io/projected/ec336d19-f03d-438f-a513-cce675eea89d-kube-api-access-g499k\") pod \"cert-manager-webhook-6486ffd997-47wq4\" (UID: \"ec336d19-f03d-438f-a513-cce675eea89d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-47wq4" Jul 02 19:57:40.565732 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:40.565701 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:40.599987 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:40.599931 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g499k\" (UniqueName: \"kubernetes.io/projected/ec336d19-f03d-438f-a513-cce675eea89d-kube-api-access-g499k\") pod \"cert-manager-webhook-6486ffd997-47wq4\" (UID: \"ec336d19-f03d-438f-a513-cce675eea89d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-47wq4" Jul 02 19:57:40.600073 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:40.600003 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ec336d19-f03d-438f-a513-cce675eea89d-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-47wq4\" (UID: \"ec336d19-f03d-438f-a513-cce675eea89d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-47wq4" Jul 02 19:57:40.618512 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:40.618480 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ec336d19-f03d-438f-a513-cce675eea89d-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-47wq4\" (UID: \"ec336d19-f03d-438f-a513-cce675eea89d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-47wq4" Jul 02 19:57:40.619249 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:40.619231 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g499k\" (UniqueName: \"kubernetes.io/projected/ec336d19-f03d-438f-a513-cce675eea89d-kube-api-access-g499k\") pod \"cert-manager-webhook-6486ffd997-47wq4\" (UID: \"ec336d19-f03d-438f-a513-cce675eea89d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-47wq4" Jul 02 19:57:40.681117 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:40.681087 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:40.767769 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:40.767742 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-47wq4" Jul 02 19:57:40.913681 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:40.913605 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-47wq4"] Jul 02 19:57:40.917698 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:57:40.917663 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podec336d19_f03d_438f_a513_cce675eea89d.slice/crio-2c6fcf5eca7436b186b4ca0ba82bb24579c7d24dd59ebd757037c520af0f8e9b WatchSource:0}: Error finding container 2c6fcf5eca7436b186b4ca0ba82bb24579c7d24dd59ebd757037c520af0f8e9b: Status 404 returned error can't find the container with id 2c6fcf5eca7436b186b4ca0ba82bb24579c7d24dd59ebd757037c520af0f8e9b Jul 02 19:57:41.216172 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:41.216135 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6f59p"] Jul 02 19:57:41.219381 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:41.219360 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6f59p" Jul 02 19:57:41.222127 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:41.222107 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 02 19:57:41.223252 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:41.223230 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zjwmg\"" Jul 02 19:57:41.223371 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:41.223278 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 02 19:57:41.233528 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:41.233507 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6f59p"] Jul 02 19:57:41.304846 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:41.304808 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8cc2f557-0496-4027-b793-b8b276b9f99b-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6f59p\" (UID: \"8cc2f557-0496-4027-b793-b8b276b9f99b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6f59p" Jul 02 19:57:41.304982 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:41.304859 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jr698\" (UniqueName: \"kubernetes.io/projected/8cc2f557-0496-4027-b793-b8b276b9f99b-kube-api-access-jr698\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6f59p\" (UID: \"8cc2f557-0496-4027-b793-b8b276b9f99b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6f59p" Jul 02 19:57:41.304982 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:41.304954 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8cc2f557-0496-4027-b793-b8b276b9f99b-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6f59p\" (UID: \"8cc2f557-0496-4027-b793-b8b276b9f99b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6f59p" Jul 02 19:57:41.405742 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:41.405705 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8cc2f557-0496-4027-b793-b8b276b9f99b-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6f59p\" (UID: \"8cc2f557-0496-4027-b793-b8b276b9f99b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6f59p" Jul 02 19:57:41.406244 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:41.405775 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8cc2f557-0496-4027-b793-b8b276b9f99b-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6f59p\" (UID: \"8cc2f557-0496-4027-b793-b8b276b9f99b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6f59p" Jul 02 19:57:41.406244 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:41.405823 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr698\" (UniqueName: \"kubernetes.io/projected/8cc2f557-0496-4027-b793-b8b276b9f99b-kube-api-access-jr698\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6f59p\" (UID: \"8cc2f557-0496-4027-b793-b8b276b9f99b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6f59p" Jul 02 19:57:41.406244 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:41.406110 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8cc2f557-0496-4027-b793-b8b276b9f99b-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6f59p\" (UID: \"8cc2f557-0496-4027-b793-b8b276b9f99b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6f59p" Jul 02 19:57:41.406244 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:41.406165 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8cc2f557-0496-4027-b793-b8b276b9f99b-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6f59p\" (UID: \"8cc2f557-0496-4027-b793-b8b276b9f99b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6f59p" Jul 02 19:57:41.415325 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:41.415292 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jr698\" (UniqueName: \"kubernetes.io/projected/8cc2f557-0496-4027-b793-b8b276b9f99b-kube-api-access-jr698\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6f59p\" (UID: \"8cc2f557-0496-4027-b793-b8b276b9f99b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6f59p" Jul 02 19:57:41.529087 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:41.529020 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6f59p" Jul 02 19:57:41.689233 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:41.689205 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6f59p"] Jul 02 19:57:41.690889 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:57:41.690857 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cc2f557_0496_4027_b793_b8b276b9f99b.slice/crio-bf64f5d89bd0037afcfc4e1ac41e5eeb52c0f7842b5f0ec31c415b6ad4c109b6 WatchSource:0}: Error finding container bf64f5d89bd0037afcfc4e1ac41e5eeb52c0f7842b5f0ec31c415b6ad4c109b6: Status 404 returned error can't find the container with id bf64f5d89bd0037afcfc4e1ac41e5eeb52c0f7842b5f0ec31c415b6ad4c109b6 Jul 02 19:57:41.716054 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:41.716022 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6f59p" event={"ID":"8cc2f557-0496-4027-b793-b8b276b9f99b","Type":"ContainerStarted","Data":"bf64f5d89bd0037afcfc4e1ac41e5eeb52c0f7842b5f0ec31c415b6ad4c109b6"} Jul 02 19:57:41.717403 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:41.717358 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-47wq4" event={"ID":"ec336d19-f03d-438f-a513-cce675eea89d","Type":"ContainerStarted","Data":"2c6fcf5eca7436b186b4ca0ba82bb24579c7d24dd59ebd757037c520af0f8e9b"} Jul 02 19:57:42.378953 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:42.378920 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:42.723322 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:42.723289 2565 generic.go:356] "Generic (PLEG): container finished" podID="8cc2f557-0496-4027-b793-b8b276b9f99b" containerID="1754ddc1ee6a8dba4eb65d71bda208c44244957a36bcd05ca1f2c3783eba3328" exitCode=0 Jul 02 19:57:42.723758 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:42.723372 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6f59p" event={"ID":"8cc2f557-0496-4027-b793-b8b276b9f99b","Type":"ContainerDied","Data":"1754ddc1ee6a8dba4eb65d71bda208c44244957a36bcd05ca1f2c3783eba3328"} Jul 02 19:57:42.727723 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:42.727701 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:43.205078 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:43.205042 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-xtj6t"] Jul 02 19:57:43.207453 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:43.207436 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xtj6t" Jul 02 19:57:43.211195 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:43.211174 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-gbcgm\"" Jul 02 19:57:43.217994 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:43.217964 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9tvg\" (UniqueName: \"kubernetes.io/projected/99458bea-e529-4886-91cb-841ecc2e790d-kube-api-access-g9tvg\") pod \"cert-manager-cainjector-559cdd8c87-xtj6t\" (UID: \"99458bea-e529-4886-91cb-841ecc2e790d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xtj6t" Jul 02 19:57:43.218102 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:43.218050 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/99458bea-e529-4886-91cb-841ecc2e790d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-xtj6t\" (UID: \"99458bea-e529-4886-91cb-841ecc2e790d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xtj6t" Jul 02 19:57:43.218457 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:43.218433 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-xtj6t"] Jul 02 19:57:43.318817 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:43.318788 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9tvg\" (UniqueName: \"kubernetes.io/projected/99458bea-e529-4886-91cb-841ecc2e790d-kube-api-access-g9tvg\") pod \"cert-manager-cainjector-559cdd8c87-xtj6t\" (UID: \"99458bea-e529-4886-91cb-841ecc2e790d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xtj6t" Jul 02 19:57:43.318926 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:43.318892 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/99458bea-e529-4886-91cb-841ecc2e790d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-xtj6t\" (UID: \"99458bea-e529-4886-91cb-841ecc2e790d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xtj6t" Jul 02 19:57:43.328119 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:43.328092 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/99458bea-e529-4886-91cb-841ecc2e790d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-xtj6t\" (UID: \"99458bea-e529-4886-91cb-841ecc2e790d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xtj6t" Jul 02 19:57:43.328403 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:43.328381 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9tvg\" (UniqueName: \"kubernetes.io/projected/99458bea-e529-4886-91cb-841ecc2e790d-kube-api-access-g9tvg\") pod \"cert-manager-cainjector-559cdd8c87-xtj6t\" (UID: \"99458bea-e529-4886-91cb-841ecc2e790d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xtj6t" Jul 02 19:57:43.516115 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:43.516025 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xtj6t" Jul 02 19:57:43.679396 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:43.679373 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-xtj6t"] Jul 02 19:57:43.681787 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:57:43.681758 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod99458bea_e529_4886_91cb_841ecc2e790d.slice/crio-6e655442a465416d8e1215695ac2e4009dd30ebd7b0156c68e7ec0fb3bd979be WatchSource:0}: Error finding container 6e655442a465416d8e1215695ac2e4009dd30ebd7b0156c68e7ec0fb3bd979be: Status 404 returned error can't find the container with id 6e655442a465416d8e1215695ac2e4009dd30ebd7b0156c68e7ec0fb3bd979be Jul 02 19:57:43.730927 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:43.730883 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xtj6t" event={"ID":"99458bea-e529-4886-91cb-841ecc2e790d","Type":"ContainerStarted","Data":"6e655442a465416d8e1215695ac2e4009dd30ebd7b0156c68e7ec0fb3bd979be"} Jul 02 19:57:43.732895 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:43.732871 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-47wq4" event={"ID":"ec336d19-f03d-438f-a513-cce675eea89d","Type":"ContainerStarted","Data":"c2bdc8f0b9c3dcbbb4d12502c020127fe4a3dee068d2f8ddc8163e4cfee1fa0e"} Jul 02 19:57:43.733024 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:43.732976 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-47wq4" Jul 02 19:57:43.753006 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:43.752955 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-47wq4" podStartSLOduration=1.427704004 podStartE2EDuration="3.75293656s" totalImagesPullingTime="2.325232556s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:57:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:57:43.750975211 +0000 UTC m=+248.817033075" watchObservedRunningTime="2026-07-02 19:57:43.75293656 +0000 UTC m=+248.818994424" Jul 02 19:57:44.732071 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:44.732047 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:44.741408 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:44.741379 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xtj6t" event={"ID":"99458bea-e529-4886-91cb-841ecc2e790d","Type":"ContainerStarted","Data":"e7672891ea4b285eae8344563c43b82cc1146ad9a27607d995bcaf4c3ccd42c1"} Jul 02 19:57:44.759397 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:44.759357 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xtj6t" podStartSLOduration=1.759326943 podStartE2EDuration="1.759326943s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:57:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:57:44.757242082 +0000 UTC m=+249.823299945" watchObservedRunningTime="2026-07-02 19:57:44.759326943 +0000 UTC m=+249.825384804" Jul 02 19:57:44.832331 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:44.832304 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:45.747205 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:45.747170 2565 generic.go:356] "Generic (PLEG): container finished" podID="8cc2f557-0496-4027-b793-b8b276b9f99b" containerID="39131f2ace3d60e1ee89e5dbe60294de3ffdbdf8bfc65aa22cc3a2f30600dda4" exitCode=0 Jul 02 19:57:45.747586 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:45.747250 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6f59p" event={"ID":"8cc2f557-0496-4027-b793-b8b276b9f99b","Type":"ContainerDied","Data":"39131f2ace3d60e1ee89e5dbe60294de3ffdbdf8bfc65aa22cc3a2f30600dda4"} Jul 02 19:57:46.753299 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:46.753255 2565 generic.go:356] "Generic (PLEG): container finished" podID="8cc2f557-0496-4027-b793-b8b276b9f99b" containerID="7b7d5e4df661516558a151bed9a148084f487623add38a0ab590e7fc4354d52b" exitCode=0 Jul 02 19:57:46.753716 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:46.753361 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6f59p" event={"ID":"8cc2f557-0496-4027-b793-b8b276b9f99b","Type":"ContainerDied","Data":"7b7d5e4df661516558a151bed9a148084f487623add38a0ab590e7fc4354d52b"} Jul 02 19:57:47.882166 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:47.882140 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6f59p" Jul 02 19:57:47.960025 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:47.959994 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8cc2f557-0496-4027-b793-b8b276b9f99b-util\") pod \"8cc2f557-0496-4027-b793-b8b276b9f99b\" (UID: \"8cc2f557-0496-4027-b793-b8b276b9f99b\") " Jul 02 19:57:47.960144 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:47.960033 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8cc2f557-0496-4027-b793-b8b276b9f99b-bundle\") pod \"8cc2f557-0496-4027-b793-b8b276b9f99b\" (UID: \"8cc2f557-0496-4027-b793-b8b276b9f99b\") " Jul 02 19:57:47.960144 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:47.960092 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jr698\" (UniqueName: \"kubernetes.io/projected/8cc2f557-0496-4027-b793-b8b276b9f99b-kube-api-access-jr698\") pod \"8cc2f557-0496-4027-b793-b8b276b9f99b\" (UID: \"8cc2f557-0496-4027-b793-b8b276b9f99b\") " Jul 02 19:57:47.960443 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:47.960420 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8cc2f557-0496-4027-b793-b8b276b9f99b-bundle" (OuterVolumeSpecName: "bundle") pod "8cc2f557-0496-4027-b793-b8b276b9f99b" (UID: "8cc2f557-0496-4027-b793-b8b276b9f99b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:57:47.962052 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:47.962029 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8cc2f557-0496-4027-b793-b8b276b9f99b-kube-api-access-jr698" (OuterVolumeSpecName: "kube-api-access-jr698") pod "8cc2f557-0496-4027-b793-b8b276b9f99b" (UID: "8cc2f557-0496-4027-b793-b8b276b9f99b"). InnerVolumeSpecName "kube-api-access-jr698". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:57:47.964664 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:47.964623 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8cc2f557-0496-4027-b793-b8b276b9f99b-util" (OuterVolumeSpecName: "util") pod "8cc2f557-0496-4027-b793-b8b276b9f99b" (UID: "8cc2f557-0496-4027-b793-b8b276b9f99b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:57:48.060716 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:48.060649 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jr698\" (UniqueName: \"kubernetes.io/projected/8cc2f557-0496-4027-b793-b8b276b9f99b-kube-api-access-jr698\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 19:57:48.060716 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:48.060673 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8cc2f557-0496-4027-b793-b8b276b9f99b-util\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 19:57:48.060716 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:48.060683 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8cc2f557-0496-4027-b793-b8b276b9f99b-bundle\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 19:57:48.763277 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:48.763252 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6f59p" Jul 02 19:57:48.763459 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:48.763278 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6f59p" event={"ID":"8cc2f557-0496-4027-b793-b8b276b9f99b","Type":"ContainerDied","Data":"bf64f5d89bd0037afcfc4e1ac41e5eeb52c0f7842b5f0ec31c415b6ad4c109b6"} Jul 02 19:57:48.763459 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:48.763317 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bf64f5d89bd0037afcfc4e1ac41e5eeb52c0f7842b5f0ec31c415b6ad4c109b6" Jul 02 19:57:49.744142 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:49.744114 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-47wq4" Jul 02 19:57:50.923114 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:50.923084 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:52.123287 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:52.123250 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:52.221128 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:52.221089 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:52.540963 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:57:52.540923 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:07.017939 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:07.017860 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:07.076353 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:07.076317 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:12.049125 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:12.049091 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:12.150714 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:12.150666 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:12.868670 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:12.868635 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv2fls"] Jul 02 19:58:12.868991 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:12.868979 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cc2f557-0496-4027-b793-b8b276b9f99b" containerName="pull" Jul 02 19:58:12.869037 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:12.868992 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cc2f557-0496-4027-b793-b8b276b9f99b" containerName="pull" Jul 02 19:58:12.869037 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:12.869003 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cc2f557-0496-4027-b793-b8b276b9f99b" containerName="extract" Jul 02 19:58:12.869037 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:12.869009 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cc2f557-0496-4027-b793-b8b276b9f99b" containerName="extract" Jul 02 19:58:12.869037 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:12.869017 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cc2f557-0496-4027-b793-b8b276b9f99b" containerName="util" Jul 02 19:58:12.869037 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:12.869022 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cc2f557-0496-4027-b793-b8b276b9f99b" containerName="util" Jul 02 19:58:12.869182 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:12.869081 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8cc2f557-0496-4027-b793-b8b276b9f99b" containerName="extract" Jul 02 19:58:12.871404 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:12.871389 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv2fls" Jul 02 19:58:12.874180 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:12.874158 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 02 19:58:12.874293 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:12.874254 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 02 19:58:12.875412 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:12.875391 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zjwmg\"" Jul 02 19:58:12.880867 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:12.880845 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv2fls"] Jul 02 19:58:12.972791 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:12.972751 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2685a99b-63a4-4f52-8bce-0d54428e9e48-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv2fls\" (UID: \"2685a99b-63a4-4f52-8bce-0d54428e9e48\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv2fls" Jul 02 19:58:12.972966 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:12.972843 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2685a99b-63a4-4f52-8bce-0d54428e9e48-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv2fls\" (UID: \"2685a99b-63a4-4f52-8bce-0d54428e9e48\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv2fls" Jul 02 19:58:12.972966 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:12.972867 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9lx5\" (UniqueName: \"kubernetes.io/projected/2685a99b-63a4-4f52-8bce-0d54428e9e48-kube-api-access-k9lx5\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv2fls\" (UID: \"2685a99b-63a4-4f52-8bce-0d54428e9e48\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv2fls" Jul 02 19:58:13.073416 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:13.073382 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2685a99b-63a4-4f52-8bce-0d54428e9e48-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv2fls\" (UID: \"2685a99b-63a4-4f52-8bce-0d54428e9e48\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv2fls" Jul 02 19:58:13.073881 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:13.073420 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9lx5\" (UniqueName: \"kubernetes.io/projected/2685a99b-63a4-4f52-8bce-0d54428e9e48-kube-api-access-k9lx5\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv2fls\" (UID: \"2685a99b-63a4-4f52-8bce-0d54428e9e48\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv2fls" Jul 02 19:58:13.073881 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:13.073466 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2685a99b-63a4-4f52-8bce-0d54428e9e48-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv2fls\" (UID: \"2685a99b-63a4-4f52-8bce-0d54428e9e48\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv2fls" Jul 02 19:58:13.073881 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:13.073816 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2685a99b-63a4-4f52-8bce-0d54428e9e48-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv2fls\" (UID: \"2685a99b-63a4-4f52-8bce-0d54428e9e48\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv2fls" Jul 02 19:58:13.073881 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:13.073833 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2685a99b-63a4-4f52-8bce-0d54428e9e48-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv2fls\" (UID: \"2685a99b-63a4-4f52-8bce-0d54428e9e48\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv2fls" Jul 02 19:58:13.082182 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:13.082152 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9lx5\" (UniqueName: \"kubernetes.io/projected/2685a99b-63a4-4f52-8bce-0d54428e9e48-kube-api-access-k9lx5\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv2fls\" (UID: \"2685a99b-63a4-4f52-8bce-0d54428e9e48\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv2fls" Jul 02 19:58:13.181051 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:13.181017 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv2fls" Jul 02 19:58:13.312447 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:13.312394 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv2fls"] Jul 02 19:58:13.314883 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:58:13.314857 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2685a99b_63a4_4f52_8bce_0d54428e9e48.slice/crio-b5668deb27ab4dfb376889415e34d9918d00c2d7ef5b848c4d79975fdce5e20b WatchSource:0}: Error finding container b5668deb27ab4dfb376889415e34d9918d00c2d7ef5b848c4d79975fdce5e20b: Status 404 returned error can't find the container with id b5668deb27ab4dfb376889415e34d9918d00c2d7ef5b848c4d79975fdce5e20b Jul 02 19:58:13.874138 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:13.874044 2565 generic.go:356] "Generic (PLEG): container finished" podID="2685a99b-63a4-4f52-8bce-0d54428e9e48" containerID="a9d552b78e62e2c80d7a4e22bec648adedf5211201e0a46477a3220f9fae4802" exitCode=0 Jul 02 19:58:13.874304 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:13.874131 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv2fls" event={"ID":"2685a99b-63a4-4f52-8bce-0d54428e9e48","Type":"ContainerDied","Data":"a9d552b78e62e2c80d7a4e22bec648adedf5211201e0a46477a3220f9fae4802"} Jul 02 19:58:13.874304 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:13.874224 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv2fls" event={"ID":"2685a99b-63a4-4f52-8bce-0d54428e9e48","Type":"ContainerStarted","Data":"b5668deb27ab4dfb376889415e34d9918d00c2d7ef5b848c4d79975fdce5e20b"} Jul 02 19:58:14.115729 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:14.115696 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:14.880715 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:14.880620 2565 generic.go:356] "Generic (PLEG): container finished" podID="2685a99b-63a4-4f52-8bce-0d54428e9e48" containerID="5779aa137d2d58f07a69b0beaf025f0c156c9a9b17dc7e99338f6f45de7c2bbd" exitCode=0 Jul 02 19:58:14.880715 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:14.880655 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv2fls" event={"ID":"2685a99b-63a4-4f52-8bce-0d54428e9e48","Type":"ContainerDied","Data":"5779aa137d2d58f07a69b0beaf025f0c156c9a9b17dc7e99338f6f45de7c2bbd"} Jul 02 19:58:15.886952 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:15.886912 2565 generic.go:356] "Generic (PLEG): container finished" podID="2685a99b-63a4-4f52-8bce-0d54428e9e48" containerID="5cf9c8511939591f4b1649dcc3b7b6186dcbbe432de4bdb7d3382649e1e9c44a" exitCode=0 Jul 02 19:58:15.887320 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:15.886980 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv2fls" event={"ID":"2685a99b-63a4-4f52-8bce-0d54428e9e48","Type":"ContainerDied","Data":"5cf9c8511939591f4b1649dcc3b7b6186dcbbe432de4bdb7d3382649e1e9c44a"} Jul 02 19:58:17.022492 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:17.022470 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv2fls" Jul 02 19:58:17.108522 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:17.108495 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2685a99b-63a4-4f52-8bce-0d54428e9e48-bundle\") pod \"2685a99b-63a4-4f52-8bce-0d54428e9e48\" (UID: \"2685a99b-63a4-4f52-8bce-0d54428e9e48\") " Jul 02 19:58:17.108522 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:17.108527 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2685a99b-63a4-4f52-8bce-0d54428e9e48-util\") pod \"2685a99b-63a4-4f52-8bce-0d54428e9e48\" (UID: \"2685a99b-63a4-4f52-8bce-0d54428e9e48\") " Jul 02 19:58:17.108724 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:17.108568 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k9lx5\" (UniqueName: \"kubernetes.io/projected/2685a99b-63a4-4f52-8bce-0d54428e9e48-kube-api-access-k9lx5\") pod \"2685a99b-63a4-4f52-8bce-0d54428e9e48\" (UID: \"2685a99b-63a4-4f52-8bce-0d54428e9e48\") " Jul 02 19:58:17.109376 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:17.109323 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2685a99b-63a4-4f52-8bce-0d54428e9e48-bundle" (OuterVolumeSpecName: "bundle") pod "2685a99b-63a4-4f52-8bce-0d54428e9e48" (UID: "2685a99b-63a4-4f52-8bce-0d54428e9e48"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:58:17.110527 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:17.110502 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2685a99b-63a4-4f52-8bce-0d54428e9e48-kube-api-access-k9lx5" (OuterVolumeSpecName: "kube-api-access-k9lx5") pod "2685a99b-63a4-4f52-8bce-0d54428e9e48" (UID: "2685a99b-63a4-4f52-8bce-0d54428e9e48"). InnerVolumeSpecName "kube-api-access-k9lx5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:58:17.114305 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:17.114264 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2685a99b-63a4-4f52-8bce-0d54428e9e48-util" (OuterVolumeSpecName: "util") pod "2685a99b-63a4-4f52-8bce-0d54428e9e48" (UID: "2685a99b-63a4-4f52-8bce-0d54428e9e48"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:58:17.209560 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:17.209535 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2685a99b-63a4-4f52-8bce-0d54428e9e48-bundle\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 19:58:17.209560 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:17.209557 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2685a99b-63a4-4f52-8bce-0d54428e9e48-util\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 19:58:17.209685 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:17.209566 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k9lx5\" (UniqueName: \"kubernetes.io/projected/2685a99b-63a4-4f52-8bce-0d54428e9e48-kube-api-access-k9lx5\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 19:58:17.898112 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:17.898036 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv2fls" event={"ID":"2685a99b-63a4-4f52-8bce-0d54428e9e48","Type":"ContainerDied","Data":"b5668deb27ab4dfb376889415e34d9918d00c2d7ef5b848c4d79975fdce5e20b"} Jul 02 19:58:17.898112 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:17.898075 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv2fls" Jul 02 19:58:17.898112 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:17.898085 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b5668deb27ab4dfb376889415e34d9918d00c2d7ef5b848c4d79975fdce5e20b" Jul 02 19:58:28.835286 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:28.835251 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:28.939732 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:28.939696 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:29.474036 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:29.474006 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:29.711822 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:29.711788 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:29.817805 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:29.817719 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:29.882918 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:29.882885 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-844d4f46fb-58m7p"] Jul 02 19:58:29.883266 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:29.883192 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2685a99b-63a4-4f52-8bce-0d54428e9e48" containerName="pull" Jul 02 19:58:29.883266 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:29.883203 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2685a99b-63a4-4f52-8bce-0d54428e9e48" containerName="pull" Jul 02 19:58:29.883266 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:29.883219 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2685a99b-63a4-4f52-8bce-0d54428e9e48" containerName="extract" Jul 02 19:58:29.883266 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:29.883224 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2685a99b-63a4-4f52-8bce-0d54428e9e48" containerName="extract" Jul 02 19:58:29.883266 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:29.883239 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2685a99b-63a4-4f52-8bce-0d54428e9e48" containerName="util" Jul 02 19:58:29.883266 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:29.883244 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2685a99b-63a4-4f52-8bce-0d54428e9e48" containerName="util" Jul 02 19:58:29.883480 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:29.883298 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2685a99b-63a4-4f52-8bce-0d54428e9e48" containerName="extract" Jul 02 19:58:29.886269 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:29.886249 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-844d4f46fb-58m7p" Jul 02 19:58:29.891281 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:29.891255 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 02 19:58:29.891798 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:29.891778 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 02 19:58:29.892026 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:29.892011 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-dmrc8\"" Jul 02 19:58:29.892280 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:29.892259 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 02 19:58:29.892388 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:29.892368 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 02 19:58:29.900630 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:29.900603 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-844d4f46fb-58m7p"] Jul 02 19:58:30.015915 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:30.015880 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/19d584c3-2f10-42b5-9739-371214597476-tmp\") pod \"opendatahub-operator-controller-manager-844d4f46fb-58m7p\" (UID: \"19d584c3-2f10-42b5-9739-371214597476\") " pod="opendatahub/opendatahub-operator-controller-manager-844d4f46fb-58m7p" Jul 02 19:58:30.016110 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:30.015939 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/19d584c3-2f10-42b5-9739-371214597476-apiservice-cert\") pod \"opendatahub-operator-controller-manager-844d4f46fb-58m7p\" (UID: \"19d584c3-2f10-42b5-9739-371214597476\") " pod="opendatahub/opendatahub-operator-controller-manager-844d4f46fb-58m7p" Jul 02 19:58:30.016110 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:30.015970 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/19d584c3-2f10-42b5-9739-371214597476-webhook-cert\") pod \"opendatahub-operator-controller-manager-844d4f46fb-58m7p\" (UID: \"19d584c3-2f10-42b5-9739-371214597476\") " pod="opendatahub/opendatahub-operator-controller-manager-844d4f46fb-58m7p" Jul 02 19:58:30.016110 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:30.015994 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/19d584c3-2f10-42b5-9739-371214597476-manifests\") pod \"opendatahub-operator-controller-manager-844d4f46fb-58m7p\" (UID: \"19d584c3-2f10-42b5-9739-371214597476\") " pod="opendatahub/opendatahub-operator-controller-manager-844d4f46fb-58m7p" Jul 02 19:58:30.016110 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:30.016061 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jxdl\" (UniqueName: \"kubernetes.io/projected/19d584c3-2f10-42b5-9739-371214597476-kube-api-access-9jxdl\") pod \"opendatahub-operator-controller-manager-844d4f46fb-58m7p\" (UID: \"19d584c3-2f10-42b5-9739-371214597476\") " pod="opendatahub/opendatahub-operator-controller-manager-844d4f46fb-58m7p" Jul 02 19:58:30.016982 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:30.016952 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:30.117076 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:30.116993 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/19d584c3-2f10-42b5-9739-371214597476-tmp\") pod \"opendatahub-operator-controller-manager-844d4f46fb-58m7p\" (UID: \"19d584c3-2f10-42b5-9739-371214597476\") " pod="opendatahub/opendatahub-operator-controller-manager-844d4f46fb-58m7p" Jul 02 19:58:30.117076 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:30.117048 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/19d584c3-2f10-42b5-9739-371214597476-apiservice-cert\") pod \"opendatahub-operator-controller-manager-844d4f46fb-58m7p\" (UID: \"19d584c3-2f10-42b5-9739-371214597476\") " pod="opendatahub/opendatahub-operator-controller-manager-844d4f46fb-58m7p" Jul 02 19:58:30.117076 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:30.117074 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/19d584c3-2f10-42b5-9739-371214597476-webhook-cert\") pod \"opendatahub-operator-controller-manager-844d4f46fb-58m7p\" (UID: \"19d584c3-2f10-42b5-9739-371214597476\") " pod="opendatahub/opendatahub-operator-controller-manager-844d4f46fb-58m7p" Jul 02 19:58:30.117311 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:30.117092 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/19d584c3-2f10-42b5-9739-371214597476-manifests\") pod \"opendatahub-operator-controller-manager-844d4f46fb-58m7p\" (UID: \"19d584c3-2f10-42b5-9739-371214597476\") " pod="opendatahub/opendatahub-operator-controller-manager-844d4f46fb-58m7p" Jul 02 19:58:30.117311 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:30.117132 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jxdl\" (UniqueName: \"kubernetes.io/projected/19d584c3-2f10-42b5-9739-371214597476-kube-api-access-9jxdl\") pod \"opendatahub-operator-controller-manager-844d4f46fb-58m7p\" (UID: \"19d584c3-2f10-42b5-9739-371214597476\") " pod="opendatahub/opendatahub-operator-controller-manager-844d4f46fb-58m7p" Jul 02 19:58:30.117579 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:30.117554 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/19d584c3-2f10-42b5-9739-371214597476-manifests\") pod \"opendatahub-operator-controller-manager-844d4f46fb-58m7p\" (UID: \"19d584c3-2f10-42b5-9739-371214597476\") " pod="opendatahub/opendatahub-operator-controller-manager-844d4f46fb-58m7p" Jul 02 19:58:30.119406 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:30.119371 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/19d584c3-2f10-42b5-9739-371214597476-tmp\") pod \"opendatahub-operator-controller-manager-844d4f46fb-58m7p\" (UID: \"19d584c3-2f10-42b5-9739-371214597476\") " pod="opendatahub/opendatahub-operator-controller-manager-844d4f46fb-58m7p" Jul 02 19:58:30.119829 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:30.119790 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/19d584c3-2f10-42b5-9739-371214597476-apiservice-cert\") pod \"opendatahub-operator-controller-manager-844d4f46fb-58m7p\" (UID: \"19d584c3-2f10-42b5-9739-371214597476\") " pod="opendatahub/opendatahub-operator-controller-manager-844d4f46fb-58m7p" Jul 02 19:58:30.119947 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:30.119868 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/19d584c3-2f10-42b5-9739-371214597476-webhook-cert\") pod \"opendatahub-operator-controller-manager-844d4f46fb-58m7p\" (UID: \"19d584c3-2f10-42b5-9739-371214597476\") " pod="opendatahub/opendatahub-operator-controller-manager-844d4f46fb-58m7p" Jul 02 19:58:30.120069 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:30.120050 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:30.126505 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:30.126485 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jxdl\" (UniqueName: \"kubernetes.io/projected/19d584c3-2f10-42b5-9739-371214597476-kube-api-access-9jxdl\") pod \"opendatahub-operator-controller-manager-844d4f46fb-58m7p\" (UID: \"19d584c3-2f10-42b5-9739-371214597476\") " pod="opendatahub/opendatahub-operator-controller-manager-844d4f46fb-58m7p" Jul 02 19:58:30.196696 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:30.196667 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-844d4f46fb-58m7p" Jul 02 19:58:30.254265 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:30.254226 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:30.341591 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:30.341568 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-844d4f46fb-58m7p"] Jul 02 19:58:30.343589 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:58:30.343557 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19d584c3_2f10_42b5_9739_371214597476.slice/crio-6416d6a37dc51adf2b7fe50b08b72d44a11d57f8274a738e69d8d57bfbd8781d WatchSource:0}: Error finding container 6416d6a37dc51adf2b7fe50b08b72d44a11d57f8274a738e69d8d57bfbd8781d: Status 404 returned error can't find the container with id 6416d6a37dc51adf2b7fe50b08b72d44a11d57f8274a738e69d8d57bfbd8781d Jul 02 19:58:30.356876 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:30.356843 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:30.477219 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:30.477185 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:30.584999 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:30.584952 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:30.605502 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:30.605467 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-56c987df7b-x68np"] Jul 02 19:58:30.609891 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:30.609874 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-56c987df7b-x68np" Jul 02 19:58:30.613088 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:30.613064 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 02 19:58:30.613305 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:30.613281 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 02 19:58:30.613446 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:30.613396 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 02 19:58:30.613631 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:30.613609 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 02 19:58:30.613724 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:30.613706 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-tq2kn\"" Jul 02 19:58:30.613724 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:30.613715 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 02 19:58:30.627049 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:30.627025 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-56c987df7b-x68np"] Jul 02 19:58:30.682707 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:30.682673 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:30.723282 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:30.723248 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d12d140d-6423-425f-9a7b-4e957128b06b-metrics-cert\") pod \"lws-controller-manager-56c987df7b-x68np\" (UID: \"d12d140d-6423-425f-9a7b-4e957128b06b\") " pod="openshift-lws-operator/lws-controller-manager-56c987df7b-x68np" Jul 02 19:58:30.723448 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:30.723363 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d12d140d-6423-425f-9a7b-4e957128b06b-manager-config\") pod \"lws-controller-manager-56c987df7b-x68np\" (UID: \"d12d140d-6423-425f-9a7b-4e957128b06b\") " pod="openshift-lws-operator/lws-controller-manager-56c987df7b-x68np" Jul 02 19:58:30.723448 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:30.723403 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d12d140d-6423-425f-9a7b-4e957128b06b-cert\") pod \"lws-controller-manager-56c987df7b-x68np\" (UID: \"d12d140d-6423-425f-9a7b-4e957128b06b\") " pod="openshift-lws-operator/lws-controller-manager-56c987df7b-x68np" Jul 02 19:58:30.723448 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:30.723425 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5d8s\" (UniqueName: \"kubernetes.io/projected/d12d140d-6423-425f-9a7b-4e957128b06b-kube-api-access-j5d8s\") pod \"lws-controller-manager-56c987df7b-x68np\" (UID: \"d12d140d-6423-425f-9a7b-4e957128b06b\") " pod="openshift-lws-operator/lws-controller-manager-56c987df7b-x68np" Jul 02 19:58:30.781739 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:30.781654 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:30.824621 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:30.824589 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d12d140d-6423-425f-9a7b-4e957128b06b-metrics-cert\") pod \"lws-controller-manager-56c987df7b-x68np\" (UID: \"d12d140d-6423-425f-9a7b-4e957128b06b\") " pod="openshift-lws-operator/lws-controller-manager-56c987df7b-x68np" Jul 02 19:58:30.824736 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:30.824664 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d12d140d-6423-425f-9a7b-4e957128b06b-manager-config\") pod \"lws-controller-manager-56c987df7b-x68np\" (UID: \"d12d140d-6423-425f-9a7b-4e957128b06b\") " pod="openshift-lws-operator/lws-controller-manager-56c987df7b-x68np" Jul 02 19:58:30.824736 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:30.824685 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d12d140d-6423-425f-9a7b-4e957128b06b-cert\") pod \"lws-controller-manager-56c987df7b-x68np\" (UID: \"d12d140d-6423-425f-9a7b-4e957128b06b\") " pod="openshift-lws-operator/lws-controller-manager-56c987df7b-x68np" Jul 02 19:58:30.824736 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:30.824702 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5d8s\" (UniqueName: \"kubernetes.io/projected/d12d140d-6423-425f-9a7b-4e957128b06b-kube-api-access-j5d8s\") pod \"lws-controller-manager-56c987df7b-x68np\" (UID: \"d12d140d-6423-425f-9a7b-4e957128b06b\") " pod="openshift-lws-operator/lws-controller-manager-56c987df7b-x68np" Jul 02 19:58:30.825397 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:30.825375 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d12d140d-6423-425f-9a7b-4e957128b06b-manager-config\") pod \"lws-controller-manager-56c987df7b-x68np\" (UID: \"d12d140d-6423-425f-9a7b-4e957128b06b\") " pod="openshift-lws-operator/lws-controller-manager-56c987df7b-x68np" Jul 02 19:58:30.827116 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:30.827097 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d12d140d-6423-425f-9a7b-4e957128b06b-cert\") pod \"lws-controller-manager-56c987df7b-x68np\" (UID: \"d12d140d-6423-425f-9a7b-4e957128b06b\") " pod="openshift-lws-operator/lws-controller-manager-56c987df7b-x68np" Jul 02 19:58:30.827196 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:30.827130 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d12d140d-6423-425f-9a7b-4e957128b06b-metrics-cert\") pod \"lws-controller-manager-56c987df7b-x68np\" (UID: \"d12d140d-6423-425f-9a7b-4e957128b06b\") " pod="openshift-lws-operator/lws-controller-manager-56c987df7b-x68np" Jul 02 19:58:30.833979 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:30.833957 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5d8s\" (UniqueName: \"kubernetes.io/projected/d12d140d-6423-425f-9a7b-4e957128b06b-kube-api-access-j5d8s\") pod \"lws-controller-manager-56c987df7b-x68np\" (UID: \"d12d140d-6423-425f-9a7b-4e957128b06b\") " pod="openshift-lws-operator/lws-controller-manager-56c987df7b-x68np" Jul 02 19:58:30.899217 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:30.899184 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:30.919533 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:30.919499 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-56c987df7b-x68np" Jul 02 19:58:30.960139 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:30.960033 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-844d4f46fb-58m7p" event={"ID":"19d584c3-2f10-42b5-9739-371214597476","Type":"ContainerStarted","Data":"6416d6a37dc51adf2b7fe50b08b72d44a11d57f8274a738e69d8d57bfbd8781d"} Jul 02 19:58:31.041190 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:31.041007 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:31.085946 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:31.085915 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-56c987df7b-x68np"] Jul 02 19:58:31.087302 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:58:31.087269 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd12d140d_6423_425f_9a7b_4e957128b06b.slice/crio-44410ce42a24bc642d08638297bb4b15e6b2593103f8985fe1bd05fdb5d09a69 WatchSource:0}: Error finding container 44410ce42a24bc642d08638297bb4b15e6b2593103f8985fe1bd05fdb5d09a69: Status 404 returned error can't find the container with id 44410ce42a24bc642d08638297bb4b15e6b2593103f8985fe1bd05fdb5d09a69 Jul 02 19:58:31.967967 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:31.967926 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-56c987df7b-x68np" event={"ID":"d12d140d-6423-425f-9a7b-4e957128b06b","Type":"ContainerStarted","Data":"44410ce42a24bc642d08638297bb4b15e6b2593103f8985fe1bd05fdb5d09a69"} Jul 02 19:58:33.981455 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:33.981404 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-844d4f46fb-58m7p" event={"ID":"19d584c3-2f10-42b5-9739-371214597476","Type":"ContainerStarted","Data":"b7d6a85715d43850970d5736e85478ec7bb05013ccca3bd3a1f6de00e2e059bc"} Jul 02 19:58:33.982805 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:33.982782 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-56c987df7b-x68np" event={"ID":"d12d140d-6423-425f-9a7b-4e957128b06b","Type":"ContainerStarted","Data":"283e2439d5376f1454e479b7ca0c2824f223103e121a3c283338977218e261fc"} Jul 02 19:58:33.982928 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:33.982897 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-56c987df7b-x68np" Jul 02 19:58:34.031148 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:34.031053 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-56c987df7b-x68np" podStartSLOduration=1.364281902 podStartE2EDuration="4.03103981s" totalImagesPullingTime="2.666757908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:58:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:58:34.029129068 +0000 UTC m=+299.095186958" watchObservedRunningTime="2026-07-02 19:58:34.03103981 +0000 UTC m=+299.097097670" Jul 02 19:58:34.994116 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:34.994081 2565 generic.go:356] "Generic (PLEG): container finished" podID="19d584c3-2f10-42b5-9739-371214597476" containerID="b7d6a85715d43850970d5736e85478ec7bb05013ccca3bd3a1f6de00e2e059bc" exitCode=0 Jul 02 19:58:34.994517 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:34.994170 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-844d4f46fb-58m7p" event={"ID":"19d584c3-2f10-42b5-9739-371214597476","Type":"ContainerDied","Data":"b7d6a85715d43850970d5736e85478ec7bb05013ccca3bd3a1f6de00e2e059bc"} Jul 02 19:58:35.374519 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:35.374492 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-6n2jb_e50ef735-52fb-4047-8c8e-9378a771bbd3/console-operator/1.log" Jul 02 19:58:35.374895 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:35.374563 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-6n2jb_e50ef735-52fb-4047-8c8e-9378a771bbd3/console-operator/1.log" Jul 02 19:58:35.386028 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:35.386011 2565 kubelet.go:1648] "Image garbage collection succeeded" Jul 02 19:58:36.001327 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:36.001291 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-844d4f46fb-58m7p" event={"ID":"19d584c3-2f10-42b5-9739-371214597476","Type":"ContainerStarted","Data":"53c23ee985460c103c0d0479a3a5347ec92c4405bce39adb7c14eef6b2636119"} Jul 02 19:58:36.001798 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:36.001422 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-844d4f46fb-58m7p" Jul 02 19:58:36.022399 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:36.022329 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-844d4f46fb-58m7p" podStartSLOduration=2.255542862 podStartE2EDuration="7.022313443s" totalImagesPullingTime="3.752293818s" totalInitContainerRuntime="1.014476763s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:58:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:58:36.022221734 +0000 UTC m=+301.088279595" watchObservedRunningTime="2026-07-02 19:58:36.022313443 +0000 UTC m=+301.088371303" Jul 02 19:58:38.065094 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:38.065059 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:39.214818 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:39.214782 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:44.996730 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:44.996698 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-56c987df7b-x68np" Jul 02 19:58:47.008243 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:47.008213 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-844d4f46fb-58m7p" Jul 02 19:58:48.932166 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:48.932131 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:49.107953 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:49.107920 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:49.679775 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:49.679726 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:49.866302 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:49.866259 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:49.965745 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:49.965653 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:50.062510 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:50.062463 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:50.162659 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:50.162622 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:50.436200 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:50.436160 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:50.756399 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:50.756266 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:51.428152 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:51.428118 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:51.498889 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:51.498854 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:52.461877 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:52.461836 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:55.805550 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:55.805515 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:55.904232 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:55.904197 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:56.417564 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:56.417511 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:56.527659 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:56.527626 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:56.915434 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:56.915398 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m9rkk"] Jul 02 19:58:56.925552 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:56.925527 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m9rkk" Jul 02 19:58:56.928216 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:56.928191 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 02 19:58:56.928355 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:56.928194 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 02 19:58:56.928355 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:56.928264 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-95sqn\"" Jul 02 19:58:56.928486 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:56.928392 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 02 19:58:56.928596 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:56.928580 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 02 19:58:56.934595 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:56.934573 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m9rkk"] Jul 02 19:58:57.054610 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:57.054569 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12f1b492-b763-4357-9785-4e1b033175f4-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-m9rkk\" (UID: \"12f1b492-b763-4357-9785-4e1b033175f4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m9rkk" Jul 02 19:58:57.054752 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:57.054616 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/12f1b492-b763-4357-9785-4e1b033175f4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-m9rkk\" (UID: \"12f1b492-b763-4357-9785-4e1b033175f4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m9rkk" Jul 02 19:58:57.054752 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:57.054710 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/12f1b492-b763-4357-9785-4e1b033175f4-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-m9rkk\" (UID: \"12f1b492-b763-4357-9785-4e1b033175f4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m9rkk" Jul 02 19:58:57.054752 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:57.054733 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svl7b\" (UniqueName: \"kubernetes.io/projected/12f1b492-b763-4357-9785-4e1b033175f4-kube-api-access-svl7b\") pod \"istiod-openshift-gateway-94bb8fbfd-m9rkk\" (UID: \"12f1b492-b763-4357-9785-4e1b033175f4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m9rkk" Jul 02 19:58:57.054874 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:57.054762 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/12f1b492-b763-4357-9785-4e1b033175f4-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-m9rkk\" (UID: \"12f1b492-b763-4357-9785-4e1b033175f4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m9rkk" Jul 02 19:58:57.054874 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:57.054783 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/12f1b492-b763-4357-9785-4e1b033175f4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-m9rkk\" (UID: \"12f1b492-b763-4357-9785-4e1b033175f4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m9rkk" Jul 02 19:58:57.054874 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:57.054802 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/12f1b492-b763-4357-9785-4e1b033175f4-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-m9rkk\" (UID: \"12f1b492-b763-4357-9785-4e1b033175f4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m9rkk" Jul 02 19:58:57.156301 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:57.156269 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/12f1b492-b763-4357-9785-4e1b033175f4-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-m9rkk\" (UID: \"12f1b492-b763-4357-9785-4e1b033175f4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m9rkk" Jul 02 19:58:57.156301 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:57.156303 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svl7b\" (UniqueName: \"kubernetes.io/projected/12f1b492-b763-4357-9785-4e1b033175f4-kube-api-access-svl7b\") pod \"istiod-openshift-gateway-94bb8fbfd-m9rkk\" (UID: \"12f1b492-b763-4357-9785-4e1b033175f4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m9rkk" Jul 02 19:58:57.156542 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:57.156327 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/12f1b492-b763-4357-9785-4e1b033175f4-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-m9rkk\" (UID: \"12f1b492-b763-4357-9785-4e1b033175f4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m9rkk" Jul 02 19:58:57.156542 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:57.156364 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/12f1b492-b763-4357-9785-4e1b033175f4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-m9rkk\" (UID: \"12f1b492-b763-4357-9785-4e1b033175f4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m9rkk" Jul 02 19:58:57.156542 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:57.156395 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/12f1b492-b763-4357-9785-4e1b033175f4-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-m9rkk\" (UID: \"12f1b492-b763-4357-9785-4e1b033175f4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m9rkk" Jul 02 19:58:57.156542 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:57.156425 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12f1b492-b763-4357-9785-4e1b033175f4-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-m9rkk\" (UID: \"12f1b492-b763-4357-9785-4e1b033175f4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m9rkk" Jul 02 19:58:57.156752 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:57.156611 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/12f1b492-b763-4357-9785-4e1b033175f4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-m9rkk\" (UID: \"12f1b492-b763-4357-9785-4e1b033175f4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m9rkk" Jul 02 19:58:57.157249 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:57.157222 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/12f1b492-b763-4357-9785-4e1b033175f4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-m9rkk\" (UID: \"12f1b492-b763-4357-9785-4e1b033175f4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m9rkk" Jul 02 19:58:57.159170 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:57.159142 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/12f1b492-b763-4357-9785-4e1b033175f4-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-m9rkk\" (UID: \"12f1b492-b763-4357-9785-4e1b033175f4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m9rkk" Jul 02 19:58:57.159284 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:57.159220 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/12f1b492-b763-4357-9785-4e1b033175f4-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-m9rkk\" (UID: \"12f1b492-b763-4357-9785-4e1b033175f4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m9rkk" Jul 02 19:58:57.159376 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:57.159285 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/12f1b492-b763-4357-9785-4e1b033175f4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-m9rkk\" (UID: \"12f1b492-b763-4357-9785-4e1b033175f4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m9rkk" Jul 02 19:58:57.159425 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:57.159384 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/12f1b492-b763-4357-9785-4e1b033175f4-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-m9rkk\" (UID: \"12f1b492-b763-4357-9785-4e1b033175f4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m9rkk" Jul 02 19:58:57.167463 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:57.167398 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-svl7b\" (UniqueName: \"kubernetes.io/projected/12f1b492-b763-4357-9785-4e1b033175f4-kube-api-access-svl7b\") pod \"istiod-openshift-gateway-94bb8fbfd-m9rkk\" (UID: \"12f1b492-b763-4357-9785-4e1b033175f4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m9rkk" Jul 02 19:58:57.167698 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:57.167645 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12f1b492-b763-4357-9785-4e1b033175f4-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-m9rkk\" (UID: \"12f1b492-b763-4357-9785-4e1b033175f4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m9rkk" Jul 02 19:58:57.214677 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:57.214644 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:57.235552 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:57.235534 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m9rkk" Jul 02 19:58:57.400741 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:57.400712 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m9rkk"] Jul 02 19:58:57.401874 ip-10-0-128-177 kubenswrapper[2565]: W0702 19:58:57.401844 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12f1b492_b763_4357_9785_4e1b033175f4.slice/crio-3ed7d9cb3aa3f01a14ed26faa7f297107586831871e91f2c3409974116ce9428 WatchSource:0}: Error finding container 3ed7d9cb3aa3f01a14ed26faa7f297107586831871e91f2c3409974116ce9428: Status 404 returned error can't find the container with id 3ed7d9cb3aa3f01a14ed26faa7f297107586831871e91f2c3409974116ce9428 Jul 02 19:58:57.404057 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:57.404036 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 19:58:57.502773 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:57.502746 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:57.600712 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:57.600668 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:58.108055 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:58.108017 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m9rkk" event={"ID":"12f1b492-b763-4357-9785-4e1b033175f4","Type":"ContainerStarted","Data":"3ed7d9cb3aa3f01a14ed26faa7f297107586831871e91f2c3409974116ce9428"} Jul 02 19:58:59.717201 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:59.717166 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 19:58:59.717460 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:59.717231 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 19:58:59.825060 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:59.825018 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:59.914734 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:58:59.914700 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:59:00.082693 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:59:00.082610 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:59:00.120544 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:59:00.120513 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m9rkk" event={"ID":"12f1b492-b763-4357-9785-4e1b033175f4","Type":"ContainerStarted","Data":"7417334ec197d93a65e0752c7ebd60379e8c312cbd3990c0ab7bb50bec8f9cd9"} Jul 02 19:59:00.120729 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:59:00.120672 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m9rkk" Jul 02 19:59:00.122365 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:59:00.122318 2565 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-m9rkk container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 02 19:59:00.122488 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:59:00.122380 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m9rkk" podUID="12f1b492-b763-4357-9785-4e1b033175f4" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 19:59:00.175169 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:59:00.175119 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m9rkk" podStartSLOduration=1.862423624 podStartE2EDuration="4.175096456s" totalImagesPullingTime="2.312672832s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:58:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:59:00.174733084 +0000 UTC m=+325.240790949" watchObservedRunningTime="2026-07-02 19:59:00.175096456 +0000 UTC m=+325.241154317" Jul 02 19:59:00.200132 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:59:00.200100 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:59:01.126169 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:59:01.126138 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m9rkk" Jul 02 19:59:01.173200 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:59:01.173166 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:59:01.313872 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:59:01.313835 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:59:03.715160 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:59:03.715116 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:59:03.815527 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:59:03.815493 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:59:30.082955 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:59:30.082866 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:59:39.013283 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:59:39.013247 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:59:50.491483 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:59:50.491440 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:59:50.591326 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:59:50.591292 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:59:50.694700 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:59:50.694654 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:59:51.406799 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:59:51.406766 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 19:59:51.603484 ip-10-0-128-177 kubenswrapper[2565]: I0702 19:59:51.603420 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:00:06.012094 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:06.012060 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kwmw2"] Jul 02 20:00:06.015758 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:06.015735 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kwmw2" Jul 02 20:00:06.018695 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:06.018664 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7dvzc\"" Jul 02 20:00:06.018695 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:06.018687 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 02 20:00:06.019684 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:06.019668 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 02 20:00:06.030449 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:06.028518 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kwmw2"] Jul 02 20:00:06.141131 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:06.141085 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20c43daa-e839-4aac-931f-409f601a9eb1-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kwmw2\" (UID: \"20c43daa-e839-4aac-931f-409f601a9eb1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kwmw2" Jul 02 20:00:06.141307 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:06.141229 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nk4bc\" (UniqueName: \"kubernetes.io/projected/20c43daa-e839-4aac-931f-409f601a9eb1-kube-api-access-nk4bc\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kwmw2\" (UID: \"20c43daa-e839-4aac-931f-409f601a9eb1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kwmw2" Jul 02 20:00:06.141398 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:06.141308 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20c43daa-e839-4aac-931f-409f601a9eb1-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kwmw2\" (UID: \"20c43daa-e839-4aac-931f-409f601a9eb1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kwmw2" Jul 02 20:00:06.242210 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:06.242168 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20c43daa-e839-4aac-931f-409f601a9eb1-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kwmw2\" (UID: \"20c43daa-e839-4aac-931f-409f601a9eb1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kwmw2" Jul 02 20:00:06.242443 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:06.242245 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nk4bc\" (UniqueName: \"kubernetes.io/projected/20c43daa-e839-4aac-931f-409f601a9eb1-kube-api-access-nk4bc\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kwmw2\" (UID: \"20c43daa-e839-4aac-931f-409f601a9eb1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kwmw2" Jul 02 20:00:06.242443 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:06.242287 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20c43daa-e839-4aac-931f-409f601a9eb1-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kwmw2\" (UID: \"20c43daa-e839-4aac-931f-409f601a9eb1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kwmw2" Jul 02 20:00:06.242674 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:06.242659 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20c43daa-e839-4aac-931f-409f601a9eb1-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kwmw2\" (UID: \"20c43daa-e839-4aac-931f-409f601a9eb1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kwmw2" Jul 02 20:00:06.242710 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:06.242656 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20c43daa-e839-4aac-931f-409f601a9eb1-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kwmw2\" (UID: \"20c43daa-e839-4aac-931f-409f601a9eb1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kwmw2" Jul 02 20:00:06.250977 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:06.250947 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nk4bc\" (UniqueName: \"kubernetes.io/projected/20c43daa-e839-4aac-931f-409f601a9eb1-kube-api-access-nk4bc\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kwmw2\" (UID: \"20c43daa-e839-4aac-931f-409f601a9eb1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kwmw2" Jul 02 20:00:06.331974 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:06.331884 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kwmw2" Jul 02 20:00:06.467653 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:06.467630 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kwmw2"] Jul 02 20:00:06.470187 ip-10-0-128-177 kubenswrapper[2565]: W0702 20:00:06.470159 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20c43daa_e839_4aac_931f_409f601a9eb1.slice/crio-6a5bea62dd5ae54cf5b999858513e82c5613c4337f431e59a4dde83867fa1ed1 WatchSource:0}: Error finding container 6a5bea62dd5ae54cf5b999858513e82c5613c4337f431e59a4dde83867fa1ed1: Status 404 returned error can't find the container with id 6a5bea62dd5ae54cf5b999858513e82c5613c4337f431e59a4dde83867fa1ed1 Jul 02 20:00:06.618688 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:06.618608 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9rwk"] Jul 02 20:00:06.622191 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:06.622172 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9rwk" Jul 02 20:00:06.630329 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:06.630300 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9rwk"] Jul 02 20:00:06.747046 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:06.747006 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/00470c70-198a-4e14-820d-ac3972c96d6f-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9rwk\" (UID: \"00470c70-198a-4e14-820d-ac3972c96d6f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9rwk" Jul 02 20:00:06.747219 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:06.747074 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkbrk\" (UniqueName: \"kubernetes.io/projected/00470c70-198a-4e14-820d-ac3972c96d6f-kube-api-access-wkbrk\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9rwk\" (UID: \"00470c70-198a-4e14-820d-ac3972c96d6f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9rwk" Jul 02 20:00:06.747219 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:06.747163 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/00470c70-198a-4e14-820d-ac3972c96d6f-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9rwk\" (UID: \"00470c70-198a-4e14-820d-ac3972c96d6f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9rwk" Jul 02 20:00:06.847826 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:06.847780 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/00470c70-198a-4e14-820d-ac3972c96d6f-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9rwk\" (UID: \"00470c70-198a-4e14-820d-ac3972c96d6f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9rwk" Jul 02 20:00:06.847985 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:06.847858 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkbrk\" (UniqueName: \"kubernetes.io/projected/00470c70-198a-4e14-820d-ac3972c96d6f-kube-api-access-wkbrk\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9rwk\" (UID: \"00470c70-198a-4e14-820d-ac3972c96d6f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9rwk" Jul 02 20:00:06.847985 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:06.847924 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/00470c70-198a-4e14-820d-ac3972c96d6f-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9rwk\" (UID: \"00470c70-198a-4e14-820d-ac3972c96d6f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9rwk" Jul 02 20:00:06.848242 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:06.848220 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/00470c70-198a-4e14-820d-ac3972c96d6f-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9rwk\" (UID: \"00470c70-198a-4e14-820d-ac3972c96d6f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9rwk" Jul 02 20:00:06.848290 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:06.848232 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/00470c70-198a-4e14-820d-ac3972c96d6f-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9rwk\" (UID: \"00470c70-198a-4e14-820d-ac3972c96d6f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9rwk" Jul 02 20:00:06.856667 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:06.856644 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkbrk\" (UniqueName: \"kubernetes.io/projected/00470c70-198a-4e14-820d-ac3972c96d6f-kube-api-access-wkbrk\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9rwk\" (UID: \"00470c70-198a-4e14-820d-ac3972c96d6f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9rwk" Jul 02 20:00:06.941724 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:06.941693 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9rwk" Jul 02 20:00:07.098936 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:07.098899 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9rwk"] Jul 02 20:00:07.101926 ip-10-0-128-177 kubenswrapper[2565]: W0702 20:00:07.101894 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00470c70_198a_4e14_820d_ac3972c96d6f.slice/crio-ffedf6af4178616dd1ccb599abfed1c5de5b8009df18f50a8fc36980e3cee4b9 WatchSource:0}: Error finding container ffedf6af4178616dd1ccb599abfed1c5de5b8009df18f50a8fc36980e3cee4b9: Status 404 returned error can't find the container with id ffedf6af4178616dd1ccb599abfed1c5de5b8009df18f50a8fc36980e3cee4b9 Jul 02 20:00:07.218570 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:07.218542 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p59n4"] Jul 02 20:00:07.221902 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:07.221885 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p59n4" Jul 02 20:00:07.229661 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:07.229630 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p59n4"] Jul 02 20:00:07.352527 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:07.352494 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71b6ed41-5d47-409b-a2ad-00111b2254e3-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p59n4\" (UID: \"71b6ed41-5d47-409b-a2ad-00111b2254e3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p59n4" Jul 02 20:00:07.352730 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:07.352551 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jm6wx\" (UniqueName: \"kubernetes.io/projected/71b6ed41-5d47-409b-a2ad-00111b2254e3-kube-api-access-jm6wx\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p59n4\" (UID: \"71b6ed41-5d47-409b-a2ad-00111b2254e3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p59n4" Jul 02 20:00:07.352730 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:07.352646 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71b6ed41-5d47-409b-a2ad-00111b2254e3-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p59n4\" (UID: \"71b6ed41-5d47-409b-a2ad-00111b2254e3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p59n4" Jul 02 20:00:07.443220 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:07.443182 2565 generic.go:356] "Generic (PLEG): container finished" podID="00470c70-198a-4e14-820d-ac3972c96d6f" containerID="6fd9873df027b4f11b98b50683f8f130643beaaefe13bcc97897e709161bad81" exitCode=0 Jul 02 20:00:07.443400 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:07.443276 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9rwk" event={"ID":"00470c70-198a-4e14-820d-ac3972c96d6f","Type":"ContainerDied","Data":"6fd9873df027b4f11b98b50683f8f130643beaaefe13bcc97897e709161bad81"} Jul 02 20:00:07.443400 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:07.443327 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9rwk" event={"ID":"00470c70-198a-4e14-820d-ac3972c96d6f","Type":"ContainerStarted","Data":"ffedf6af4178616dd1ccb599abfed1c5de5b8009df18f50a8fc36980e3cee4b9"} Jul 02 20:00:07.444901 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:07.444879 2565 generic.go:356] "Generic (PLEG): container finished" podID="20c43daa-e839-4aac-931f-409f601a9eb1" containerID="dadb73bbc7cefe7ff84d94010b62df7f66f8940ed776a49b7b226ff5ca351eb5" exitCode=0 Jul 02 20:00:07.444988 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:07.444938 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kwmw2" event={"ID":"20c43daa-e839-4aac-931f-409f601a9eb1","Type":"ContainerDied","Data":"dadb73bbc7cefe7ff84d94010b62df7f66f8940ed776a49b7b226ff5ca351eb5"} Jul 02 20:00:07.444988 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:07.444980 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kwmw2" event={"ID":"20c43daa-e839-4aac-931f-409f601a9eb1","Type":"ContainerStarted","Data":"6a5bea62dd5ae54cf5b999858513e82c5613c4337f431e59a4dde83867fa1ed1"} Jul 02 20:00:07.453636 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:07.453618 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jm6wx\" (UniqueName: \"kubernetes.io/projected/71b6ed41-5d47-409b-a2ad-00111b2254e3-kube-api-access-jm6wx\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p59n4\" (UID: \"71b6ed41-5d47-409b-a2ad-00111b2254e3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p59n4" Jul 02 20:00:07.453715 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:07.453664 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71b6ed41-5d47-409b-a2ad-00111b2254e3-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p59n4\" (UID: \"71b6ed41-5d47-409b-a2ad-00111b2254e3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p59n4" Jul 02 20:00:07.453715 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:07.453708 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71b6ed41-5d47-409b-a2ad-00111b2254e3-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p59n4\" (UID: \"71b6ed41-5d47-409b-a2ad-00111b2254e3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p59n4" Jul 02 20:00:07.454052 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:07.454032 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71b6ed41-5d47-409b-a2ad-00111b2254e3-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p59n4\" (UID: \"71b6ed41-5d47-409b-a2ad-00111b2254e3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p59n4" Jul 02 20:00:07.454123 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:07.454069 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71b6ed41-5d47-409b-a2ad-00111b2254e3-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p59n4\" (UID: \"71b6ed41-5d47-409b-a2ad-00111b2254e3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p59n4" Jul 02 20:00:07.464708 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:07.464684 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jm6wx\" (UniqueName: \"kubernetes.io/projected/71b6ed41-5d47-409b-a2ad-00111b2254e3-kube-api-access-jm6wx\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p59n4\" (UID: \"71b6ed41-5d47-409b-a2ad-00111b2254e3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p59n4" Jul 02 20:00:07.570450 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:07.570413 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p59n4" Jul 02 20:00:07.616511 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:07.616480 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p9vmx"] Jul 02 20:00:07.620213 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:07.620195 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p9vmx" Jul 02 20:00:07.631006 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:07.630835 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p9vmx"] Jul 02 20:00:07.715118 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:07.715093 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p59n4"] Jul 02 20:00:07.716674 ip-10-0-128-177 kubenswrapper[2565]: W0702 20:00:07.716645 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71b6ed41_5d47_409b_a2ad_00111b2254e3.slice/crio-6e44956cee96c6bcc501351b25f0cea3f9b0f71f7d8049e6f104652097b12ee1 WatchSource:0}: Error finding container 6e44956cee96c6bcc501351b25f0cea3f9b0f71f7d8049e6f104652097b12ee1: Status 404 returned error can't find the container with id 6e44956cee96c6bcc501351b25f0cea3f9b0f71f7d8049e6f104652097b12ee1 Jul 02 20:00:07.756470 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:07.756447 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f72fdf9b-80ec-460d-ac5d-5cb57db22d88-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p9vmx\" (UID: \"f72fdf9b-80ec-460d-ac5d-5cb57db22d88\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p9vmx" Jul 02 20:00:07.756559 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:07.756487 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f72fdf9b-80ec-460d-ac5d-5cb57db22d88-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p9vmx\" (UID: \"f72fdf9b-80ec-460d-ac5d-5cb57db22d88\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p9vmx" Jul 02 20:00:07.756597 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:07.756570 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcqbn\" (UniqueName: \"kubernetes.io/projected/f72fdf9b-80ec-460d-ac5d-5cb57db22d88-kube-api-access-vcqbn\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p9vmx\" (UID: \"f72fdf9b-80ec-460d-ac5d-5cb57db22d88\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p9vmx" Jul 02 20:00:07.857273 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:07.857237 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcqbn\" (UniqueName: \"kubernetes.io/projected/f72fdf9b-80ec-460d-ac5d-5cb57db22d88-kube-api-access-vcqbn\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p9vmx\" (UID: \"f72fdf9b-80ec-460d-ac5d-5cb57db22d88\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p9vmx" Jul 02 20:00:07.857452 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:07.857312 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f72fdf9b-80ec-460d-ac5d-5cb57db22d88-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p9vmx\" (UID: \"f72fdf9b-80ec-460d-ac5d-5cb57db22d88\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p9vmx" Jul 02 20:00:07.857452 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:07.857356 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f72fdf9b-80ec-460d-ac5d-5cb57db22d88-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p9vmx\" (UID: \"f72fdf9b-80ec-460d-ac5d-5cb57db22d88\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p9vmx" Jul 02 20:00:07.857692 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:07.857677 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f72fdf9b-80ec-460d-ac5d-5cb57db22d88-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p9vmx\" (UID: \"f72fdf9b-80ec-460d-ac5d-5cb57db22d88\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p9vmx" Jul 02 20:00:07.857742 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:07.857708 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f72fdf9b-80ec-460d-ac5d-5cb57db22d88-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p9vmx\" (UID: \"f72fdf9b-80ec-460d-ac5d-5cb57db22d88\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p9vmx" Jul 02 20:00:07.866145 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:07.866120 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcqbn\" (UniqueName: \"kubernetes.io/projected/f72fdf9b-80ec-460d-ac5d-5cb57db22d88-kube-api-access-vcqbn\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p9vmx\" (UID: \"f72fdf9b-80ec-460d-ac5d-5cb57db22d88\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p9vmx" Jul 02 20:00:07.937162 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:07.937123 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p9vmx" Jul 02 20:00:08.074418 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:08.074383 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p9vmx"] Jul 02 20:00:08.100220 ip-10-0-128-177 kubenswrapper[2565]: W0702 20:00:08.100187 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf72fdf9b_80ec_460d_ac5d_5cb57db22d88.slice/crio-bc343f9e7ba1285d82d4feadf3b0fb957978a241d9fa2aad54d199856f9e59ca WatchSource:0}: Error finding container bc343f9e7ba1285d82d4feadf3b0fb957978a241d9fa2aad54d199856f9e59ca: Status 404 returned error can't find the container with id bc343f9e7ba1285d82d4feadf3b0fb957978a241d9fa2aad54d199856f9e59ca Jul 02 20:00:08.454816 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:08.454789 2565 generic.go:356] "Generic (PLEG): container finished" podID="71b6ed41-5d47-409b-a2ad-00111b2254e3" containerID="2199c3c1772ac6f1487349785c877035a2814234d4ee9fa5e35e9aa3c820d8dc" exitCode=0 Jul 02 20:00:08.454977 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:08.454869 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p59n4" event={"ID":"71b6ed41-5d47-409b-a2ad-00111b2254e3","Type":"ContainerDied","Data":"2199c3c1772ac6f1487349785c877035a2814234d4ee9fa5e35e9aa3c820d8dc"} Jul 02 20:00:08.454977 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:08.454968 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p59n4" event={"ID":"71b6ed41-5d47-409b-a2ad-00111b2254e3","Type":"ContainerStarted","Data":"6e44956cee96c6bcc501351b25f0cea3f9b0f71f7d8049e6f104652097b12ee1"} Jul 02 20:00:08.456707 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:08.456681 2565 generic.go:356] "Generic (PLEG): container finished" podID="00470c70-198a-4e14-820d-ac3972c96d6f" containerID="eaa035f1bbc64099c557b27ba4303ddaf4586ce1cb7ca16b04e5d65c8b75f80f" exitCode=0 Jul 02 20:00:08.456808 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:08.456793 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9rwk" event={"ID":"00470c70-198a-4e14-820d-ac3972c96d6f","Type":"ContainerDied","Data":"eaa035f1bbc64099c557b27ba4303ddaf4586ce1cb7ca16b04e5d65c8b75f80f"} Jul 02 20:00:08.458461 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:08.458438 2565 generic.go:356] "Generic (PLEG): container finished" podID="f72fdf9b-80ec-460d-ac5d-5cb57db22d88" containerID="9eb0a94dda42474925059484fdd953c2602bf39bb920bbcba3fa067c5dde4b0c" exitCode=0 Jul 02 20:00:08.458534 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:08.458467 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p9vmx" event={"ID":"f72fdf9b-80ec-460d-ac5d-5cb57db22d88","Type":"ContainerDied","Data":"9eb0a94dda42474925059484fdd953c2602bf39bb920bbcba3fa067c5dde4b0c"} Jul 02 20:00:08.458534 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:08.458510 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p9vmx" event={"ID":"f72fdf9b-80ec-460d-ac5d-5cb57db22d88","Type":"ContainerStarted","Data":"bc343f9e7ba1285d82d4feadf3b0fb957978a241d9fa2aad54d199856f9e59ca"} Jul 02 20:00:09.465208 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:09.465176 2565 generic.go:356] "Generic (PLEG): container finished" podID="20c43daa-e839-4aac-931f-409f601a9eb1" containerID="71c31530774d18778f18525ee2d2a162d74e525dbc623ce24b8645fd2348a652" exitCode=0 Jul 02 20:00:09.465598 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:09.465267 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kwmw2" event={"ID":"20c43daa-e839-4aac-931f-409f601a9eb1","Type":"ContainerDied","Data":"71c31530774d18778f18525ee2d2a162d74e525dbc623ce24b8645fd2348a652"} Jul 02 20:00:09.467097 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:09.467076 2565 generic.go:356] "Generic (PLEG): container finished" podID="71b6ed41-5d47-409b-a2ad-00111b2254e3" containerID="c708411a3134a91e58abc2ca02abf17f3f06ff198d54ffede8df6f1ca0a9c431" exitCode=0 Jul 02 20:00:09.467202 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:09.467155 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p59n4" event={"ID":"71b6ed41-5d47-409b-a2ad-00111b2254e3","Type":"ContainerDied","Data":"c708411a3134a91e58abc2ca02abf17f3f06ff198d54ffede8df6f1ca0a9c431"} Jul 02 20:00:09.469394 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:09.469361 2565 generic.go:356] "Generic (PLEG): container finished" podID="00470c70-198a-4e14-820d-ac3972c96d6f" containerID="310e8a7455394e8e352001c379b81e6237471c362815c8fe1233805da1b156a3" exitCode=0 Jul 02 20:00:09.469484 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:09.469449 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9rwk" event={"ID":"00470c70-198a-4e14-820d-ac3972c96d6f","Type":"ContainerDied","Data":"310e8a7455394e8e352001c379b81e6237471c362815c8fe1233805da1b156a3"} Jul 02 20:00:09.471158 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:09.471139 2565 generic.go:356] "Generic (PLEG): container finished" podID="f72fdf9b-80ec-460d-ac5d-5cb57db22d88" containerID="6f0de7c581a8ac2eaf1e90d72f11610b075ef80c18b397a39fae23cd76419ab2" exitCode=0 Jul 02 20:00:09.471248 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:09.471175 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p9vmx" event={"ID":"f72fdf9b-80ec-460d-ac5d-5cb57db22d88","Type":"ContainerDied","Data":"6f0de7c581a8ac2eaf1e90d72f11610b075ef80c18b397a39fae23cd76419ab2"} Jul 02 20:00:10.478331 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:10.478298 2565 generic.go:356] "Generic (PLEG): container finished" podID="f72fdf9b-80ec-460d-ac5d-5cb57db22d88" containerID="c3e579ff292fd3d91f332dc596f89a5bdd8db8ec17917940629974445aef39a7" exitCode=0 Jul 02 20:00:10.478735 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:10.478385 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p9vmx" event={"ID":"f72fdf9b-80ec-460d-ac5d-5cb57db22d88","Type":"ContainerDied","Data":"c3e579ff292fd3d91f332dc596f89a5bdd8db8ec17917940629974445aef39a7"} Jul 02 20:00:10.480558 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:10.480532 2565 generic.go:356] "Generic (PLEG): container finished" podID="20c43daa-e839-4aac-931f-409f601a9eb1" containerID="d4509b426be35aff593a096737c9948b4b0be95ef431ef5ee3de51b277650f85" exitCode=0 Jul 02 20:00:10.480676 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:10.480562 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kwmw2" event={"ID":"20c43daa-e839-4aac-931f-409f601a9eb1","Type":"ContainerDied","Data":"d4509b426be35aff593a096737c9948b4b0be95ef431ef5ee3de51b277650f85"} Jul 02 20:00:10.482635 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:10.482615 2565 generic.go:356] "Generic (PLEG): container finished" podID="71b6ed41-5d47-409b-a2ad-00111b2254e3" containerID="475e6274f8caa47baf11b583944207a649b5bbf3d12b9e249ab967c0ceb4db65" exitCode=0 Jul 02 20:00:10.482732 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:10.482677 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p59n4" event={"ID":"71b6ed41-5d47-409b-a2ad-00111b2254e3","Type":"ContainerDied","Data":"475e6274f8caa47baf11b583944207a649b5bbf3d12b9e249ab967c0ceb4db65"} Jul 02 20:00:10.616067 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:10.616039 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9rwk" Jul 02 20:00:10.784320 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:10.784288 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wkbrk\" (UniqueName: \"kubernetes.io/projected/00470c70-198a-4e14-820d-ac3972c96d6f-kube-api-access-wkbrk\") pod \"00470c70-198a-4e14-820d-ac3972c96d6f\" (UID: \"00470c70-198a-4e14-820d-ac3972c96d6f\") " Jul 02 20:00:10.784502 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:10.784409 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/00470c70-198a-4e14-820d-ac3972c96d6f-bundle\") pod \"00470c70-198a-4e14-820d-ac3972c96d6f\" (UID: \"00470c70-198a-4e14-820d-ac3972c96d6f\") " Jul 02 20:00:10.784502 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:10.784488 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/00470c70-198a-4e14-820d-ac3972c96d6f-util\") pod \"00470c70-198a-4e14-820d-ac3972c96d6f\" (UID: \"00470c70-198a-4e14-820d-ac3972c96d6f\") " Jul 02 20:00:10.784892 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:10.784854 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00470c70-198a-4e14-820d-ac3972c96d6f-bundle" (OuterVolumeSpecName: "bundle") pod "00470c70-198a-4e14-820d-ac3972c96d6f" (UID: "00470c70-198a-4e14-820d-ac3972c96d6f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:00:10.786602 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:10.786544 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00470c70-198a-4e14-820d-ac3972c96d6f-kube-api-access-wkbrk" (OuterVolumeSpecName: "kube-api-access-wkbrk") pod "00470c70-198a-4e14-820d-ac3972c96d6f" (UID: "00470c70-198a-4e14-820d-ac3972c96d6f"). InnerVolumeSpecName "kube-api-access-wkbrk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:00:10.789862 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:10.789825 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00470c70-198a-4e14-820d-ac3972c96d6f-util" (OuterVolumeSpecName: "util") pod "00470c70-198a-4e14-820d-ac3972c96d6f" (UID: "00470c70-198a-4e14-820d-ac3972c96d6f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:00:10.885760 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:10.885718 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/00470c70-198a-4e14-820d-ac3972c96d6f-bundle\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 20:00:10.885760 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:10.885751 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/00470c70-198a-4e14-820d-ac3972c96d6f-util\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 20:00:10.885760 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:10.885765 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wkbrk\" (UniqueName: \"kubernetes.io/projected/00470c70-198a-4e14-820d-ac3972c96d6f-kube-api-access-wkbrk\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 20:00:11.489241 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:11.489211 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9rwk" Jul 02 20:00:11.489619 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:11.489237 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9rwk" event={"ID":"00470c70-198a-4e14-820d-ac3972c96d6f","Type":"ContainerDied","Data":"ffedf6af4178616dd1ccb599abfed1c5de5b8009df18f50a8fc36980e3cee4b9"} Jul 02 20:00:11.489619 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:11.489296 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ffedf6af4178616dd1ccb599abfed1c5de5b8009df18f50a8fc36980e3cee4b9" Jul 02 20:00:11.628589 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:11.628565 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p9vmx" Jul 02 20:00:11.685192 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:11.685169 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p59n4" Jul 02 20:00:11.688063 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:11.688044 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kwmw2" Jul 02 20:00:11.795195 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:11.795106 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jm6wx\" (UniqueName: \"kubernetes.io/projected/71b6ed41-5d47-409b-a2ad-00111b2254e3-kube-api-access-jm6wx\") pod \"71b6ed41-5d47-409b-a2ad-00111b2254e3\" (UID: \"71b6ed41-5d47-409b-a2ad-00111b2254e3\") " Jul 02 20:00:11.795195 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:11.795173 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71b6ed41-5d47-409b-a2ad-00111b2254e3-bundle\") pod \"71b6ed41-5d47-409b-a2ad-00111b2254e3\" (UID: \"71b6ed41-5d47-409b-a2ad-00111b2254e3\") " Jul 02 20:00:11.795455 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:11.795204 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20c43daa-e839-4aac-931f-409f601a9eb1-util\") pod \"20c43daa-e839-4aac-931f-409f601a9eb1\" (UID: \"20c43daa-e839-4aac-931f-409f601a9eb1\") " Jul 02 20:00:11.795455 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:11.795226 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nk4bc\" (UniqueName: \"kubernetes.io/projected/20c43daa-e839-4aac-931f-409f601a9eb1-kube-api-access-nk4bc\") pod \"20c43daa-e839-4aac-931f-409f601a9eb1\" (UID: \"20c43daa-e839-4aac-931f-409f601a9eb1\") " Jul 02 20:00:11.795455 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:11.795249 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f72fdf9b-80ec-460d-ac5d-5cb57db22d88-util\") pod \"f72fdf9b-80ec-460d-ac5d-5cb57db22d88\" (UID: \"f72fdf9b-80ec-460d-ac5d-5cb57db22d88\") " Jul 02 20:00:11.795455 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:11.795280 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f72fdf9b-80ec-460d-ac5d-5cb57db22d88-bundle\") pod \"f72fdf9b-80ec-460d-ac5d-5cb57db22d88\" (UID: \"f72fdf9b-80ec-460d-ac5d-5cb57db22d88\") " Jul 02 20:00:11.795455 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:11.795407 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vcqbn\" (UniqueName: \"kubernetes.io/projected/f72fdf9b-80ec-460d-ac5d-5cb57db22d88-kube-api-access-vcqbn\") pod \"f72fdf9b-80ec-460d-ac5d-5cb57db22d88\" (UID: \"f72fdf9b-80ec-460d-ac5d-5cb57db22d88\") " Jul 02 20:00:11.795455 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:11.795447 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71b6ed41-5d47-409b-a2ad-00111b2254e3-util\") pod \"71b6ed41-5d47-409b-a2ad-00111b2254e3\" (UID: \"71b6ed41-5d47-409b-a2ad-00111b2254e3\") " Jul 02 20:00:11.795722 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:11.795474 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20c43daa-e839-4aac-931f-409f601a9eb1-bundle\") pod \"20c43daa-e839-4aac-931f-409f601a9eb1\" (UID: \"20c43daa-e839-4aac-931f-409f601a9eb1\") " Jul 02 20:00:11.796050 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:11.796017 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71b6ed41-5d47-409b-a2ad-00111b2254e3-bundle" (OuterVolumeSpecName: "bundle") pod "71b6ed41-5d47-409b-a2ad-00111b2254e3" (UID: "71b6ed41-5d47-409b-a2ad-00111b2254e3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:00:11.796323 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:11.796300 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20c43daa-e839-4aac-931f-409f601a9eb1-bundle" (OuterVolumeSpecName: "bundle") pod "20c43daa-e839-4aac-931f-409f601a9eb1" (UID: "20c43daa-e839-4aac-931f-409f601a9eb1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:00:11.797400 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:11.797360 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f72fdf9b-80ec-460d-ac5d-5cb57db22d88-bundle" (OuterVolumeSpecName: "bundle") pod "f72fdf9b-80ec-460d-ac5d-5cb57db22d88" (UID: "f72fdf9b-80ec-460d-ac5d-5cb57db22d88"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:00:11.797577 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:11.797548 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71b6ed41-5d47-409b-a2ad-00111b2254e3-kube-api-access-jm6wx" (OuterVolumeSpecName: "kube-api-access-jm6wx") pod "71b6ed41-5d47-409b-a2ad-00111b2254e3" (UID: "71b6ed41-5d47-409b-a2ad-00111b2254e3"). InnerVolumeSpecName "kube-api-access-jm6wx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:00:11.797689 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:11.797624 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20c43daa-e839-4aac-931f-409f601a9eb1-kube-api-access-nk4bc" (OuterVolumeSpecName: "kube-api-access-nk4bc") pod "20c43daa-e839-4aac-931f-409f601a9eb1" (UID: "20c43daa-e839-4aac-931f-409f601a9eb1"). InnerVolumeSpecName "kube-api-access-nk4bc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:00:11.797817 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:11.797796 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f72fdf9b-80ec-460d-ac5d-5cb57db22d88-kube-api-access-vcqbn" (OuterVolumeSpecName: "kube-api-access-vcqbn") pod "f72fdf9b-80ec-460d-ac5d-5cb57db22d88" (UID: "f72fdf9b-80ec-460d-ac5d-5cb57db22d88"). InnerVolumeSpecName "kube-api-access-vcqbn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:00:11.801963 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:11.801943 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f72fdf9b-80ec-460d-ac5d-5cb57db22d88-util" (OuterVolumeSpecName: "util") pod "f72fdf9b-80ec-460d-ac5d-5cb57db22d88" (UID: "f72fdf9b-80ec-460d-ac5d-5cb57db22d88"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:00:11.802450 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:11.802429 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71b6ed41-5d47-409b-a2ad-00111b2254e3-util" (OuterVolumeSpecName: "util") pod "71b6ed41-5d47-409b-a2ad-00111b2254e3" (UID: "71b6ed41-5d47-409b-a2ad-00111b2254e3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:00:11.836246 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:11.836212 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20c43daa-e839-4aac-931f-409f601a9eb1-util" (OuterVolumeSpecName: "util") pod "20c43daa-e839-4aac-931f-409f601a9eb1" (UID: "20c43daa-e839-4aac-931f-409f601a9eb1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:00:11.896595 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:11.896559 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71b6ed41-5d47-409b-a2ad-00111b2254e3-bundle\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 20:00:11.896595 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:11.896591 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20c43daa-e839-4aac-931f-409f601a9eb1-util\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 20:00:11.896595 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:11.896601 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nk4bc\" (UniqueName: \"kubernetes.io/projected/20c43daa-e839-4aac-931f-409f601a9eb1-kube-api-access-nk4bc\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 20:00:11.896810 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:11.896611 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f72fdf9b-80ec-460d-ac5d-5cb57db22d88-util\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 20:00:11.896810 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:11.896620 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f72fdf9b-80ec-460d-ac5d-5cb57db22d88-bundle\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 20:00:11.896810 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:11.896627 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vcqbn\" (UniqueName: \"kubernetes.io/projected/f72fdf9b-80ec-460d-ac5d-5cb57db22d88-kube-api-access-vcqbn\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 20:00:11.896810 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:11.896635 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71b6ed41-5d47-409b-a2ad-00111b2254e3-util\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 20:00:11.896810 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:11.896644 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20c43daa-e839-4aac-931f-409f601a9eb1-bundle\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 20:00:11.896810 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:11.896652 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jm6wx\" (UniqueName: \"kubernetes.io/projected/71b6ed41-5d47-409b-a2ad-00111b2254e3-kube-api-access-jm6wx\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 20:00:12.496199 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:12.496167 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p9vmx" Jul 02 20:00:12.496199 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:12.496192 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p9vmx" event={"ID":"f72fdf9b-80ec-460d-ac5d-5cb57db22d88","Type":"ContainerDied","Data":"bc343f9e7ba1285d82d4feadf3b0fb957978a241d9fa2aad54d199856f9e59ca"} Jul 02 20:00:12.496735 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:12.496273 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bc343f9e7ba1285d82d4feadf3b0fb957978a241d9fa2aad54d199856f9e59ca" Jul 02 20:00:12.497975 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:12.497955 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kwmw2" Jul 02 20:00:12.498101 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:12.497951 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kwmw2" event={"ID":"20c43daa-e839-4aac-931f-409f601a9eb1","Type":"ContainerDied","Data":"6a5bea62dd5ae54cf5b999858513e82c5613c4337f431e59a4dde83867fa1ed1"} Jul 02 20:00:12.498101 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:12.498092 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6a5bea62dd5ae54cf5b999858513e82c5613c4337f431e59a4dde83867fa1ed1" Jul 02 20:00:12.499748 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:12.499728 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p59n4" event={"ID":"71b6ed41-5d47-409b-a2ad-00111b2254e3","Type":"ContainerDied","Data":"6e44956cee96c6bcc501351b25f0cea3f9b0f71f7d8049e6f104652097b12ee1"} Jul 02 20:00:12.499857 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:12.499752 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p59n4" Jul 02 20:00:12.499857 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:12.499760 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6e44956cee96c6bcc501351b25f0cea3f9b0f71f7d8049e6f104652097b12ee1" Jul 02 20:00:13.665533 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:13.665496 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:00:14.067200 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:14.067148 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:00:18.882754 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:18.882710 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:00:21.304820 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:21.304777 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:00:21.398406 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:21.398370 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:00:21.704100 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:21.704067 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:00:23.303129 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:23.303088 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:00:23.399248 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:23.399206 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:00:24.160633 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:24.160578 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:00:24.259928 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:24.259879 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:00:25.942146 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:25.942107 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:00:26.888714 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:26.888662 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:00:27.750456 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:27.750413 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:00:30.731568 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:30.731535 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:00:31.082984 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:31.082891 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:00:31.142083 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:31.142048 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:00:31.666916 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:31.666873 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:00:31.831352 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:31.831312 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:00:32.214879 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:32.214841 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:00:32.319807 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:32.319764 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:00:32.560934 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:32.560849 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:00:34.278637 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:34.278594 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:00:34.387901 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:34.387867 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:00:35.396992 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:35.396958 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:00:35.551845 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:35.551806 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:00:37.876373 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:37.876311 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:00:37.944904 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:37.944870 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:00:44.262042 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:44.261975 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:00:44.352238 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:44.352202 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:00:45.201273 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:45.201241 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xmjtt"] Jul 02 20:00:45.201618 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:45.201605 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20c43daa-e839-4aac-931f-409f601a9eb1" containerName="pull" Jul 02 20:00:45.201668 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:45.201620 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="20c43daa-e839-4aac-931f-409f601a9eb1" containerName="pull" Jul 02 20:00:45.201668 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:45.201630 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20c43daa-e839-4aac-931f-409f601a9eb1" containerName="util" Jul 02 20:00:45.201668 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:45.201636 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="20c43daa-e839-4aac-931f-409f601a9eb1" containerName="util" Jul 02 20:00:45.201668 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:45.201642 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71b6ed41-5d47-409b-a2ad-00111b2254e3" containerName="util" Jul 02 20:00:45.201668 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:45.201647 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="71b6ed41-5d47-409b-a2ad-00111b2254e3" containerName="util" Jul 02 20:00:45.201668 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:45.201653 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00470c70-198a-4e14-820d-ac3972c96d6f" containerName="extract" Jul 02 20:00:45.201668 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:45.201658 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="00470c70-198a-4e14-820d-ac3972c96d6f" containerName="extract" Jul 02 20:00:45.201668 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:45.201665 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f72fdf9b-80ec-460d-ac5d-5cb57db22d88" containerName="pull" Jul 02 20:00:45.201668 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:45.201670 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f72fdf9b-80ec-460d-ac5d-5cb57db22d88" containerName="pull" Jul 02 20:00:45.201930 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:45.201677 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20c43daa-e839-4aac-931f-409f601a9eb1" containerName="extract" Jul 02 20:00:45.201930 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:45.201682 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="20c43daa-e839-4aac-931f-409f601a9eb1" containerName="extract" Jul 02 20:00:45.201930 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:45.201689 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f72fdf9b-80ec-460d-ac5d-5cb57db22d88" containerName="util" Jul 02 20:00:45.201930 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:45.201694 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f72fdf9b-80ec-460d-ac5d-5cb57db22d88" containerName="util" Jul 02 20:00:45.201930 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:45.201701 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71b6ed41-5d47-409b-a2ad-00111b2254e3" containerName="extract" Jul 02 20:00:45.201930 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:45.201706 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="71b6ed41-5d47-409b-a2ad-00111b2254e3" containerName="extract" Jul 02 20:00:45.201930 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:45.201719 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f72fdf9b-80ec-460d-ac5d-5cb57db22d88" containerName="extract" Jul 02 20:00:45.201930 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:45.201726 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f72fdf9b-80ec-460d-ac5d-5cb57db22d88" containerName="extract" Jul 02 20:00:45.201930 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:45.201733 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00470c70-198a-4e14-820d-ac3972c96d6f" containerName="util" Jul 02 20:00:45.201930 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:45.201738 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="00470c70-198a-4e14-820d-ac3972c96d6f" containerName="util" Jul 02 20:00:45.201930 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:45.201747 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00470c70-198a-4e14-820d-ac3972c96d6f" containerName="pull" Jul 02 20:00:45.201930 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:45.201752 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="00470c70-198a-4e14-820d-ac3972c96d6f" containerName="pull" Jul 02 20:00:45.201930 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:45.201760 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71b6ed41-5d47-409b-a2ad-00111b2254e3" containerName="pull" Jul 02 20:00:45.201930 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:45.201765 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="71b6ed41-5d47-409b-a2ad-00111b2254e3" containerName="pull" Jul 02 20:00:45.201930 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:45.201813 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="20c43daa-e839-4aac-931f-409f601a9eb1" containerName="extract" Jul 02 20:00:45.201930 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:45.201820 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="71b6ed41-5d47-409b-a2ad-00111b2254e3" containerName="extract" Jul 02 20:00:45.201930 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:45.201829 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f72fdf9b-80ec-460d-ac5d-5cb57db22d88" containerName="extract" Jul 02 20:00:45.201930 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:45.201836 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="00470c70-198a-4e14-820d-ac3972c96d6f" containerName="extract" Jul 02 20:00:45.206376 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:45.206359 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xmjtt" Jul 02 20:00:45.209444 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:45.209422 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 02 20:00:45.209583 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:45.209423 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 02 20:00:45.209583 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:45.209529 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-nzpwx\"" Jul 02 20:00:45.221839 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:45.221816 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xmjtt"] Jul 02 20:00:45.257101 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:45.257053 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef12cf26-5a07-4983-9679-a95d7c149257-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-xmjtt\" (UID: \"ef12cf26-5a07-4983-9679-a95d7c149257\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xmjtt" Jul 02 20:00:45.257299 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:45.257216 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvzv9\" (UniqueName: \"kubernetes.io/projected/ef12cf26-5a07-4983-9679-a95d7c149257-kube-api-access-vvzv9\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-xmjtt\" (UID: \"ef12cf26-5a07-4983-9679-a95d7c149257\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xmjtt" Jul 02 20:00:45.358709 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:45.358653 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvzv9\" (UniqueName: \"kubernetes.io/projected/ef12cf26-5a07-4983-9679-a95d7c149257-kube-api-access-vvzv9\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-xmjtt\" (UID: \"ef12cf26-5a07-4983-9679-a95d7c149257\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xmjtt" Jul 02 20:00:45.359115 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:45.358750 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef12cf26-5a07-4983-9679-a95d7c149257-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-xmjtt\" (UID: \"ef12cf26-5a07-4983-9679-a95d7c149257\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xmjtt" Jul 02 20:00:45.359156 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:45.359130 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef12cf26-5a07-4983-9679-a95d7c149257-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-xmjtt\" (UID: \"ef12cf26-5a07-4983-9679-a95d7c149257\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xmjtt" Jul 02 20:00:45.369251 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:45.369224 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvzv9\" (UniqueName: \"kubernetes.io/projected/ef12cf26-5a07-4983-9679-a95d7c149257-kube-api-access-vvzv9\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-xmjtt\" (UID: \"ef12cf26-5a07-4983-9679-a95d7c149257\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xmjtt" Jul 02 20:00:45.516140 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:45.516047 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xmjtt" Jul 02 20:00:45.655985 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:45.655935 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xmjtt"] Jul 02 20:00:45.658430 ip-10-0-128-177 kubenswrapper[2565]: W0702 20:00:45.658404 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef12cf26_5a07_4983_9679_a95d7c149257.slice/crio-6ae0f101ff7dbc465d497980ff39c9637114bc0205c73f9c747c36d2352e4619 WatchSource:0}: Error finding container 6ae0f101ff7dbc465d497980ff39c9637114bc0205c73f9c747c36d2352e4619: Status 404 returned error can't find the container with id 6ae0f101ff7dbc465d497980ff39c9637114bc0205c73f9c747c36d2352e4619 Jul 02 20:00:46.011739 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:46.011700 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xmjtt"] Jul 02 20:00:46.017065 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:46.017031 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xmjtt"] Jul 02 20:00:50.137080 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:50.137037 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:00:50.323098 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:50.323058 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:00:50.693435 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:50.693389 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xmjtt" podUID="ef12cf26-5a07-4983-9679-a95d7c149257" containerName="manager" containerID="cri-o://84fe64a2d0a32d39d7f3bfbe86e6770fbc02199b52784714603ce13088441819" gracePeriod=2 Jul 02 20:00:50.936676 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:50.936650 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xmjtt" Jul 02 20:00:50.939069 ip-10-0-128-177 kubenswrapper[2565]: E0702 20:00:50.939041 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-xmjtt\" is forbidden: User \"system:node:ip-10-0-128-177.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-177.ec2.internal' and this object" podUID="ef12cf26-5a07-4983-9679-a95d7c149257" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xmjtt" Jul 02 20:00:51.008690 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:51.008602 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vvzv9\" (UniqueName: \"kubernetes.io/projected/ef12cf26-5a07-4983-9679-a95d7c149257-kube-api-access-vvzv9\") pod \"ef12cf26-5a07-4983-9679-a95d7c149257\" (UID: \"ef12cf26-5a07-4983-9679-a95d7c149257\") " Jul 02 20:00:51.008690 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:51.008667 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef12cf26-5a07-4983-9679-a95d7c149257-extensions-socket-volume\") pod \"ef12cf26-5a07-4983-9679-a95d7c149257\" (UID: \"ef12cf26-5a07-4983-9679-a95d7c149257\") " Jul 02 20:00:51.008922 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:51.008897 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef12cf26-5a07-4983-9679-a95d7c149257-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ef12cf26-5a07-4983-9679-a95d7c149257" (UID: "ef12cf26-5a07-4983-9679-a95d7c149257"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:00:51.010732 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:51.010705 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef12cf26-5a07-4983-9679-a95d7c149257-kube-api-access-vvzv9" (OuterVolumeSpecName: "kube-api-access-vvzv9") pod "ef12cf26-5a07-4983-9679-a95d7c149257" (UID: "ef12cf26-5a07-4983-9679-a95d7c149257"). InnerVolumeSpecName "kube-api-access-vvzv9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:00:51.110116 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:51.110078 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vvzv9\" (UniqueName: \"kubernetes.io/projected/ef12cf26-5a07-4983-9679-a95d7c149257-kube-api-access-vvzv9\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 20:00:51.110116 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:51.110108 2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef12cf26-5a07-4983-9679-a95d7c149257-extensions-socket-volume\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 20:00:51.520390 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:51.520355 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef12cf26-5a07-4983-9679-a95d7c149257" path="/var/lib/kubelet/pods/ef12cf26-5a07-4983-9679-a95d7c149257/volumes" Jul 02 20:00:51.699824 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:51.699793 2565 generic.go:356] "Generic (PLEG): container finished" podID="ef12cf26-5a07-4983-9679-a95d7c149257" containerID="84fe64a2d0a32d39d7f3bfbe86e6770fbc02199b52784714603ce13088441819" exitCode=2 Jul 02 20:00:51.700005 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:51.699835 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xmjtt" Jul 02 20:00:51.700005 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:51.699900 2565 scope.go:117] "RemoveContainer" containerID="84fe64a2d0a32d39d7f3bfbe86e6770fbc02199b52784714603ce13088441819" Jul 02 20:00:51.704464 ip-10-0-128-177 kubenswrapper[2565]: E0702 20:00:51.704432 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-xmjtt\" is forbidden: User \"system:node:ip-10-0-128-177.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-177.ec2.internal' and this object" podUID="ef12cf26-5a07-4983-9679-a95d7c149257" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xmjtt" Jul 02 20:00:51.708874 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:51.708844 2565 scope.go:117] "RemoveContainer" containerID="84fe64a2d0a32d39d7f3bfbe86e6770fbc02199b52784714603ce13088441819" Jul 02 20:00:51.709101 ip-10-0-128-177 kubenswrapper[2565]: E0702 20:00:51.709082 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84fe64a2d0a32d39d7f3bfbe86e6770fbc02199b52784714603ce13088441819\": container with ID starting with 84fe64a2d0a32d39d7f3bfbe86e6770fbc02199b52784714603ce13088441819 not found: ID does not exist" containerID="84fe64a2d0a32d39d7f3bfbe86e6770fbc02199b52784714603ce13088441819" Jul 02 20:00:51.709159 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:51.709109 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84fe64a2d0a32d39d7f3bfbe86e6770fbc02199b52784714603ce13088441819"} err="failed to get container status \"84fe64a2d0a32d39d7f3bfbe86e6770fbc02199b52784714603ce13088441819\": rpc error: code = NotFound desc = could not find container \"84fe64a2d0a32d39d7f3bfbe86e6770fbc02199b52784714603ce13088441819\": container with ID starting with 84fe64a2d0a32d39d7f3bfbe86e6770fbc02199b52784714603ce13088441819 not found: ID does not exist" Jul 02 20:00:51.862030 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:51.861954 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:00:51.962685 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:51.962655 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:00:55.421487 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:55.421454 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:00:55.524467 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:00:55.524433 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:01:01.903373 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:01:01.903271 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:01:02.001076 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:01:02.001034 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:01:07.469714 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:01:07.469676 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:01:07.531705 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:01:07.531669 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:01:08.070652 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:01:08.070616 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:01:08.181694 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:01:08.181661 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:01:11.476836 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:01:11.476799 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:01:11.578677 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:01:11.578603 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:01:15.058859 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:01:15.058822 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:01:15.135159 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:01:15.135113 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:01:17.197900 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:01:17.197864 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jpzh5"] Jul 02 20:01:17.198362 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:01:17.198226 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef12cf26-5a07-4983-9679-a95d7c149257" containerName="manager" Jul 02 20:01:17.198362 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:01:17.198236 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef12cf26-5a07-4983-9679-a95d7c149257" containerName="manager" Jul 02 20:01:17.198362 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:01:17.198308 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef12cf26-5a07-4983-9679-a95d7c149257" containerName="manager" Jul 02 20:01:17.202423 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:01:17.202402 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jpzh5" Jul 02 20:01:17.205678 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:01:17.205655 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-nzpwx\"" Jul 02 20:01:17.206281 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:01:17.206263 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 02 20:01:17.206724 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:01:17.206709 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 02 20:01:17.222460 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:01:17.222434 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jpzh5"] Jul 02 20:01:17.348257 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:01:17.348213 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/61a044f2-96ec-487d-bcd6-9c77ead2d69b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-jpzh5\" (UID: \"61a044f2-96ec-487d-bcd6-9c77ead2d69b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jpzh5" Jul 02 20:01:17.348485 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:01:17.348335 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h79cf\" (UniqueName: \"kubernetes.io/projected/61a044f2-96ec-487d-bcd6-9c77ead2d69b-kube-api-access-h79cf\") pod \"kuadrant-operator-controller-manager-86878c769f-jpzh5\" (UID: \"61a044f2-96ec-487d-bcd6-9c77ead2d69b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jpzh5" Jul 02 20:01:17.449109 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:01:17.449024 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h79cf\" (UniqueName: \"kubernetes.io/projected/61a044f2-96ec-487d-bcd6-9c77ead2d69b-kube-api-access-h79cf\") pod \"kuadrant-operator-controller-manager-86878c769f-jpzh5\" (UID: \"61a044f2-96ec-487d-bcd6-9c77ead2d69b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jpzh5" Jul 02 20:01:17.449109 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:01:17.449081 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/61a044f2-96ec-487d-bcd6-9c77ead2d69b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-jpzh5\" (UID: \"61a044f2-96ec-487d-bcd6-9c77ead2d69b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jpzh5" Jul 02 20:01:17.449471 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:01:17.449454 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/61a044f2-96ec-487d-bcd6-9c77ead2d69b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-jpzh5\" (UID: \"61a044f2-96ec-487d-bcd6-9c77ead2d69b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jpzh5" Jul 02 20:01:17.457482 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:01:17.457460 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h79cf\" (UniqueName: \"kubernetes.io/projected/61a044f2-96ec-487d-bcd6-9c77ead2d69b-kube-api-access-h79cf\") pod \"kuadrant-operator-controller-manager-86878c769f-jpzh5\" (UID: \"61a044f2-96ec-487d-bcd6-9c77ead2d69b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jpzh5" Jul 02 20:01:17.512326 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:01:17.512281 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jpzh5" Jul 02 20:01:17.666433 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:01:17.666410 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jpzh5"] Jul 02 20:01:17.669091 ip-10-0-128-177 kubenswrapper[2565]: W0702 20:01:17.669065 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61a044f2_96ec_487d_bcd6_9c77ead2d69b.slice/crio-db1f1cdb3ecf291825530c92771817bee92cb7ce5056eb51c9c85d858c0f748b WatchSource:0}: Error finding container db1f1cdb3ecf291825530c92771817bee92cb7ce5056eb51c9c85d858c0f748b: Status 404 returned error can't find the container with id db1f1cdb3ecf291825530c92771817bee92cb7ce5056eb51c9c85d858c0f748b Jul 02 20:01:17.839494 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:01:17.839451 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jpzh5" event={"ID":"61a044f2-96ec-487d-bcd6-9c77ead2d69b","Type":"ContainerStarted","Data":"7680111c12731cd4246db090210f4e8f82d1a64ac3d19c54829cb1858aa51d3d"} Jul 02 20:01:17.839685 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:01:17.839505 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jpzh5" event={"ID":"61a044f2-96ec-487d-bcd6-9c77ead2d69b","Type":"ContainerStarted","Data":"db1f1cdb3ecf291825530c92771817bee92cb7ce5056eb51c9c85d858c0f748b"} Jul 02 20:01:17.839685 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:01:17.839560 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jpzh5" Jul 02 20:01:17.868719 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:01:17.868667 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jpzh5" podStartSLOduration=0.868645044 podStartE2EDuration="868.645044ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:01:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:01:17.866336059 +0000 UTC m=+462.932393931" watchObservedRunningTime="2026-07-02 20:01:17.868645044 +0000 UTC m=+462.934702905" Jul 02 20:01:20.782939 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:01:20.782905 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:01:20.880086 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:01:20.880045 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:01:28.847911 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:01:28.847877 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jpzh5" Jul 02 20:01:33.375576 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:01:33.375540 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:01:34.006445 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:01:34.006410 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:01:36.992989 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:01:36.992953 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:01:37.116035 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:01:37.115998 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:01:37.184881 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:01:37.184851 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:01:37.926511 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:01:37.926467 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:01:37.988130 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:01:37.988082 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:01:56.866468 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:01:56.866418 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:02:08.846739 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:02:08.846696 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:02:08.947218 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:02:08.947168 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:02:12.562761 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:02:12.562726 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:02:14.897233 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:02:14.897197 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:02:15.005698 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:02:15.005663 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:02:18.639317 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:02:18.639278 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:02:18.739077 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:02:18.739042 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:02:43.202413 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:02:43.202317 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:02:43.255588 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:02:43.255541 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:02:50.079871 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:02:50.079838 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:02:50.512540 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:02:50.512500 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:02:50.889095 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:02:50.889019 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:02:51.052217 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:02:51.052184 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:02:51.150829 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:02:51.150744 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:03:01.807482 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:01.807426 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:03:01.904787 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:01.904746 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:03:16.892057 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:16.892022 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5276n"] Jul 02 20:03:16.895613 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:16.895594 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5276n" Jul 02 20:03:16.899413 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:16.899395 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 02 20:03:16.899587 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:16.899575 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 02 20:03:16.899645 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:16.899603 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-whwbw\"" Jul 02 20:03:16.899645 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:16.899603 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 02 20:03:16.905026 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:16.905006 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5276n"] Jul 02 20:03:16.980616 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:16.980587 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b551f9a6-bbb4-4bad-a804-8625624c30a5-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5276n\" (UID: \"b551f9a6-bbb4-4bad-a804-8625624c30a5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5276n" Jul 02 20:03:16.980796 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:16.980630 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b551f9a6-bbb4-4bad-a804-8625624c30a5-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5276n\" (UID: \"b551f9a6-bbb4-4bad-a804-8625624c30a5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5276n" Jul 02 20:03:16.980796 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:16.980713 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b551f9a6-bbb4-4bad-a804-8625624c30a5-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5276n\" (UID: \"b551f9a6-bbb4-4bad-a804-8625624c30a5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5276n" Jul 02 20:03:16.980913 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:16.980807 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b551f9a6-bbb4-4bad-a804-8625624c30a5-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5276n\" (UID: \"b551f9a6-bbb4-4bad-a804-8625624c30a5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5276n" Jul 02 20:03:16.980913 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:16.980839 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5s7w5\" (UniqueName: \"kubernetes.io/projected/b551f9a6-bbb4-4bad-a804-8625624c30a5-kube-api-access-5s7w5\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5276n\" (UID: \"b551f9a6-bbb4-4bad-a804-8625624c30a5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5276n" Jul 02 20:03:16.980913 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:16.980899 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b551f9a6-bbb4-4bad-a804-8625624c30a5-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5276n\" (UID: \"b551f9a6-bbb4-4bad-a804-8625624c30a5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5276n" Jul 02 20:03:16.992787 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:16.992747 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:03:17.081767 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:17.081737 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b551f9a6-bbb4-4bad-a804-8625624c30a5-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5276n\" (UID: \"b551f9a6-bbb4-4bad-a804-8625624c30a5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5276n" Jul 02 20:03:17.081958 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:17.081782 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b551f9a6-bbb4-4bad-a804-8625624c30a5-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5276n\" (UID: \"b551f9a6-bbb4-4bad-a804-8625624c30a5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5276n" Jul 02 20:03:17.081958 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:17.081830 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b551f9a6-bbb4-4bad-a804-8625624c30a5-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5276n\" (UID: \"b551f9a6-bbb4-4bad-a804-8625624c30a5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5276n" Jul 02 20:03:17.081958 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:17.081848 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5s7w5\" (UniqueName: \"kubernetes.io/projected/b551f9a6-bbb4-4bad-a804-8625624c30a5-kube-api-access-5s7w5\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5276n\" (UID: \"b551f9a6-bbb4-4bad-a804-8625624c30a5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5276n" Jul 02 20:03:17.081958 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:17.081874 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b551f9a6-bbb4-4bad-a804-8625624c30a5-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5276n\" (UID: \"b551f9a6-bbb4-4bad-a804-8625624c30a5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5276n" Jul 02 20:03:17.081958 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:17.081900 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b551f9a6-bbb4-4bad-a804-8625624c30a5-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5276n\" (UID: \"b551f9a6-bbb4-4bad-a804-8625624c30a5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5276n" Jul 02 20:03:17.082312 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:17.082287 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b551f9a6-bbb4-4bad-a804-8625624c30a5-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5276n\" (UID: \"b551f9a6-bbb4-4bad-a804-8625624c30a5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5276n" Jul 02 20:03:17.082401 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:17.082353 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b551f9a6-bbb4-4bad-a804-8625624c30a5-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5276n\" (UID: \"b551f9a6-bbb4-4bad-a804-8625624c30a5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5276n" Jul 02 20:03:17.082440 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:17.082405 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b551f9a6-bbb4-4bad-a804-8625624c30a5-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5276n\" (UID: \"b551f9a6-bbb4-4bad-a804-8625624c30a5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5276n" Jul 02 20:03:17.084182 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:17.084160 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b551f9a6-bbb4-4bad-a804-8625624c30a5-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5276n\" (UID: \"b551f9a6-bbb4-4bad-a804-8625624c30a5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5276n" Jul 02 20:03:17.084439 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:17.084421 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b551f9a6-bbb4-4bad-a804-8625624c30a5-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5276n\" (UID: \"b551f9a6-bbb4-4bad-a804-8625624c30a5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5276n" Jul 02 20:03:17.089921 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:17.089893 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5s7w5\" (UniqueName: \"kubernetes.io/projected/b551f9a6-bbb4-4bad-a804-8625624c30a5-kube-api-access-5s7w5\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5276n\" (UID: \"b551f9a6-bbb4-4bad-a804-8625624c30a5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5276n" Jul 02 20:03:17.206838 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:17.206802 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5276n" Jul 02 20:03:17.341497 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:17.341461 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5276n"] Jul 02 20:03:17.345214 ip-10-0-128-177 kubenswrapper[2565]: W0702 20:03:17.345187 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb551f9a6_bbb4_4bad_a804_8625624c30a5.slice/crio-7bd6371d9b6c2e212c7df6ab25d53b6c2ddcd057cd60fe6b56d0cfd158217443 WatchSource:0}: Error finding container 7bd6371d9b6c2e212c7df6ab25d53b6c2ddcd057cd60fe6b56d0cfd158217443: Status 404 returned error can't find the container with id 7bd6371d9b6c2e212c7df6ab25d53b6c2ddcd057cd60fe6b56d0cfd158217443 Jul 02 20:03:17.454914 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:17.454876 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5276n" event={"ID":"b551f9a6-bbb4-4bad-a804-8625624c30a5","Type":"ContainerStarted","Data":"7bd6371d9b6c2e212c7df6ab25d53b6c2ddcd057cd60fe6b56d0cfd158217443"} Jul 02 20:03:19.467695 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:19.467657 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5276n" event={"ID":"b551f9a6-bbb4-4bad-a804-8625624c30a5","Type":"ContainerStarted","Data":"b2f87d8e42eede77326015e5a4ab49e825f7706cc3551f1b4c3a1137d682beaa"} Jul 02 20:03:19.487058 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:19.486999 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5276n" podStartSLOduration=2.421139823 podStartE2EDuration="3.486981107s" totalImagesPullingTime="1.065841284s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:03:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:03:19.484611247 +0000 UTC m=+584.550669124" watchObservedRunningTime="2026-07-02 20:03:19.486981107 +0000 UTC m=+584.553038965" Jul 02 20:03:27.207355 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:27.207289 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5276n" Jul 02 20:03:27.207748 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:27.207383 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5276n" Jul 02 20:03:27.219915 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:27.219894 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5276n" Jul 02 20:03:27.522688 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:27.522610 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5276n" Jul 02 20:03:35.410604 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:35.410492 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-6n2jb_e50ef735-52fb-4047-8c8e-9378a771bbd3/console-operator/1.log" Jul 02 20:03:35.411958 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:35.411074 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-6n2jb_e50ef735-52fb-4047-8c8e-9378a771bbd3/console-operator/1.log" Jul 02 20:03:41.584959 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:41.584909 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:03:49.689674 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:49.689639 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-fpgmp"] Jul 02 20:03:49.693116 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:49.693092 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fpgmp" Jul 02 20:03:49.695838 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:49.695817 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 02 20:03:49.706597 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:49.706573 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-fpgmp"] Jul 02 20:03:49.731279 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:49.731237 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:03:49.871991 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:49.871952 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c94ba429-19a0-432f-afbe-bcf7332feddc-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fpgmp\" (UID: \"c94ba429-19a0-432f-afbe-bcf7332feddc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fpgmp" Jul 02 20:03:49.872171 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:49.871994 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c94ba429-19a0-432f-afbe-bcf7332feddc-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fpgmp\" (UID: \"c94ba429-19a0-432f-afbe-bcf7332feddc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fpgmp" Jul 02 20:03:49.872171 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:49.872026 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c94ba429-19a0-432f-afbe-bcf7332feddc-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fpgmp\" (UID: \"c94ba429-19a0-432f-afbe-bcf7332feddc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fpgmp" Jul 02 20:03:49.872171 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:49.872099 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c94ba429-19a0-432f-afbe-bcf7332feddc-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fpgmp\" (UID: \"c94ba429-19a0-432f-afbe-bcf7332feddc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fpgmp" Jul 02 20:03:49.872171 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:49.872154 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c94ba429-19a0-432f-afbe-bcf7332feddc-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fpgmp\" (UID: \"c94ba429-19a0-432f-afbe-bcf7332feddc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fpgmp" Jul 02 20:03:49.872335 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:49.872206 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdlkc\" (UniqueName: \"kubernetes.io/projected/c94ba429-19a0-432f-afbe-bcf7332feddc-kube-api-access-sdlkc\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fpgmp\" (UID: \"c94ba429-19a0-432f-afbe-bcf7332feddc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fpgmp" Jul 02 20:03:49.973510 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:49.973410 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c94ba429-19a0-432f-afbe-bcf7332feddc-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fpgmp\" (UID: \"c94ba429-19a0-432f-afbe-bcf7332feddc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fpgmp" Jul 02 20:03:49.973510 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:49.973455 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c94ba429-19a0-432f-afbe-bcf7332feddc-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fpgmp\" (UID: \"c94ba429-19a0-432f-afbe-bcf7332feddc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fpgmp" Jul 02 20:03:49.973510 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:49.973492 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdlkc\" (UniqueName: \"kubernetes.io/projected/c94ba429-19a0-432f-afbe-bcf7332feddc-kube-api-access-sdlkc\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fpgmp\" (UID: \"c94ba429-19a0-432f-afbe-bcf7332feddc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fpgmp" Jul 02 20:03:49.973786 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:49.973563 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c94ba429-19a0-432f-afbe-bcf7332feddc-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fpgmp\" (UID: \"c94ba429-19a0-432f-afbe-bcf7332feddc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fpgmp" Jul 02 20:03:49.973786 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:49.973579 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c94ba429-19a0-432f-afbe-bcf7332feddc-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fpgmp\" (UID: \"c94ba429-19a0-432f-afbe-bcf7332feddc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fpgmp" Jul 02 20:03:49.973786 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:49.973598 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c94ba429-19a0-432f-afbe-bcf7332feddc-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fpgmp\" (UID: \"c94ba429-19a0-432f-afbe-bcf7332feddc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fpgmp" Jul 02 20:03:49.973930 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:49.973837 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c94ba429-19a0-432f-afbe-bcf7332feddc-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fpgmp\" (UID: \"c94ba429-19a0-432f-afbe-bcf7332feddc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fpgmp" Jul 02 20:03:49.973991 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:49.973933 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c94ba429-19a0-432f-afbe-bcf7332feddc-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fpgmp\" (UID: \"c94ba429-19a0-432f-afbe-bcf7332feddc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fpgmp" Jul 02 20:03:49.973991 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:49.973956 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c94ba429-19a0-432f-afbe-bcf7332feddc-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fpgmp\" (UID: \"c94ba429-19a0-432f-afbe-bcf7332feddc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fpgmp" Jul 02 20:03:49.975924 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:49.975899 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c94ba429-19a0-432f-afbe-bcf7332feddc-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fpgmp\" (UID: \"c94ba429-19a0-432f-afbe-bcf7332feddc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fpgmp" Jul 02 20:03:49.976130 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:49.976111 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c94ba429-19a0-432f-afbe-bcf7332feddc-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fpgmp\" (UID: \"c94ba429-19a0-432f-afbe-bcf7332feddc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fpgmp" Jul 02 20:03:49.981783 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:49.981765 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdlkc\" (UniqueName: \"kubernetes.io/projected/c94ba429-19a0-432f-afbe-bcf7332feddc-kube-api-access-sdlkc\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fpgmp\" (UID: \"c94ba429-19a0-432f-afbe-bcf7332feddc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fpgmp" Jul 02 20:03:50.004723 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:50.004690 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fpgmp" Jul 02 20:03:50.145142 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:50.145116 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-fpgmp"] Jul 02 20:03:50.147800 ip-10-0-128-177 kubenswrapper[2565]: W0702 20:03:50.147765 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc94ba429_19a0_432f_afbe_bcf7332feddc.slice/crio-9433edab08d36bb8ac8746363129325af4200213376fe468fafcb4fa40513568 WatchSource:0}: Error finding container 9433edab08d36bb8ac8746363129325af4200213376fe468fafcb4fa40513568: Status 404 returned error can't find the container with id 9433edab08d36bb8ac8746363129325af4200213376fe468fafcb4fa40513568 Jul 02 20:03:50.632858 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:50.632764 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fpgmp" event={"ID":"c94ba429-19a0-432f-afbe-bcf7332feddc","Type":"ContainerStarted","Data":"82a787a6020c353cea2401336734cdc34354ee7b0aa73a69ede6284a6684b40e"} Jul 02 20:03:50.632858 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:50.632820 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fpgmp" event={"ID":"c94ba429-19a0-432f-afbe-bcf7332feddc","Type":"ContainerStarted","Data":"9433edab08d36bb8ac8746363129325af4200213376fe468fafcb4fa40513568"} Jul 02 20:03:50.650767 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:50.650704 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fpgmp" podStartSLOduration=1.471109463 podStartE2EDuration="1.650684767s" totalImagesPullingTime="179.575304ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:03:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:03:50.650046844 +0000 UTC m=+615.716104749" watchObservedRunningTime="2026-07-02 20:03:50.650684767 +0000 UTC m=+615.716742684" Jul 02 20:03:58.814552 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:58.814446 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:03:58.914806 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:03:58.914766 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:04:00.005674 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:04:00.005627 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fpgmp" Jul 02 20:04:00.006099 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:04:00.005690 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fpgmp" Jul 02 20:04:00.018535 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:04:00.018508 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fpgmp" Jul 02 20:04:00.694661 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:04:00.694633 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fpgmp" Jul 02 20:04:06.123862 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:04:06.123819 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:04:14.014784 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:04:14.014740 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:04:25.915615 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:04:25.915573 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:05:00.384459 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:05:00.384424 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:05:00.436460 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:05:00.436435 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:05:20.702016 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:05:20.701984 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:05:20.783118 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:05:20.783075 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:05:26.606643 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:05:26.606611 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:05:26.668880 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:05:26.668840 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:05:35.651060 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:05:35.650965 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:05:35.752004 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:05:35.751963 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:05:36.770706 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:05:36.770672 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:05:36.877489 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:05:36.877457 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:05:51.027805 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:05:51.027755 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:06:26.892980 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:06:26.892935 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:06:47.519791 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:06:47.519712 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:06:48.697072 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:06:48.697034 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:07:23.376832 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:07:23.376792 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:07:23.460905 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:07:23.460872 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:07:23.581394 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:07:23.581336 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:07:29.328985 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:07:29.328951 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:07:29.436218 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:07:29.436186 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:07:29.536415 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:07:29.536378 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:07:29.634586 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:07:29.634501 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:07:35.302981 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:07:35.302950 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:07:35.401720 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:07:35.401681 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:08:35.444355 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:08:35.444310 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-6n2jb_e50ef735-52fb-4047-8c8e-9378a771bbd3/console-operator/1.log" Jul 02 20:08:35.448048 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:08:35.448026 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-6n2jb_e50ef735-52fb-4047-8c8e-9378a771bbd3/console-operator/1.log" Jul 02 20:11:21.267413 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:11:21.267362 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:11:23.147173 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:11:23.147128 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jpzh5"] Jul 02 20:11:23.147631 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:11:23.147391 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jpzh5" podUID="61a044f2-96ec-487d-bcd6-9c77ead2d69b" containerName="manager" containerID="cri-o://7680111c12731cd4246db090210f4e8f82d1a64ac3d19c54829cb1858aa51d3d" gracePeriod=10 Jul 02 20:11:25.903961 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:11:25.903937 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jpzh5" Jul 02 20:11:25.997210 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:11:25.997168 2565 generic.go:356] "Generic (PLEG): container finished" podID="61a044f2-96ec-487d-bcd6-9c77ead2d69b" containerID="7680111c12731cd4246db090210f4e8f82d1a64ac3d19c54829cb1858aa51d3d" exitCode=0 Jul 02 20:11:25.997426 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:11:25.997212 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jpzh5" Jul 02 20:11:25.997426 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:11:25.997264 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jpzh5" event={"ID":"61a044f2-96ec-487d-bcd6-9c77ead2d69b","Type":"ContainerDied","Data":"7680111c12731cd4246db090210f4e8f82d1a64ac3d19c54829cb1858aa51d3d"} Jul 02 20:11:25.997426 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:11:25.997321 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jpzh5" event={"ID":"61a044f2-96ec-487d-bcd6-9c77ead2d69b","Type":"ContainerDied","Data":"db1f1cdb3ecf291825530c92771817bee92cb7ce5056eb51c9c85d858c0f748b"} Jul 02 20:11:25.997426 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:11:25.997366 2565 scope.go:117] "RemoveContainer" containerID="7680111c12731cd4246db090210f4e8f82d1a64ac3d19c54829cb1858aa51d3d" Jul 02 20:11:26.007040 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:11:26.007021 2565 scope.go:117] "RemoveContainer" containerID="7680111c12731cd4246db090210f4e8f82d1a64ac3d19c54829cb1858aa51d3d" Jul 02 20:11:26.007297 ip-10-0-128-177 kubenswrapper[2565]: E0702 20:11:26.007280 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7680111c12731cd4246db090210f4e8f82d1a64ac3d19c54829cb1858aa51d3d\": container with ID starting with 7680111c12731cd4246db090210f4e8f82d1a64ac3d19c54829cb1858aa51d3d not found: ID does not exist" containerID="7680111c12731cd4246db090210f4e8f82d1a64ac3d19c54829cb1858aa51d3d" Jul 02 20:11:26.007360 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:11:26.007308 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7680111c12731cd4246db090210f4e8f82d1a64ac3d19c54829cb1858aa51d3d"} err="failed to get container status \"7680111c12731cd4246db090210f4e8f82d1a64ac3d19c54829cb1858aa51d3d\": rpc error: code = NotFound desc = could not find container \"7680111c12731cd4246db090210f4e8f82d1a64ac3d19c54829cb1858aa51d3d\": container with ID starting with 7680111c12731cd4246db090210f4e8f82d1a64ac3d19c54829cb1858aa51d3d not found: ID does not exist" Jul 02 20:11:26.061520 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:11:26.061486 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/61a044f2-96ec-487d-bcd6-9c77ead2d69b-extensions-socket-volume\") pod \"61a044f2-96ec-487d-bcd6-9c77ead2d69b\" (UID: \"61a044f2-96ec-487d-bcd6-9c77ead2d69b\") " Jul 02 20:11:26.061679 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:11:26.061548 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h79cf\" (UniqueName: \"kubernetes.io/projected/61a044f2-96ec-487d-bcd6-9c77ead2d69b-kube-api-access-h79cf\") pod \"61a044f2-96ec-487d-bcd6-9c77ead2d69b\" (UID: \"61a044f2-96ec-487d-bcd6-9c77ead2d69b\") " Jul 02 20:11:26.061896 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:11:26.061872 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61a044f2-96ec-487d-bcd6-9c77ead2d69b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "61a044f2-96ec-487d-bcd6-9c77ead2d69b" (UID: "61a044f2-96ec-487d-bcd6-9c77ead2d69b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:11:26.063649 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:11:26.063628 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61a044f2-96ec-487d-bcd6-9c77ead2d69b-kube-api-access-h79cf" (OuterVolumeSpecName: "kube-api-access-h79cf") pod "61a044f2-96ec-487d-bcd6-9c77ead2d69b" (UID: "61a044f2-96ec-487d-bcd6-9c77ead2d69b"). InnerVolumeSpecName "kube-api-access-h79cf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:11:26.162999 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:11:26.162961 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h79cf\" (UniqueName: \"kubernetes.io/projected/61a044f2-96ec-487d-bcd6-9c77ead2d69b-kube-api-access-h79cf\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 20:11:26.162999 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:11:26.162993 2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/61a044f2-96ec-487d-bcd6-9c77ead2d69b-extensions-socket-volume\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 20:11:26.321107 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:11:26.321071 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jpzh5"] Jul 02 20:11:26.325438 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:11:26.325410 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jpzh5"] Jul 02 20:11:27.521130 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:11:27.521057 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61a044f2-96ec-487d-bcd6-9c77ead2d69b" path="/var/lib/kubelet/pods/61a044f2-96ec-487d-bcd6-9c77ead2d69b/volumes" Jul 02 20:12:24.263027 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:12:24.262987 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hjtbh"] Jul 02 20:12:24.263635 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:12:24.263521 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61a044f2-96ec-487d-bcd6-9c77ead2d69b" containerName="manager" Jul 02 20:12:24.263635 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:12:24.263540 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="61a044f2-96ec-487d-bcd6-9c77ead2d69b" containerName="manager" Jul 02 20:12:24.263766 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:12:24.263660 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="61a044f2-96ec-487d-bcd6-9c77ead2d69b" containerName="manager" Jul 02 20:12:24.265886 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:12:24.265866 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hjtbh" Jul 02 20:12:24.268729 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:12:24.268704 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 02 20:12:24.268840 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:12:24.268728 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-nzpwx\"" Jul 02 20:12:24.268840 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:12:24.268717 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 02 20:12:24.282197 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:12:24.282163 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hjtbh"] Jul 02 20:12:24.351041 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:12:24.351009 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drhcx\" (UniqueName: \"kubernetes.io/projected/56a2b865-4924-460c-906b-c5c3519a1cf3-kube-api-access-drhcx\") pod \"kuadrant-operator-controller-manager-86878c769f-hjtbh\" (UID: \"56a2b865-4924-460c-906b-c5c3519a1cf3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hjtbh" Jul 02 20:12:24.351215 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:12:24.351126 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/56a2b865-4924-460c-906b-c5c3519a1cf3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-hjtbh\" (UID: \"56a2b865-4924-460c-906b-c5c3519a1cf3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hjtbh" Jul 02 20:12:24.452413 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:12:24.452381 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/56a2b865-4924-460c-906b-c5c3519a1cf3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-hjtbh\" (UID: \"56a2b865-4924-460c-906b-c5c3519a1cf3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hjtbh" Jul 02 20:12:24.452571 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:12:24.452435 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drhcx\" (UniqueName: \"kubernetes.io/projected/56a2b865-4924-460c-906b-c5c3519a1cf3-kube-api-access-drhcx\") pod \"kuadrant-operator-controller-manager-86878c769f-hjtbh\" (UID: \"56a2b865-4924-460c-906b-c5c3519a1cf3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hjtbh" Jul 02 20:12:24.452736 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:12:24.452716 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/56a2b865-4924-460c-906b-c5c3519a1cf3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-hjtbh\" (UID: \"56a2b865-4924-460c-906b-c5c3519a1cf3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hjtbh" Jul 02 20:12:24.461114 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:12:24.461088 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-drhcx\" (UniqueName: \"kubernetes.io/projected/56a2b865-4924-460c-906b-c5c3519a1cf3-kube-api-access-drhcx\") pod \"kuadrant-operator-controller-manager-86878c769f-hjtbh\" (UID: \"56a2b865-4924-460c-906b-c5c3519a1cf3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hjtbh" Jul 02 20:12:24.579883 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:12:24.579798 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hjtbh" Jul 02 20:12:24.718773 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:12:24.718747 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hjtbh"] Jul 02 20:12:24.720638 ip-10-0-128-177 kubenswrapper[2565]: W0702 20:12:24.720608 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56a2b865_4924_460c_906b_c5c3519a1cf3.slice/crio-9a7010fa6ea928c5096a77fa6b48b9a078cf8224e2acf0cf763a8aec7b54e465 WatchSource:0}: Error finding container 9a7010fa6ea928c5096a77fa6b48b9a078cf8224e2acf0cf763a8aec7b54e465: Status 404 returned error can't find the container with id 9a7010fa6ea928c5096a77fa6b48b9a078cf8224e2acf0cf763a8aec7b54e465 Jul 02 20:12:25.298667 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:12:25.298630 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hjtbh" event={"ID":"56a2b865-4924-460c-906b-c5c3519a1cf3","Type":"ContainerStarted","Data":"8d3a532753e2f8260c0987c2474496b6f8980c4f409d0c9b2b35db43f87bcc39"} Jul 02 20:12:25.299094 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:12:25.298683 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hjtbh" event={"ID":"56a2b865-4924-460c-906b-c5c3519a1cf3","Type":"ContainerStarted","Data":"9a7010fa6ea928c5096a77fa6b48b9a078cf8224e2acf0cf763a8aec7b54e465"} Jul 02 20:12:25.299094 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:12:25.298751 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hjtbh" Jul 02 20:12:25.320628 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:12:25.320581 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hjtbh" podStartSLOduration=1.32056555 podStartE2EDuration="1.32056555s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:12:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:12:25.319147052 +0000 UTC m=+1130.385204925" watchObservedRunningTime="2026-07-02 20:12:25.32056555 +0000 UTC m=+1130.386623411" Jul 02 20:12:36.306369 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:12:36.306313 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hjtbh" Jul 02 20:13:31.076880 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:13:31.076844 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:13:31.158930 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:13:31.158896 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:13:35.487302 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:13:35.487194 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-6n2jb_e50ef735-52fb-4047-8c8e-9378a771bbd3/console-operator/1.log" Jul 02 20:13:35.492435 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:13:35.492414 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-6n2jb_e50ef735-52fb-4047-8c8e-9378a771bbd3/console-operator/1.log" Jul 02 20:14:16.092233 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:14:16.092199 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:14:35.268689 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:14:35.268555 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:17:01.326958 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:17:01.326920 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:17:03.092149 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:17:03.092112 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:18:05.413574 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:18:05.413537 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:18:15.678788 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:18:15.678755 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:18:23.330832 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:18:23.330784 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:18:28.438357 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:18:28.438318 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:18:31.317070 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:18:31.317024 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:18:31.414836 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:18:31.414801 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:18:31.781671 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:18:31.781630 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:18:35.531798 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:18:35.531693 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-6n2jb_e50ef735-52fb-4047-8c8e-9378a771bbd3/console-operator/1.log" Jul 02 20:18:35.538140 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:18:35.538120 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-6n2jb_e50ef735-52fb-4047-8c8e-9378a771bbd3/console-operator/1.log" Jul 02 20:18:37.631502 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:18:37.631466 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:18:37.702109 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:18:37.702074 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:18:37.846185 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:18:37.846154 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:18:37.940253 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:18:37.940215 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:18:39.119222 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:18:39.119181 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:18:39.196673 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:18:39.196645 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:18:39.264953 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:18:39.264913 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:18:39.365633 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:18:39.365594 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:18:39.670972 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:18:39.670933 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:18:39.771418 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:18:39.771379 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:18:41.432281 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:18:41.432233 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:18:44.118151 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:18:44.118091 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:18:44.308668 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:18:44.308632 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:18:44.409096 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:18:44.409000 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:18:44.513545 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:18:44.513505 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:18:47.414635 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:18:47.414605 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:18:50.345381 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:18:50.345324 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:18:50.447569 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:18:50.447522 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:18:50.576367 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:18:50.576305 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:18:50.645793 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:18:50.645702 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:18:51.780108 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:18:51.780071 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:18:51.871335 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:18:51.871303 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:18:51.930040 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:18:51.930004 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:18:52.065071 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:18:52.064984 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:18:52.343370 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:18:52.343248 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:18:52.445067 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:18:52.445016 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:18:53.610906 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:18:53.610864 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:18:56.954617 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:18:56.954579 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:18:57.256040 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:18:57.255899 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:19:03.283243 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:19:03.283208 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:19:03.386055 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:19:03.386022 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:19:09.286672 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:19:09.286623 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:19:09.387132 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:19:09.387099 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:19:09.505115 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:19:09.505078 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:19:10.315019 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:19:10.314982 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:19:10.368868 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:19:10.368831 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:19:10.696026 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:19:10.695987 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:19:10.780121 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:19:10.780092 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:19:10.846638 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:19:10.846605 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:19:10.944716 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:19:10.944679 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:19:11.384825 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:19:11.384791 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:19:11.485765 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:19:11.485736 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:19:13.692139 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:19:13.692111 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:19:15.215803 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:19:15.215766 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:19:15.453462 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:19:15.453430 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:19:15.561495 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:19:15.561423 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:19:15.668652 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:19:15.668623 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:19:16.969723 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:19:16.969682 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:19:21.269353 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:19:21.269300 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:19:21.340733 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:19:21.340700 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:19:21.766717 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:19:21.766682 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:19:21.861730 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:19:21.861699 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:19:21.934417 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:19:21.934377 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:19:23.379971 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:19:23.379923 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:19:29.032711 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:19:29.032670 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:19:29.129150 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:19:29.129109 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:19:29.228868 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:19:29.228834 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:19:29.328771 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:19:29.328689 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:19:29.742062 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:19:29.741958 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:19:55.706993 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:19:55.706953 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:20:01.502160 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:20:01.502112 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:20:01.565038 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:20:01.565001 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:20:01.652921 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:20:01.652884 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:20:01.753246 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:20:01.753158 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:20:17.681449 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:20:17.681415 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:20:23.371212 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:20:23.371164 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:20:23.473392 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:20:23.473353 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:20:23.570328 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:20:23.570297 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:20:34.120692 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:20:34.120609 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:20:34.980406 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:20:34.980371 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:20:40.693418 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:20:40.693375 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:20:40.806671 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:20:40.806638 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:20:40.892154 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:20:40.892119 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:20:40.992770 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:20:40.992674 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:20:41.786122 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:20:41.786092 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:20:41.909775 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:20:41.909735 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:20:42.036899 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:20:42.036807 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:20:43.668022 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:20:43.667985 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:20:49.450636 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:20:49.450587 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:20:49.521885 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:20:49.521832 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:20:50.120917 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:20:50.120876 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:20:50.681379 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:20:50.681317 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:20:55.835036 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:20:55.834997 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:20:55.934887 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:20:55.934850 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:20:56.096584 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:20:56.096501 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:20:56.409004 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:20:56.408921 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:20:56.881664 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:20:56.881630 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:20:59.389193 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:20:59.389151 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:20:59.482728 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:20:59.482683 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:20:59.562046 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:20:59.562011 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:20:59.754170 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:20:59.754128 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:21:00.074614 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:21:00.074501 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:21:00.172310 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:21:00.172269 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:21:03.884463 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:21:03.884431 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:21:04.538286 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:21:04.538249 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:21:04.630609 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:21:04.630569 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:21:04.966994 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:21:04.966956 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:21:10.931911 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:21:10.931874 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:21:11.033112 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:21:11.033076 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:21:11.311602 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:21:11.311512 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:21:11.636857 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:21:11.636782 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:21:11.709963 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:21:11.709930 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:21:17.474623 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:21:17.474582 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:21:17.532248 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:21:17.532214 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:21:17.729181 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:21:17.729080 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:21:17.949724 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:21:17.949692 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:21:18.062098 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:21:18.061998 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:21:18.118544 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:21:18.118508 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:21:18.280457 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:21:18.280413 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:21:23.824280 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:21:23.824225 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:21:23.926756 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:21:23.926721 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:21:24.021774 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:21:24.021720 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:21:24.230646 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:21:24.230608 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:21:29.905848 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:21:29.905808 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:21:29.967788 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:21:29.967747 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:21:36.322054 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:21:36.322022 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:21:36.646674 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:21:36.646590 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:21:36.997730 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:21:36.997698 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:21:39.705661 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:21:39.705618 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:21:39.800306 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:21:39.800266 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:21:39.899235 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:21:39.899191 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:21:40.416623 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:21:40.416584 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:21:40.518354 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:21:40.518316 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:21:40.618319 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:21:40.618288 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:21:44.077154 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:21:44.077121 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:22:02.123150 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:22:02.123060 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:22:10.178645 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:22:10.178614 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:22:11.473472 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:22:11.473434 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:22:26.768921 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:22:26.768882 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:22:27.185892 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:22:27.185858 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:22:27.287250 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:22:27.287204 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:22:27.585422 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:22:27.585310 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:22:32.888493 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:22:32.888459 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:22:37.923586 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:22:37.923545 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:23:14.760305 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:23:14.760265 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:23:15.298061 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:23:15.298023 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:23:21.369685 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:23:21.369647 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:23:27.254278 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:23:27.254187 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:23:27.356189 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:23:27.356155 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:23:27.545607 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:23:27.545508 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:23:27.788716 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:23:27.788678 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:23:28.856691 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:23:28.856649 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:23:28.954588 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:23:28.954552 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:23:29.055083 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:23:29.055048 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:23:29.827132 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:23:29.827093 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:23:29.915800 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:23:29.915743 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:23:30.015630 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:23:30.015595 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:23:31.433554 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:23:31.433519 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:23:35.566978 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:23:35.566877 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-6n2jb_e50ef735-52fb-4047-8c8e-9378a771bbd3/console-operator/1.log" Jul 02 20:23:35.576182 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:23:35.576164 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-6n2jb_e50ef735-52fb-4047-8c8e-9378a771bbd3/console-operator/1.log" Jul 02 20:23:37.545469 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:23:37.545434 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:23:37.645881 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:23:37.645843 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:23:38.255880 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:23:38.255832 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:23:44.170252 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:23:44.170209 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:23:44.332590 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:23:44.332551 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:23:44.442736 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:23:44.442697 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:23:54.927862 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:23:54.927818 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:23:55.280835 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:23:55.280749 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:24:16.303670 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:24:16.303622 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:24:18.435809 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:24:18.435774 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:24:22.253716 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:24:22.253678 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:24:22.326783 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:24:22.326742 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:24:22.570587 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:24:22.570498 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:24:22.892316 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:24:22.892237 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:24:23.323780 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:24:23.323721 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:24:25.586027 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:24:25.585989 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:24:25.687631 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:24:25.687594 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:24:25.776424 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:24:25.776395 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:24:25.869371 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:24:25.869262 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:24:26.404641 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:24:26.404608 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:24:26.503880 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:24:26.503846 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:24:29.993504 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:24:29.993470 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:24:30.312708 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:24:30.312628 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:24:30.647676 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:24:30.647584 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:24:30.916318 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:24:30.916229 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:24:33.571130 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:24:33.571078 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:24:33.671928 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:24:33.671886 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:24:33.724837 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:24:33.724806 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-b-761cb8-86c798cc7-twhdv"] Jul 02 20:24:33.728309 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:24:33.728294 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-761cb8-86c798cc7-twhdv" Jul 02 20:24:33.733716 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:24:33.733665 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-zvdpx\"" Jul 02 20:24:33.734530 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:24:33.734507 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-b-761cb8-serving-cert\"" Jul 02 20:24:33.744328 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:24:33.744304 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-761cb8-86c798cc7-twhdv"] Jul 02 20:24:33.779308 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:24:33.779277 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:24:33.817585 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:24:33.817554 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5128dffe-60d5-47be-beb5-9df214fa6354-openshift-service-ca\") pod \"maas-api-e2e-inf-b-761cb8-86c798cc7-twhdv\" (UID: \"5128dffe-60d5-47be-beb5-9df214fa6354\") " pod="opendatahub/maas-api-e2e-inf-b-761cb8-86c798cc7-twhdv" Jul 02 20:24:33.817694 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:24:33.817588 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvc6z\" (UniqueName: \"kubernetes.io/projected/5128dffe-60d5-47be-beb5-9df214fa6354-kube-api-access-xvc6z\") pod \"maas-api-e2e-inf-b-761cb8-86c798cc7-twhdv\" (UID: \"5128dffe-60d5-47be-beb5-9df214fa6354\") " pod="opendatahub/maas-api-e2e-inf-b-761cb8-86c798cc7-twhdv" Jul 02 20:24:33.817694 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:24:33.817639 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5128dffe-60d5-47be-beb5-9df214fa6354-maas-api-tls\") pod \"maas-api-e2e-inf-b-761cb8-86c798cc7-twhdv\" (UID: \"5128dffe-60d5-47be-beb5-9df214fa6354\") " pod="opendatahub/maas-api-e2e-inf-b-761cb8-86c798cc7-twhdv" Jul 02 20:24:33.918522 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:24:33.918439 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5128dffe-60d5-47be-beb5-9df214fa6354-openshift-service-ca\") pod \"maas-api-e2e-inf-b-761cb8-86c798cc7-twhdv\" (UID: \"5128dffe-60d5-47be-beb5-9df214fa6354\") " pod="opendatahub/maas-api-e2e-inf-b-761cb8-86c798cc7-twhdv" Jul 02 20:24:33.918522 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:24:33.918477 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvc6z\" (UniqueName: \"kubernetes.io/projected/5128dffe-60d5-47be-beb5-9df214fa6354-kube-api-access-xvc6z\") pod \"maas-api-e2e-inf-b-761cb8-86c798cc7-twhdv\" (UID: \"5128dffe-60d5-47be-beb5-9df214fa6354\") " pod="opendatahub/maas-api-e2e-inf-b-761cb8-86c798cc7-twhdv" Jul 02 20:24:33.918522 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:24:33.918510 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5128dffe-60d5-47be-beb5-9df214fa6354-maas-api-tls\") pod \"maas-api-e2e-inf-b-761cb8-86c798cc7-twhdv\" (UID: \"5128dffe-60d5-47be-beb5-9df214fa6354\") " pod="opendatahub/maas-api-e2e-inf-b-761cb8-86c798cc7-twhdv" Jul 02 20:24:33.919115 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:24:33.919090 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5128dffe-60d5-47be-beb5-9df214fa6354-openshift-service-ca\") pod \"maas-api-e2e-inf-b-761cb8-86c798cc7-twhdv\" (UID: \"5128dffe-60d5-47be-beb5-9df214fa6354\") " pod="opendatahub/maas-api-e2e-inf-b-761cb8-86c798cc7-twhdv" Jul 02 20:24:33.920903 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:24:33.920881 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5128dffe-60d5-47be-beb5-9df214fa6354-maas-api-tls\") pod \"maas-api-e2e-inf-b-761cb8-86c798cc7-twhdv\" (UID: \"5128dffe-60d5-47be-beb5-9df214fa6354\") " pod="opendatahub/maas-api-e2e-inf-b-761cb8-86c798cc7-twhdv" Jul 02 20:24:33.930840 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:24:33.930816 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvc6z\" (UniqueName: \"kubernetes.io/projected/5128dffe-60d5-47be-beb5-9df214fa6354-kube-api-access-xvc6z\") pod \"maas-api-e2e-inf-b-761cb8-86c798cc7-twhdv\" (UID: \"5128dffe-60d5-47be-beb5-9df214fa6354\") " pod="opendatahub/maas-api-e2e-inf-b-761cb8-86c798cc7-twhdv" Jul 02 20:24:33.998781 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:24:33.998749 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:24:34.039805 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:24:34.039773 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-761cb8-86c798cc7-twhdv" Jul 02 20:24:34.189843 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:24:34.189819 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-761cb8-86c798cc7-twhdv"] Jul 02 20:24:34.191266 ip-10-0-128-177 kubenswrapper[2565]: W0702 20:24:34.191232 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5128dffe_60d5_47be_beb5_9df214fa6354.slice/crio-085cb6175beaa6186a4d41136f6eb71386847daa2a4e14cddf9e600231960625 WatchSource:0}: Error finding container 085cb6175beaa6186a4d41136f6eb71386847daa2a4e14cddf9e600231960625: Status 404 returned error can't find the container with id 085cb6175beaa6186a4d41136f6eb71386847daa2a4e14cddf9e600231960625 Jul 02 20:24:34.192641 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:24:34.192624 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 20:24:34.454974 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:24:34.454887 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:24:34.555299 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:24:34.555227 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:24:35.093865 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:24:35.093787 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-761cb8-86c798cc7-twhdv" event={"ID":"5128dffe-60d5-47be-beb5-9df214fa6354","Type":"ContainerStarted","Data":"085cb6175beaa6186a4d41136f6eb71386847daa2a4e14cddf9e600231960625"} Jul 02 20:24:36.100418 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:24:36.100382 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-761cb8-86c798cc7-twhdv" event={"ID":"5128dffe-60d5-47be-beb5-9df214fa6354","Type":"ContainerStarted","Data":"94617c839f8f770ac8fc54ee8353ba6039fa11ddb0a21790a23ea32e544a0b0e"} Jul 02 20:24:36.100869 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:24:36.100442 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-b-761cb8-86c798cc7-twhdv" Jul 02 20:24:36.130102 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:24:36.130056 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-b-761cb8-86c798cc7-twhdv" podStartSLOduration=1.760589755 podStartE2EDuration="3.130041012s" totalImagesPullingTime="1.369451257s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:24:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:24:36.128668839 +0000 UTC m=+1861.194726702" watchObservedRunningTime="2026-07-02 20:24:36.130041012 +0000 UTC m=+1861.196098894" Jul 02 20:24:38.060749 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:24:38.060709 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:24:42.110981 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:24:42.110954 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-b-761cb8-86c798cc7-twhdv" Jul 02 20:24:47.362962 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:24:47.362927 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:24:47.461032 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:24:47.460984 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:24:48.862842 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:24:48.862804 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:24:55.262590 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:24:55.262547 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:24:55.370696 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:24:55.370662 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:25:18.142196 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:18.142164 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-761cb8/test-model-761cb8-kserve-6f55d5c855-5pv87"] Jul 02 20:25:18.145996 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:18.145979 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-761cb8/test-model-761cb8-kserve-6f55d5c855-5pv87" Jul 02 20:25:18.149236 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:18.149217 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-761cb8\"/\"test-model-761cb8-kserve-self-signed-certs\"" Jul 02 20:25:18.150302 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:18.150284 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-761cb8\"/\"openshift-service-ca.crt\"" Jul 02 20:25:18.150441 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:18.150421 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-761cb8\"/\"kube-root-ca.crt\"" Jul 02 20:25:18.150517 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:18.150504 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-761cb8\"/\"default-dockercfg-7xgg8\"" Jul 02 20:25:18.175102 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:18.175078 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-761cb8/test-model-761cb8-kserve-6f55d5c855-5pv87"] Jul 02 20:25:18.201041 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:18.201015 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:25:18.310393 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:18.310355 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317-model-cache\") pod \"test-model-761cb8-kserve-6f55d5c855-5pv87\" (UID: \"ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317\") " pod="ai-tenant-e2e-inf-b-761cb8/test-model-761cb8-kserve-6f55d5c855-5pv87" Jul 02 20:25:18.310576 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:18.310414 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmj4d\" (UniqueName: \"kubernetes.io/projected/ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317-kube-api-access-wmj4d\") pod \"test-model-761cb8-kserve-6f55d5c855-5pv87\" (UID: \"ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317\") " pod="ai-tenant-e2e-inf-b-761cb8/test-model-761cb8-kserve-6f55d5c855-5pv87" Jul 02 20:25:18.310576 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:18.310470 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317-home\") pod \"test-model-761cb8-kserve-6f55d5c855-5pv87\" (UID: \"ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317\") " pod="ai-tenant-e2e-inf-b-761cb8/test-model-761cb8-kserve-6f55d5c855-5pv87" Jul 02 20:25:18.310576 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:18.310538 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317-dshm\") pod \"test-model-761cb8-kserve-6f55d5c855-5pv87\" (UID: \"ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317\") " pod="ai-tenant-e2e-inf-b-761cb8/test-model-761cb8-kserve-6f55d5c855-5pv87" Jul 02 20:25:18.310748 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:18.310630 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317-tmp-dir\") pod \"test-model-761cb8-kserve-6f55d5c855-5pv87\" (UID: \"ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317\") " pod="ai-tenant-e2e-inf-b-761cb8/test-model-761cb8-kserve-6f55d5c855-5pv87" Jul 02 20:25:18.310748 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:18.310656 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317-tls-certs\") pod \"test-model-761cb8-kserve-6f55d5c855-5pv87\" (UID: \"ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317\") " pod="ai-tenant-e2e-inf-b-761cb8/test-model-761cb8-kserve-6f55d5c855-5pv87" Jul 02 20:25:18.411954 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:18.411854 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317-tmp-dir\") pod \"test-model-761cb8-kserve-6f55d5c855-5pv87\" (UID: \"ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317\") " pod="ai-tenant-e2e-inf-b-761cb8/test-model-761cb8-kserve-6f55d5c855-5pv87" Jul 02 20:25:18.411954 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:18.411896 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317-tls-certs\") pod \"test-model-761cb8-kserve-6f55d5c855-5pv87\" (UID: \"ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317\") " pod="ai-tenant-e2e-inf-b-761cb8/test-model-761cb8-kserve-6f55d5c855-5pv87" Jul 02 20:25:18.411954 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:18.411923 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317-model-cache\") pod \"test-model-761cb8-kserve-6f55d5c855-5pv87\" (UID: \"ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317\") " pod="ai-tenant-e2e-inf-b-761cb8/test-model-761cb8-kserve-6f55d5c855-5pv87" Jul 02 20:25:18.412238 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:18.411954 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmj4d\" (UniqueName: \"kubernetes.io/projected/ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317-kube-api-access-wmj4d\") pod \"test-model-761cb8-kserve-6f55d5c855-5pv87\" (UID: \"ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317\") " pod="ai-tenant-e2e-inf-b-761cb8/test-model-761cb8-kserve-6f55d5c855-5pv87" Jul 02 20:25:18.412238 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:18.412003 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317-home\") pod \"test-model-761cb8-kserve-6f55d5c855-5pv87\" (UID: \"ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317\") " pod="ai-tenant-e2e-inf-b-761cb8/test-model-761cb8-kserve-6f55d5c855-5pv87" Jul 02 20:25:18.412238 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:18.412055 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317-dshm\") pod \"test-model-761cb8-kserve-6f55d5c855-5pv87\" (UID: \"ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317\") " pod="ai-tenant-e2e-inf-b-761cb8/test-model-761cb8-kserve-6f55d5c855-5pv87" Jul 02 20:25:18.412442 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:18.412297 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317-model-cache\") pod \"test-model-761cb8-kserve-6f55d5c855-5pv87\" (UID: \"ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317\") " pod="ai-tenant-e2e-inf-b-761cb8/test-model-761cb8-kserve-6f55d5c855-5pv87" Jul 02 20:25:18.412442 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:18.412368 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317-tmp-dir\") pod \"test-model-761cb8-kserve-6f55d5c855-5pv87\" (UID: \"ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317\") " pod="ai-tenant-e2e-inf-b-761cb8/test-model-761cb8-kserve-6f55d5c855-5pv87" Jul 02 20:25:18.412442 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:18.412411 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317-home\") pod \"test-model-761cb8-kserve-6f55d5c855-5pv87\" (UID: \"ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317\") " pod="ai-tenant-e2e-inf-b-761cb8/test-model-761cb8-kserve-6f55d5c855-5pv87" Jul 02 20:25:18.414150 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:18.414128 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317-dshm\") pod \"test-model-761cb8-kserve-6f55d5c855-5pv87\" (UID: \"ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317\") " pod="ai-tenant-e2e-inf-b-761cb8/test-model-761cb8-kserve-6f55d5c855-5pv87" Jul 02 20:25:18.414520 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:18.414498 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317-tls-certs\") pod \"test-model-761cb8-kserve-6f55d5c855-5pv87\" (UID: \"ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317\") " pod="ai-tenant-e2e-inf-b-761cb8/test-model-761cb8-kserve-6f55d5c855-5pv87" Jul 02 20:25:18.423145 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:18.423126 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmj4d\" (UniqueName: \"kubernetes.io/projected/ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317-kube-api-access-wmj4d\") pod \"test-model-761cb8-kserve-6f55d5c855-5pv87\" (UID: \"ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317\") " pod="ai-tenant-e2e-inf-b-761cb8/test-model-761cb8-kserve-6f55d5c855-5pv87" Jul 02 20:25:18.455144 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:18.455121 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-761cb8/test-model-761cb8-kserve-6f55d5c855-5pv87" Jul 02 20:25:18.595700 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:18.595665 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-761cb8/test-model-761cb8-kserve-6f55d5c855-5pv87"] Jul 02 20:25:18.599016 ip-10-0-128-177 kubenswrapper[2565]: W0702 20:25:18.598990 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podecfe9bd4_c4b8_43f0_99e7_a6f8f08bd317.slice/crio-f68d2d3e9f2d530427fe20155adb37d13d1211ee422367dfa2c9fb805d5fd129 WatchSource:0}: Error finding container f68d2d3e9f2d530427fe20155adb37d13d1211ee422367dfa2c9fb805d5fd129: Status 404 returned error can't find the container with id f68d2d3e9f2d530427fe20155adb37d13d1211ee422367dfa2c9fb805d5fd129 Jul 02 20:25:19.325673 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:19.325638 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-761cb8/test-model-761cb8-kserve-6f55d5c855-5pv87" event={"ID":"ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317","Type":"ContainerStarted","Data":"11fa201c9b3d6c95b68506f52065d0dd1a16ed119cd0c4bb70d002777e441061"} Jul 02 20:25:19.325673 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:19.325681 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-761cb8/test-model-761cb8-kserve-6f55d5c855-5pv87" event={"ID":"ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317","Type":"ContainerStarted","Data":"f68d2d3e9f2d530427fe20155adb37d13d1211ee422367dfa2c9fb805d5fd129"} Jul 02 20:25:19.347154 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:19.347110 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-761cb8/test-model-761cb8-kserve-6f55d5c855-5pv87" podStartSLOduration=1.34709657 podStartE2EDuration="1.34709657s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:25:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:25:19.345195964 +0000 UTC m=+1904.411253825" watchObservedRunningTime="2026-07-02 20:25:19.34709657 +0000 UTC m=+1904.413154431" Jul 02 20:25:28.455353 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:28.455304 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-761cb8/test-model-761cb8-kserve-6f55d5c855-5pv87" Jul 02 20:25:28.455863 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:28.455371 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-761cb8/test-model-761cb8-kserve-6f55d5c855-5pv87" Jul 02 20:25:28.468521 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:28.468490 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-761cb8/test-model-761cb8-kserve-6f55d5c855-5pv87" Jul 02 20:25:29.388784 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:29.388755 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-761cb8/test-model-761cb8-kserve-6f55d5c855-5pv87" Jul 02 20:25:37.202251 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:37.202217 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:25:38.075861 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:38.075827 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-761cb8/test-model-761cb8-kserve-6f55d5c855-5pv87"] Jul 02 20:25:38.099139 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:38.099105 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:25:38.284064 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:38.284019 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:25:38.660749 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:38.660719 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:25:38.759053 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:38.759022 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:25:38.865735 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:38.865699 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:25:39.021566 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:39.021530 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:25:43.734201 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:43.734170 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:25:53.095719 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:53.095671 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-761cb8/test-model-761cb8-kserve-6f55d5c855-5pv87" podUID="ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317" containerName="main" containerID="cri-o://11fa201c9b3d6c95b68506f52065d0dd1a16ed119cd0c4bb70d002777e441061" gracePeriod=45 Jul 02 20:25:53.353225 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:53.353150 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-761cb8/test-model-761cb8-kserve-6f55d5c855-5pv87" Jul 02 20:25:53.420270 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:53.420234 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317-tls-certs\") pod \"ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317\" (UID: \"ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317\") " Jul 02 20:25:53.420463 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:53.420302 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317-tmp-dir\") pod \"ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317\" (UID: \"ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317\") " Jul 02 20:25:53.420463 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:53.420323 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317-model-cache\") pod \"ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317\" (UID: \"ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317\") " Jul 02 20:25:53.420463 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:53.420439 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317-home\") pod \"ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317\" (UID: \"ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317\") " Jul 02 20:25:53.420633 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:53.420493 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wmj4d\" (UniqueName: \"kubernetes.io/projected/ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317-kube-api-access-wmj4d\") pod \"ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317\" (UID: \"ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317\") " Jul 02 20:25:53.420633 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:53.420521 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317-dshm\") pod \"ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317\" (UID: \"ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317\") " Jul 02 20:25:53.420633 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:53.420564 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317-model-cache" (OuterVolumeSpecName: "model-cache") pod "ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317" (UID: "ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:25:53.420633 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:53.420581 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317" (UID: "ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:25:53.420811 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:53.420700 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317-home" (OuterVolumeSpecName: "home") pod "ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317" (UID: "ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:25:53.420903 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:53.420876 2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317-model-cache\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 20:25:53.420903 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:53.420900 2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317-home\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 20:25:53.420903 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:53.420910 2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317-tmp-dir\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 20:25:53.422551 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:53.422525 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317" (UID: "ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 20:25:53.422551 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:53.422543 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317-dshm" (OuterVolumeSpecName: "dshm") pod "ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317" (UID: "ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:25:53.422670 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:53.422648 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317-kube-api-access-wmj4d" (OuterVolumeSpecName: "kube-api-access-wmj4d") pod "ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317" (UID: "ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317"). InnerVolumeSpecName "kube-api-access-wmj4d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:25:53.506315 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:53.506283 2565 generic.go:356] "Generic (PLEG): container finished" podID="ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317" containerID="11fa201c9b3d6c95b68506f52065d0dd1a16ed119cd0c4bb70d002777e441061" exitCode=0 Jul 02 20:25:53.506476 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:53.506328 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-761cb8/test-model-761cb8-kserve-6f55d5c855-5pv87" Jul 02 20:25:53.506476 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:53.506380 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-761cb8/test-model-761cb8-kserve-6f55d5c855-5pv87" event={"ID":"ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317","Type":"ContainerDied","Data":"11fa201c9b3d6c95b68506f52065d0dd1a16ed119cd0c4bb70d002777e441061"} Jul 02 20:25:53.506476 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:53.506425 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-761cb8/test-model-761cb8-kserve-6f55d5c855-5pv87" event={"ID":"ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317","Type":"ContainerDied","Data":"f68d2d3e9f2d530427fe20155adb37d13d1211ee422367dfa2c9fb805d5fd129"} Jul 02 20:25:53.506476 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:53.506443 2565 scope.go:117] "RemoveContainer" containerID="11fa201c9b3d6c95b68506f52065d0dd1a16ed119cd0c4bb70d002777e441061" Jul 02 20:25:53.515458 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:53.515440 2565 scope.go:117] "RemoveContainer" containerID="11fa201c9b3d6c95b68506f52065d0dd1a16ed119cd0c4bb70d002777e441061" Jul 02 20:25:53.515709 ip-10-0-128-177 kubenswrapper[2565]: E0702 20:25:53.515690 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11fa201c9b3d6c95b68506f52065d0dd1a16ed119cd0c4bb70d002777e441061\": container with ID starting with 11fa201c9b3d6c95b68506f52065d0dd1a16ed119cd0c4bb70d002777e441061 not found: ID does not exist" containerID="11fa201c9b3d6c95b68506f52065d0dd1a16ed119cd0c4bb70d002777e441061" Jul 02 20:25:53.515771 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:53.515718 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11fa201c9b3d6c95b68506f52065d0dd1a16ed119cd0c4bb70d002777e441061"} err="failed to get container status \"11fa201c9b3d6c95b68506f52065d0dd1a16ed119cd0c4bb70d002777e441061\": rpc error: code = NotFound desc = could not find container \"11fa201c9b3d6c95b68506f52065d0dd1a16ed119cd0c4bb70d002777e441061\": container with ID starting with 11fa201c9b3d6c95b68506f52065d0dd1a16ed119cd0c4bb70d002777e441061 not found: ID does not exist" Jul 02 20:25:53.521625 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:53.521607 2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317-tls-certs\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 20:25:53.521625 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:53.521626 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wmj4d\" (UniqueName: \"kubernetes.io/projected/ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317-kube-api-access-wmj4d\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 20:25:53.521744 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:53.521635 2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317-dshm\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 20:25:53.529239 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:53.529218 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-761cb8/test-model-761cb8-kserve-6f55d5c855-5pv87"] Jul 02 20:25:53.533311 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:53.533285 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-761cb8/test-model-761cb8-kserve-6f55d5c855-5pv87"] Jul 02 20:25:55.520083 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:25:55.520046 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317" path="/var/lib/kubelet/pods/ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317/volumes" Jul 02 20:26:13.985983 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:13.985939 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:26:14.044307 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:14.044271 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:26:20.689419 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:20.689375 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:26:20.989313 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:20.989220 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:26:21.237328 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:21.237291 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:26:21.414625 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:21.414547 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:26:21.832763 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:21.832731 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:26:21.932824 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:21.932789 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:26:22.079831 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:22.079783 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-761cb8-86c798cc7-twhdv"] Jul 02 20:26:22.080075 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:22.080047 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-b-761cb8-86c798cc7-twhdv" podUID="5128dffe-60d5-47be-beb5-9df214fa6354" containerName="maas-api" containerID="cri-o://94617c839f8f770ac8fc54ee8353ba6039fa11ddb0a21790a23ea32e544a0b0e" gracePeriod=30 Jul 02 20:26:22.106099 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:22.106016 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-e2e-inf-b-761cb8-86c798cc7-twhdv" podUID="5128dffe-60d5-47be-beb5-9df214fa6354" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.42:8443/health\": dial tcp 10.132.0.42:8443: connect: connection refused" Jul 02 20:26:22.113840 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:22.113797 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:26:22.532550 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:22.532524 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-761cb8-86c798cc7-twhdv" Jul 02 20:26:22.652321 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:22.652225 2565 generic.go:356] "Generic (PLEG): container finished" podID="5128dffe-60d5-47be-beb5-9df214fa6354" containerID="94617c839f8f770ac8fc54ee8353ba6039fa11ddb0a21790a23ea32e544a0b0e" exitCode=0 Jul 02 20:26:22.652321 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:22.652283 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-761cb8-86c798cc7-twhdv" Jul 02 20:26:22.652511 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:22.652330 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-761cb8-86c798cc7-twhdv" event={"ID":"5128dffe-60d5-47be-beb5-9df214fa6354","Type":"ContainerDied","Data":"94617c839f8f770ac8fc54ee8353ba6039fa11ddb0a21790a23ea32e544a0b0e"} Jul 02 20:26:22.652511 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:22.652427 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-761cb8-86c798cc7-twhdv" event={"ID":"5128dffe-60d5-47be-beb5-9df214fa6354","Type":"ContainerDied","Data":"085cb6175beaa6186a4d41136f6eb71386847daa2a4e14cddf9e600231960625"} Jul 02 20:26:22.652511 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:22.652455 2565 scope.go:117] "RemoveContainer" containerID="94617c839f8f770ac8fc54ee8353ba6039fa11ddb0a21790a23ea32e544a0b0e" Jul 02 20:26:22.663426 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:22.663319 2565 scope.go:117] "RemoveContainer" containerID="94617c839f8f770ac8fc54ee8353ba6039fa11ddb0a21790a23ea32e544a0b0e" Jul 02 20:26:22.664066 ip-10-0-128-177 kubenswrapper[2565]: E0702 20:26:22.664047 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94617c839f8f770ac8fc54ee8353ba6039fa11ddb0a21790a23ea32e544a0b0e\": container with ID starting with 94617c839f8f770ac8fc54ee8353ba6039fa11ddb0a21790a23ea32e544a0b0e not found: ID does not exist" containerID="94617c839f8f770ac8fc54ee8353ba6039fa11ddb0a21790a23ea32e544a0b0e" Jul 02 20:26:22.664159 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:22.664078 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94617c839f8f770ac8fc54ee8353ba6039fa11ddb0a21790a23ea32e544a0b0e"} err="failed to get container status \"94617c839f8f770ac8fc54ee8353ba6039fa11ddb0a21790a23ea32e544a0b0e\": rpc error: code = NotFound desc = could not find container \"94617c839f8f770ac8fc54ee8353ba6039fa11ddb0a21790a23ea32e544a0b0e\": container with ID starting with 94617c839f8f770ac8fc54ee8353ba6039fa11ddb0a21790a23ea32e544a0b0e not found: ID does not exist" Jul 02 20:26:22.686402 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:22.686375 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5128dffe-60d5-47be-beb5-9df214fa6354-openshift-service-ca\") pod \"5128dffe-60d5-47be-beb5-9df214fa6354\" (UID: \"5128dffe-60d5-47be-beb5-9df214fa6354\") " Jul 02 20:26:22.686537 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:22.686423 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5128dffe-60d5-47be-beb5-9df214fa6354-maas-api-tls\") pod \"5128dffe-60d5-47be-beb5-9df214fa6354\" (UID: \"5128dffe-60d5-47be-beb5-9df214fa6354\") " Jul 02 20:26:22.686537 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:22.686520 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xvc6z\" (UniqueName: \"kubernetes.io/projected/5128dffe-60d5-47be-beb5-9df214fa6354-kube-api-access-xvc6z\") pod \"5128dffe-60d5-47be-beb5-9df214fa6354\" (UID: \"5128dffe-60d5-47be-beb5-9df214fa6354\") " Jul 02 20:26:22.686768 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:22.686742 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5128dffe-60d5-47be-beb5-9df214fa6354-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5128dffe-60d5-47be-beb5-9df214fa6354" (UID: "5128dffe-60d5-47be-beb5-9df214fa6354"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 20:26:22.688547 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:22.688522 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5128dffe-60d5-47be-beb5-9df214fa6354-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5128dffe-60d5-47be-beb5-9df214fa6354" (UID: "5128dffe-60d5-47be-beb5-9df214fa6354"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 20:26:22.688633 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:22.688611 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5128dffe-60d5-47be-beb5-9df214fa6354-kube-api-access-xvc6z" (OuterVolumeSpecName: "kube-api-access-xvc6z") pod "5128dffe-60d5-47be-beb5-9df214fa6354" (UID: "5128dffe-60d5-47be-beb5-9df214fa6354"). InnerVolumeSpecName "kube-api-access-xvc6z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:26:22.787246 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:22.787198 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xvc6z\" (UniqueName: \"kubernetes.io/projected/5128dffe-60d5-47be-beb5-9df214fa6354-kube-api-access-xvc6z\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 20:26:22.787246 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:22.787240 2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5128dffe-60d5-47be-beb5-9df214fa6354-openshift-service-ca\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 20:26:22.787246 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:22.787252 2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5128dffe-60d5-47be-beb5-9df214fa6354-maas-api-tls\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 20:26:22.975878 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:22.975848 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-761cb8-86c798cc7-twhdv"] Jul 02 20:26:22.981882 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:22.981859 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-761cb8-86c798cc7-twhdv"] Jul 02 20:26:23.520540 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:23.520508 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5128dffe-60d5-47be-beb5-9df214fa6354" path="/var/lib/kubelet/pods/5128dffe-60d5-47be-beb5-9df214fa6354/volumes" Jul 02 20:26:28.390528 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:28.390441 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:26:28.526427 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:28.526389 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:26:28.694873 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:28.694842 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:26:28.917793 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:28.917753 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:26:29.258660 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:29.258624 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:26:29.683931 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:29.683897 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:26:30.482111 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:30.482068 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:26:33.282418 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:33.282379 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:26:33.380837 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:33.380804 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:26:33.520581 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:33.520554 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-a-c51599-6796786b74-9j7qw"] Jul 02 20:26:33.520886 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:33.520874 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317" containerName="main" Jul 02 20:26:33.520886 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:33.520887 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317" containerName="main" Jul 02 20:26:33.520975 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:33.520898 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5128dffe-60d5-47be-beb5-9df214fa6354" containerName="maas-api" Jul 02 20:26:33.520975 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:33.520904 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5128dffe-60d5-47be-beb5-9df214fa6354" containerName="maas-api" Jul 02 20:26:33.520975 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:33.520972 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5128dffe-60d5-47be-beb5-9df214fa6354" containerName="maas-api" Jul 02 20:26:33.521080 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:33.520980 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecfe9bd4-c4b8-43f0-99e7-a6f8f08bd317" containerName="main" Jul 02 20:26:33.527424 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:33.525743 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-c51599-6796786b74-9j7qw" Jul 02 20:26:33.529831 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:33.529804 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-a-c51599-serving-cert\"" Jul 02 20:26:33.530774 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:33.530745 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-zvdpx\"" Jul 02 20:26:33.534117 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:33.534055 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-c51599-6796786b74-9j7qw"] Jul 02 20:26:33.558311 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:33.558278 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:26:33.573565 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:33.573537 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ql5vt\" (UniqueName: \"kubernetes.io/projected/29b06936-f297-4d93-91a2-b6d51d11cecd-kube-api-access-ql5vt\") pod \"maas-api-e2e-api-a-c51599-6796786b74-9j7qw\" (UID: \"29b06936-f297-4d93-91a2-b6d51d11cecd\") " pod="opendatahub/maas-api-e2e-api-a-c51599-6796786b74-9j7qw" Jul 02 20:26:33.573680 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:33.573573 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/29b06936-f297-4d93-91a2-b6d51d11cecd-openshift-service-ca\") pod \"maas-api-e2e-api-a-c51599-6796786b74-9j7qw\" (UID: \"29b06936-f297-4d93-91a2-b6d51d11cecd\") " pod="opendatahub/maas-api-e2e-api-a-c51599-6796786b74-9j7qw" Jul 02 20:26:33.573680 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:33.573613 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/29b06936-f297-4d93-91a2-b6d51d11cecd-maas-api-tls\") pod \"maas-api-e2e-api-a-c51599-6796786b74-9j7qw\" (UID: \"29b06936-f297-4d93-91a2-b6d51d11cecd\") " pod="opendatahub/maas-api-e2e-api-a-c51599-6796786b74-9j7qw" Jul 02 20:26:33.656676 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:33.656633 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:26:33.674666 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:33.674639 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/29b06936-f297-4d93-91a2-b6d51d11cecd-maas-api-tls\") pod \"maas-api-e2e-api-a-c51599-6796786b74-9j7qw\" (UID: \"29b06936-f297-4d93-91a2-b6d51d11cecd\") " pod="opendatahub/maas-api-e2e-api-a-c51599-6796786b74-9j7qw" Jul 02 20:26:33.674793 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:33.674730 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ql5vt\" (UniqueName: \"kubernetes.io/projected/29b06936-f297-4d93-91a2-b6d51d11cecd-kube-api-access-ql5vt\") pod \"maas-api-e2e-api-a-c51599-6796786b74-9j7qw\" (UID: \"29b06936-f297-4d93-91a2-b6d51d11cecd\") " pod="opendatahub/maas-api-e2e-api-a-c51599-6796786b74-9j7qw" Jul 02 20:26:33.674793 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:33.674765 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/29b06936-f297-4d93-91a2-b6d51d11cecd-openshift-service-ca\") pod \"maas-api-e2e-api-a-c51599-6796786b74-9j7qw\" (UID: \"29b06936-f297-4d93-91a2-b6d51d11cecd\") " pod="opendatahub/maas-api-e2e-api-a-c51599-6796786b74-9j7qw" Jul 02 20:26:33.675327 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:33.675310 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/29b06936-f297-4d93-91a2-b6d51d11cecd-openshift-service-ca\") pod \"maas-api-e2e-api-a-c51599-6796786b74-9j7qw\" (UID: \"29b06936-f297-4d93-91a2-b6d51d11cecd\") " pod="opendatahub/maas-api-e2e-api-a-c51599-6796786b74-9j7qw" Jul 02 20:26:33.677005 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:33.676988 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/29b06936-f297-4d93-91a2-b6d51d11cecd-maas-api-tls\") pod \"maas-api-e2e-api-a-c51599-6796786b74-9j7qw\" (UID: \"29b06936-f297-4d93-91a2-b6d51d11cecd\") " pod="opendatahub/maas-api-e2e-api-a-c51599-6796786b74-9j7qw" Jul 02 20:26:33.690637 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:33.690618 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ql5vt\" (UniqueName: \"kubernetes.io/projected/29b06936-f297-4d93-91a2-b6d51d11cecd-kube-api-access-ql5vt\") pod \"maas-api-e2e-api-a-c51599-6796786b74-9j7qw\" (UID: \"29b06936-f297-4d93-91a2-b6d51d11cecd\") " pod="opendatahub/maas-api-e2e-api-a-c51599-6796786b74-9j7qw" Jul 02 20:26:33.839555 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:33.839472 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-c51599-6796786b74-9j7qw" Jul 02 20:26:33.979000 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:33.978974 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-c51599-6796786b74-9j7qw"] Jul 02 20:26:33.980297 ip-10-0-128-177 kubenswrapper[2565]: W0702 20:26:33.980275 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29b06936_f297_4d93_91a2_b6d51d11cecd.slice/crio-c0001ccef055dc3fd63a6cd2128274548a01c9b201398d4c394ee49c433627ae WatchSource:0}: Error finding container c0001ccef055dc3fd63a6cd2128274548a01c9b201398d4c394ee49c433627ae: Status 404 returned error can't find the container with id c0001ccef055dc3fd63a6cd2128274548a01c9b201398d4c394ee49c433627ae Jul 02 20:26:34.069876 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:34.069836 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:26:34.184571 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:34.184535 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:26:34.720466 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:34.720436 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-c51599-6796786b74-9j7qw" event={"ID":"29b06936-f297-4d93-91a2-b6d51d11cecd","Type":"ContainerStarted","Data":"a6aef80d19c04d9b5001899c6eec9e0920fc4555293b02980598970862618efa"} Jul 02 20:26:34.720815 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:34.720483 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-c51599-6796786b74-9j7qw" event={"ID":"29b06936-f297-4d93-91a2-b6d51d11cecd","Type":"ContainerStarted","Data":"c0001ccef055dc3fd63a6cd2128274548a01c9b201398d4c394ee49c433627ae"} Jul 02 20:26:34.720815 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:34.720571 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-a-c51599-6796786b74-9j7qw" Jul 02 20:26:34.745081 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:34.745038 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-a-c51599-6796786b74-9j7qw" podStartSLOduration=1.3662985810000001 podStartE2EDuration="1.745024836s" totalImagesPullingTime="378.726255ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:26:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:26:34.74460466 +0000 UTC m=+1979.810662521" watchObservedRunningTime="2026-07-02 20:26:34.745024836 +0000 UTC m=+1979.811082697" Jul 02 20:26:37.771882 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:37.771840 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:26:38.220486 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:38.220453 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:26:38.646755 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:38.646678 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:26:38.898630 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:38.898531 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:26:40.731392 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:40.731362 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-a-c51599-6796786b74-9j7qw" Jul 02 20:26:41.287967 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:41.287912 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:26:41.382721 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:41.382688 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:26:41.387649 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:41.387622 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-b-3d76cb-7fb88c5994-9vb8h"] Jul 02 20:26:41.391581 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:41.391557 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-3d76cb-7fb88c5994-9vb8h" Jul 02 20:26:41.394668 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:41.394645 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-b-3d76cb-serving-cert\"" Jul 02 20:26:41.404498 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:41.404474 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-3d76cb-7fb88c5994-9vb8h"] Jul 02 20:26:41.446676 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:41.446641 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96db7b08-05fb-4282-aece-abc8b1fb31b7-openshift-service-ca\") pod \"maas-api-e2e-api-b-3d76cb-7fb88c5994-9vb8h\" (UID: \"96db7b08-05fb-4282-aece-abc8b1fb31b7\") " pod="opendatahub/maas-api-e2e-api-b-3d76cb-7fb88c5994-9vb8h" Jul 02 20:26:41.446856 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:41.446707 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96db7b08-05fb-4282-aece-abc8b1fb31b7-maas-api-tls\") pod \"maas-api-e2e-api-b-3d76cb-7fb88c5994-9vb8h\" (UID: \"96db7b08-05fb-4282-aece-abc8b1fb31b7\") " pod="opendatahub/maas-api-e2e-api-b-3d76cb-7fb88c5994-9vb8h" Jul 02 20:26:41.446856 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:41.446801 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7t4m\" (UniqueName: \"kubernetes.io/projected/96db7b08-05fb-4282-aece-abc8b1fb31b7-kube-api-access-g7t4m\") pod \"maas-api-e2e-api-b-3d76cb-7fb88c5994-9vb8h\" (UID: \"96db7b08-05fb-4282-aece-abc8b1fb31b7\") " pod="opendatahub/maas-api-e2e-api-b-3d76cb-7fb88c5994-9vb8h" Jul 02 20:26:41.462948 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:41.462908 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:26:41.548204 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:41.548116 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96db7b08-05fb-4282-aece-abc8b1fb31b7-openshift-service-ca\") pod \"maas-api-e2e-api-b-3d76cb-7fb88c5994-9vb8h\" (UID: \"96db7b08-05fb-4282-aece-abc8b1fb31b7\") " pod="opendatahub/maas-api-e2e-api-b-3d76cb-7fb88c5994-9vb8h" Jul 02 20:26:41.548204 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:41.548184 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96db7b08-05fb-4282-aece-abc8b1fb31b7-maas-api-tls\") pod \"maas-api-e2e-api-b-3d76cb-7fb88c5994-9vb8h\" (UID: \"96db7b08-05fb-4282-aece-abc8b1fb31b7\") " pod="opendatahub/maas-api-e2e-api-b-3d76cb-7fb88c5994-9vb8h" Jul 02 20:26:41.548450 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:41.548236 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7t4m\" (UniqueName: \"kubernetes.io/projected/96db7b08-05fb-4282-aece-abc8b1fb31b7-kube-api-access-g7t4m\") pod \"maas-api-e2e-api-b-3d76cb-7fb88c5994-9vb8h\" (UID: \"96db7b08-05fb-4282-aece-abc8b1fb31b7\") " pod="opendatahub/maas-api-e2e-api-b-3d76cb-7fb88c5994-9vb8h" Jul 02 20:26:41.548450 ip-10-0-128-177 kubenswrapper[2565]: E0702 20:26:41.548321 2565 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-b-3d76cb-serving-cert: secret "maas-api-e2e-api-b-3d76cb-serving-cert" not found Jul 02 20:26:41.548450 ip-10-0-128-177 kubenswrapper[2565]: E0702 20:26:41.548429 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96db7b08-05fb-4282-aece-abc8b1fb31b7-maas-api-tls podName:96db7b08-05fb-4282-aece-abc8b1fb31b7 nodeName:}" failed. No retries permitted until 2026-07-02 20:26:42.048405303 +0000 UTC m=+1987.114463174 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/96db7b08-05fb-4282-aece-abc8b1fb31b7-maas-api-tls") pod "maas-api-e2e-api-b-3d76cb-7fb88c5994-9vb8h" (UID: "96db7b08-05fb-4282-aece-abc8b1fb31b7") : secret "maas-api-e2e-api-b-3d76cb-serving-cert" not found Jul 02 20:26:41.548885 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:41.548866 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96db7b08-05fb-4282-aece-abc8b1fb31b7-openshift-service-ca\") pod \"maas-api-e2e-api-b-3d76cb-7fb88c5994-9vb8h\" (UID: \"96db7b08-05fb-4282-aece-abc8b1fb31b7\") " pod="opendatahub/maas-api-e2e-api-b-3d76cb-7fb88c5994-9vb8h" Jul 02 20:26:41.560416 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:41.560385 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7t4m\" (UniqueName: \"kubernetes.io/projected/96db7b08-05fb-4282-aece-abc8b1fb31b7-kube-api-access-g7t4m\") pod \"maas-api-e2e-api-b-3d76cb-7fb88c5994-9vb8h\" (UID: \"96db7b08-05fb-4282-aece-abc8b1fb31b7\") " pod="opendatahub/maas-api-e2e-api-b-3d76cb-7fb88c5994-9vb8h" Jul 02 20:26:41.713097 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:41.713056 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:26:42.054101 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:42.054056 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96db7b08-05fb-4282-aece-abc8b1fb31b7-maas-api-tls\") pod \"maas-api-e2e-api-b-3d76cb-7fb88c5994-9vb8h\" (UID: \"96db7b08-05fb-4282-aece-abc8b1fb31b7\") " pod="opendatahub/maas-api-e2e-api-b-3d76cb-7fb88c5994-9vb8h" Jul 02 20:26:42.056634 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:42.056601 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96db7b08-05fb-4282-aece-abc8b1fb31b7-maas-api-tls\") pod \"maas-api-e2e-api-b-3d76cb-7fb88c5994-9vb8h\" (UID: \"96db7b08-05fb-4282-aece-abc8b1fb31b7\") " pod="opendatahub/maas-api-e2e-api-b-3d76cb-7fb88c5994-9vb8h" Jul 02 20:26:42.208781 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:42.208750 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:26:42.302996 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:42.302965 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-3d76cb-7fb88c5994-9vb8h" Jul 02 20:26:42.303187 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:42.303075 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:26:42.442214 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:42.442186 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-3d76cb-7fb88c5994-9vb8h"] Jul 02 20:26:42.444035 ip-10-0-128-177 kubenswrapper[2565]: W0702 20:26:42.444010 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96db7b08_05fb_4282_aece_abc8b1fb31b7.slice/crio-ab6ec4d81cf54033fe17058de84bba4fb8d1071d6da0907fb78b2cf70b3d4fe1 WatchSource:0}: Error finding container ab6ec4d81cf54033fe17058de84bba4fb8d1071d6da0907fb78b2cf70b3d4fe1: Status 404 returned error can't find the container with id ab6ec4d81cf54033fe17058de84bba4fb8d1071d6da0907fb78b2cf70b3d4fe1 Jul 02 20:26:42.769892 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:42.769851 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-3d76cb-7fb88c5994-9vb8h" event={"ID":"96db7b08-05fb-4282-aece-abc8b1fb31b7","Type":"ContainerStarted","Data":"ab6ec4d81cf54033fe17058de84bba4fb8d1071d6da0907fb78b2cf70b3d4fe1"} Jul 02 20:26:43.783059 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:43.783022 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-3d76cb-7fb88c5994-9vb8h" event={"ID":"96db7b08-05fb-4282-aece-abc8b1fb31b7","Type":"ContainerStarted","Data":"d42e51985b7b8a943c9d1e2c570e9bbb3e2b24fa0c1decf8956ddc388323514f"} Jul 02 20:26:43.783513 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:43.783145 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-b-3d76cb-7fb88c5994-9vb8h" Jul 02 20:26:43.805580 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:43.805525 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-b-3d76cb-7fb88c5994-9vb8h" podStartSLOduration=2.465536434 podStartE2EDuration="2.805510242s" totalImagesPullingTime="339.973808ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:26:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:26:43.804020661 +0000 UTC m=+1988.870078526" watchObservedRunningTime="2026-07-02 20:26:43.805510242 +0000 UTC m=+1988.871568104" Jul 02 20:26:46.140283 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:46.140248 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:26:49.793459 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:49.793425 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-b-3d76cb-7fb88c5994-9vb8h" Jul 02 20:26:53.908528 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:53.908492 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:26:54.298539 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:54.298505 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:26:54.398052 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:54.398015 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:26:54.498806 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:54.498774 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:26:54.559680 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:54.559567 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-c51599-6796786b74-9j7qw"] Jul 02 20:26:54.559854 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:54.559802 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-a-c51599-6796786b74-9j7qw" podUID="29b06936-f297-4d93-91a2-b6d51d11cecd" containerName="maas-api" containerID="cri-o://a6aef80d19c04d9b5001899c6eec9e0920fc4555293b02980598970862618efa" gracePeriod=30 Jul 02 20:26:54.600022 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:54.599988 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:26:54.815881 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:54.815818 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-c51599-6796786b74-9j7qw" Jul 02 20:26:54.843186 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:54.843135 2565 generic.go:356] "Generic (PLEG): container finished" podID="29b06936-f297-4d93-91a2-b6d51d11cecd" containerID="a6aef80d19c04d9b5001899c6eec9e0920fc4555293b02980598970862618efa" exitCode=0 Jul 02 20:26:54.843382 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:54.843242 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-c51599-6796786b74-9j7qw" Jul 02 20:26:54.843382 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:54.843282 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-c51599-6796786b74-9j7qw" event={"ID":"29b06936-f297-4d93-91a2-b6d51d11cecd","Type":"ContainerDied","Data":"a6aef80d19c04d9b5001899c6eec9e0920fc4555293b02980598970862618efa"} Jul 02 20:26:54.843382 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:54.843359 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-c51599-6796786b74-9j7qw" event={"ID":"29b06936-f297-4d93-91a2-b6d51d11cecd","Type":"ContainerDied","Data":"c0001ccef055dc3fd63a6cd2128274548a01c9b201398d4c394ee49c433627ae"} Jul 02 20:26:54.844480 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:54.843393 2565 scope.go:117] "RemoveContainer" containerID="a6aef80d19c04d9b5001899c6eec9e0920fc4555293b02980598970862618efa" Jul 02 20:26:54.855134 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:54.855107 2565 scope.go:117] "RemoveContainer" containerID="a6aef80d19c04d9b5001899c6eec9e0920fc4555293b02980598970862618efa" Jul 02 20:26:54.855536 ip-10-0-128-177 kubenswrapper[2565]: E0702 20:26:54.855507 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6aef80d19c04d9b5001899c6eec9e0920fc4555293b02980598970862618efa\": container with ID starting with a6aef80d19c04d9b5001899c6eec9e0920fc4555293b02980598970862618efa not found: ID does not exist" containerID="a6aef80d19c04d9b5001899c6eec9e0920fc4555293b02980598970862618efa" Jul 02 20:26:54.855683 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:54.855543 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6aef80d19c04d9b5001899c6eec9e0920fc4555293b02980598970862618efa"} err="failed to get container status \"a6aef80d19c04d9b5001899c6eec9e0920fc4555293b02980598970862618efa\": rpc error: code = NotFound desc = could not find container \"a6aef80d19c04d9b5001899c6eec9e0920fc4555293b02980598970862618efa\": container with ID starting with a6aef80d19c04d9b5001899c6eec9e0920fc4555293b02980598970862618efa not found: ID does not exist" Jul 02 20:26:54.975188 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:54.975154 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/29b06936-f297-4d93-91a2-b6d51d11cecd-maas-api-tls\") pod \"29b06936-f297-4d93-91a2-b6d51d11cecd\" (UID: \"29b06936-f297-4d93-91a2-b6d51d11cecd\") " Jul 02 20:26:54.975188 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:54.975193 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/29b06936-f297-4d93-91a2-b6d51d11cecd-openshift-service-ca\") pod \"29b06936-f297-4d93-91a2-b6d51d11cecd\" (UID: \"29b06936-f297-4d93-91a2-b6d51d11cecd\") " Jul 02 20:26:54.975625 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:54.975256 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ql5vt\" (UniqueName: \"kubernetes.io/projected/29b06936-f297-4d93-91a2-b6d51d11cecd-kube-api-access-ql5vt\") pod \"29b06936-f297-4d93-91a2-b6d51d11cecd\" (UID: \"29b06936-f297-4d93-91a2-b6d51d11cecd\") " Jul 02 20:26:54.975701 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:54.975674 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29b06936-f297-4d93-91a2-b6d51d11cecd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "29b06936-f297-4d93-91a2-b6d51d11cecd" (UID: "29b06936-f297-4d93-91a2-b6d51d11cecd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 20:26:54.977330 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:54.977304 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29b06936-f297-4d93-91a2-b6d51d11cecd-kube-api-access-ql5vt" (OuterVolumeSpecName: "kube-api-access-ql5vt") pod "29b06936-f297-4d93-91a2-b6d51d11cecd" (UID: "29b06936-f297-4d93-91a2-b6d51d11cecd"). InnerVolumeSpecName "kube-api-access-ql5vt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:26:54.977330 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:54.977318 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29b06936-f297-4d93-91a2-b6d51d11cecd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "29b06936-f297-4d93-91a2-b6d51d11cecd" (UID: "29b06936-f297-4d93-91a2-b6d51d11cecd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 20:26:55.076224 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:55.076136 2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/29b06936-f297-4d93-91a2-b6d51d11cecd-maas-api-tls\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 20:26:55.076224 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:55.076169 2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/29b06936-f297-4d93-91a2-b6d51d11cecd-openshift-service-ca\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 20:26:55.076224 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:55.076180 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ql5vt\" (UniqueName: \"kubernetes.io/projected/29b06936-f297-4d93-91a2-b6d51d11cecd-kube-api-access-ql5vt\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 20:26:55.165954 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:55.165921 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-c51599-6796786b74-9j7qw"] Jul 02 20:26:55.169954 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:55.169926 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-a-c51599-6796786b74-9j7qw"] Jul 02 20:26:55.521182 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:26:55.521147 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29b06936-f297-4d93-91a2-b6d51d11cecd" path="/var/lib/kubelet/pods/29b06936-f297-4d93-91a2-b6d51d11cecd/volumes" Jul 02 20:27:00.506394 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:00.506358 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:27:00.614508 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:00.614465 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:27:00.861574 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:00.861482 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:27:01.033888 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:01.033854 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:27:01.202203 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:01.202161 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:27:01.592280 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:01.592186 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:27:01.693869 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:01.693834 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:27:01.791959 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:01.791924 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:27:01.954025 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:01.953992 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-3d76cb-7fb88c5994-9vb8h"] Jul 02 20:27:01.954251 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:01.954225 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-b-3d76cb-7fb88c5994-9vb8h" podUID="96db7b08-05fb-4282-aece-abc8b1fb31b7" containerName="maas-api" containerID="cri-o://d42e51985b7b8a943c9d1e2c570e9bbb3e2b24fa0c1decf8956ddc388323514f" gracePeriod=30 Jul 02 20:27:01.982773 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:01.982740 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:27:02.207016 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:02.206949 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-3d76cb-7fb88c5994-9vb8h" Jul 02 20:27:02.342398 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:02.342361 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96db7b08-05fb-4282-aece-abc8b1fb31b7-maas-api-tls\") pod \"96db7b08-05fb-4282-aece-abc8b1fb31b7\" (UID: \"96db7b08-05fb-4282-aece-abc8b1fb31b7\") " Jul 02 20:27:02.342591 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:02.342416 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g7t4m\" (UniqueName: \"kubernetes.io/projected/96db7b08-05fb-4282-aece-abc8b1fb31b7-kube-api-access-g7t4m\") pod \"96db7b08-05fb-4282-aece-abc8b1fb31b7\" (UID: \"96db7b08-05fb-4282-aece-abc8b1fb31b7\") " Jul 02 20:27:02.342591 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:02.342540 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96db7b08-05fb-4282-aece-abc8b1fb31b7-openshift-service-ca\") pod \"96db7b08-05fb-4282-aece-abc8b1fb31b7\" (UID: \"96db7b08-05fb-4282-aece-abc8b1fb31b7\") " Jul 02 20:27:02.342888 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:02.342863 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96db7b08-05fb-4282-aece-abc8b1fb31b7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "96db7b08-05fb-4282-aece-abc8b1fb31b7" (UID: "96db7b08-05fb-4282-aece-abc8b1fb31b7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 20:27:02.344491 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:02.344472 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96db7b08-05fb-4282-aece-abc8b1fb31b7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "96db7b08-05fb-4282-aece-abc8b1fb31b7" (UID: "96db7b08-05fb-4282-aece-abc8b1fb31b7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 20:27:02.344589 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:02.344571 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96db7b08-05fb-4282-aece-abc8b1fb31b7-kube-api-access-g7t4m" (OuterVolumeSpecName: "kube-api-access-g7t4m") pod "96db7b08-05fb-4282-aece-abc8b1fb31b7" (UID: "96db7b08-05fb-4282-aece-abc8b1fb31b7"). InnerVolumeSpecName "kube-api-access-g7t4m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:27:02.443734 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:02.443699 2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96db7b08-05fb-4282-aece-abc8b1fb31b7-maas-api-tls\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 20:27:02.443734 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:02.443729 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g7t4m\" (UniqueName: \"kubernetes.io/projected/96db7b08-05fb-4282-aece-abc8b1fb31b7-kube-api-access-g7t4m\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 20:27:02.443734 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:02.443739 2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96db7b08-05fb-4282-aece-abc8b1fb31b7-openshift-service-ca\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 20:27:02.887742 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:02.887702 2565 generic.go:356] "Generic (PLEG): container finished" podID="96db7b08-05fb-4282-aece-abc8b1fb31b7" containerID="d42e51985b7b8a943c9d1e2c570e9bbb3e2b24fa0c1decf8956ddc388323514f" exitCode=0 Jul 02 20:27:02.888153 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:02.887750 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-3d76cb-7fb88c5994-9vb8h" Jul 02 20:27:02.888153 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:02.887792 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-3d76cb-7fb88c5994-9vb8h" event={"ID":"96db7b08-05fb-4282-aece-abc8b1fb31b7","Type":"ContainerDied","Data":"d42e51985b7b8a943c9d1e2c570e9bbb3e2b24fa0c1decf8956ddc388323514f"} Jul 02 20:27:02.888153 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:02.887858 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-3d76cb-7fb88c5994-9vb8h" event={"ID":"96db7b08-05fb-4282-aece-abc8b1fb31b7","Type":"ContainerDied","Data":"ab6ec4d81cf54033fe17058de84bba4fb8d1071d6da0907fb78b2cf70b3d4fe1"} Jul 02 20:27:02.888153 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:02.887891 2565 scope.go:117] "RemoveContainer" containerID="d42e51985b7b8a943c9d1e2c570e9bbb3e2b24fa0c1decf8956ddc388323514f" Jul 02 20:27:02.897606 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:02.897587 2565 scope.go:117] "RemoveContainer" containerID="d42e51985b7b8a943c9d1e2c570e9bbb3e2b24fa0c1decf8956ddc388323514f" Jul 02 20:27:02.897859 ip-10-0-128-177 kubenswrapper[2565]: E0702 20:27:02.897839 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d42e51985b7b8a943c9d1e2c570e9bbb3e2b24fa0c1decf8956ddc388323514f\": container with ID starting with d42e51985b7b8a943c9d1e2c570e9bbb3e2b24fa0c1decf8956ddc388323514f not found: ID does not exist" containerID="d42e51985b7b8a943c9d1e2c570e9bbb3e2b24fa0c1decf8956ddc388323514f" Jul 02 20:27:02.897898 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:02.897870 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d42e51985b7b8a943c9d1e2c570e9bbb3e2b24fa0c1decf8956ddc388323514f"} err="failed to get container status \"d42e51985b7b8a943c9d1e2c570e9bbb3e2b24fa0c1decf8956ddc388323514f\": rpc error: code = NotFound desc = could not find container \"d42e51985b7b8a943c9d1e2c570e9bbb3e2b24fa0c1decf8956ddc388323514f\": container with ID starting with d42e51985b7b8a943c9d1e2c570e9bbb3e2b24fa0c1decf8956ddc388323514f not found: ID does not exist" Jul 02 20:27:02.918558 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:02.918529 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-3d76cb-7fb88c5994-9vb8h"] Jul 02 20:27:02.923029 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:02.922999 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-b-3d76cb-7fb88c5994-9vb8h"] Jul 02 20:27:03.520225 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:03.520190 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96db7b08-05fb-4282-aece-abc8b1fb31b7" path="/var/lib/kubelet/pods/96db7b08-05fb-4282-aece-abc8b1fb31b7/volumes" Jul 02 20:27:09.008851 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:09.008811 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:27:09.103919 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:09.103881 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:27:09.371745 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:09.371661 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:27:09.582640 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:09.582600 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:27:09.915670 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:09.915631 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:27:10.252717 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:10.252683 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d"] Jul 02 20:27:10.253200 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:10.253054 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96db7b08-05fb-4282-aece-abc8b1fb31b7" containerName="maas-api" Jul 02 20:27:10.253200 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:10.253066 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="96db7b08-05fb-4282-aece-abc8b1fb31b7" containerName="maas-api" Jul 02 20:27:10.253200 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:10.253076 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29b06936-f297-4d93-91a2-b6d51d11cecd" containerName="maas-api" Jul 02 20:27:10.253200 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:10.253082 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="29b06936-f297-4d93-91a2-b6d51d11cecd" containerName="maas-api" Jul 02 20:27:10.253200 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:10.253164 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="96db7b08-05fb-4282-aece-abc8b1fb31b7" containerName="maas-api" Jul 02 20:27:10.253200 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:10.253177 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="29b06936-f297-4d93-91a2-b6d51d11cecd" containerName="maas-api" Jul 02 20:27:10.256170 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:10.256154 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d" Jul 02 20:27:10.261099 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:10.261080 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-cd8cf5-openshift-default-dockercfg-mtwbb\"" Jul 02 20:27:10.284250 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:10.284220 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d"] Jul 02 20:27:10.307807 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:10.307778 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:27:10.309988 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:10.309967 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f653cfb-66fc-42e1-be84-b1ef8cb25177-istio-token\") pod \"e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d\" (UID: \"3f653cfb-66fc-42e1-be84-b1ef8cb25177\") " pod="openshift-ingress/e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d" Jul 02 20:27:10.310084 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:10.310020 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f653cfb-66fc-42e1-be84-b1ef8cb25177-istio-envoy\") pod \"e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d\" (UID: \"3f653cfb-66fc-42e1-be84-b1ef8cb25177\") " pod="openshift-ingress/e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d" Jul 02 20:27:10.310165 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:10.310140 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f653cfb-66fc-42e1-be84-b1ef8cb25177-credential-socket\") pod \"e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d\" (UID: \"3f653cfb-66fc-42e1-be84-b1ef8cb25177\") " pod="openshift-ingress/e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d" Jul 02 20:27:10.310213 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:10.310184 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f653cfb-66fc-42e1-be84-b1ef8cb25177-workload-certs\") pod \"e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d\" (UID: \"3f653cfb-66fc-42e1-be84-b1ef8cb25177\") " pod="openshift-ingress/e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d" Jul 02 20:27:10.310253 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:10.310224 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f653cfb-66fc-42e1-be84-b1ef8cb25177-workload-socket\") pod \"e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d\" (UID: \"3f653cfb-66fc-42e1-be84-b1ef8cb25177\") " pod="openshift-ingress/e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d" Jul 02 20:27:10.310253 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:10.310248 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f653cfb-66fc-42e1-be84-b1ef8cb25177-istio-data\") pod \"e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d\" (UID: \"3f653cfb-66fc-42e1-be84-b1ef8cb25177\") " pod="openshift-ingress/e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d" Jul 02 20:27:10.310330 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:10.310268 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f653cfb-66fc-42e1-be84-b1ef8cb25177-istiod-ca-cert\") pod \"e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d\" (UID: \"3f653cfb-66fc-42e1-be84-b1ef8cb25177\") " pod="openshift-ingress/e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d" Jul 02 20:27:10.310395 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:10.310360 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f653cfb-66fc-42e1-be84-b1ef8cb25177-istio-podinfo\") pod \"e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d\" (UID: \"3f653cfb-66fc-42e1-be84-b1ef8cb25177\") " pod="openshift-ingress/e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d" Jul 02 20:27:10.310433 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:10.310419 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2r2hp\" (UniqueName: \"kubernetes.io/projected/3f653cfb-66fc-42e1-be84-b1ef8cb25177-kube-api-access-2r2hp\") pod \"e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d\" (UID: \"3f653cfb-66fc-42e1-be84-b1ef8cb25177\") " pod="openshift-ingress/e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d" Jul 02 20:27:10.410841 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:10.410805 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f653cfb-66fc-42e1-be84-b1ef8cb25177-istio-envoy\") pod \"e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d\" (UID: \"3f653cfb-66fc-42e1-be84-b1ef8cb25177\") " pod="openshift-ingress/e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d" Jul 02 20:27:10.411039 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:10.410872 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f653cfb-66fc-42e1-be84-b1ef8cb25177-credential-socket\") pod \"e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d\" (UID: \"3f653cfb-66fc-42e1-be84-b1ef8cb25177\") " pod="openshift-ingress/e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d" Jul 02 20:27:10.411039 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:10.410901 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f653cfb-66fc-42e1-be84-b1ef8cb25177-workload-certs\") pod \"e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d\" (UID: \"3f653cfb-66fc-42e1-be84-b1ef8cb25177\") " pod="openshift-ingress/e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d" Jul 02 20:27:10.411039 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:10.410930 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f653cfb-66fc-42e1-be84-b1ef8cb25177-workload-socket\") pod \"e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d\" (UID: \"3f653cfb-66fc-42e1-be84-b1ef8cb25177\") " pod="openshift-ingress/e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d" Jul 02 20:27:10.411039 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:10.410955 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f653cfb-66fc-42e1-be84-b1ef8cb25177-istio-data\") pod \"e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d\" (UID: \"3f653cfb-66fc-42e1-be84-b1ef8cb25177\") " pod="openshift-ingress/e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d" Jul 02 20:27:10.411258 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:10.411030 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f653cfb-66fc-42e1-be84-b1ef8cb25177-istiod-ca-cert\") pod \"e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d\" (UID: \"3f653cfb-66fc-42e1-be84-b1ef8cb25177\") " pod="openshift-ingress/e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d" Jul 02 20:27:10.411258 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:10.411092 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f653cfb-66fc-42e1-be84-b1ef8cb25177-istio-podinfo\") pod \"e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d\" (UID: \"3f653cfb-66fc-42e1-be84-b1ef8cb25177\") " pod="openshift-ingress/e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d" Jul 02 20:27:10.411258 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:10.411138 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2r2hp\" (UniqueName: \"kubernetes.io/projected/3f653cfb-66fc-42e1-be84-b1ef8cb25177-kube-api-access-2r2hp\") pod \"e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d\" (UID: \"3f653cfb-66fc-42e1-be84-b1ef8cb25177\") " pod="openshift-ingress/e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d" Jul 02 20:27:10.411258 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:10.411202 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f653cfb-66fc-42e1-be84-b1ef8cb25177-istio-token\") pod \"e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d\" (UID: \"3f653cfb-66fc-42e1-be84-b1ef8cb25177\") " pod="openshift-ingress/e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d" Jul 02 20:27:10.411531 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:10.411512 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f653cfb-66fc-42e1-be84-b1ef8cb25177-workload-socket\") pod \"e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d\" (UID: \"3f653cfb-66fc-42e1-be84-b1ef8cb25177\") " pod="openshift-ingress/e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d" Jul 02 20:27:10.411602 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:10.411553 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f653cfb-66fc-42e1-be84-b1ef8cb25177-istio-data\") pod \"e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d\" (UID: \"3f653cfb-66fc-42e1-be84-b1ef8cb25177\") " pod="openshift-ingress/e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d" Jul 02 20:27:10.411782 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:10.411764 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f653cfb-66fc-42e1-be84-b1ef8cb25177-credential-socket\") pod \"e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d\" (UID: \"3f653cfb-66fc-42e1-be84-b1ef8cb25177\") " pod="openshift-ingress/e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d" Jul 02 20:27:10.412009 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:10.411983 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f653cfb-66fc-42e1-be84-b1ef8cb25177-istiod-ca-cert\") pod \"e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d\" (UID: \"3f653cfb-66fc-42e1-be84-b1ef8cb25177\") " pod="openshift-ingress/e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d" Jul 02 20:27:10.412121 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:10.412102 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f653cfb-66fc-42e1-be84-b1ef8cb25177-workload-certs\") pod \"e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d\" (UID: \"3f653cfb-66fc-42e1-be84-b1ef8cb25177\") " pod="openshift-ingress/e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d" Jul 02 20:27:10.413593 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:10.413569 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f653cfb-66fc-42e1-be84-b1ef8cb25177-istio-envoy\") pod \"e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d\" (UID: \"3f653cfb-66fc-42e1-be84-b1ef8cb25177\") " pod="openshift-ingress/e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d" Jul 02 20:27:10.413689 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:10.413668 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f653cfb-66fc-42e1-be84-b1ef8cb25177-istio-podinfo\") pod \"e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d\" (UID: \"3f653cfb-66fc-42e1-be84-b1ef8cb25177\") " pod="openshift-ingress/e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d" Jul 02 20:27:10.422399 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:10.422374 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f653cfb-66fc-42e1-be84-b1ef8cb25177-istio-token\") pod \"e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d\" (UID: \"3f653cfb-66fc-42e1-be84-b1ef8cb25177\") " pod="openshift-ingress/e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d" Jul 02 20:27:10.422521 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:10.422502 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r2hp\" (UniqueName: \"kubernetes.io/projected/3f653cfb-66fc-42e1-be84-b1ef8cb25177-kube-api-access-2r2hp\") pod \"e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d\" (UID: \"3f653cfb-66fc-42e1-be84-b1ef8cb25177\") " pod="openshift-ingress/e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d" Jul 02 20:27:10.566493 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:10.566404 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d" Jul 02 20:27:10.584883 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:10.584838 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:27:10.732172 ip-10-0-128-177 kubenswrapper[2565]: W0702 20:27:10.732142 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f653cfb_66fc_42e1_be84_b1ef8cb25177.slice/crio-111083f8d3a44d912114bd6dba3b533c36181cfc701cf4f3d167d8be9eadf67b WatchSource:0}: Error finding container 111083f8d3a44d912114bd6dba3b533c36181cfc701cf4f3d167d8be9eadf67b: Status 404 returned error can't find the container with id 111083f8d3a44d912114bd6dba3b533c36181cfc701cf4f3d167d8be9eadf67b Jul 02 20:27:10.737459 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:10.737435 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d"] Jul 02 20:27:10.931420 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:10.931381 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d" event={"ID":"3f653cfb-66fc-42e1-be84-b1ef8cb25177","Type":"ContainerStarted","Data":"111083f8d3a44d912114bd6dba3b533c36181cfc701cf4f3d167d8be9eadf67b"} Jul 02 20:27:11.475697 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:11.475633 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:27:12.979120 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:12.979066 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:27:13.705058 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:13.705020 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:27:13.705187 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:13.705093 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:27:13.705187 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:13.705123 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:27:13.958459 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:13.958361 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d" event={"ID":"3f653cfb-66fc-42e1-be84-b1ef8cb25177","Type":"ContainerStarted","Data":"694c309f040baa8c8bed53c7fccf5a8e248c307ff7641d736b10c1738ffeb631"} Jul 02 20:27:13.989854 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:13.989803 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d" podStartSLOduration=1.019358187 podStartE2EDuration="3.989785941s" totalImagesPullingTime="2.970427754s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:27:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:27:13.986882026 +0000 UTC m=+2019.052939914" watchObservedRunningTime="2026-07-02 20:27:13.989785941 +0000 UTC m=+2019.055843801" Jul 02 20:27:14.566606 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:14.566573 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d" Jul 02 20:27:14.571309 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:14.571283 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d" Jul 02 20:27:14.963782 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:14.963740 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d" Jul 02 20:27:14.964768 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:14.964749 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d" Jul 02 20:27:16.301645 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:16.301608 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:27:16.501992 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:16.501958 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:27:16.796149 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:16.796112 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:27:17.539671 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:17.539642 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:27:17.791438 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:17.791325 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:27:20.743632 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:20.743596 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:27:21.113887 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:21.113792 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:27:21.478287 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:21.478244 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:27:21.641854 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:21.641808 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:27:24.723775 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:24.723735 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:27:24.880541 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:24.880488 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-b-fa5d1d-5f8678d5c9-sbh94"] Jul 02 20:27:24.884844 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:24.884821 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-fa5d1d-5f8678d5c9-sbh94" Jul 02 20:27:24.892697 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:24.892674 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-b-fa5d1d-serving-cert\"" Jul 02 20:27:24.892896 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:24.892882 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-zvdpx\"" Jul 02 20:27:24.894604 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:24.894578 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:27:24.914799 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:24.914778 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-fa5d1d-5f8678d5c9-sbh94"] Jul 02 20:27:24.945039 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:24.945016 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhq4z\" (UniqueName: \"kubernetes.io/projected/a3f692b3-778d-46a5-8768-2a0d61a65bd7-kube-api-access-nhq4z\") pod \"maas-api-e2e-shared-b-fa5d1d-5f8678d5c9-sbh94\" (UID: \"a3f692b3-778d-46a5-8768-2a0d61a65bd7\") " pod="opendatahub/maas-api-e2e-shared-b-fa5d1d-5f8678d5c9-sbh94" Jul 02 20:27:24.945154 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:24.945054 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3f692b3-778d-46a5-8768-2a0d61a65bd7-maas-api-tls\") pod \"maas-api-e2e-shared-b-fa5d1d-5f8678d5c9-sbh94\" (UID: \"a3f692b3-778d-46a5-8768-2a0d61a65bd7\") " pod="opendatahub/maas-api-e2e-shared-b-fa5d1d-5f8678d5c9-sbh94" Jul 02 20:27:24.945154 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:24.945088 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3f692b3-778d-46a5-8768-2a0d61a65bd7-openshift-service-ca\") pod \"maas-api-e2e-shared-b-fa5d1d-5f8678d5c9-sbh94\" (UID: \"a3f692b3-778d-46a5-8768-2a0d61a65bd7\") " pod="opendatahub/maas-api-e2e-shared-b-fa5d1d-5f8678d5c9-sbh94" Jul 02 20:27:25.046466 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:25.046392 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhq4z\" (UniqueName: \"kubernetes.io/projected/a3f692b3-778d-46a5-8768-2a0d61a65bd7-kube-api-access-nhq4z\") pod \"maas-api-e2e-shared-b-fa5d1d-5f8678d5c9-sbh94\" (UID: \"a3f692b3-778d-46a5-8768-2a0d61a65bd7\") " pod="opendatahub/maas-api-e2e-shared-b-fa5d1d-5f8678d5c9-sbh94" Jul 02 20:27:25.046466 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:25.046435 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3f692b3-778d-46a5-8768-2a0d61a65bd7-maas-api-tls\") pod \"maas-api-e2e-shared-b-fa5d1d-5f8678d5c9-sbh94\" (UID: \"a3f692b3-778d-46a5-8768-2a0d61a65bd7\") " pod="opendatahub/maas-api-e2e-shared-b-fa5d1d-5f8678d5c9-sbh94" Jul 02 20:27:25.046648 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:25.046467 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3f692b3-778d-46a5-8768-2a0d61a65bd7-openshift-service-ca\") pod \"maas-api-e2e-shared-b-fa5d1d-5f8678d5c9-sbh94\" (UID: \"a3f692b3-778d-46a5-8768-2a0d61a65bd7\") " pod="opendatahub/maas-api-e2e-shared-b-fa5d1d-5f8678d5c9-sbh94" Jul 02 20:27:25.047099 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:25.047076 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3f692b3-778d-46a5-8768-2a0d61a65bd7-openshift-service-ca\") pod \"maas-api-e2e-shared-b-fa5d1d-5f8678d5c9-sbh94\" (UID: \"a3f692b3-778d-46a5-8768-2a0d61a65bd7\") " pod="opendatahub/maas-api-e2e-shared-b-fa5d1d-5f8678d5c9-sbh94" Jul 02 20:27:25.051615 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:25.051588 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3f692b3-778d-46a5-8768-2a0d61a65bd7-maas-api-tls\") pod \"maas-api-e2e-shared-b-fa5d1d-5f8678d5c9-sbh94\" (UID: \"a3f692b3-778d-46a5-8768-2a0d61a65bd7\") " pod="opendatahub/maas-api-e2e-shared-b-fa5d1d-5f8678d5c9-sbh94" Jul 02 20:27:25.074023 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:25.073992 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhq4z\" (UniqueName: \"kubernetes.io/projected/a3f692b3-778d-46a5-8768-2a0d61a65bd7-kube-api-access-nhq4z\") pod \"maas-api-e2e-shared-b-fa5d1d-5f8678d5c9-sbh94\" (UID: \"a3f692b3-778d-46a5-8768-2a0d61a65bd7\") " pod="opendatahub/maas-api-e2e-shared-b-fa5d1d-5f8678d5c9-sbh94" Jul 02 20:27:25.124219 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:25.124184 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:27:25.195847 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:25.195811 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-fa5d1d-5f8678d5c9-sbh94" Jul 02 20:27:25.322839 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:25.322803 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:27:25.376854 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:25.376616 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-fa5d1d-5f8678d5c9-sbh94"] Jul 02 20:27:25.379196 ip-10-0-128-177 kubenswrapper[2565]: W0702 20:27:25.379121 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3f692b3_778d_46a5_8768_2a0d61a65bd7.slice/crio-2c43a3e6461563fa6a17537f2511dd9dcd77c745845115d26880fb0d64fa88c9 WatchSource:0}: Error finding container 2c43a3e6461563fa6a17537f2511dd9dcd77c745845115d26880fb0d64fa88c9: Status 404 returned error can't find the container with id 2c43a3e6461563fa6a17537f2511dd9dcd77c745845115d26880fb0d64fa88c9 Jul 02 20:27:25.822827 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:25.822798 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:27:25.940033 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:25.939993 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:27:26.022378 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:26.022324 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-fa5d1d-5f8678d5c9-sbh94" event={"ID":"a3f692b3-778d-46a5-8768-2a0d61a65bd7","Type":"ContainerStarted","Data":"47f06a52a087f53cbe39d55768b20418903d8d95d152c241188fc471be527248"} Jul 02 20:27:26.022560 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:26.022425 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-fa5d1d-5f8678d5c9-sbh94" event={"ID":"a3f692b3-778d-46a5-8768-2a0d61a65bd7","Type":"ContainerStarted","Data":"2c43a3e6461563fa6a17537f2511dd9dcd77c745845115d26880fb0d64fa88c9"} Jul 02 20:27:26.022560 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:26.022474 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-b-fa5d1d-5f8678d5c9-sbh94" Jul 02 20:27:26.078438 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:26.057832 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-b-fa5d1d-5f8678d5c9-sbh94" podStartSLOduration=1.659018234 podStartE2EDuration="2.057800422s" totalImagesPullingTime="398.782188ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:27:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:27:26.056619808 +0000 UTC m=+2031.122677673" watchObservedRunningTime="2026-07-02 20:27:26.057800422 +0000 UTC m=+2031.123858286" Jul 02 20:27:29.134087 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:29.134053 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:27:29.965324 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:29.965228 2565 patch_prober.go:28] interesting pod/e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 02 20:27:29.965324 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:29.965294 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d" podUID="3f653cfb-66fc-42e1-be84-b1ef8cb25177" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 02 20:27:30.047674 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:30.047643 2565 generic.go:356] "Generic (PLEG): container finished" podID="3f653cfb-66fc-42e1-be84-b1ef8cb25177" containerID="694c309f040baa8c8bed53c7fccf5a8e248c307ff7641d736b10c1738ffeb631" exitCode=0 Jul 02 20:27:30.047857 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:30.047716 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d" event={"ID":"3f653cfb-66fc-42e1-be84-b1ef8cb25177","Type":"ContainerDied","Data":"694c309f040baa8c8bed53c7fccf5a8e248c307ff7641d736b10c1738ffeb631"} Jul 02 20:27:30.048127 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:30.048114 2565 scope.go:117] "RemoveContainer" containerID="694c309f040baa8c8bed53c7fccf5a8e248c307ff7641d736b10c1738ffeb631" Jul 02 20:27:30.050389 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:30.050325 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:27:30.050491 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:30.050441 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:27:30.050491 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:30.050485 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:27:31.055591 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:31.055560 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d" event={"ID":"3f653cfb-66fc-42e1-be84-b1ef8cb25177","Type":"ContainerStarted","Data":"a7519d20b124b3bea560dd41538403e0a4095cd498b29e79511c3dc402c9abd3"} Jul 02 20:27:31.567147 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:31.567099 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d" Jul 02 20:27:31.567386 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:31.567243 2565 patch_prober.go:28] interesting pod/e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 02 20:27:31.567386 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:31.567293 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d" podUID="3f653cfb-66fc-42e1-be84-b1ef8cb25177" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 02 20:27:32.034974 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:32.034937 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-b-fa5d1d-5f8678d5c9-sbh94" Jul 02 20:27:32.567583 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:32.567543 2565 patch_prober.go:28] interesting pod/e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 02 20:27:32.568258 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:32.568226 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d" podUID="3f653cfb-66fc-42e1-be84-b1ef8cb25177" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 02 20:27:33.567449 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:33.567403 2565 patch_prober.go:28] interesting pod/e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 02 20:27:33.567670 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:33.567473 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d" podUID="3f653cfb-66fc-42e1-be84-b1ef8cb25177" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 02 20:27:34.567818 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:34.567764 2565 patch_prober.go:28] interesting pod/e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 02 20:27:34.568323 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:34.567853 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d" podUID="3f653cfb-66fc-42e1-be84-b1ef8cb25177" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 02 20:27:35.572662 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:35.572636 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d" Jul 02 20:27:35.573086 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:35.573037 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d" Jul 02 20:27:35.573682 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:35.573664 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d" Jul 02 20:27:38.625100 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:38.625056 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:27:38.751388 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:38.751354 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:27:46.796476 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:46.796437 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:27:46.895139 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:27:46.895101 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:28:00.209815 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:28:00.209728 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:28:27.505115 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:28:27.505078 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:28:31.141535 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:28:31.141489 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:28:35.601855 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:28:35.601822 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-6n2jb_e50ef735-52fb-4047-8c8e-9378a771bbd3/console-operator/1.log" Jul 02 20:28:35.613866 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:28:35.613842 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-6n2jb_e50ef735-52fb-4047-8c8e-9378a771bbd3/console-operator/1.log" Jul 02 20:29:37.194737 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:29:37.194645 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:30:00.133003 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:30:00.132969 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-fa5d1d-29717070-hz4j2"] Jul 02 20:30:00.136429 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:30:00.136408 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-fa5d1d-29717070-hz4j2" Jul 02 20:30:00.147745 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:30:00.147715 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-fa5d1d-29717070-hz4j2"] Jul 02 20:30:00.239729 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:30:00.239695 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4pql\" (UniqueName: \"kubernetes.io/projected/edd3a316-2ec0-44b2-ad19-c1b3dbc9852d-kube-api-access-t4pql\") pod \"maas-api-key-cleanup-e2e-shared-b-fa5d1d-29717070-hz4j2\" (UID: \"edd3a316-2ec0-44b2-ad19-c1b3dbc9852d\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-fa5d1d-29717070-hz4j2" Jul 02 20:30:00.340872 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:30:00.340822 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4pql\" (UniqueName: \"kubernetes.io/projected/edd3a316-2ec0-44b2-ad19-c1b3dbc9852d-kube-api-access-t4pql\") pod \"maas-api-key-cleanup-e2e-shared-b-fa5d1d-29717070-hz4j2\" (UID: \"edd3a316-2ec0-44b2-ad19-c1b3dbc9852d\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-fa5d1d-29717070-hz4j2" Jul 02 20:30:00.349733 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:30:00.349698 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4pql\" (UniqueName: \"kubernetes.io/projected/edd3a316-2ec0-44b2-ad19-c1b3dbc9852d-kube-api-access-t4pql\") pod \"maas-api-key-cleanup-e2e-shared-b-fa5d1d-29717070-hz4j2\" (UID: \"edd3a316-2ec0-44b2-ad19-c1b3dbc9852d\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-fa5d1d-29717070-hz4j2" Jul 02 20:30:00.449336 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:30:00.449306 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-fa5d1d-29717070-hz4j2" Jul 02 20:30:00.584447 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:30:00.584418 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-fa5d1d-29717070-hz4j2"] Jul 02 20:30:00.586613 ip-10-0-128-177 kubenswrapper[2565]: W0702 20:30:00.586585 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedd3a316_2ec0_44b2_ad19_c1b3dbc9852d.slice/crio-08a131cbba79c271ef288400dc5745ba9cdb31067793138683e8c95697a1f1b3 WatchSource:0}: Error finding container 08a131cbba79c271ef288400dc5745ba9cdb31067793138683e8c95697a1f1b3: Status 404 returned error can't find the container with id 08a131cbba79c271ef288400dc5745ba9cdb31067793138683e8c95697a1f1b3 Jul 02 20:30:00.591990 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:30:00.591969 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 20:30:00.852304 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:30:00.852217 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-fa5d1d-29717070-hz4j2" event={"ID":"edd3a316-2ec0-44b2-ad19-c1b3dbc9852d","Type":"ContainerStarted","Data":"08a131cbba79c271ef288400dc5745ba9cdb31067793138683e8c95697a1f1b3"} Jul 02 20:30:03.872444 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:30:03.872412 2565 generic.go:356] "Generic (PLEG): container finished" podID="edd3a316-2ec0-44b2-ad19-c1b3dbc9852d" containerID="6374725a539aac1a64cf31708d275b09ea50f8af484b7c6b90adc839afaef64f" exitCode=0 Jul 02 20:30:03.872803 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:30:03.872466 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-fa5d1d-29717070-hz4j2" event={"ID":"edd3a316-2ec0-44b2-ad19-c1b3dbc9852d","Type":"ContainerDied","Data":"6374725a539aac1a64cf31708d275b09ea50f8af484b7c6b90adc839afaef64f"} Jul 02 20:30:05.012407 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:30:05.012379 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-fa5d1d-29717070-hz4j2" Jul 02 20:30:05.088042 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:30:05.088005 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t4pql\" (UniqueName: \"kubernetes.io/projected/edd3a316-2ec0-44b2-ad19-c1b3dbc9852d-kube-api-access-t4pql\") pod \"edd3a316-2ec0-44b2-ad19-c1b3dbc9852d\" (UID: \"edd3a316-2ec0-44b2-ad19-c1b3dbc9852d\") " Jul 02 20:30:05.090130 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:30:05.090098 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edd3a316-2ec0-44b2-ad19-c1b3dbc9852d-kube-api-access-t4pql" (OuterVolumeSpecName: "kube-api-access-t4pql") pod "edd3a316-2ec0-44b2-ad19-c1b3dbc9852d" (UID: "edd3a316-2ec0-44b2-ad19-c1b3dbc9852d"). InnerVolumeSpecName "kube-api-access-t4pql". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:30:05.188799 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:30:05.188756 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t4pql\" (UniqueName: \"kubernetes.io/projected/edd3a316-2ec0-44b2-ad19-c1b3dbc9852d-kube-api-access-t4pql\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 20:30:05.884610 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:30:05.884519 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-fa5d1d-29717070-hz4j2" Jul 02 20:30:05.884610 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:30:05.884547 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-fa5d1d-29717070-hz4j2" event={"ID":"edd3a316-2ec0-44b2-ad19-c1b3dbc9852d","Type":"ContainerDied","Data":"08a131cbba79c271ef288400dc5745ba9cdb31067793138683e8c95697a1f1b3"} Jul 02 20:30:05.884610 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:30:05.884599 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="08a131cbba79c271ef288400dc5745ba9cdb31067793138683e8c95697a1f1b3" Jul 02 20:30:22.889319 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:30:22.889277 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:30:23.798110 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:30:23.798071 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:30:33.233981 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:30:33.233946 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:30:34.742518 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:30:34.742481 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:30:34.843936 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:30:34.843898 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:30:54.918356 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:30:54.918302 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:31:03.758873 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:31:03.758765 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:31:52.944651 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:31:52.944609 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:31:53.594568 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:31:53.594519 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:31:55.924909 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:31:55.924871 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:32:08.794628 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:32:08.794589 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:32:12.313868 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:32:12.313800 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:32:12.412180 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:32:12.412144 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:32:36.524614 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:32:36.524579 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:32:39.490987 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:32:39.490949 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:32:39.595715 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:32:39.595680 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:32:47.616793 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:32:47.616752 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:32:47.718051 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:32:47.718018 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:33:22.985137 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:33:22.985080 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:33:23.824565 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:33:23.824533 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:33:24.885228 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:33:24.885190 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:33:25.268988 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:33:25.268949 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:33:25.369252 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:33:25.369214 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:33:25.507692 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:33:25.507649 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:33:25.662198 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:33:25.662106 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:33:30.348467 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:33:30.348427 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:33:35.638115 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:33:35.638090 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-6n2jb_e50ef735-52fb-4047-8c8e-9378a771bbd3/console-operator/1.log" Jul 02 20:33:35.650334 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:33:35.650309 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-6n2jb_e50ef735-52fb-4047-8c8e-9378a771bbd3/console-operator/1.log" Jul 02 20:34:07.423756 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:07.423657 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:34:07.684718 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:07.684680 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d"] Jul 02 20:34:07.684957 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:07.684930 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d" podUID="3f653cfb-66fc-42e1-be84-b1ef8cb25177" containerName="istio-proxy" containerID="cri-o://a7519d20b124b3bea560dd41538403e0a4095cd498b29e79511c3dc402c9abd3" gracePeriod=30 Jul 02 20:34:07.714152 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:07.714117 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:34:08.014838 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:08.014745 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:34:08.313854 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:08.313766 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:34:08.704094 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:08.704052 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:34:08.856478 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:08.856432 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:34:08.956567 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:08.956450 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:34:09.080752 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:09.080716 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-fa5d1d-5f8678d5c9-sbh94"] Jul 02 20:34:09.081003 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:09.080979 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-b-fa5d1d-5f8678d5c9-sbh94" podUID="a3f692b3-778d-46a5-8768-2a0d61a65bd7" containerName="maas-api" containerID="cri-o://47f06a52a087f53cbe39d55768b20418903d8d95d152c241188fc471be527248" gracePeriod=30 Jul 02 20:34:09.111544 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:09.111505 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-fa5d1d-29717070-hz4j2"] Jul 02 20:34:09.114389 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:09.114363 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-fa5d1d-29717070-hz4j2"] Jul 02 20:34:09.135617 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:09.135587 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:34:09.227691 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:09.227495 2565 generic.go:356] "Generic (PLEG): container finished" podID="a3f692b3-778d-46a5-8768-2a0d61a65bd7" containerID="47f06a52a087f53cbe39d55768b20418903d8d95d152c241188fc471be527248" exitCode=0 Jul 02 20:34:09.227691 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:09.227539 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-fa5d1d-5f8678d5c9-sbh94" event={"ID":"a3f692b3-778d-46a5-8768-2a0d61a65bd7","Type":"ContainerDied","Data":"47f06a52a087f53cbe39d55768b20418903d8d95d152c241188fc471be527248"} Jul 02 20:34:09.329056 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:09.329034 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-fa5d1d-5f8678d5c9-sbh94" Jul 02 20:34:09.393046 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:09.393010 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nhq4z\" (UniqueName: \"kubernetes.io/projected/a3f692b3-778d-46a5-8768-2a0d61a65bd7-kube-api-access-nhq4z\") pod \"a3f692b3-778d-46a5-8768-2a0d61a65bd7\" (UID: \"a3f692b3-778d-46a5-8768-2a0d61a65bd7\") " Jul 02 20:34:09.393254 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:09.393107 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3f692b3-778d-46a5-8768-2a0d61a65bd7-openshift-service-ca\") pod \"a3f692b3-778d-46a5-8768-2a0d61a65bd7\" (UID: \"a3f692b3-778d-46a5-8768-2a0d61a65bd7\") " Jul 02 20:34:09.393254 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:09.393147 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3f692b3-778d-46a5-8768-2a0d61a65bd7-maas-api-tls\") pod \"a3f692b3-778d-46a5-8768-2a0d61a65bd7\" (UID: \"a3f692b3-778d-46a5-8768-2a0d61a65bd7\") " Jul 02 20:34:09.393507 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:09.393485 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3f692b3-778d-46a5-8768-2a0d61a65bd7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a3f692b3-778d-46a5-8768-2a0d61a65bd7" (UID: "a3f692b3-778d-46a5-8768-2a0d61a65bd7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 20:34:09.395145 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:09.395123 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3f692b3-778d-46a5-8768-2a0d61a65bd7-kube-api-access-nhq4z" (OuterVolumeSpecName: "kube-api-access-nhq4z") pod "a3f692b3-778d-46a5-8768-2a0d61a65bd7" (UID: "a3f692b3-778d-46a5-8768-2a0d61a65bd7"). InnerVolumeSpecName "kube-api-access-nhq4z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:34:09.395207 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:09.395189 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3f692b3-778d-46a5-8768-2a0d61a65bd7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a3f692b3-778d-46a5-8768-2a0d61a65bd7" (UID: "a3f692b3-778d-46a5-8768-2a0d61a65bd7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 20:34:09.494575 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:09.494484 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nhq4z\" (UniqueName: \"kubernetes.io/projected/a3f692b3-778d-46a5-8768-2a0d61a65bd7-kube-api-access-nhq4z\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 20:34:09.494575 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:09.494515 2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3f692b3-778d-46a5-8768-2a0d61a65bd7-openshift-service-ca\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 20:34:09.494575 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:09.494529 2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3f692b3-778d-46a5-8768-2a0d61a65bd7-maas-api-tls\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 20:34:09.520229 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:09.520187 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="edd3a316-2ec0-44b2-ad19-c1b3dbc9852d" path="/var/lib/kubelet/pods/edd3a316-2ec0-44b2-ad19-c1b3dbc9852d/volumes" Jul 02 20:34:10.234275 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:10.234245 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-fa5d1d-5f8678d5c9-sbh94" Jul 02 20:34:10.234697 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:10.234271 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-fa5d1d-5f8678d5c9-sbh94" event={"ID":"a3f692b3-778d-46a5-8768-2a0d61a65bd7","Type":"ContainerDied","Data":"2c43a3e6461563fa6a17537f2511dd9dcd77c745845115d26880fb0d64fa88c9"} Jul 02 20:34:10.234697 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:10.234370 2565 scope.go:117] "RemoveContainer" containerID="47f06a52a087f53cbe39d55768b20418903d8d95d152c241188fc471be527248" Jul 02 20:34:10.252274 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:10.252249 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-fa5d1d-5f8678d5c9-sbh94"] Jul 02 20:34:10.255866 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:10.255844 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-fa5d1d-5f8678d5c9-sbh94"] Jul 02 20:34:11.520888 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:11.520853 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3f692b3-778d-46a5-8768-2a0d61a65bd7" path="/var/lib/kubelet/pods/a3f692b3-778d-46a5-8768-2a0d61a65bd7/volumes" Jul 02 20:34:12.938295 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:12.938272 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d" Jul 02 20:34:13.026439 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:13.026322 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f653cfb-66fc-42e1-be84-b1ef8cb25177-istio-data\") pod \"3f653cfb-66fc-42e1-be84-b1ef8cb25177\" (UID: \"3f653cfb-66fc-42e1-be84-b1ef8cb25177\") " Jul 02 20:34:13.026439 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:13.026396 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f653cfb-66fc-42e1-be84-b1ef8cb25177-workload-socket\") pod \"3f653cfb-66fc-42e1-be84-b1ef8cb25177\" (UID: \"3f653cfb-66fc-42e1-be84-b1ef8cb25177\") " Jul 02 20:34:13.026439 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:13.026414 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f653cfb-66fc-42e1-be84-b1ef8cb25177-istio-podinfo\") pod \"3f653cfb-66fc-42e1-be84-b1ef8cb25177\" (UID: \"3f653cfb-66fc-42e1-be84-b1ef8cb25177\") " Jul 02 20:34:13.026439 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:13.026437 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f653cfb-66fc-42e1-be84-b1ef8cb25177-istio-token\") pod \"3f653cfb-66fc-42e1-be84-b1ef8cb25177\" (UID: \"3f653cfb-66fc-42e1-be84-b1ef8cb25177\") " Jul 02 20:34:13.026804 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:13.026453 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f653cfb-66fc-42e1-be84-b1ef8cb25177-istiod-ca-cert\") pod \"3f653cfb-66fc-42e1-be84-b1ef8cb25177\" (UID: \"3f653cfb-66fc-42e1-be84-b1ef8cb25177\") " Jul 02 20:34:13.026804 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:13.026483 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f653cfb-66fc-42e1-be84-b1ef8cb25177-workload-certs\") pod \"3f653cfb-66fc-42e1-be84-b1ef8cb25177\" (UID: \"3f653cfb-66fc-42e1-be84-b1ef8cb25177\") " Jul 02 20:34:13.026804 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:13.026507 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f653cfb-66fc-42e1-be84-b1ef8cb25177-credential-socket\") pod \"3f653cfb-66fc-42e1-be84-b1ef8cb25177\" (UID: \"3f653cfb-66fc-42e1-be84-b1ef8cb25177\") " Jul 02 20:34:13.026804 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:13.026550 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f653cfb-66fc-42e1-be84-b1ef8cb25177-istio-envoy\") pod \"3f653cfb-66fc-42e1-be84-b1ef8cb25177\" (UID: \"3f653cfb-66fc-42e1-be84-b1ef8cb25177\") " Jul 02 20:34:13.026804 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:13.026623 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2r2hp\" (UniqueName: \"kubernetes.io/projected/3f653cfb-66fc-42e1-be84-b1ef8cb25177-kube-api-access-2r2hp\") pod \"3f653cfb-66fc-42e1-be84-b1ef8cb25177\" (UID: \"3f653cfb-66fc-42e1-be84-b1ef8cb25177\") " Jul 02 20:34:13.026804 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:13.026780 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f653cfb-66fc-42e1-be84-b1ef8cb25177-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3f653cfb-66fc-42e1-be84-b1ef8cb25177" (UID: "3f653cfb-66fc-42e1-be84-b1ef8cb25177"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:34:13.026804 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:13.026793 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f653cfb-66fc-42e1-be84-b1ef8cb25177-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3f653cfb-66fc-42e1-be84-b1ef8cb25177" (UID: "3f653cfb-66fc-42e1-be84-b1ef8cb25177"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:34:13.027155 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:13.026813 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f653cfb-66fc-42e1-be84-b1ef8cb25177-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3f653cfb-66fc-42e1-be84-b1ef8cb25177" (UID: "3f653cfb-66fc-42e1-be84-b1ef8cb25177"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:34:13.027155 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:13.026878 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f653cfb-66fc-42e1-be84-b1ef8cb25177-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3f653cfb-66fc-42e1-be84-b1ef8cb25177" (UID: "3f653cfb-66fc-42e1-be84-b1ef8cb25177"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 20:34:13.027155 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:13.026984 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f653cfb-66fc-42e1-be84-b1ef8cb25177-workload-socket\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 20:34:13.027155 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:13.027004 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f653cfb-66fc-42e1-be84-b1ef8cb25177-istiod-ca-cert\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 20:34:13.027155 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:13.027019 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f653cfb-66fc-42e1-be84-b1ef8cb25177-workload-certs\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 20:34:13.027155 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:13.027033 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f653cfb-66fc-42e1-be84-b1ef8cb25177-credential-socket\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 20:34:13.027400 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:13.027256 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f653cfb-66fc-42e1-be84-b1ef8cb25177-istio-data" (OuterVolumeSpecName: "istio-data") pod "3f653cfb-66fc-42e1-be84-b1ef8cb25177" (UID: "3f653cfb-66fc-42e1-be84-b1ef8cb25177"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:34:13.028917 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:13.028889 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f653cfb-66fc-42e1-be84-b1ef8cb25177-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3f653cfb-66fc-42e1-be84-b1ef8cb25177" (UID: "3f653cfb-66fc-42e1-be84-b1ef8cb25177"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:34:13.029034 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:13.028959 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f653cfb-66fc-42e1-be84-b1ef8cb25177-kube-api-access-2r2hp" (OuterVolumeSpecName: "kube-api-access-2r2hp") pod "3f653cfb-66fc-42e1-be84-b1ef8cb25177" (UID: "3f653cfb-66fc-42e1-be84-b1ef8cb25177"). InnerVolumeSpecName "kube-api-access-2r2hp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:34:13.029100 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:13.029077 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3f653cfb-66fc-42e1-be84-b1ef8cb25177-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3f653cfb-66fc-42e1-be84-b1ef8cb25177" (UID: "3f653cfb-66fc-42e1-be84-b1ef8cb25177"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 20:34:13.029155 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:13.029101 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f653cfb-66fc-42e1-be84-b1ef8cb25177-istio-token" (OuterVolumeSpecName: "istio-token") pod "3f653cfb-66fc-42e1-be84-b1ef8cb25177" (UID: "3f653cfb-66fc-42e1-be84-b1ef8cb25177"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:34:13.127641 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:13.127609 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f653cfb-66fc-42e1-be84-b1ef8cb25177-istio-data\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 20:34:13.127641 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:13.127636 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f653cfb-66fc-42e1-be84-b1ef8cb25177-istio-podinfo\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 20:34:13.127641 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:13.127645 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f653cfb-66fc-42e1-be84-b1ef8cb25177-istio-token\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 20:34:13.127641 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:13.127653 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f653cfb-66fc-42e1-be84-b1ef8cb25177-istio-envoy\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 20:34:13.127925 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:13.127662 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2r2hp\" (UniqueName: \"kubernetes.io/projected/3f653cfb-66fc-42e1-be84-b1ef8cb25177-kube-api-access-2r2hp\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\"" Jul 02 20:34:13.253553 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:13.253518 2565 generic.go:356] "Generic (PLEG): container finished" podID="3f653cfb-66fc-42e1-be84-b1ef8cb25177" containerID="a7519d20b124b3bea560dd41538403e0a4095cd498b29e79511c3dc402c9abd3" exitCode=0 Jul 02 20:34:13.253751 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:13.253588 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d" Jul 02 20:34:13.253751 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:13.253600 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d" event={"ID":"3f653cfb-66fc-42e1-be84-b1ef8cb25177","Type":"ContainerDied","Data":"a7519d20b124b3bea560dd41538403e0a4095cd498b29e79511c3dc402c9abd3"} Jul 02 20:34:13.253751 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:13.253668 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d" event={"ID":"3f653cfb-66fc-42e1-be84-b1ef8cb25177","Type":"ContainerDied","Data":"111083f8d3a44d912114bd6dba3b533c36181cfc701cf4f3d167d8be9eadf67b"} Jul 02 20:34:13.253751 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:13.253699 2565 scope.go:117] "RemoveContainer" containerID="a7519d20b124b3bea560dd41538403e0a4095cd498b29e79511c3dc402c9abd3" Jul 02 20:34:13.264180 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:13.264163 2565 scope.go:117] "RemoveContainer" containerID="694c309f040baa8c8bed53c7fccf5a8e248c307ff7641d736b10c1738ffeb631" Jul 02 20:34:13.272099 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:13.272072 2565 scope.go:117] "RemoveContainer" containerID="a7519d20b124b3bea560dd41538403e0a4095cd498b29e79511c3dc402c9abd3" Jul 02 20:34:13.272372 ip-10-0-128-177 kubenswrapper[2565]: E0702 20:34:13.272328 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7519d20b124b3bea560dd41538403e0a4095cd498b29e79511c3dc402c9abd3\": container with ID starting with a7519d20b124b3bea560dd41538403e0a4095cd498b29e79511c3dc402c9abd3 not found: ID does not exist" containerID="a7519d20b124b3bea560dd41538403e0a4095cd498b29e79511c3dc402c9abd3" Jul 02 20:34:13.272430 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:13.272381 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7519d20b124b3bea560dd41538403e0a4095cd498b29e79511c3dc402c9abd3"} err="failed to get container status \"a7519d20b124b3bea560dd41538403e0a4095cd498b29e79511c3dc402c9abd3\": rpc error: code = NotFound desc = could not find container \"a7519d20b124b3bea560dd41538403e0a4095cd498b29e79511c3dc402c9abd3\": container with ID starting with a7519d20b124b3bea560dd41538403e0a4095cd498b29e79511c3dc402c9abd3 not found: ID does not exist" Jul 02 20:34:13.272430 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:13.272399 2565 scope.go:117] "RemoveContainer" containerID="694c309f040baa8c8bed53c7fccf5a8e248c307ff7641d736b10c1738ffeb631" Jul 02 20:34:13.272653 ip-10-0-128-177 kubenswrapper[2565]: E0702 20:34:13.272635 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"694c309f040baa8c8bed53c7fccf5a8e248c307ff7641d736b10c1738ffeb631\": container with ID starting with 694c309f040baa8c8bed53c7fccf5a8e248c307ff7641d736b10c1738ffeb631 not found: ID does not exist" containerID="694c309f040baa8c8bed53c7fccf5a8e248c307ff7641d736b10c1738ffeb631" Jul 02 20:34:13.272706 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:13.272658 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"694c309f040baa8c8bed53c7fccf5a8e248c307ff7641d736b10c1738ffeb631"} err="failed to get container status \"694c309f040baa8c8bed53c7fccf5a8e248c307ff7641d736b10c1738ffeb631\": rpc error: code = NotFound desc = could not find container \"694c309f040baa8c8bed53c7fccf5a8e248c307ff7641d736b10c1738ffeb631\": container with ID starting with 694c309f040baa8c8bed53c7fccf5a8e248c307ff7641d736b10c1738ffeb631 not found: ID does not exist" Jul 02 20:34:13.281311 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:13.281253 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d"] Jul 02 20:34:13.285761 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:13.285727 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-cd8cf5-openshift-default-7965f6c5c5-fks9d"] Jul 02 20:34:13.520418 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:13.520385 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f653cfb-66fc-42e1-be84-b1ef8cb25177" path="/var/lib/kubelet/pods/3f653cfb-66fc-42e1-be84-b1ef8cb25177/volumes" Jul 02 20:34:14.787309 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:14.787269 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:34:14.887863 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:14.887818 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:34:15.096656 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:15.096557 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:34:15.320652 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:15.320613 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:34:21.283223 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:21.283194 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-844d4f46fb-58m7p_19d584c3-2f10-42b5-9739-371214597476/copy-manifests/0.log" Jul 02 20:34:21.302566 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:21.302532 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-844d4f46fb-58m7p_19d584c3-2f10-42b5-9739-371214597476/manager/0.log" Jul 02 20:34:22.415015 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:22.414981 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9rwk_00470c70-198a-4e14-820d-ac3972c96d6f/util/0.log" Jul 02 20:34:22.421164 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:22.421136 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9rwk_00470c70-198a-4e14-820d-ac3972c96d6f/pull/0.log" Jul 02 20:34:22.427490 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:22.427468 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9rwk_00470c70-198a-4e14-820d-ac3972c96d6f/extract/0.log" Jul 02 20:34:22.535392 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:22.535358 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kwmw2_20c43daa-e839-4aac-931f-409f601a9eb1/util/0.log" Jul 02 20:34:22.542509 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:22.542482 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kwmw2_20c43daa-e839-4aac-931f-409f601a9eb1/pull/0.log" Jul 02 20:34:22.549626 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:22.549587 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kwmw2_20c43daa-e839-4aac-931f-409f601a9eb1/extract/0.log" Jul 02 20:34:22.661015 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:22.660984 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p9vmx_f72fdf9b-80ec-460d-ac5d-5cb57db22d88/util/0.log" Jul 02 20:34:22.667568 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:22.667492 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p9vmx_f72fdf9b-80ec-460d-ac5d-5cb57db22d88/pull/0.log" Jul 02 20:34:22.673725 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:22.673705 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p9vmx_f72fdf9b-80ec-460d-ac5d-5cb57db22d88/extract/0.log" Jul 02 20:34:22.792763 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:22.792727 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p59n4_71b6ed41-5d47-409b-a2ad-00111b2254e3/util/0.log" Jul 02 20:34:22.804355 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:22.804316 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p59n4_71b6ed41-5d47-409b-a2ad-00111b2254e3/pull/0.log" Jul 02 20:34:22.816416 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:22.816391 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p59n4_71b6ed41-5d47-409b-a2ad-00111b2254e3/extract/0.log" Jul 02 20:34:23.534727 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:23.534697 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-hjtbh_56a2b865-4924-460c-906b-c5c3519a1cf3/manager/0.log" Jul 02 20:34:24.242766 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:24.242720 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-m9rkk_12f1b492-b763-4357-9785-4e1b033175f4/discovery/0.log" Jul 02 20:34:24.949061 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:24.949008 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-597bb6b665-89gn9_bb9a81bb-c236-45e6-8f38-130eac986587/router/0.log" Jul 02 20:34:25.286917 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:25.286819 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-5276n_b551f9a6-bbb4-4bad-a804-8625624c30a5/main/0.log" Jul 02 20:34:25.509304 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:25.509256 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-fpgmp_c94ba429-19a0-432f-afbe-bcf7332feddc/main/0.log" Jul 02 20:34:30.018872 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:30.018830 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:34:30.116197 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:30.116158 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" limit=1024 Jul 02 20:34:32.890697 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:32.890662 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-pkncj_e92927e3-3534-4747-ad6e-e0df14b731d3/global-pull-secret-syncer/0.log" Jul 02 20:34:32.994191 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:32.994147 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-n844d_1a07d0dc-9f29-40ae-af8e-0cbacaa4bd61/konnectivity-agent/0.log" Jul 02 20:34:33.084818 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:33.084790 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-177.ec2.internal_ac215e8f2fda4d1193f85f856768dbe3/haproxy/0.log" Jul 02 20:34:37.857730 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:37.857696 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9rwk_00470c70-198a-4e14-820d-ac3972c96d6f/extract/0.log" Jul 02 20:34:37.884636 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:37.884605 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9rwk_00470c70-198a-4e14-820d-ac3972c96d6f/util/0.log" Jul 02 20:34:37.918812 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:37.918785 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9rwk_00470c70-198a-4e14-820d-ac3972c96d6f/pull/0.log" Jul 02 20:34:37.946876 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:37.946842 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kwmw2_20c43daa-e839-4aac-931f-409f601a9eb1/extract/0.log" Jul 02 20:34:37.971085 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:37.971056 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kwmw2_20c43daa-e839-4aac-931f-409f601a9eb1/util/0.log" Jul 02 20:34:38.002385 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:38.002333 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kwmw2_20c43daa-e839-4aac-931f-409f601a9eb1/pull/0.log" Jul 02 20:34:38.033568 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:38.033544 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p9vmx_f72fdf9b-80ec-460d-ac5d-5cb57db22d88/extract/0.log" Jul 02 20:34:38.059074 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:38.059047 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p9vmx_f72fdf9b-80ec-460d-ac5d-5cb57db22d88/util/0.log" Jul 02 20:34:38.086806 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:38.086776 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p9vmx_f72fdf9b-80ec-460d-ac5d-5cb57db22d88/pull/0.log" Jul 02 20:34:38.119107 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:38.119003 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p59n4_71b6ed41-5d47-409b-a2ad-00111b2254e3/extract/0.log" Jul 02 20:34:38.144390 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:38.144364 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p59n4_71b6ed41-5d47-409b-a2ad-00111b2254e3/util/0.log" Jul 02 20:34:38.173125 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:38.173103 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p59n4_71b6ed41-5d47-409b-a2ad-00111b2254e3/pull/0.log" Jul 02 20:34:38.766838 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:38.766798 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-hjtbh_56a2b865-4924-460c-906b-c5c3519a1cf3/manager/0.log" Jul 02 20:34:40.553320 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:40.553233 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6/alertmanager/0.log" Jul 02 20:34:40.581024 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:40.580994 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6/config-reloader/0.log" Jul 02 20:34:40.615284 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:40.615261 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6/kube-rbac-proxy-web/0.log" Jul 02 20:34:40.661089 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:40.661063 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6/kube-rbac-proxy/0.log" Jul 02 20:34:40.692231 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:40.692196 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6/kube-rbac-proxy-metric/0.log" Jul 02 20:34:40.722179 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:40.722144 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6/prom-label-proxy/0.log" Jul 02 20:34:40.749907 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:40.749879 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3c1dc8a9-cb25-440f-bcd1-5312f8f4d8c6/init-config-reloader/0.log" Jul 02 20:34:40.800123 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:40.800089 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-8265f_e2878a16-7611-42fd-8bf4-4e30b6da7b82/cluster-monitoring-operator/0.log" Jul 02 20:34:41.160916 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:41.160886 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tlvh7_b26c314e-3e90-40ff-a7fd-175eb7f61a7c/node-exporter/0.log" Jul 02 20:34:41.190365 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:41.190315 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tlvh7_b26c314e-3e90-40ff-a7fd-175eb7f61a7c/kube-rbac-proxy/0.log" Jul 02 20:34:41.214650 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:41.214624 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tlvh7_b26c314e-3e90-40ff-a7fd-175eb7f61a7c/init-textfile/0.log" Jul 02 20:34:41.243591 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:41.243561 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-r86rw_b895e2b1-32b3-4000-a791-fd8dfcd82d5c/kube-rbac-proxy-main/0.log" Jul 02 20:34:41.265157 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:41.265130 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-r86rw_b895e2b1-32b3-4000-a791-fd8dfcd82d5c/kube-rbac-proxy-self/0.log" Jul 02 20:34:41.292932 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:41.292902 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-r86rw_b895e2b1-32b3-4000-a791-fd8dfcd82d5c/openshift-state-metrics/0.log" Jul 02 20:34:41.620898 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:41.620867 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-656f7f4d4b-pjwmg_5169d1e8-28ce-4265-ade6-5001e840a37d/telemeter-client/0.log" Jul 02 20:34:41.645635 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:41.645607 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-656f7f4d4b-pjwmg_5169d1e8-28ce-4265-ade6-5001e840a37d/reload/0.log" Jul 02 20:34:41.666536 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:41.666510 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-656f7f4d4b-pjwmg_5169d1e8-28ce-4265-ade6-5001e840a37d/kube-rbac-proxy/0.log" Jul 02 20:34:42.932135 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:42.932102 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xgw55/perf-node-gather-daemonset-djtxr"] Jul 02 20:34:42.932512 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:42.932487 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f653cfb-66fc-42e1-be84-b1ef8cb25177" containerName="istio-proxy" Jul 02 20:34:42.932512 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:42.932499 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f653cfb-66fc-42e1-be84-b1ef8cb25177" containerName="istio-proxy" Jul 02 20:34:42.932512 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:42.932508 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f653cfb-66fc-42e1-be84-b1ef8cb25177" containerName="istio-proxy" Jul 02 20:34:42.932621 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:42.932513 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f653cfb-66fc-42e1-be84-b1ef8cb25177" containerName="istio-proxy" Jul 02 20:34:42.932621 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:42.932528 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3f692b3-778d-46a5-8768-2a0d61a65bd7" containerName="maas-api" Jul 02 20:34:42.932621 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:42.932533 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3f692b3-778d-46a5-8768-2a0d61a65bd7" containerName="maas-api" Jul 02 20:34:42.932621 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:42.932542 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edd3a316-2ec0-44b2-ad19-c1b3dbc9852d" containerName="cleanup" Jul 02 20:34:42.932621 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:42.932547 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="edd3a316-2ec0-44b2-ad19-c1b3dbc9852d" containerName="cleanup" Jul 02 20:34:42.932621 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:42.932609 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="edd3a316-2ec0-44b2-ad19-c1b3dbc9852d" containerName="cleanup" Jul 02 20:34:42.932621 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:42.932615 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f653cfb-66fc-42e1-be84-b1ef8cb25177" containerName="istio-proxy" Jul 02 20:34:42.932621 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:42.932623 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f653cfb-66fc-42e1-be84-b1ef8cb25177" containerName="istio-proxy" Jul 02 20:34:42.932876 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:42.932629 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3f692b3-778d-46a5-8768-2a0d61a65bd7" containerName="maas-api" Jul 02 20:34:42.935580 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:42.935555 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xgw55/perf-node-gather-daemonset-djtxr" Jul 02 20:34:42.938556 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:42.938531 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xgw55\"/\"kube-root-ca.crt\"" Jul 02 20:34:42.938680 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:42.938531 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xgw55\"/\"openshift-service-ca.crt\"" Jul 02 20:34:42.938680 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:42.938590 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xgw55\"/\"default-dockercfg-v2l27\"" Jul 02 20:34:42.948162 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:42.948135 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xgw55/perf-node-gather-daemonset-djtxr"] Jul 02 20:34:43.001424 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:43.001378 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9a3a0fbc-8142-45de-bf66-be56441dbc94-podres\") pod \"perf-node-gather-daemonset-djtxr\" (UID: \"9a3a0fbc-8142-45de-bf66-be56441dbc94\") " pod="openshift-must-gather-xgw55/perf-node-gather-daemonset-djtxr" Jul 02 20:34:43.001631 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:43.001446 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hch8x\" (UniqueName: \"kubernetes.io/projected/9a3a0fbc-8142-45de-bf66-be56441dbc94-kube-api-access-hch8x\") pod \"perf-node-gather-daemonset-djtxr\" (UID: \"9a3a0fbc-8142-45de-bf66-be56441dbc94\") " pod="openshift-must-gather-xgw55/perf-node-gather-daemonset-djtxr" Jul 02 20:34:43.001631 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:43.001500 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9a3a0fbc-8142-45de-bf66-be56441dbc94-sys\") pod \"perf-node-gather-daemonset-djtxr\" (UID: \"9a3a0fbc-8142-45de-bf66-be56441dbc94\") " pod="openshift-must-gather-xgw55/perf-node-gather-daemonset-djtxr" Jul 02 20:34:43.001631 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:43.001581 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9a3a0fbc-8142-45de-bf66-be56441dbc94-lib-modules\") pod \"perf-node-gather-daemonset-djtxr\" (UID: \"9a3a0fbc-8142-45de-bf66-be56441dbc94\") " pod="openshift-must-gather-xgw55/perf-node-gather-daemonset-djtxr" Jul 02 20:34:43.001631 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:43.001612 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9a3a0fbc-8142-45de-bf66-be56441dbc94-proc\") pod \"perf-node-gather-daemonset-djtxr\" (UID: \"9a3a0fbc-8142-45de-bf66-be56441dbc94\") " pod="openshift-must-gather-xgw55/perf-node-gather-daemonset-djtxr" Jul 02 20:34:43.059008 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:43.058975 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-88qmn_195ee027-26f0-4912-84c7-5bce84da9e51/networking-console-plugin/0.log" Jul 02 20:34:43.102865 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:43.102831 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9a3a0fbc-8142-45de-bf66-be56441dbc94-podres\") pod \"perf-node-gather-daemonset-djtxr\" (UID: \"9a3a0fbc-8142-45de-bf66-be56441dbc94\") " pod="openshift-must-gather-xgw55/perf-node-gather-daemonset-djtxr" Jul 02 20:34:43.103036 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:43.102881 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hch8x\" (UniqueName: \"kubernetes.io/projected/9a3a0fbc-8142-45de-bf66-be56441dbc94-kube-api-access-hch8x\") pod \"perf-node-gather-daemonset-djtxr\" (UID: \"9a3a0fbc-8142-45de-bf66-be56441dbc94\") " pod="openshift-must-gather-xgw55/perf-node-gather-daemonset-djtxr" Jul 02 20:34:43.103036 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:43.102915 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9a3a0fbc-8142-45de-bf66-be56441dbc94-sys\") pod \"perf-node-gather-daemonset-djtxr\" (UID: \"9a3a0fbc-8142-45de-bf66-be56441dbc94\") " pod="openshift-must-gather-xgw55/perf-node-gather-daemonset-djtxr" Jul 02 20:34:43.103036 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:43.102960 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9a3a0fbc-8142-45de-bf66-be56441dbc94-lib-modules\") pod \"perf-node-gather-daemonset-djtxr\" (UID: \"9a3a0fbc-8142-45de-bf66-be56441dbc94\") " pod="openshift-must-gather-xgw55/perf-node-gather-daemonset-djtxr" Jul 02 20:34:43.103036 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:43.102978 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9a3a0fbc-8142-45de-bf66-be56441dbc94-proc\") pod \"perf-node-gather-daemonset-djtxr\" (UID: \"9a3a0fbc-8142-45de-bf66-be56441dbc94\") " pod="openshift-must-gather-xgw55/perf-node-gather-daemonset-djtxr" Jul 02 20:34:43.103036 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:43.103008 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9a3a0fbc-8142-45de-bf66-be56441dbc94-podres\") pod \"perf-node-gather-daemonset-djtxr\" (UID: \"9a3a0fbc-8142-45de-bf66-be56441dbc94\") " pod="openshift-must-gather-xgw55/perf-node-gather-daemonset-djtxr" Jul 02 20:34:43.103036 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:43.103031 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9a3a0fbc-8142-45de-bf66-be56441dbc94-sys\") pod \"perf-node-gather-daemonset-djtxr\" (UID: \"9a3a0fbc-8142-45de-bf66-be56441dbc94\") " pod="openshift-must-gather-xgw55/perf-node-gather-daemonset-djtxr" Jul 02 20:34:43.103239 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:43.103049 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9a3a0fbc-8142-45de-bf66-be56441dbc94-proc\") pod \"perf-node-gather-daemonset-djtxr\" (UID: \"9a3a0fbc-8142-45de-bf66-be56441dbc94\") " pod="openshift-must-gather-xgw55/perf-node-gather-daemonset-djtxr" Jul 02 20:34:43.103239 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:43.103111 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9a3a0fbc-8142-45de-bf66-be56441dbc94-lib-modules\") pod \"perf-node-gather-daemonset-djtxr\" (UID: \"9a3a0fbc-8142-45de-bf66-be56441dbc94\") " pod="openshift-must-gather-xgw55/perf-node-gather-daemonset-djtxr" Jul 02 20:34:43.112085 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:43.112056 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hch8x\" (UniqueName: \"kubernetes.io/projected/9a3a0fbc-8142-45de-bf66-be56441dbc94-kube-api-access-hch8x\") pod \"perf-node-gather-daemonset-djtxr\" (UID: \"9a3a0fbc-8142-45de-bf66-be56441dbc94\") " pod="openshift-must-gather-xgw55/perf-node-gather-daemonset-djtxr" Jul 02 20:34:43.246258 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:43.246165 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xgw55/perf-node-gather-daemonset-djtxr" Jul 02 20:34:43.388368 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:43.388314 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xgw55/perf-node-gather-daemonset-djtxr"] Jul 02 20:34:43.390251 ip-10-0-128-177 kubenswrapper[2565]: W0702 20:34:43.390229 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9a3a0fbc_8142_45de_bf66_be56441dbc94.slice/crio-d0a1ccb05714835d66fe7273c8191ff8700f6f229c300b53be7475b889619586 WatchSource:0}: Error finding container d0a1ccb05714835d66fe7273c8191ff8700f6f229c300b53be7475b889619586: Status 404 returned error can't find the container with id d0a1ccb05714835d66fe7273c8191ff8700f6f229c300b53be7475b889619586 Jul 02 20:34:43.417151 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:43.417125 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xgw55/perf-node-gather-daemonset-djtxr" event={"ID":"9a3a0fbc-8142-45de-bf66-be56441dbc94","Type":"ContainerStarted","Data":"d0a1ccb05714835d66fe7273c8191ff8700f6f229c300b53be7475b889619586"} Jul 02 20:34:43.669723 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:43.669638 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-6n2jb_e50ef735-52fb-4047-8c8e-9378a771bbd3/console-operator/1.log" Jul 02 20:34:43.677063 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:43.677032 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-6n2jb_e50ef735-52fb-4047-8c8e-9378a771bbd3/console-operator/2.log" Jul 02 20:34:44.160748 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:44.160711 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-8z7k7_2a48c92c-2c90-4c0b-82c5-9ef29c22c17a/download-server/0.log" Jul 02 20:34:44.424393 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:44.424278 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xgw55/perf-node-gather-daemonset-djtxr" event={"ID":"9a3a0fbc-8142-45de-bf66-be56441dbc94","Type":"ContainerStarted","Data":"4124c73f6d57a5ecae63b2f63645a2a9e411e446530cc42079a23606311de95d"} Jul 02 20:34:44.424393 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:44.424366 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-xgw55/perf-node-gather-daemonset-djtxr" Jul 02 20:34:44.445384 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:44.445324 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xgw55/perf-node-gather-daemonset-djtxr" podStartSLOduration=2.445310465 podStartE2EDuration="2.445310465s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:34:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:34:44.444180745 +0000 UTC m=+2469.510238607" watchObservedRunningTime="2026-07-02 20:34:44.445310465 +0000 UTC m=+2469.511368325" Jul 02 20:34:44.756721 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:44.756692 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-dd6df_37501a0b-36db-40db-bf27-c4cee6bcb6fd/volume-data-source-validator/0.log" Jul 02 20:34:45.868571 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:45.868545 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-j6rjf_d0d49ed6-ee77-432c-ab59-a83758e51a48/dns/0.log" Jul 02 20:34:45.893099 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:45.893065 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-j6rjf_d0d49ed6-ee77-432c-ab59-a83758e51a48/kube-rbac-proxy/0.log" Jul 02 20:34:46.075449 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:46.075420 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kxsct_20e92fd6-0a2e-471d-a090-1b96d06600c6/dns-node-resolver/0.log" Jul 02 20:34:46.700967 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:46.700939 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-56fgj_7295278e-a6f2-4725-99e7-7f76ea6da868/node-ca/0.log" Jul 02 20:34:47.949288 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:47.949252 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-m9rkk_12f1b492-b763-4357-9785-4e1b033175f4/discovery/0.log" Jul 02 20:34:48.178011 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:48.177984 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-597bb6b665-89gn9_bb9a81bb-c236-45e6-8f38-130eac986587/router/0.log" Jul 02 20:34:48.945382 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:48.945331 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-krlc4_b85e6f64-6fa0-4722-a51d-72e2b1bc200b/serve-healthcheck-canary/0.log" Jul 02 20:34:49.431678 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:49.431645 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-drhbp_6d5bada9-0dfe-4f19-b549-3395492c6f5a/insights-operator/0.log" Jul 02 20:34:49.434652 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:49.434631 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-drhbp_6d5bada9-0dfe-4f19-b549-3395492c6f5a/insights-operator/1.log" Jul 02 20:34:49.627484 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:49.627447 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-scmht_746e97fe-6921-499b-87af-2a8474c0a5e6/kube-rbac-proxy/0.log" Jul 02 20:34:49.654295 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:49.654270 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-scmht_746e97fe-6921-499b-87af-2a8474c0a5e6/exporter/0.log" Jul 02 20:34:49.683240 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:49.683154 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-scmht_746e97fe-6921-499b-87af-2a8474c0a5e6/extractor/0.log" Jul 02 20:34:50.439988 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:50.439954 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-xgw55/perf-node-gather-daemonset-djtxr" Jul 02 20:34:52.548057 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:52.548006 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-844d4f46fb-58m7p_19d584c3-2f10-42b5-9739-371214597476/manager/0.log" Jul 02 20:34:52.568432 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:52.568407 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-844d4f46fb-58m7p_19d584c3-2f10-42b5-9739-371214597476/copy-manifests/0.log" Jul 02 20:34:53.444590 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:53.444556 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-m9rkk_12f1b492-b763-4357-9785-4e1b033175f4/discovery/0.log" Jul 02 20:34:53.590486 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:53.590448 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-597bb6b665-89gn9_bb9a81bb-c236-45e6-8f38-130eac986587/router/0.log" Jul 02 20:34:54.106022 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:54.105991 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-56c987df7b-x68np_d12d140d-6423-425f-9a7b-4e957128b06b/manager/0.log" Jul 02 20:34:55.004136 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:55.004104 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-m9rkk_12f1b492-b763-4357-9785-4e1b033175f4/discovery/0.log" Jul 02 20:34:55.166036 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:55.165953 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-597bb6b665-89gn9_bb9a81bb-c236-45e6-8f38-130eac986587/router/0.log" Jul 02 20:34:59.469558 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:59.469502 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-p9t9k_4cf90fa7-f624-4043-8ecc-b27547b6a98b/kube-storage-version-migrator-operator/1.log" Jul 02 20:34:59.471084 ip-10-0-128-177 kubenswrapper[2565]: I0702 20:34:59.471048 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-p9t9k_4cf90fa7-f624-4043-8ecc-b27547b6a98b/kube-storage-version-migrator-operator/0.log"