Jul 06 13:45:06.086903 ip-10-0-134-85 systemd[1]: Starting Kubernetes Kubelet... Jul 06 13:45:06.496979 ip-10-0-134-85 kubenswrapper[2556]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 13:45:06.496979 ip-10-0-134-85 kubenswrapper[2556]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 06 13:45:06.496979 ip-10-0-134-85 kubenswrapper[2556]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 13:45:06.496979 ip-10-0-134-85 kubenswrapper[2556]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 06 13:45:06.496979 ip-10-0-134-85 kubenswrapper[2556]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 13:45:06.496979 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.478908 2556 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 06 13:45:06.496979 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483447 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 13:45:06.496979 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483458 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 13:45:06.496979 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483462 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 13:45:06.496979 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483465 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 13:45:06.496979 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483467 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 13:45:06.496979 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483470 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 13:45:06.496979 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483477 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 13:45:06.496979 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483480 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 13:45:06.501603 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483483 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 13:45:06.501603 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483486 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 13:45:06.501603 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483488 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 13:45:06.501603 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483491 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 13:45:06.501603 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483494 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 13:45:06.501603 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483496 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 13:45:06.501603 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483499 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 13:45:06.501603 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483501 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 13:45:06.501603 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483504 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 13:45:06.501603 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483508 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 13:45:06.501603 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483511 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 13:45:06.501603 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483513 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 13:45:06.501603 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483516 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 13:45:06.501603 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483520 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 13:45:06.501603 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483524 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 13:45:06.501603 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483528 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 13:45:06.501603 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483530 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 13:45:06.501603 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483534 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 13:45:06.501603 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483536 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 13:45:06.502177 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483539 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 13:45:06.502177 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483542 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 13:45:06.502177 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483544 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 13:45:06.502177 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483547 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 13:45:06.502177 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483550 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 13:45:06.502177 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483552 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 13:45:06.502177 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483555 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 13:45:06.502177 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483558 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 13:45:06.502177 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483560 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 13:45:06.502177 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483562 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 13:45:06.502177 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483565 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 13:45:06.502177 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483568 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 13:45:06.502177 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483570 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 13:45:06.502177 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483573 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 13:45:06.502177 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483576 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 13:45:06.502177 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483578 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 13:45:06.502177 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483581 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 13:45:06.502177 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483584 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 13:45:06.502177 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483588 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 13:45:06.502825 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483592 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 13:45:06.502825 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483595 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 13:45:06.502825 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483599 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 13:45:06.502825 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483602 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 13:45:06.502825 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483604 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 13:45:06.502825 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483607 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 13:45:06.502825 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483610 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 13:45:06.502825 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483613 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 13:45:06.502825 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483630 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 13:45:06.502825 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483633 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 13:45:06.502825 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483636 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 13:45:06.502825 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483640 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 13:45:06.502825 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483643 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 13:45:06.502825 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483647 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 13:45:06.502825 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483651 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 13:45:06.502825 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483653 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 13:45:06.502825 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483656 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 13:45:06.502825 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483659 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 13:45:06.502825 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483662 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 13:45:06.502825 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483664 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 13:45:06.503465 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483667 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 13:45:06.503465 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483669 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 13:45:06.503465 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483672 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 13:45:06.503465 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483675 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 13:45:06.503465 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483677 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 13:45:06.503465 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483680 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 13:45:06.503465 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483686 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 13:45:06.503465 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483688 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 13:45:06.503465 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483691 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 13:45:06.503465 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483694 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 13:45:06.503465 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483697 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 13:45:06.503465 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483700 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 13:45:06.503465 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483702 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 13:45:06.503465 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483705 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 13:45:06.503465 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483708 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 13:45:06.503465 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483710 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 13:45:06.503465 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483713 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 13:45:06.503465 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483715 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 13:45:06.503465 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483718 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 13:45:06.503465 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483720 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 13:45:06.504111 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483723 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 13:45:06.504111 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483726 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 13:45:06.504111 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483728 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 13:45:06.504111 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483731 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 13:45:06.504111 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483733 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 06 13:45:06.504111 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483736 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 13:45:06.504111 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483738 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 13:45:06.504111 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483741 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 13:45:06.504111 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483744 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 13:45:06.504111 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483746 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 13:45:06.504111 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483749 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 13:45:06.504111 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483751 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 13:45:06.504111 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.483754 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 13:45:06.504111 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485599 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 13:45:06.504111 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485611 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 06 13:45:06.504111 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485632 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 13:45:06.504111 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485636 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 13:45:06.504111 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485639 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 13:45:06.504111 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485643 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 13:45:06.504111 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485646 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 13:45:06.504111 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485648 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 13:45:06.504752 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485652 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 13:45:06.504752 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485654 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 13:45:06.504752 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485657 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 13:45:06.504752 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485660 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 13:45:06.504752 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485662 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 13:45:06.504752 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485665 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 13:45:06.504752 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485667 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 13:45:06.504752 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485670 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 13:45:06.504752 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485673 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 13:45:06.504752 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485675 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 13:45:06.504752 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485678 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 13:45:06.504752 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485680 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 13:45:06.504752 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485683 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 13:45:06.504752 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485685 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 13:45:06.504752 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485688 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 13:45:06.504752 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485690 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 13:45:06.504752 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485693 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 13:45:06.504752 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485700 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 13:45:06.504752 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485703 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 13:45:06.505370 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485707 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 13:45:06.505370 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485711 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 13:45:06.505370 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485714 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 13:45:06.505370 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485717 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 13:45:06.505370 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485720 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 13:45:06.505370 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485723 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 13:45:06.505370 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485725 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 13:45:06.505370 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485728 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 13:45:06.505370 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485731 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 13:45:06.505370 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485734 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 13:45:06.505370 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485737 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 13:45:06.505370 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485740 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 13:45:06.505370 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485742 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 13:45:06.505370 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485745 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 13:45:06.505370 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485747 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 13:45:06.505370 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485750 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 13:45:06.505370 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485753 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 13:45:06.505370 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485756 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 13:45:06.505370 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485758 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 13:45:06.506006 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485761 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 13:45:06.506006 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485763 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 13:45:06.506006 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485766 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 13:45:06.506006 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485768 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 13:45:06.506006 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485772 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 13:45:06.506006 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485774 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 13:45:06.506006 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485777 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 13:45:06.506006 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485780 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 13:45:06.506006 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485783 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 13:45:06.506006 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485785 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 13:45:06.506006 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485788 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 13:45:06.506006 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485791 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 13:45:06.506006 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485794 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 13:45:06.506006 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485796 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 13:45:06.506006 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485799 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 13:45:06.506006 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485801 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 13:45:06.506006 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485804 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 13:45:06.506006 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485807 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 13:45:06.506006 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485809 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 13:45:06.506647 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485812 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 13:45:06.506647 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485815 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 13:45:06.506647 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485818 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 13:45:06.506647 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485821 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 13:45:06.506647 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485823 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 13:45:06.506647 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485827 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 13:45:06.506647 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485830 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 13:45:06.506647 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485832 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 13:45:06.506647 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485835 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 13:45:06.506647 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485837 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 13:45:06.506647 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485840 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 13:45:06.506647 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485842 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 13:45:06.506647 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485845 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 13:45:06.506647 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485847 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 13:45:06.506647 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485850 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 13:45:06.506647 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485852 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 13:45:06.506647 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485854 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 13:45:06.506647 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485858 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 13:45:06.506647 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485863 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 13:45:06.507257 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485866 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 13:45:06.507257 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485869 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 13:45:06.507257 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485873 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 13:45:06.507257 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485876 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 13:45:06.507257 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485879 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 13:45:06.507257 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485883 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 13:45:06.507257 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485886 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 13:45:06.507257 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485889 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 13:45:06.507257 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485892 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 13:45:06.507257 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485895 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 13:45:06.507257 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485898 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 13:45:06.507257 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485900 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 13:45:06.507257 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485903 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 13:45:06.507257 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485908 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 13:45:06.507257 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.485918 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 13:45:06.507257 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486301 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 13:45:06.507257 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486307 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 13:45:06.507257 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486310 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 13:45:06.507257 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486313 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 13:45:06.507887 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486316 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 13:45:06.507887 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486319 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 13:45:06.507887 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486322 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 13:45:06.507887 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486325 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 13:45:06.507887 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486327 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 13:45:06.507887 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486330 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 13:45:06.507887 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486333 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 13:45:06.507887 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486335 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 13:45:06.507887 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486351 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 13:45:06.507887 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486355 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 13:45:06.507887 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486358 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 13:45:06.507887 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486362 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 13:45:06.507887 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486366 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 13:45:06.507887 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486370 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 13:45:06.507887 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486374 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 13:45:06.507887 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486378 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 13:45:06.507887 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486381 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 13:45:06.507887 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486384 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 13:45:06.507887 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486388 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 13:45:06.508502 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486390 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 13:45:06.508502 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486393 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 13:45:06.508502 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486396 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 13:45:06.508502 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486399 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 13:45:06.508502 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486401 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 13:45:06.508502 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486404 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 13:45:06.508502 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486407 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 13:45:06.508502 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486412 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 13:45:06.508502 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486415 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 13:45:06.508502 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486418 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 13:45:06.508502 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486420 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 13:45:06.508502 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486423 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 13:45:06.508502 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486425 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 13:45:06.508502 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486428 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 13:45:06.508502 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486431 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 13:45:06.508502 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486433 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 13:45:06.508502 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486436 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 13:45:06.508502 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486439 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 13:45:06.508502 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486441 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 13:45:06.508502 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486444 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 13:45:06.509168 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486446 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 13:45:06.509168 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486449 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 13:45:06.509168 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486451 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 13:45:06.509168 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486454 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 13:45:06.509168 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486457 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 13:45:06.509168 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486459 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 13:45:06.509168 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486462 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 13:45:06.509168 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486465 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 13:45:06.509168 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486467 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 13:45:06.509168 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486472 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 13:45:06.509168 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486474 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 13:45:06.509168 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486476 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 13:45:06.509168 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486479 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 13:45:06.509168 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486482 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 13:45:06.509168 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486484 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 13:45:06.509168 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486486 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 13:45:06.509168 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486490 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 13:45:06.509168 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486493 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 13:45:06.509168 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486496 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 13:45:06.509168 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486501 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 06 13:45:06.509811 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486503 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 13:45:06.509811 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486506 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 13:45:06.509811 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486509 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 13:45:06.509811 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486512 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 13:45:06.509811 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486516 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 13:45:06.509811 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486518 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 13:45:06.509811 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486521 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 13:45:06.509811 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486524 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 13:45:06.509811 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486527 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 13:45:06.509811 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486530 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 13:45:06.509811 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486533 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 13:45:06.509811 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486536 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 13:45:06.509811 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486538 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 13:45:06.509811 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486541 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 13:45:06.509811 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486544 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 13:45:06.509811 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486546 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 13:45:06.509811 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486549 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 13:45:06.509811 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486551 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 13:45:06.509811 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486554 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 13:45:06.509811 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486557 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 13:45:06.510464 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486559 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 13:45:06.510464 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486563 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 13:45:06.510464 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486565 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 13:45:06.510464 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486568 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 13:45:06.510464 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486570 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 13:45:06.510464 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486573 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 13:45:06.510464 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486575 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 13:45:06.510464 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486578 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 13:45:06.510464 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486580 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 13:45:06.510464 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486583 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 13:45:06.510464 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486585 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 13:45:06.510464 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486591 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 13:45:06.510464 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486594 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 13:45:06.510464 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486597 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 13:45:06.510464 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486599 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 13:45:06.510464 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.486602 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 13:45:06.510464 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486680 2556 flags.go:64] FLAG: --address="0.0.0.0" Jul 06 13:45:06.510464 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486688 2556 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 06 13:45:06.510464 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486698 2556 flags.go:64] FLAG: --anonymous-auth="true" Jul 06 13:45:06.510464 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486703 2556 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 06 13:45:06.510464 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486707 2556 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 06 13:45:06.589948 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486710 2556 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 06 13:45:06.589948 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486714 2556 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 06 13:45:06.589948 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486717 2556 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 06 13:45:06.589948 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486720 2556 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 06 13:45:06.589948 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486723 2556 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 06 13:45:06.589948 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486727 2556 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 06 13:45:06.589948 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486730 2556 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 06 13:45:06.589948 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486733 2556 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 06 13:45:06.589948 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486736 2556 flags.go:64] FLAG: --cgroup-root="" Jul 06 13:45:06.589948 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486739 2556 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 06 13:45:06.589948 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486742 2556 flags.go:64] FLAG: --client-ca-file="" Jul 06 13:45:06.589948 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486746 2556 flags.go:64] FLAG: --cloud-provider="external" Jul 06 13:45:06.589948 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486751 2556 flags.go:64] FLAG: --cluster-dns="[]" Jul 06 13:45:06.589948 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486755 2556 flags.go:64] FLAG: --cluster-domain="" Jul 06 13:45:06.589948 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486758 2556 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 06 13:45:06.589948 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486761 2556 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 06 13:45:06.589948 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486764 2556 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 06 13:45:06.589948 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486767 2556 flags.go:64] FLAG: --container-log-max-files="5" Jul 06 13:45:06.589948 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486771 2556 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 06 13:45:06.589948 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486774 2556 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 06 13:45:06.589948 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486777 2556 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 06 13:45:06.589948 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486780 2556 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 06 13:45:06.589948 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486785 2556 flags.go:64] FLAG: --contention-profiling="false" Jul 06 13:45:06.589948 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486788 2556 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 06 13:45:06.565081 ip-10-0-134-85 systemd[1]: Started Kubernetes Kubelet. Jul 06 13:45:06.590952 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486791 2556 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 06 13:45:06.590952 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486794 2556 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 06 13:45:06.590952 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486797 2556 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 06 13:45:06.590952 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486801 2556 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 06 13:45:06.590952 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486804 2556 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 06 13:45:06.590952 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486806 2556 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 06 13:45:06.590952 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486809 2556 flags.go:64] FLAG: --enable-load-reader="false" Jul 06 13:45:06.590952 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486812 2556 flags.go:64] FLAG: --enable-server="true" Jul 06 13:45:06.590952 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486815 2556 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 06 13:45:06.590952 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486819 2556 flags.go:64] FLAG: --event-burst="100" Jul 06 13:45:06.590952 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486822 2556 flags.go:64] FLAG: --event-qps="50" Jul 06 13:45:06.590952 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486825 2556 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 06 13:45:06.590952 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486828 2556 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 06 13:45:06.590952 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486831 2556 flags.go:64] FLAG: --eviction-hard="" Jul 06 13:45:06.590952 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486835 2556 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 06 13:45:06.590952 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486838 2556 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 06 13:45:06.590952 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486840 2556 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 06 13:45:06.590952 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486843 2556 flags.go:64] FLAG: --eviction-soft="" Jul 06 13:45:06.590952 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486846 2556 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 06 13:45:06.590952 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486849 2556 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 06 13:45:06.590952 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486854 2556 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 06 13:45:06.590952 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486857 2556 flags.go:64] FLAG: --experimental-mounter-path="" Jul 06 13:45:06.590952 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486859 2556 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 06 13:45:06.590952 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486862 2556 flags.go:64] FLAG: --fail-swap-on="true" Jul 06 13:45:06.590952 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486865 2556 flags.go:64] FLAG: --feature-gates="" Jul 06 13:45:06.591983 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486869 2556 flags.go:64] FLAG: --file-check-frequency="20s" Jul 06 13:45:06.591983 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486872 2556 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 06 13:45:06.591983 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486875 2556 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 06 13:45:06.591983 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486878 2556 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 06 13:45:06.591983 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486881 2556 flags.go:64] FLAG: --healthz-port="10248" Jul 06 13:45:06.591983 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486885 2556 flags.go:64] FLAG: --help="false" Jul 06 13:45:06.591983 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486888 2556 flags.go:64] FLAG: --hostname-override="ip-10-0-134-85.ec2.internal" Jul 06 13:45:06.591983 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486891 2556 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 06 13:45:06.591983 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486894 2556 flags.go:64] FLAG: --http-check-frequency="20s" Jul 06 13:45:06.591983 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486897 2556 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 06 13:45:06.591983 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486900 2556 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 06 13:45:06.591983 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486903 2556 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 06 13:45:06.591983 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486906 2556 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 06 13:45:06.591983 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486909 2556 flags.go:64] FLAG: --image-service-endpoint="" Jul 06 13:45:06.591983 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486912 2556 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 06 13:45:06.591983 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486915 2556 flags.go:64] FLAG: --kube-api-burst="100" Jul 06 13:45:06.591983 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486917 2556 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 06 13:45:06.591983 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486920 2556 flags.go:64] FLAG: --kube-api-qps="50" Jul 06 13:45:06.591983 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486923 2556 flags.go:64] FLAG: --kube-reserved="" Jul 06 13:45:06.591983 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486926 2556 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 06 13:45:06.591983 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486929 2556 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 06 13:45:06.591983 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486932 2556 flags.go:64] FLAG: --kubelet-cgroups="" Jul 06 13:45:06.591983 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486935 2556 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 06 13:45:06.591983 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486938 2556 flags.go:64] FLAG: --lock-file="" Jul 06 13:45:06.593017 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486940 2556 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 06 13:45:06.593017 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486943 2556 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 06 13:45:06.593017 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486946 2556 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 06 13:45:06.593017 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486952 2556 flags.go:64] FLAG: --log-json-split-stream="false" Jul 06 13:45:06.593017 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486955 2556 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 06 13:45:06.593017 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486958 2556 flags.go:64] FLAG: --log-text-split-stream="false" Jul 06 13:45:06.593017 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486961 2556 flags.go:64] FLAG: --logging-format="text" Jul 06 13:45:06.593017 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486963 2556 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 06 13:45:06.593017 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486966 2556 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 06 13:45:06.593017 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486969 2556 flags.go:64] FLAG: --manifest-url="" Jul 06 13:45:06.593017 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486972 2556 flags.go:64] FLAG: --manifest-url-header="" Jul 06 13:45:06.593017 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486976 2556 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 06 13:45:06.593017 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486979 2556 flags.go:64] FLAG: --max-open-files="1000000" Jul 06 13:45:06.593017 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486983 2556 flags.go:64] FLAG: --max-pods="110" Jul 06 13:45:06.593017 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486986 2556 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 06 13:45:06.593017 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486989 2556 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 06 13:45:06.593017 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486992 2556 flags.go:64] FLAG: --memory-manager-policy="None" Jul 06 13:45:06.593017 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486995 2556 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 06 13:45:06.593017 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.486998 2556 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 06 13:45:06.593017 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.487001 2556 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 06 13:45:06.593017 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.487004 2556 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 06 13:45:06.593017 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.487011 2556 flags.go:64] FLAG: --node-status-max-images="50" Jul 06 13:45:06.593017 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.487014 2556 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 06 13:45:06.593017 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.487016 2556 flags.go:64] FLAG: --oom-score-adj="-999" Jul 06 13:45:06.593017 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.487019 2556 flags.go:64] FLAG: --pod-cidr="" Jul 06 13:45:06.594040 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.487022 2556 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 06 13:45:06.594040 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.487027 2556 flags.go:64] FLAG: --pod-manifest-path="" Jul 06 13:45:06.594040 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.487030 2556 flags.go:64] FLAG: --pod-max-pids="-1" Jul 06 13:45:06.594040 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.487033 2556 flags.go:64] FLAG: --pods-per-core="0" Jul 06 13:45:06.594040 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.487035 2556 flags.go:64] FLAG: --port="10250" Jul 06 13:45:06.594040 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.487038 2556 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 06 13:45:06.594040 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.487041 2556 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-075f6871ce388225a" Jul 06 13:45:06.594040 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.487044 2556 flags.go:64] FLAG: --qos-reserved="" Jul 06 13:45:06.594040 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.487047 2556 flags.go:64] FLAG: --read-only-port="10255" Jul 06 13:45:06.594040 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.487050 2556 flags.go:64] FLAG: --register-node="true" Jul 06 13:45:06.594040 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.487054 2556 flags.go:64] FLAG: --register-with-taints="" Jul 06 13:45:06.594040 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.487057 2556 flags.go:64] FLAG: --registry-burst="10" Jul 06 13:45:06.594040 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.487061 2556 flags.go:64] FLAG: --registry-qps="5" Jul 06 13:45:06.594040 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.487063 2556 flags.go:64] FLAG: --reserved-cpus="" Jul 06 13:45:06.594040 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.487067 2556 flags.go:64] FLAG: --reserved-memory="" Jul 06 13:45:06.594040 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.487071 2556 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 06 13:45:06.594040 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.487074 2556 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 06 13:45:06.594040 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.487077 2556 flags.go:64] FLAG: --rotate-certificates="false" Jul 06 13:45:06.594040 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.487080 2556 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 06 13:45:06.594040 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.487082 2556 flags.go:64] FLAG: --runonce="false" Jul 06 13:45:06.594040 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.487085 2556 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 06 13:45:06.594040 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.487091 2556 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 06 13:45:06.594040 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.487094 2556 flags.go:64] FLAG: --seccomp-default="false" Jul 06 13:45:06.594040 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.487097 2556 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 06 13:45:06.594040 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.487100 2556 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 06 13:45:06.595076 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.487103 2556 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 06 13:45:06.595076 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.487106 2556 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 06 13:45:06.595076 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.487109 2556 flags.go:64] FLAG: --storage-driver-password="root" Jul 06 13:45:06.595076 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.487112 2556 flags.go:64] FLAG: --storage-driver-secure="false" Jul 06 13:45:06.595076 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.487115 2556 flags.go:64] FLAG: --storage-driver-table="stats" Jul 06 13:45:06.595076 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.487117 2556 flags.go:64] FLAG: --storage-driver-user="root" Jul 06 13:45:06.595076 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.487120 2556 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 06 13:45:06.595076 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.487123 2556 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 06 13:45:06.595076 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.487126 2556 flags.go:64] FLAG: --system-cgroups="" Jul 06 13:45:06.595076 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.487128 2556 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 06 13:45:06.595076 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.487134 2556 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 06 13:45:06.595076 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.487137 2556 flags.go:64] FLAG: --tls-cert-file="" Jul 06 13:45:06.595076 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.487139 2556 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 06 13:45:06.595076 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.487144 2556 flags.go:64] FLAG: --tls-min-version="" Jul 06 13:45:06.595076 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.487147 2556 flags.go:64] FLAG: --tls-private-key-file="" Jul 06 13:45:06.595076 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.487150 2556 flags.go:64] FLAG: --topology-manager-policy="none" Jul 06 13:45:06.595076 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.487153 2556 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 06 13:45:06.595076 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.487157 2556 flags.go:64] FLAG: --topology-manager-scope="container" Jul 06 13:45:06.595076 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.487160 2556 flags.go:64] FLAG: --v="2" Jul 06 13:45:06.595076 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.487164 2556 flags.go:64] FLAG: --version="false" Jul 06 13:45:06.595076 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.487168 2556 flags.go:64] FLAG: --vmodule="" Jul 06 13:45:06.595076 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.487171 2556 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 06 13:45:06.595076 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.487175 2556 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 06 13:45:06.595076 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487289 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 13:45:06.595076 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487292 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 13:45:06.595792 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487295 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 13:45:06.595792 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487297 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 13:45:06.595792 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487300 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 13:45:06.595792 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487304 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 13:45:06.595792 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487307 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 13:45:06.595792 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487309 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 13:45:06.595792 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487312 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 13:45:06.595792 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487315 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 13:45:06.595792 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487317 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 13:45:06.595792 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487320 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 13:45:06.595792 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487322 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 13:45:06.595792 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487325 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 13:45:06.595792 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487328 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 13:45:06.595792 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487330 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 13:45:06.595792 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487333 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 13:45:06.595792 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487335 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 13:45:06.595792 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487337 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 13:45:06.595792 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487340 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 13:45:06.595792 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487342 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 13:45:06.595792 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487345 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 13:45:06.595792 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487347 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 13:45:06.697687 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487350 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 13:45:06.697687 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487352 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 13:45:06.697687 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487355 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 13:45:06.697687 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487358 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 13:45:06.697687 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487361 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 13:45:06.697687 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487364 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 13:45:06.697687 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487366 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 13:45:06.697687 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487369 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 13:45:06.697687 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487372 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 13:45:06.697687 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487375 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 13:45:06.697687 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487377 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 13:45:06.697687 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487379 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 13:45:06.697687 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487382 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 13:45:06.697687 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487385 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 13:45:06.697687 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487388 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 13:45:06.697687 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487391 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 13:45:06.697687 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487394 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 13:45:06.697687 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487396 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 13:45:06.697687 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487399 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 13:45:06.699846 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487401 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 13:45:06.699846 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487404 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 13:45:06.699846 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487406 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 13:45:06.699846 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487409 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 13:45:06.699846 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487411 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 13:45:06.699846 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487414 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 13:45:06.699846 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487417 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 13:45:06.699846 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487419 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 13:45:06.699846 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487421 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 13:45:06.699846 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487424 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 13:45:06.699846 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487426 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 13:45:06.699846 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487429 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 13:45:06.699846 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487431 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 13:45:06.699846 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487434 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 13:45:06.699846 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487436 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 13:45:06.699846 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487439 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 13:45:06.699846 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487442 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 13:45:06.699846 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487445 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 13:45:06.699846 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487447 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 13:45:06.700474 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487450 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 13:45:06.700474 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487453 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 13:45:06.700474 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487456 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 13:45:06.700474 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487459 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 13:45:06.700474 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487461 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 13:45:06.700474 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487464 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 13:45:06.700474 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487466 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 13:45:06.700474 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487468 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 13:45:06.700474 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487472 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 13:45:06.700474 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487475 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 13:45:06.700474 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487477 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 13:45:06.700474 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487480 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 13:45:06.700474 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487482 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 13:45:06.700474 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487485 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 13:45:06.700474 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487487 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 13:45:06.700474 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487490 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 13:45:06.700474 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487492 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 13:45:06.700474 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487495 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 13:45:06.700474 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487497 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 13:45:06.700474 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487500 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 13:45:06.701159 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487502 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 13:45:06.701159 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487505 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 13:45:06.701159 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487507 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 13:45:06.701159 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487510 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 13:45:06.701159 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487513 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 13:45:06.701159 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487515 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 13:45:06.701159 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487518 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 13:45:06.701159 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487520 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 13:45:06.701159 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487523 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 13:45:06.701159 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487527 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 13:45:06.701159 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487530 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 13:45:06.701159 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487533 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 06 13:45:06.701159 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487537 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 13:45:06.701159 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487541 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 13:45:06.701159 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487544 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 13:45:06.701159 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487548 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 13:45:06.701159 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487551 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 13:45:06.701159 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.487555 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 13:45:06.701716 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.488372 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 13:45:06.701716 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.494959 2556 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 06 13:45:06.701716 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.494972 2556 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 06 13:45:06.701716 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.495750 2556 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 06 13:45:06.701716 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.495758 2556 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 06 13:45:06.701716 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.495833 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 13:45:06.701716 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.495838 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 13:45:06.701716 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.495844 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 13:45:06.701716 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.495846 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 13:45:06.701716 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.495849 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 13:45:06.701716 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.495853 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 13:45:06.701716 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.495855 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 13:45:06.701716 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.495858 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 13:45:06.701716 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.495861 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 13:45:06.701716 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.495864 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 13:45:06.702210 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.495867 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 13:45:06.702210 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.495869 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 13:45:06.702210 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.495872 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 13:45:06.702210 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.495875 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 13:45:06.702210 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.495879 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 13:45:06.702210 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.495883 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 13:45:06.702210 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.495886 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 13:45:06.702210 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.495889 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 13:45:06.702210 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.495892 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 13:45:06.702210 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.495895 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 13:45:06.702210 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.495897 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 13:45:06.702210 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.495902 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 13:45:06.702210 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.495905 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 13:45:06.702210 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.495908 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 13:45:06.702210 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.495911 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 13:45:06.702210 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.495914 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 13:45:06.702210 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.495916 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 13:45:06.702210 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.495919 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 13:45:06.702210 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.495921 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 13:45:06.702776 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.495924 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 13:45:06.702776 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.495926 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 13:45:06.702776 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.495929 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 13:45:06.702776 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.495931 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 13:45:06.702776 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.495933 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 13:45:06.702776 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.495937 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 13:45:06.702776 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.495940 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 13:45:06.702776 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.495944 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 13:45:06.702776 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.495947 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 13:45:06.702776 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.495950 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 13:45:06.702776 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.495953 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 13:45:06.702776 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.495956 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 13:45:06.702776 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.495958 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 13:45:06.702776 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.495961 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 13:45:06.702776 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.495964 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 13:45:06.702776 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.495966 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 06 13:45:06.702776 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.495969 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 13:45:06.702776 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.495973 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 13:45:06.702776 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.495977 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 13:45:06.703380 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.495980 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 13:45:06.703380 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.495983 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 13:45:06.703380 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.495986 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 13:45:06.703380 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.495989 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 13:45:06.703380 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.495991 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 13:45:06.703380 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.495994 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 13:45:06.703380 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.495996 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 13:45:06.703380 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.495999 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 13:45:06.703380 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496001 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 13:45:06.703380 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496005 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 13:45:06.703380 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496008 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 13:45:06.703380 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496010 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 13:45:06.703380 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496013 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 13:45:06.703380 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496016 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 13:45:06.703380 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496018 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 13:45:06.703380 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496021 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 13:45:06.703380 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496023 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 13:45:06.703380 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496026 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 13:45:06.703380 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496029 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 13:45:06.703380 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496032 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 13:45:06.703993 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496036 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 13:45:06.703993 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496039 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 13:45:06.703993 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496042 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 13:45:06.703993 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496044 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 13:45:06.703993 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496047 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 13:45:06.703993 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496050 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 13:45:06.703993 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496052 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 13:45:06.703993 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496055 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 13:45:06.703993 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496058 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 13:45:06.703993 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496061 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 13:45:06.703993 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496063 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 13:45:06.703993 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496066 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 13:45:06.703993 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496068 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 13:45:06.703993 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496071 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 13:45:06.703993 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496074 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 13:45:06.703993 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496076 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 13:45:06.703993 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496079 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 13:45:06.703993 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496081 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 13:45:06.703993 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496084 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 13:45:06.703993 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496086 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 13:45:06.704560 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496089 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 13:45:06.704560 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496092 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 13:45:06.704560 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496095 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 13:45:06.704560 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496097 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 13:45:06.704560 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496100 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 13:45:06.704560 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496102 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 13:45:06.704560 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496104 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 13:45:06.704560 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496107 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 13:45:06.704560 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496109 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 13:45:06.704560 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496112 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 13:45:06.704560 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496115 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 13:45:06.704560 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.496120 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 13:45:06.704560 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496230 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 13:45:06.704560 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496234 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 13:45:06.704975 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496237 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 13:45:06.704975 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496240 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 13:45:06.704975 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496243 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 13:45:06.704975 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496246 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 13:45:06.704975 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496249 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 13:45:06.704975 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496252 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 13:45:06.704975 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496254 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 13:45:06.704975 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496257 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 13:45:06.704975 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496259 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 13:45:06.704975 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496262 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 13:45:06.704975 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496265 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 13:45:06.704975 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496267 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 13:45:06.704975 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496269 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 13:45:06.704975 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496272 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 13:45:06.704975 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496274 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 13:45:06.704975 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496277 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 13:45:06.704975 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496280 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 13:45:06.704975 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496282 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 13:45:06.704975 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496285 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 13:45:06.704975 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496288 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 13:45:06.705523 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496290 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 13:45:06.705523 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496293 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 13:45:06.705523 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496296 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 13:45:06.705523 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496298 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 13:45:06.705523 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496301 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 13:45:06.705523 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496303 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 13:45:06.705523 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496306 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 13:45:06.705523 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496309 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 13:45:06.705523 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496311 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 13:45:06.705523 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496315 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 13:45:06.705523 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496319 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 13:45:06.705523 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496322 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 13:45:06.705523 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496324 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 13:45:06.705523 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496327 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 13:45:06.705523 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496329 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 13:45:06.705523 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496332 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 13:45:06.705523 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496334 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 13:45:06.705523 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496337 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 13:45:06.705523 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496340 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 13:45:06.705523 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496342 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 13:45:06.706068 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496345 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 13:45:06.706068 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496347 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 13:45:06.706068 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496350 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 13:45:06.706068 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496352 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 13:45:06.706068 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496355 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 13:45:06.706068 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496357 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 13:45:06.706068 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496359 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 13:45:06.706068 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496362 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 13:45:06.706068 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496364 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 13:45:06.706068 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496367 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 13:45:06.706068 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496369 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 13:45:06.706068 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496372 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 13:45:06.706068 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496374 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 13:45:06.706068 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496377 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 13:45:06.706068 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496380 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 13:45:06.706068 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496382 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 13:45:06.706068 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496385 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 06 13:45:06.706068 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496387 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 13:45:06.706068 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496390 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 13:45:06.706068 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496392 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 13:45:06.706068 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496395 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 13:45:06.706681 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496398 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 13:45:06.706681 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496403 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 13:45:06.706681 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496407 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 13:45:06.706681 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496410 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 13:45:06.706681 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496412 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 13:45:06.706681 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496415 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 13:45:06.706681 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496418 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 13:45:06.706681 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496421 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 13:45:06.706681 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496424 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 13:45:06.706681 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496427 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 13:45:06.706681 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496429 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 13:45:06.706681 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496432 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 13:45:06.706681 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496434 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 13:45:06.706681 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496437 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 13:45:06.706681 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496441 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 13:45:06.706681 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496444 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 13:45:06.706681 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496447 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 13:45:06.706681 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496450 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 13:45:06.707148 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496453 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 13:45:06.707148 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496456 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 13:45:06.707148 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496459 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 13:45:06.707148 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496461 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 13:45:06.707148 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496464 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 13:45:06.707148 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496466 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 13:45:06.707148 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496469 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 13:45:06.707148 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496471 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 13:45:06.707148 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496474 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 13:45:06.707148 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496478 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 13:45:06.707148 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496481 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 13:45:06.707148 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496484 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 13:45:06.707148 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496487 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 13:45:06.707148 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496489 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 13:45:06.707148 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496493 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 13:45:06.707148 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496496 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 13:45:06.707148 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496499 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 13:45:06.707148 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:06.496502 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 13:45:06.707669 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.496507 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 13:45:06.707669 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.496608 2556 server.go:962] "Client rotation is on, will bootstrap in background" Jul 06 13:45:06.707669 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.498776 2556 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 06 13:45:06.707669 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.500309 2556 server.go:1019] "Starting client certificate rotation" Jul 06 13:45:06.707669 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.501433 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 13:45:06.707669 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.501470 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 13:45:06.707669 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.503114 2556 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 13:45:06.707669 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.505775 2556 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 13:45:06.707669 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.520666 2556 log.go:25] "Validated CRI v1 runtime API" Jul 06 13:45:06.707669 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.528406 2556 log.go:25] "Validated CRI v1 image API" Jul 06 13:45:06.707669 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.529278 2556 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 06 13:45:06.707669 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.533200 2556 fs.go:135] Filesystem UUIDs: map[3e4f8f53-deda-4645-b41b-e6bec628ad64:/dev/nvme0n1p4 71487441-6bb3-47b9-ba2b-5142e2693d5a:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 06 13:45:06.708044 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.533215 2556 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 06 13:45:06.708044 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.539573 2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 13:45:06.708208 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.541680 2556 manager.go:216] Machine: {Timestamp:2026-07-06 13:45:06.540416538 +0000 UTC m=+0.340162222 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100789 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec246e4b1b421f39794e4306111d8c44 SystemUUID:ec246e4b-1b42-1f39-794e-4306111d8c44 BootID:47aa1a9d-4f22-4273-8d07-53fd2466a68a Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:6e:f1:09:9b:47 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:6e:f1:09:9b:47 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5e:67:43:de:58:42 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 06 13:45:06.708208 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.541784 2556 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 06 13:45:06.708208 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.541853 2556 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 06 13:45:06.708208 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.545495 2556 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 06 13:45:06.708208 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.545521 2556 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-85.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 06 13:45:06.708208 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.546373 2556 topology_manager.go:138] "Creating topology manager with none policy" Jul 06 13:45:06.708208 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.546383 2556 container_manager_linux.go:309] "Creating device plugin manager" Jul 06 13:45:06.708208 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.546391 2556 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 13:45:06.708208 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.547191 2556 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 13:45:06.708208 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.548937 2556 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 06 13:45:06.708208 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.552496 2556 state_mem.go:36] "Initialized new in-memory state store" Jul 06 13:45:06.708208 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.552607 2556 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 06 13:45:06.708208 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.552644 2556 kubelet.go:486] "Attempting to sync node with API server" Jul 06 13:45:06.708208 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.552658 2556 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 06 13:45:06.708208 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.552672 2556 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 06 13:45:06.708208 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.552681 2556 kubelet.go:398] "Adding apiserver pod source" Jul 06 13:45:06.708208 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.552690 2556 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 06 13:45:06.708208 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.552972 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 13:45:06.708779 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.552987 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 13:45:06.708779 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.556147 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jgcwb" Jul 06 13:45:06.708779 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.556294 2556 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 06 13:45:06.708779 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.558570 2556 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 06 13:45:06.708779 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.558597 2556 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 06 13:45:06.708779 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.559776 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 06 13:45:06.708779 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.559789 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 06 13:45:06.708779 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.559795 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 06 13:45:06.708779 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.559800 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 06 13:45:06.708779 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.559808 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 06 13:45:06.708779 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.559813 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 06 13:45:06.708779 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.559820 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 06 13:45:06.708779 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.559827 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 06 13:45:06.708779 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.559833 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 06 13:45:06.708779 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.559839 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 06 13:45:06.708779 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.559852 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 06 13:45:06.708779 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.559857 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 06 13:45:06.708779 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.561095 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jgcwb" Jul 06 13:45:06.708779 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.561336 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 06 13:45:06.708779 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.561345 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 06 13:45:06.708779 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.564234 2556 server.go:1268] "Started kubelet" Jul 06 13:45:06.708779 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.564397 2556 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 06 13:45:06.708779 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.564462 2556 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 06 13:45:06.708779 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.564457 2556 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 06 13:45:06.708779 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.566738 2556 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 06 13:45:06.708779 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.567313 2556 server.go:310] "Adding debug handlers to kubelet server" Jul 06 13:45:06.708779 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.570724 2556 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 13:45:06.708779 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:06.570993 2556 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 06 13:45:06.708779 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.574745 2556 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 06 13:45:06.708779 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.574746 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 06 13:45:06.708779 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:06.575020 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-85.ec2.internal\" not found" Jul 06 13:45:06.708779 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.575530 2556 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 06 13:45:06.708779 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.575534 2556 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 06 13:45:06.708779 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.575551 2556 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 06 13:45:06.708779 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.575647 2556 reconstruct.go:97] "Volume reconstruction finished" Jul 06 13:45:06.708779 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.575658 2556 reconciler.go:29] "Reconciler: start to sync state" Jul 06 13:45:06.708779 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.575762 2556 factory.go:55] Registering systemd factory Jul 06 13:45:06.708779 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.575777 2556 factory.go:223] Registration of the systemd container factory successfully Jul 06 13:45:06.708779 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.576016 2556 factory.go:153] Registering CRI-O factory Jul 06 13:45:06.708779 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.576039 2556 factory.go:223] Registration of the crio container factory successfully Jul 06 13:45:06.708779 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.576093 2556 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 06 13:45:06.708779 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.576118 2556 factory.go:103] Registering Raw factory Jul 06 13:45:06.708779 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.576134 2556 manager.go:1196] Started watching for new ooms in manager Jul 06 13:45:06.708779 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.576868 2556 manager.go:349] Starting recovery of all containers Jul 06 13:45:06.708779 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.576947 2556 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-134-85.ec2.internal" not found Jul 06 13:45:06.708779 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.577547 2556 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 13:45:06.708779 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.577992 2556 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 13:45:06.708779 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:06.580818 2556 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-134-85.ec2.internal\" not found" node="ip-10-0-134-85.ec2.internal" Jul 06 13:45:06.708779 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.586669 2556 manager.go:354] Recovery completed Jul 06 13:45:06.708779 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.590719 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 13:45:06.708779 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.592459 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-85.ec2.internal" event="NodeHasSufficientMemory" Jul 06 13:45:06.712293 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.592491 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-85.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 13:45:06.712293 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.592508 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-85.ec2.internal" event="NodeHasSufficientPID" Jul 06 13:45:06.712293 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.593030 2556 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 06 13:45:06.712293 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.593040 2556 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 06 13:45:06.712293 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.593042 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 13:45:06.712293 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.593064 2556 state_mem.go:36] "Initialized new in-memory state store" Jul 06 13:45:06.712293 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.593699 2556 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-134-85.ec2.internal" not found Jul 06 13:45:06.712293 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.593735 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-85.ec2.internal" event="NodeHasSufficientMemory" Jul 06 13:45:06.712293 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.593764 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-85.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 13:45:06.712293 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.593789 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-85.ec2.internal" event="NodeHasSufficientPID" Jul 06 13:45:06.712293 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.594394 2556 policy_none.go:49] "None policy: Start" Jul 06 13:45:06.712293 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.594406 2556 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 06 13:45:06.712293 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.594415 2556 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 06 13:45:06.712293 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.595515 2556 policy_none.go:47] "Start" Jul 06 13:45:06.712293 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.645144 2556 manager.go:337] "Starting Device Plugin manager" Jul 06 13:45:06.712293 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:06.645262 2556 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 06 13:45:06.712293 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.645271 2556 server.go:87] "Starting device plugin registration server" Jul 06 13:45:06.712293 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.645442 2556 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 06 13:45:06.712293 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.645451 2556 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 06 13:45:06.712293 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.645536 2556 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 06 13:45:06.712293 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.645657 2556 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 06 13:45:06.712293 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.645670 2556 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 06 13:45:06.712293 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:06.646041 2556 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 06 13:45:06.712293 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:06.646089 2556 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-85.ec2.internal\" not found" Jul 06 13:45:06.712293 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.653363 2556 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-134-85.ec2.internal" not found Jul 06 13:45:06.886823 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.747040 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 13:45:06.886823 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.748388 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-85.ec2.internal" event="NodeHasSufficientMemory" Jul 06 13:45:06.886823 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.748423 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-85.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 13:45:06.886823 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.748439 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-85.ec2.internal" event="NodeHasSufficientPID" Jul 06 13:45:06.886823 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.748475 2556 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-85.ec2.internal" Jul 06 13:45:06.886823 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.759356 2556 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-85.ec2.internal" Jul 06 13:45:06.886823 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.779229 2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 06 13:45:06.886823 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.780443 2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 06 13:45:06.886823 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.780499 2556 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 06 13:45:06.886823 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.780521 2556 kubelet.go:2448] "Starting kubelet main sync loop" Jul 06 13:45:06.886823 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:06.780557 2556 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 06 13:45:06.886823 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.782948 2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 13:45:06.886823 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.881053 2556 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-85.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-85.ec2.internal"] Jul 06 13:45:06.886823 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.882829 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-85.ec2.internal" Jul 06 13:45:06.886823 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.884053 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-85.ec2.internal" Jul 06 13:45:07.083716 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.905218 2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-85.ec2.internal" Jul 06 13:45:07.083716 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.909474 2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-85.ec2.internal" Jul 06 13:45:07.083716 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.919303 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 13:45:07.083716 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.920268 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 13:45:07.083716 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.978495 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6d4feb6891ad8edcfe276a6edcabbad7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-85.ec2.internal\" (UID: \"6d4feb6891ad8edcfe276a6edcabbad7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-85.ec2.internal" Jul 06 13:45:07.083716 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.978515 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6d4feb6891ad8edcfe276a6edcabbad7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-85.ec2.internal\" (UID: \"6d4feb6891ad8edcfe276a6edcabbad7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-85.ec2.internal" Jul 06 13:45:07.083716 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:06.978533 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/918473a18bd382b5ab12df4cdc26e303-config\") pod \"kube-apiserver-proxy-ip-10-0-134-85.ec2.internal\" (UID: \"918473a18bd382b5ab12df4cdc26e303\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-85.ec2.internal" Jul 06 13:45:07.083716 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.080110 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6d4feb6891ad8edcfe276a6edcabbad7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-85.ec2.internal\" (UID: \"6d4feb6891ad8edcfe276a6edcabbad7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-85.ec2.internal" Jul 06 13:45:07.083716 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.080211 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6d4feb6891ad8edcfe276a6edcabbad7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-85.ec2.internal\" (UID: \"6d4feb6891ad8edcfe276a6edcabbad7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-85.ec2.internal" Jul 06 13:45:07.083716 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.080445 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6d4feb6891ad8edcfe276a6edcabbad7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-85.ec2.internal\" (UID: \"6d4feb6891ad8edcfe276a6edcabbad7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-85.ec2.internal" Jul 06 13:45:07.083716 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.080535 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6d4feb6891ad8edcfe276a6edcabbad7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-85.ec2.internal\" (UID: \"6d4feb6891ad8edcfe276a6edcabbad7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-85.ec2.internal" Jul 06 13:45:07.083716 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.080787 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/918473a18bd382b5ab12df4cdc26e303-config\") pod \"kube-apiserver-proxy-ip-10-0-134-85.ec2.internal\" (UID: \"918473a18bd382b5ab12df4cdc26e303\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-85.ec2.internal" Jul 06 13:45:07.083716 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.080674 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/918473a18bd382b5ab12df4cdc26e303-config\") pod \"kube-apiserver-proxy-ip-10-0-134-85.ec2.internal\" (UID: \"918473a18bd382b5ab12df4cdc26e303\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-85.ec2.internal" Jul 06 13:45:07.261815 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.224174 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-85.ec2.internal" Jul 06 13:45:07.261815 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.226502 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-85.ec2.internal" Jul 06 13:45:07.517728 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.502388 2556 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 06 13:45:07.517728 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.502494 2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 13:45:07.517728 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.502520 2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 13:45:07.517728 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.502798 2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 13:45:07.605537 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.555397 2556 apiserver.go:52] "Watching apiserver" Jul 06 13:45:07.605537 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.565306 2556 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 06 13:45:07.605537 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.566572 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-hsbqp","kube-system/global-pull-secret-syncer-w5psk","openshift-image-registry/node-ca-wmfs6","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-85.ec2.internal","openshift-multus/multus-additional-cni-plugins-6krtq","openshift-multus/network-metrics-daemon-jkhgk","openshift-network-operator/iptables-alerter-rzflg","kube-system/konnectivity-agent-266zj","kube-system/kube-apiserver-proxy-ip-10-0-134-85.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnbsk","openshift-cluster-node-tuning-operator/tuned-dp8pp","openshift-dns/node-resolver-jpdcl","openshift-multus/multus-b8v6z","openshift-network-diagnostics/network-check-target-nzf92"] Jul 06 13:45:07.605537 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.567815 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 13:40:07 +0000 UTC" deadline="2028-03-10 19:24:34.174325912 +0000 UTC" Jul 06 13:45:07.605537 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.567859 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14717h39m26.606471161s" Jul 06 13:45:07.605537 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.568289 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:45:07.605537 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.570779 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w5psk" Jul 06 13:45:07.605537 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:07.570829 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w5psk" podUID="b400c7ed-fd28-44f0-802f-17b18fa21328" Jul 06 13:45:07.605537 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.571145 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wmfs6" Jul 06 13:45:07.605537 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.571300 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 06 13:45:07.605537 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.571456 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 06 13:45:07.605537 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.571582 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 06 13:45:07.605537 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.571754 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-w4smv\"" Jul 06 13:45:07.605537 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.572606 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 06 13:45:07.605537 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.572842 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6krtq" Jul 06 13:45:07.605537 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.574081 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 06 13:45:07.605537 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.574224 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkhgk" Jul 06 13:45:07.605537 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:07.574271 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkhgk" podUID="d9712593-e5bd-42d1-bb8f-3e81c9c588f4" Jul 06 13:45:07.605537 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.574313 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 06 13:45:07.605537 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.574488 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 06 13:45:07.605537 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.574500 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 06 13:45:07.605537 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.574718 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 06 13:45:07.605537 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.574893 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-h9bt7\"" Jul 06 13:45:07.605537 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.575005 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 06 13:45:07.605537 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.592905 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 06 13:45:07.605537 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.592985 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 06 13:45:07.605537 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.593057 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 06 13:45:07.605537 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.593218 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 06 13:45:07.605537 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.593496 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 06 13:45:07.605537 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.593631 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-g6t25\"" Jul 06 13:45:07.605537 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.593937 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rzflg" Jul 06 13:45:07.608203 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.594530 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-266zj" Jul 06 13:45:07.608203 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.596764 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 06 13:45:07.608203 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.596933 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnbsk" Jul 06 13:45:07.608203 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.596983 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 06 13:45:07.608203 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.597048 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xbwb2\"" Jul 06 13:45:07.608203 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.597443 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-j7khd\"" Jul 06 13:45:07.608203 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.597450 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 06 13:45:07.608203 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.597930 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 06 13:45:07.608203 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.597958 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 06 13:45:07.608203 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.598595 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dp8pp" Jul 06 13:45:07.608203 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.599562 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-skx7r\"" Jul 06 13:45:07.608203 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.599572 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 06 13:45:07.608203 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.599610 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 06 13:45:07.608203 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.599564 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 06 13:45:07.608203 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.601212 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 06 13:45:07.608203 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.601434 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 06 13:45:07.608203 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.601755 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-r2rrh\"" Jul 06 13:45:07.608203 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.601912 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jpdcl" Jul 06 13:45:07.608203 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.604665 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ff7tj\"" Jul 06 13:45:07.608203 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.604872 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 06 13:45:07.608203 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.605021 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nzf92" Jul 06 13:45:07.608203 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.605025 2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 13:45:07.608203 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:07.605065 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nzf92" podUID="88c479d6-98eb-4c89-892c-eac6ac9629d0" Jul 06 13:45:07.608203 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.605165 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-b8v6z" Jul 06 13:45:07.608203 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.605271 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 06 13:45:07.608203 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.607828 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-mxfs9\"" Jul 06 13:45:07.608203 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.607986 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 06 13:45:07.692225 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.632846 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-cts4c" Jul 06 13:45:07.692225 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.641126 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-cts4c" Jul 06 13:45:07.692225 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.682298 2556 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 06 13:45:07.700557 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.700169 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9712593-e5bd-42d1-bb8f-3e81c9c588f4-metrics-certs\") pod \"network-metrics-daemon-jkhgk\" (UID: \"d9712593-e5bd-42d1-bb8f-3e81c9c588f4\") " pod="openshift-multus/network-metrics-daemon-jkhgk" Jul 06 13:45:07.700557 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.700207 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/32c4c811-3283-4b48-85ea-1ace503aa644-os-release\") pod \"multus-b8v6z\" (UID: \"32c4c811-3283-4b48-85ea-1ace503aa644\") " pod="openshift-multus/multus-b8v6z" Jul 06 13:45:07.700557 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.700235 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/32c4c811-3283-4b48-85ea-1ace503aa644-multus-daemon-config\") pod \"multus-b8v6z\" (UID: \"32c4c811-3283-4b48-85ea-1ace503aa644\") " pod="openshift-multus/multus-b8v6z" Jul 06 13:45:07.701249 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.700776 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/52c0b86f-6d49-489b-ae17-4167edbc66d8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hsbqp\" (UID: \"52c0b86f-6d49-489b-ae17-4167edbc66d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:45:07.701249 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.700809 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ec186ecf-a1ec-4c1f-a529-f5c101d3e604-etc-sysconfig\") pod \"tuned-dp8pp\" (UID: \"ec186ecf-a1ec-4c1f-a529-f5c101d3e604\") " pod="openshift-cluster-node-tuning-operator/tuned-dp8pp" Jul 06 13:45:07.701249 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.700834 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ec186ecf-a1ec-4c1f-a529-f5c101d3e604-sys\") pod \"tuned-dp8pp\" (UID: \"ec186ecf-a1ec-4c1f-a529-f5c101d3e604\") " pod="openshift-cluster-node-tuning-operator/tuned-dp8pp" Jul 06 13:45:07.701249 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.700859 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec186ecf-a1ec-4c1f-a529-f5c101d3e604-var-lib-kubelet\") pod \"tuned-dp8pp\" (UID: \"ec186ecf-a1ec-4c1f-a529-f5c101d3e604\") " pod="openshift-cluster-node-tuning-operator/tuned-dp8pp" Jul 06 13:45:07.701249 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.700883 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ec186ecf-a1ec-4c1f-a529-f5c101d3e604-host\") pod \"tuned-dp8pp\" (UID: \"ec186ecf-a1ec-4c1f-a529-f5c101d3e604\") " pod="openshift-cluster-node-tuning-operator/tuned-dp8pp" Jul 06 13:45:07.701249 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.700921 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/32c4c811-3283-4b48-85ea-1ace503aa644-hostroot\") pod \"multus-b8v6z\" (UID: \"32c4c811-3283-4b48-85ea-1ace503aa644\") " pod="openshift-multus/multus-b8v6z" Jul 06 13:45:07.701249 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.700949 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82tkp\" (UniqueName: \"kubernetes.io/projected/d9712593-e5bd-42d1-bb8f-3e81c9c588f4-kube-api-access-82tkp\") pod \"network-metrics-daemon-jkhgk\" (UID: \"d9712593-e5bd-42d1-bb8f-3e81c9c588f4\") " pod="openshift-multus/network-metrics-daemon-jkhgk" Jul 06 13:45:07.701249 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.700980 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/52c0b86f-6d49-489b-ae17-4167edbc66d8-host-run-netns\") pod \"ovnkube-node-hsbqp\" (UID: \"52c0b86f-6d49-489b-ae17-4167edbc66d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:45:07.701249 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.701014 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gc6wd\" (UniqueName: \"kubernetes.io/projected/52c0b86f-6d49-489b-ae17-4167edbc66d8-kube-api-access-gc6wd\") pod \"ovnkube-node-hsbqp\" (UID: \"52c0b86f-6d49-489b-ae17-4167edbc66d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:45:07.701249 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.701044 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/32c4c811-3283-4b48-85ea-1ace503aa644-multus-conf-dir\") pod \"multus-b8v6z\" (UID: \"32c4c811-3283-4b48-85ea-1ace503aa644\") " pod="openshift-multus/multus-b8v6z" Jul 06 13:45:07.701249 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.701072 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2s8h5\" (UniqueName: \"kubernetes.io/projected/32c4c811-3283-4b48-85ea-1ace503aa644-kube-api-access-2s8h5\") pod \"multus-b8v6z\" (UID: \"32c4c811-3283-4b48-85ea-1ace503aa644\") " pod="openshift-multus/multus-b8v6z" Jul 06 13:45:07.701249 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.701097 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ec186ecf-a1ec-4c1f-a529-f5c101d3e604-tmp\") pod \"tuned-dp8pp\" (UID: \"ec186ecf-a1ec-4c1f-a529-f5c101d3e604\") " pod="openshift-cluster-node-tuning-operator/tuned-dp8pp" Jul 06 13:45:07.701249 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.701122 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/32c4c811-3283-4b48-85ea-1ace503aa644-cni-binary-copy\") pod \"multus-b8v6z\" (UID: \"32c4c811-3283-4b48-85ea-1ace503aa644\") " pod="openshift-multus/multus-b8v6z" Jul 06 13:45:07.701249 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.701172 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/52c0b86f-6d49-489b-ae17-4167edbc66d8-host-kubelet\") pod \"ovnkube-node-hsbqp\" (UID: \"52c0b86f-6d49-489b-ae17-4167edbc66d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:45:07.701249 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.701240 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/52c0b86f-6d49-489b-ae17-4167edbc66d8-etc-openvswitch\") pod \"ovnkube-node-hsbqp\" (UID: \"52c0b86f-6d49-489b-ae17-4167edbc66d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:45:07.702382 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.701263 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/52c0b86f-6d49-489b-ae17-4167edbc66d8-env-overrides\") pod \"ovnkube-node-hsbqp\" (UID: \"52c0b86f-6d49-489b-ae17-4167edbc66d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:45:07.702382 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.701310 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2f4f1d96-1e31-4efd-8569-e719707555e7-agent-certs\") pod \"konnectivity-agent-266zj\" (UID: \"2f4f1d96-1e31-4efd-8569-e719707555e7\") " pod="kube-system/konnectivity-agent-266zj" Jul 06 13:45:07.702382 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.701370 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/163581f7-7372-4f70-be9b-5a2aabaac5ed-etc-selinux\") pod \"aws-ebs-csi-driver-node-mnbsk\" (UID: \"163581f7-7372-4f70-be9b-5a2aabaac5ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnbsk" Jul 06 13:45:07.702382 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.701399 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ec186ecf-a1ec-4c1f-a529-f5c101d3e604-etc-tuned\") pod \"tuned-dp8pp\" (UID: \"ec186ecf-a1ec-4c1f-a529-f5c101d3e604\") " pod="openshift-cluster-node-tuning-operator/tuned-dp8pp" Jul 06 13:45:07.702382 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.701417 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/52c0b86f-6d49-489b-ae17-4167edbc66d8-host-cni-bin\") pod \"ovnkube-node-hsbqp\" (UID: \"52c0b86f-6d49-489b-ae17-4167edbc66d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:45:07.702382 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.701433 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/163581f7-7372-4f70-be9b-5a2aabaac5ed-device-dir\") pod \"aws-ebs-csi-driver-node-mnbsk\" (UID: \"163581f7-7372-4f70-be9b-5a2aabaac5ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnbsk" Jul 06 13:45:07.702382 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.701448 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/32c4c811-3283-4b48-85ea-1ace503aa644-host-var-lib-kubelet\") pod \"multus-b8v6z\" (UID: \"32c4c811-3283-4b48-85ea-1ace503aa644\") " pod="openshift-multus/multus-b8v6z" Jul 06 13:45:07.702382 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.701463 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/52c0b86f-6d49-489b-ae17-4167edbc66d8-systemd-units\") pod \"ovnkube-node-hsbqp\" (UID: \"52c0b86f-6d49-489b-ae17-4167edbc66d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:45:07.702382 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.701498 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rht7\" (UniqueName: \"kubernetes.io/projected/b1c8c2d7-c914-4438-b4f4-80142ffc45c3-kube-api-access-9rht7\") pod \"iptables-alerter-rzflg\" (UID: \"b1c8c2d7-c914-4438-b4f4-80142ffc45c3\") " pod="openshift-network-operator/iptables-alerter-rzflg" Jul 06 13:45:07.702382 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.701520 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2f4f1d96-1e31-4efd-8569-e719707555e7-konnectivity-ca\") pod \"konnectivity-agent-266zj\" (UID: \"2f4f1d96-1e31-4efd-8569-e719707555e7\") " pod="kube-system/konnectivity-agent-266zj" Jul 06 13:45:07.702382 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.701547 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ec186ecf-a1ec-4c1f-a529-f5c101d3e604-etc-sysctl-conf\") pod \"tuned-dp8pp\" (UID: \"ec186ecf-a1ec-4c1f-a529-f5c101d3e604\") " pod="openshift-cluster-node-tuning-operator/tuned-dp8pp" Jul 06 13:45:07.702382 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.701579 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t285x\" (UniqueName: \"kubernetes.io/projected/d9c6489d-fe7d-4af6-a03d-04488b5a20ac-kube-api-access-t285x\") pod \"node-resolver-jpdcl\" (UID: \"d9c6489d-fe7d-4af6-a03d-04488b5a20ac\") " pod="openshift-dns/node-resolver-jpdcl" Jul 06 13:45:07.702382 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.701601 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/32c4c811-3283-4b48-85ea-1ace503aa644-host-run-k8s-cni-cncf-io\") pod \"multus-b8v6z\" (UID: \"32c4c811-3283-4b48-85ea-1ace503aa644\") " pod="openshift-multus/multus-b8v6z" Jul 06 13:45:07.702382 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.701649 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/52c0b86f-6d49-489b-ae17-4167edbc66d8-run-systemd\") pod \"ovnkube-node-hsbqp\" (UID: \"52c0b86f-6d49-489b-ae17-4167edbc66d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:45:07.702382 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.701679 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/32c4c811-3283-4b48-85ea-1ace503aa644-host-var-lib-cni-bin\") pod \"multus-b8v6z\" (UID: \"32c4c811-3283-4b48-85ea-1ace503aa644\") " pod="openshift-multus/multus-b8v6z" Jul 06 13:45:07.702382 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.701696 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6s6gk\" (UniqueName: \"kubernetes.io/projected/88c479d6-98eb-4c89-892c-eac6ac9629d0-kube-api-access-6s6gk\") pod \"network-check-target-nzf92\" (UID: \"88c479d6-98eb-4c89-892c-eac6ac9629d0\") " pod="openshift-network-diagnostics/network-check-target-nzf92" Jul 06 13:45:07.703051 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.701719 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/108cc216-aac3-41b5-b7c2-45d33ed8eef7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6krtq\" (UID: \"108cc216-aac3-41b5-b7c2-45d33ed8eef7\") " pod="openshift-multus/multus-additional-cni-plugins-6krtq" Jul 06 13:45:07.703051 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.701761 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/52c0b86f-6d49-489b-ae17-4167edbc66d8-run-ovn\") pod \"ovnkube-node-hsbqp\" (UID: \"52c0b86f-6d49-489b-ae17-4167edbc66d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:45:07.703051 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.701802 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b400c7ed-fd28-44f0-802f-17b18fa21328-kubelet-config\") pod \"global-pull-secret-syncer-w5psk\" (UID: \"b400c7ed-fd28-44f0-802f-17b18fa21328\") " pod="kube-system/global-pull-secret-syncer-w5psk" Jul 06 13:45:07.703051 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.701830 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/32c4c811-3283-4b48-85ea-1ace503aa644-host-var-lib-cni-multus\") pod \"multus-b8v6z\" (UID: \"32c4c811-3283-4b48-85ea-1ace503aa644\") " pod="openshift-multus/multus-b8v6z" Jul 06 13:45:07.703051 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.701855 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/32c4c811-3283-4b48-85ea-1ace503aa644-etc-kubernetes\") pod \"multus-b8v6z\" (UID: \"32c4c811-3283-4b48-85ea-1ace503aa644\") " pod="openshift-multus/multus-b8v6z" Jul 06 13:45:07.703051 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.701877 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/73be228a-e09a-4ef2-9df5-b3ef9a8324fc-serviceca\") pod \"node-ca-wmfs6\" (UID: \"73be228a-e09a-4ef2-9df5-b3ef9a8324fc\") " pod="openshift-image-registry/node-ca-wmfs6" Jul 06 13:45:07.703051 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.701899 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qz69s\" (UniqueName: \"kubernetes.io/projected/108cc216-aac3-41b5-b7c2-45d33ed8eef7-kube-api-access-qz69s\") pod \"multus-additional-cni-plugins-6krtq\" (UID: \"108cc216-aac3-41b5-b7c2-45d33ed8eef7\") " pod="openshift-multus/multus-additional-cni-plugins-6krtq" Jul 06 13:45:07.703051 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.701916 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/52c0b86f-6d49-489b-ae17-4167edbc66d8-run-openvswitch\") pod \"ovnkube-node-hsbqp\" (UID: \"52c0b86f-6d49-489b-ae17-4167edbc66d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:45:07.703051 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.701936 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/52c0b86f-6d49-489b-ae17-4167edbc66d8-host-cni-netd\") pod \"ovnkube-node-hsbqp\" (UID: \"52c0b86f-6d49-489b-ae17-4167edbc66d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:45:07.703051 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.701952 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/52c0b86f-6d49-489b-ae17-4167edbc66d8-ovnkube-script-lib\") pod \"ovnkube-node-hsbqp\" (UID: \"52c0b86f-6d49-489b-ae17-4167edbc66d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:45:07.703051 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.701968 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b400c7ed-fd28-44f0-802f-17b18fa21328-original-pull-secret\") pod \"global-pull-secret-syncer-w5psk\" (UID: \"b400c7ed-fd28-44f0-802f-17b18fa21328\") " pod="kube-system/global-pull-secret-syncer-w5psk" Jul 06 13:45:07.703051 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.701990 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ec186ecf-a1ec-4c1f-a529-f5c101d3e604-run\") pod \"tuned-dp8pp\" (UID: \"ec186ecf-a1ec-4c1f-a529-f5c101d3e604\") " pod="openshift-cluster-node-tuning-operator/tuned-dp8pp" Jul 06 13:45:07.703051 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.702006 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ec186ecf-a1ec-4c1f-a529-f5c101d3e604-lib-modules\") pod \"tuned-dp8pp\" (UID: \"ec186ecf-a1ec-4c1f-a529-f5c101d3e604\") " pod="openshift-cluster-node-tuning-operator/tuned-dp8pp" Jul 06 13:45:07.703051 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.702035 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/108cc216-aac3-41b5-b7c2-45d33ed8eef7-cnibin\") pod \"multus-additional-cni-plugins-6krtq\" (UID: \"108cc216-aac3-41b5-b7c2-45d33ed8eef7\") " pod="openshift-multus/multus-additional-cni-plugins-6krtq" Jul 06 13:45:07.703051 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.702058 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/52c0b86f-6d49-489b-ae17-4167edbc66d8-host-slash\") pod \"ovnkube-node-hsbqp\" (UID: \"52c0b86f-6d49-489b-ae17-4167edbc66d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:45:07.703051 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.702078 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/163581f7-7372-4f70-be9b-5a2aabaac5ed-socket-dir\") pod \"aws-ebs-csi-driver-node-mnbsk\" (UID: \"163581f7-7372-4f70-be9b-5a2aabaac5ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnbsk" Jul 06 13:45:07.785615 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.702101 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/32c4c811-3283-4b48-85ea-1ace503aa644-multus-cni-dir\") pod \"multus-b8v6z\" (UID: \"32c4c811-3283-4b48-85ea-1ace503aa644\") " pod="openshift-multus/multus-b8v6z" Jul 06 13:45:07.785615 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.702126 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/32c4c811-3283-4b48-85ea-1ace503aa644-multus-socket-dir-parent\") pod \"multus-b8v6z\" (UID: \"32c4c811-3283-4b48-85ea-1ace503aa644\") " pod="openshift-multus/multus-b8v6z" Jul 06 13:45:07.785615 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.702151 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/32c4c811-3283-4b48-85ea-1ace503aa644-host-run-netns\") pod \"multus-b8v6z\" (UID: \"32c4c811-3283-4b48-85ea-1ace503aa644\") " pod="openshift-multus/multus-b8v6z" Jul 06 13:45:07.785615 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.702170 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/52c0b86f-6d49-489b-ae17-4167edbc66d8-var-lib-openvswitch\") pod \"ovnkube-node-hsbqp\" (UID: \"52c0b86f-6d49-489b-ae17-4167edbc66d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:45:07.785615 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.702188 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/52c0b86f-6d49-489b-ae17-4167edbc66d8-host-run-ovn-kubernetes\") pod \"ovnkube-node-hsbqp\" (UID: \"52c0b86f-6d49-489b-ae17-4167edbc66d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:45:07.785615 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.702203 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b400c7ed-fd28-44f0-802f-17b18fa21328-dbus\") pod \"global-pull-secret-syncer-w5psk\" (UID: \"b400c7ed-fd28-44f0-802f-17b18fa21328\") " pod="kube-system/global-pull-secret-syncer-w5psk" Jul 06 13:45:07.785615 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.702226 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/163581f7-7372-4f70-be9b-5a2aabaac5ed-registration-dir\") pod \"aws-ebs-csi-driver-node-mnbsk\" (UID: \"163581f7-7372-4f70-be9b-5a2aabaac5ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnbsk" Jul 06 13:45:07.785615 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.702249 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9b4m\" (UniqueName: \"kubernetes.io/projected/ec186ecf-a1ec-4c1f-a529-f5c101d3e604-kube-api-access-q9b4m\") pod \"tuned-dp8pp\" (UID: \"ec186ecf-a1ec-4c1f-a529-f5c101d3e604\") " pod="openshift-cluster-node-tuning-operator/tuned-dp8pp" Jul 06 13:45:07.785615 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.702266 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/32c4c811-3283-4b48-85ea-1ace503aa644-host-run-multus-certs\") pod \"multus-b8v6z\" (UID: \"32c4c811-3283-4b48-85ea-1ace503aa644\") " pod="openshift-multus/multus-b8v6z" Jul 06 13:45:07.785615 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.702280 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/52c0b86f-6d49-489b-ae17-4167edbc66d8-log-socket\") pod \"ovnkube-node-hsbqp\" (UID: \"52c0b86f-6d49-489b-ae17-4167edbc66d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:45:07.785615 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.702295 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4p6k\" (UniqueName: \"kubernetes.io/projected/73be228a-e09a-4ef2-9df5-b3ef9a8324fc-kube-api-access-r4p6k\") pod \"node-ca-wmfs6\" (UID: \"73be228a-e09a-4ef2-9df5-b3ef9a8324fc\") " pod="openshift-image-registry/node-ca-wmfs6" Jul 06 13:45:07.785615 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.702308 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/108cc216-aac3-41b5-b7c2-45d33ed8eef7-system-cni-dir\") pod \"multus-additional-cni-plugins-6krtq\" (UID: \"108cc216-aac3-41b5-b7c2-45d33ed8eef7\") " pod="openshift-multus/multus-additional-cni-plugins-6krtq" Jul 06 13:45:07.785615 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.702327 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/52c0b86f-6d49-489b-ae17-4167edbc66d8-node-log\") pod \"ovnkube-node-hsbqp\" (UID: \"52c0b86f-6d49-489b-ae17-4167edbc66d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:45:07.785615 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.702344 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/163581f7-7372-4f70-be9b-5a2aabaac5ed-sys-fs\") pod \"aws-ebs-csi-driver-node-mnbsk\" (UID: \"163581f7-7372-4f70-be9b-5a2aabaac5ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnbsk" Jul 06 13:45:07.785615 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.702366 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wqfg\" (UniqueName: \"kubernetes.io/projected/163581f7-7372-4f70-be9b-5a2aabaac5ed-kube-api-access-7wqfg\") pod \"aws-ebs-csi-driver-node-mnbsk\" (UID: \"163581f7-7372-4f70-be9b-5a2aabaac5ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnbsk" Jul 06 13:45:07.785615 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.702387 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9c6489d-fe7d-4af6-a03d-04488b5a20ac-tmp-dir\") pod \"node-resolver-jpdcl\" (UID: \"d9c6489d-fe7d-4af6-a03d-04488b5a20ac\") " pod="openshift-dns/node-resolver-jpdcl" Jul 06 13:45:07.786313 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.702409 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/32c4c811-3283-4b48-85ea-1ace503aa644-cnibin\") pod \"multus-b8v6z\" (UID: \"32c4c811-3283-4b48-85ea-1ace503aa644\") " pod="openshift-multus/multus-b8v6z" Jul 06 13:45:07.786313 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.702426 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/108cc216-aac3-41b5-b7c2-45d33ed8eef7-cni-binary-copy\") pod \"multus-additional-cni-plugins-6krtq\" (UID: \"108cc216-aac3-41b5-b7c2-45d33ed8eef7\") " pod="openshift-multus/multus-additional-cni-plugins-6krtq" Jul 06 13:45:07.786313 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.702440 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/108cc216-aac3-41b5-b7c2-45d33ed8eef7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6krtq\" (UID: \"108cc216-aac3-41b5-b7c2-45d33ed8eef7\") " pod="openshift-multus/multus-additional-cni-plugins-6krtq" Jul 06 13:45:07.786313 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.702454 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ec186ecf-a1ec-4c1f-a529-f5c101d3e604-etc-modprobe-d\") pod \"tuned-dp8pp\" (UID: \"ec186ecf-a1ec-4c1f-a529-f5c101d3e604\") " pod="openshift-cluster-node-tuning-operator/tuned-dp8pp" Jul 06 13:45:07.786313 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.702477 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ec186ecf-a1ec-4c1f-a529-f5c101d3e604-etc-systemd\") pod \"tuned-dp8pp\" (UID: \"ec186ecf-a1ec-4c1f-a529-f5c101d3e604\") " pod="openshift-cluster-node-tuning-operator/tuned-dp8pp" Jul 06 13:45:07.786313 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.702499 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d9c6489d-fe7d-4af6-a03d-04488b5a20ac-hosts-file\") pod \"node-resolver-jpdcl\" (UID: \"d9c6489d-fe7d-4af6-a03d-04488b5a20ac\") " pod="openshift-dns/node-resolver-jpdcl" Jul 06 13:45:07.786313 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.702514 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/32c4c811-3283-4b48-85ea-1ace503aa644-system-cni-dir\") pod \"multus-b8v6z\" (UID: \"32c4c811-3283-4b48-85ea-1ace503aa644\") " pod="openshift-multus/multus-b8v6z" Jul 06 13:45:07.786313 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.702527 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/73be228a-e09a-4ef2-9df5-b3ef9a8324fc-host\") pod \"node-ca-wmfs6\" (UID: \"73be228a-e09a-4ef2-9df5-b3ef9a8324fc\") " pod="openshift-image-registry/node-ca-wmfs6" Jul 06 13:45:07.786313 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.702541 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/52c0b86f-6d49-489b-ae17-4167edbc66d8-ovnkube-config\") pod \"ovnkube-node-hsbqp\" (UID: \"52c0b86f-6d49-489b-ae17-4167edbc66d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:45:07.786313 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.702568 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b1c8c2d7-c914-4438-b4f4-80142ffc45c3-host-slash\") pod \"iptables-alerter-rzflg\" (UID: \"b1c8c2d7-c914-4438-b4f4-80142ffc45c3\") " pod="openshift-network-operator/iptables-alerter-rzflg" Jul 06 13:45:07.786313 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.702594 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/163581f7-7372-4f70-be9b-5a2aabaac5ed-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mnbsk\" (UID: \"163581f7-7372-4f70-be9b-5a2aabaac5ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnbsk" Jul 06 13:45:07.786313 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.702613 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/108cc216-aac3-41b5-b7c2-45d33ed8eef7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6krtq\" (UID: \"108cc216-aac3-41b5-b7c2-45d33ed8eef7\") " pod="openshift-multus/multus-additional-cni-plugins-6krtq" Jul 06 13:45:07.786313 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.702642 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/52c0b86f-6d49-489b-ae17-4167edbc66d8-ovn-node-metrics-cert\") pod \"ovnkube-node-hsbqp\" (UID: \"52c0b86f-6d49-489b-ae17-4167edbc66d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:45:07.786313 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.702658 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b1c8c2d7-c914-4438-b4f4-80142ffc45c3-iptables-alerter-script\") pod \"iptables-alerter-rzflg\" (UID: \"b1c8c2d7-c914-4438-b4f4-80142ffc45c3\") " pod="openshift-network-operator/iptables-alerter-rzflg" Jul 06 13:45:07.786313 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.702694 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ec186ecf-a1ec-4c1f-a529-f5c101d3e604-etc-kubernetes\") pod \"tuned-dp8pp\" (UID: \"ec186ecf-a1ec-4c1f-a529-f5c101d3e604\") " pod="openshift-cluster-node-tuning-operator/tuned-dp8pp" Jul 06 13:45:07.786313 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.702717 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ec186ecf-a1ec-4c1f-a529-f5c101d3e604-etc-sysctl-d\") pod \"tuned-dp8pp\" (UID: \"ec186ecf-a1ec-4c1f-a529-f5c101d3e604\") " pod="openshift-cluster-node-tuning-operator/tuned-dp8pp" Jul 06 13:45:07.788399 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.702745 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/108cc216-aac3-41b5-b7c2-45d33ed8eef7-os-release\") pod \"multus-additional-cni-plugins-6krtq\" (UID: \"108cc216-aac3-41b5-b7c2-45d33ed8eef7\") " pod="openshift-multus/multus-additional-cni-plugins-6krtq" Jul 06 13:45:07.873003 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.803763 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9c6489d-fe7d-4af6-a03d-04488b5a20ac-tmp-dir\") pod \"node-resolver-jpdcl\" (UID: \"d9c6489d-fe7d-4af6-a03d-04488b5a20ac\") " pod="openshift-dns/node-resolver-jpdcl" Jul 06 13:45:07.873003 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.803789 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/32c4c811-3283-4b48-85ea-1ace503aa644-cnibin\") pod \"multus-b8v6z\" (UID: \"32c4c811-3283-4b48-85ea-1ace503aa644\") " pod="openshift-multus/multus-b8v6z" Jul 06 13:45:07.873003 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.803811 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/108cc216-aac3-41b5-b7c2-45d33ed8eef7-cni-binary-copy\") pod \"multus-additional-cni-plugins-6krtq\" (UID: \"108cc216-aac3-41b5-b7c2-45d33ed8eef7\") " pod="openshift-multus/multus-additional-cni-plugins-6krtq" Jul 06 13:45:07.873003 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.803829 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/108cc216-aac3-41b5-b7c2-45d33ed8eef7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6krtq\" (UID: \"108cc216-aac3-41b5-b7c2-45d33ed8eef7\") " pod="openshift-multus/multus-additional-cni-plugins-6krtq" Jul 06 13:45:07.873003 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.803845 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ec186ecf-a1ec-4c1f-a529-f5c101d3e604-etc-modprobe-d\") pod \"tuned-dp8pp\" (UID: \"ec186ecf-a1ec-4c1f-a529-f5c101d3e604\") " pod="openshift-cluster-node-tuning-operator/tuned-dp8pp" Jul 06 13:45:07.873003 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.803890 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ec186ecf-a1ec-4c1f-a529-f5c101d3e604-etc-systemd\") pod \"tuned-dp8pp\" (UID: \"ec186ecf-a1ec-4c1f-a529-f5c101d3e604\") " pod="openshift-cluster-node-tuning-operator/tuned-dp8pp" Jul 06 13:45:07.873003 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.803894 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/32c4c811-3283-4b48-85ea-1ace503aa644-cnibin\") pod \"multus-b8v6z\" (UID: \"32c4c811-3283-4b48-85ea-1ace503aa644\") " pod="openshift-multus/multus-b8v6z" Jul 06 13:45:07.873003 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.803913 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d9c6489d-fe7d-4af6-a03d-04488b5a20ac-hosts-file\") pod \"node-resolver-jpdcl\" (UID: \"d9c6489d-fe7d-4af6-a03d-04488b5a20ac\") " pod="openshift-dns/node-resolver-jpdcl" Jul 06 13:45:07.873003 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.803936 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/32c4c811-3283-4b48-85ea-1ace503aa644-system-cni-dir\") pod \"multus-b8v6z\" (UID: \"32c4c811-3283-4b48-85ea-1ace503aa644\") " pod="openshift-multus/multus-b8v6z" Jul 06 13:45:07.873003 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.803952 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ec186ecf-a1ec-4c1f-a529-f5c101d3e604-etc-systemd\") pod \"tuned-dp8pp\" (UID: \"ec186ecf-a1ec-4c1f-a529-f5c101d3e604\") " pod="openshift-cluster-node-tuning-operator/tuned-dp8pp" Jul 06 13:45:07.873003 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.803956 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/73be228a-e09a-4ef2-9df5-b3ef9a8324fc-host\") pod \"node-ca-wmfs6\" (UID: \"73be228a-e09a-4ef2-9df5-b3ef9a8324fc\") " pod="openshift-image-registry/node-ca-wmfs6" Jul 06 13:45:07.873003 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.803978 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/52c0b86f-6d49-489b-ae17-4167edbc66d8-ovnkube-config\") pod \"ovnkube-node-hsbqp\" (UID: \"52c0b86f-6d49-489b-ae17-4167edbc66d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:45:07.873003 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.803992 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/32c4c811-3283-4b48-85ea-1ace503aa644-system-cni-dir\") pod \"multus-b8v6z\" (UID: \"32c4c811-3283-4b48-85ea-1ace503aa644\") " pod="openshift-multus/multus-b8v6z" Jul 06 13:45:07.873003 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.804001 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b1c8c2d7-c914-4438-b4f4-80142ffc45c3-host-slash\") pod \"iptables-alerter-rzflg\" (UID: \"b1c8c2d7-c914-4438-b4f4-80142ffc45c3\") " pod="openshift-network-operator/iptables-alerter-rzflg" Jul 06 13:45:07.873003 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.804001 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d9c6489d-fe7d-4af6-a03d-04488b5a20ac-hosts-file\") pod \"node-resolver-jpdcl\" (UID: \"d9c6489d-fe7d-4af6-a03d-04488b5a20ac\") " pod="openshift-dns/node-resolver-jpdcl" Jul 06 13:45:07.873003 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.804025 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/73be228a-e09a-4ef2-9df5-b3ef9a8324fc-host\") pod \"node-ca-wmfs6\" (UID: \"73be228a-e09a-4ef2-9df5-b3ef9a8324fc\") " pod="openshift-image-registry/node-ca-wmfs6" Jul 06 13:45:07.873003 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.804027 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/108cc216-aac3-41b5-b7c2-45d33ed8eef7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6krtq\" (UID: \"108cc216-aac3-41b5-b7c2-45d33ed8eef7\") " pod="openshift-multus/multus-additional-cni-plugins-6krtq" Jul 06 13:45:07.873003 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.804026 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/163581f7-7372-4f70-be9b-5a2aabaac5ed-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mnbsk\" (UID: \"163581f7-7372-4f70-be9b-5a2aabaac5ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnbsk" Jul 06 13:45:07.874089 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.804073 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/108cc216-aac3-41b5-b7c2-45d33ed8eef7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6krtq\" (UID: \"108cc216-aac3-41b5-b7c2-45d33ed8eef7\") " pod="openshift-multus/multus-additional-cni-plugins-6krtq" Jul 06 13:45:07.874089 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.804078 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b1c8c2d7-c914-4438-b4f4-80142ffc45c3-host-slash\") pod \"iptables-alerter-rzflg\" (UID: \"b1c8c2d7-c914-4438-b4f4-80142ffc45c3\") " pod="openshift-network-operator/iptables-alerter-rzflg" Jul 06 13:45:07.874089 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.804101 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/52c0b86f-6d49-489b-ae17-4167edbc66d8-ovn-node-metrics-cert\") pod \"ovnkube-node-hsbqp\" (UID: \"52c0b86f-6d49-489b-ae17-4167edbc66d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:45:07.874089 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.804126 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b1c8c2d7-c914-4438-b4f4-80142ffc45c3-iptables-alerter-script\") pod \"iptables-alerter-rzflg\" (UID: \"b1c8c2d7-c914-4438-b4f4-80142ffc45c3\") " pod="openshift-network-operator/iptables-alerter-rzflg" Jul 06 13:45:07.874089 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.804151 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ec186ecf-a1ec-4c1f-a529-f5c101d3e604-etc-kubernetes\") pod \"tuned-dp8pp\" (UID: \"ec186ecf-a1ec-4c1f-a529-f5c101d3e604\") " pod="openshift-cluster-node-tuning-operator/tuned-dp8pp" Jul 06 13:45:07.874089 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.804180 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ec186ecf-a1ec-4c1f-a529-f5c101d3e604-etc-sysctl-d\") pod \"tuned-dp8pp\" (UID: \"ec186ecf-a1ec-4c1f-a529-f5c101d3e604\") " pod="openshift-cluster-node-tuning-operator/tuned-dp8pp" Jul 06 13:45:07.874089 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.804201 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/108cc216-aac3-41b5-b7c2-45d33ed8eef7-os-release\") pod \"multus-additional-cni-plugins-6krtq\" (UID: \"108cc216-aac3-41b5-b7c2-45d33ed8eef7\") " pod="openshift-multus/multus-additional-cni-plugins-6krtq" Jul 06 13:45:07.874089 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.804222 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9712593-e5bd-42d1-bb8f-3e81c9c588f4-metrics-certs\") pod \"network-metrics-daemon-jkhgk\" (UID: \"d9712593-e5bd-42d1-bb8f-3e81c9c588f4\") " pod="openshift-multus/network-metrics-daemon-jkhgk" Jul 06 13:45:07.874089 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.804241 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/32c4c811-3283-4b48-85ea-1ace503aa644-os-release\") pod \"multus-b8v6z\" (UID: \"32c4c811-3283-4b48-85ea-1ace503aa644\") " pod="openshift-multus/multus-b8v6z" Jul 06 13:45:07.874089 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.804258 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9c6489d-fe7d-4af6-a03d-04488b5a20ac-tmp-dir\") pod \"node-resolver-jpdcl\" (UID: \"d9c6489d-fe7d-4af6-a03d-04488b5a20ac\") " pod="openshift-dns/node-resolver-jpdcl" Jul 06 13:45:07.874089 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.804308 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ec186ecf-a1ec-4c1f-a529-f5c101d3e604-etc-kubernetes\") pod \"tuned-dp8pp\" (UID: \"ec186ecf-a1ec-4c1f-a529-f5c101d3e604\") " pod="openshift-cluster-node-tuning-operator/tuned-dp8pp" Jul 06 13:45:07.874089 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.804260 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ec186ecf-a1ec-4c1f-a529-f5c101d3e604-etc-modprobe-d\") pod \"tuned-dp8pp\" (UID: \"ec186ecf-a1ec-4c1f-a529-f5c101d3e604\") " pod="openshift-cluster-node-tuning-operator/tuned-dp8pp" Jul 06 13:45:07.874089 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.804151 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/163581f7-7372-4f70-be9b-5a2aabaac5ed-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mnbsk\" (UID: \"163581f7-7372-4f70-be9b-5a2aabaac5ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnbsk" Jul 06 13:45:07.874089 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.804342 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/108cc216-aac3-41b5-b7c2-45d33ed8eef7-os-release\") pod \"multus-additional-cni-plugins-6krtq\" (UID: \"108cc216-aac3-41b5-b7c2-45d33ed8eef7\") " pod="openshift-multus/multus-additional-cni-plugins-6krtq" Jul 06 13:45:07.874089 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.804262 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/32c4c811-3283-4b48-85ea-1ace503aa644-multus-daemon-config\") pod \"multus-b8v6z\" (UID: \"32c4c811-3283-4b48-85ea-1ace503aa644\") " pod="openshift-multus/multus-b8v6z" Jul 06 13:45:07.874089 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:07.804452 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 13:45:07.874089 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:07.804529 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9712593-e5bd-42d1-bb8f-3e81c9c588f4-metrics-certs podName:d9712593-e5bd-42d1-bb8f-3e81c9c588f4 nodeName:}" failed. No retries permitted until 2026-07-06 13:45:08.304507511 +0000 UTC m=+2.104253200 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d9712593-e5bd-42d1-bb8f-3e81c9c588f4-metrics-certs") pod "network-metrics-daemon-jkhgk" (UID: "d9712593-e5bd-42d1-bb8f-3e81c9c588f4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 13:45:07.876738 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.804614 2556 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 06 13:45:07.876738 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.804661 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/108cc216-aac3-41b5-b7c2-45d33ed8eef7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6krtq\" (UID: \"108cc216-aac3-41b5-b7c2-45d33ed8eef7\") " pod="openshift-multus/multus-additional-cni-plugins-6krtq" Jul 06 13:45:07.876738 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.804747 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/32c4c811-3283-4b48-85ea-1ace503aa644-os-release\") pod \"multus-b8v6z\" (UID: \"32c4c811-3283-4b48-85ea-1ace503aa644\") " pod="openshift-multus/multus-b8v6z" Jul 06 13:45:07.876738 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.804853 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/52c0b86f-6d49-489b-ae17-4167edbc66d8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hsbqp\" (UID: \"52c0b86f-6d49-489b-ae17-4167edbc66d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:45:07.876738 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.804874 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ec186ecf-a1ec-4c1f-a529-f5c101d3e604-etc-sysctl-d\") pod \"tuned-dp8pp\" (UID: \"ec186ecf-a1ec-4c1f-a529-f5c101d3e604\") " pod="openshift-cluster-node-tuning-operator/tuned-dp8pp" Jul 06 13:45:07.876738 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.804896 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/52c0b86f-6d49-489b-ae17-4167edbc66d8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hsbqp\" (UID: \"52c0b86f-6d49-489b-ae17-4167edbc66d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:45:07.876738 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.804935 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ec186ecf-a1ec-4c1f-a529-f5c101d3e604-etc-sysconfig\") pod \"tuned-dp8pp\" (UID: \"ec186ecf-a1ec-4c1f-a529-f5c101d3e604\") " pod="openshift-cluster-node-tuning-operator/tuned-dp8pp" Jul 06 13:45:07.876738 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.804961 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ec186ecf-a1ec-4c1f-a529-f5c101d3e604-sys\") pod \"tuned-dp8pp\" (UID: \"ec186ecf-a1ec-4c1f-a529-f5c101d3e604\") " pod="openshift-cluster-node-tuning-operator/tuned-dp8pp" Jul 06 13:45:07.876738 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.804984 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ec186ecf-a1ec-4c1f-a529-f5c101d3e604-etc-sysconfig\") pod \"tuned-dp8pp\" (UID: \"ec186ecf-a1ec-4c1f-a529-f5c101d3e604\") " pod="openshift-cluster-node-tuning-operator/tuned-dp8pp" Jul 06 13:45:07.876738 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.804986 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec186ecf-a1ec-4c1f-a529-f5c101d3e604-var-lib-kubelet\") pod \"tuned-dp8pp\" (UID: \"ec186ecf-a1ec-4c1f-a529-f5c101d3e604\") " pod="openshift-cluster-node-tuning-operator/tuned-dp8pp" Jul 06 13:45:07.876738 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.805029 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec186ecf-a1ec-4c1f-a529-f5c101d3e604-var-lib-kubelet\") pod \"tuned-dp8pp\" (UID: \"ec186ecf-a1ec-4c1f-a529-f5c101d3e604\") " pod="openshift-cluster-node-tuning-operator/tuned-dp8pp" Jul 06 13:45:07.876738 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.805043 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ec186ecf-a1ec-4c1f-a529-f5c101d3e604-host\") pod \"tuned-dp8pp\" (UID: \"ec186ecf-a1ec-4c1f-a529-f5c101d3e604\") " pod="openshift-cluster-node-tuning-operator/tuned-dp8pp" Jul 06 13:45:07.876738 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.805059 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b1c8c2d7-c914-4438-b4f4-80142ffc45c3-iptables-alerter-script\") pod \"iptables-alerter-rzflg\" (UID: \"b1c8c2d7-c914-4438-b4f4-80142ffc45c3\") " pod="openshift-network-operator/iptables-alerter-rzflg" Jul 06 13:45:07.876738 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.805075 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ec186ecf-a1ec-4c1f-a529-f5c101d3e604-sys\") pod \"tuned-dp8pp\" (UID: \"ec186ecf-a1ec-4c1f-a529-f5c101d3e604\") " pod="openshift-cluster-node-tuning-operator/tuned-dp8pp" Jul 06 13:45:07.876738 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.805069 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/32c4c811-3283-4b48-85ea-1ace503aa644-hostroot\") pod \"multus-b8v6z\" (UID: \"32c4c811-3283-4b48-85ea-1ace503aa644\") " pod="openshift-multus/multus-b8v6z" Jul 06 13:45:07.876738 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.805113 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/32c4c811-3283-4b48-85ea-1ace503aa644-hostroot\") pod \"multus-b8v6z\" (UID: \"32c4c811-3283-4b48-85ea-1ace503aa644\") " pod="openshift-multus/multus-b8v6z" Jul 06 13:45:07.876738 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.805092 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ec186ecf-a1ec-4c1f-a529-f5c101d3e604-host\") pod \"tuned-dp8pp\" (UID: \"ec186ecf-a1ec-4c1f-a529-f5c101d3e604\") " pod="openshift-cluster-node-tuning-operator/tuned-dp8pp" Jul 06 13:45:07.876738 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.805129 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82tkp\" (UniqueName: \"kubernetes.io/projected/d9712593-e5bd-42d1-bb8f-3e81c9c588f4-kube-api-access-82tkp\") pod \"network-metrics-daemon-jkhgk\" (UID: \"d9712593-e5bd-42d1-bb8f-3e81c9c588f4\") " pod="openshift-multus/network-metrics-daemon-jkhgk" Jul 06 13:45:07.878992 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.805158 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/52c0b86f-6d49-489b-ae17-4167edbc66d8-host-run-netns\") pod \"ovnkube-node-hsbqp\" (UID: \"52c0b86f-6d49-489b-ae17-4167edbc66d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:45:07.878992 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.805185 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gc6wd\" (UniqueName: \"kubernetes.io/projected/52c0b86f-6d49-489b-ae17-4167edbc66d8-kube-api-access-gc6wd\") pod \"ovnkube-node-hsbqp\" (UID: \"52c0b86f-6d49-489b-ae17-4167edbc66d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:45:07.878992 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.805210 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/32c4c811-3283-4b48-85ea-1ace503aa644-multus-conf-dir\") pod \"multus-b8v6z\" (UID: \"32c4c811-3283-4b48-85ea-1ace503aa644\") " pod="openshift-multus/multus-b8v6z" Jul 06 13:45:07.878992 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.805236 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2s8h5\" (UniqueName: \"kubernetes.io/projected/32c4c811-3283-4b48-85ea-1ace503aa644-kube-api-access-2s8h5\") pod \"multus-b8v6z\" (UID: \"32c4c811-3283-4b48-85ea-1ace503aa644\") " pod="openshift-multus/multus-b8v6z" Jul 06 13:45:07.878992 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.805265 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ec186ecf-a1ec-4c1f-a529-f5c101d3e604-tmp\") pod \"tuned-dp8pp\" (UID: \"ec186ecf-a1ec-4c1f-a529-f5c101d3e604\") " pod="openshift-cluster-node-tuning-operator/tuned-dp8pp" Jul 06 13:45:07.878992 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.805276 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/108cc216-aac3-41b5-b7c2-45d33ed8eef7-cni-binary-copy\") pod \"multus-additional-cni-plugins-6krtq\" (UID: \"108cc216-aac3-41b5-b7c2-45d33ed8eef7\") " pod="openshift-multus/multus-additional-cni-plugins-6krtq" Jul 06 13:45:07.878992 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.805289 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/32c4c811-3283-4b48-85ea-1ace503aa644-cni-binary-copy\") pod \"multus-b8v6z\" (UID: \"32c4c811-3283-4b48-85ea-1ace503aa644\") " pod="openshift-multus/multus-b8v6z" Jul 06 13:45:07.878992 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.805314 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/52c0b86f-6d49-489b-ae17-4167edbc66d8-host-kubelet\") pod \"ovnkube-node-hsbqp\" (UID: \"52c0b86f-6d49-489b-ae17-4167edbc66d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:45:07.878992 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.805340 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/52c0b86f-6d49-489b-ae17-4167edbc66d8-etc-openvswitch\") pod \"ovnkube-node-hsbqp\" (UID: \"52c0b86f-6d49-489b-ae17-4167edbc66d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:45:07.878992 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.805357 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/32c4c811-3283-4b48-85ea-1ace503aa644-multus-daemon-config\") pod \"multus-b8v6z\" (UID: \"32c4c811-3283-4b48-85ea-1ace503aa644\") " pod="openshift-multus/multus-b8v6z" Jul 06 13:45:07.878992 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.805366 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/52c0b86f-6d49-489b-ae17-4167edbc66d8-env-overrides\") pod \"ovnkube-node-hsbqp\" (UID: \"52c0b86f-6d49-489b-ae17-4167edbc66d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:45:07.878992 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.805416 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/52c0b86f-6d49-489b-ae17-4167edbc66d8-host-kubelet\") pod \"ovnkube-node-hsbqp\" (UID: \"52c0b86f-6d49-489b-ae17-4167edbc66d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:45:07.878992 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.805423 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/52c0b86f-6d49-489b-ae17-4167edbc66d8-etc-openvswitch\") pod \"ovnkube-node-hsbqp\" (UID: \"52c0b86f-6d49-489b-ae17-4167edbc66d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:45:07.878992 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.805455 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/52c0b86f-6d49-489b-ae17-4167edbc66d8-host-run-netns\") pod \"ovnkube-node-hsbqp\" (UID: \"52c0b86f-6d49-489b-ae17-4167edbc66d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:45:07.878992 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.805457 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2f4f1d96-1e31-4efd-8569-e719707555e7-agent-certs\") pod \"konnectivity-agent-266zj\" (UID: \"2f4f1d96-1e31-4efd-8569-e719707555e7\") " pod="kube-system/konnectivity-agent-266zj" Jul 06 13:45:07.878992 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.805505 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/163581f7-7372-4f70-be9b-5a2aabaac5ed-etc-selinux\") pod \"aws-ebs-csi-driver-node-mnbsk\" (UID: \"163581f7-7372-4f70-be9b-5a2aabaac5ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnbsk" Jul 06 13:45:07.878992 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.805255 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/32c4c811-3283-4b48-85ea-1ace503aa644-multus-conf-dir\") pod \"multus-b8v6z\" (UID: \"32c4c811-3283-4b48-85ea-1ace503aa644\") " pod="openshift-multus/multus-b8v6z" Jul 06 13:45:07.878992 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.805534 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ec186ecf-a1ec-4c1f-a529-f5c101d3e604-etc-tuned\") pod \"tuned-dp8pp\" (UID: \"ec186ecf-a1ec-4c1f-a529-f5c101d3e604\") " pod="openshift-cluster-node-tuning-operator/tuned-dp8pp" Jul 06 13:45:07.960476 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.805594 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/52c0b86f-6d49-489b-ae17-4167edbc66d8-host-cni-bin\") pod \"ovnkube-node-hsbqp\" (UID: \"52c0b86f-6d49-489b-ae17-4167edbc66d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:45:07.960476 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.805624 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/163581f7-7372-4f70-be9b-5a2aabaac5ed-etc-selinux\") pod \"aws-ebs-csi-driver-node-mnbsk\" (UID: \"163581f7-7372-4f70-be9b-5a2aabaac5ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnbsk" Jul 06 13:45:07.960476 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.805708 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/52c0b86f-6d49-489b-ae17-4167edbc66d8-host-cni-bin\") pod \"ovnkube-node-hsbqp\" (UID: \"52c0b86f-6d49-489b-ae17-4167edbc66d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:45:07.960476 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.805791 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/163581f7-7372-4f70-be9b-5a2aabaac5ed-device-dir\") pod \"aws-ebs-csi-driver-node-mnbsk\" (UID: \"163581f7-7372-4f70-be9b-5a2aabaac5ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnbsk" Jul 06 13:45:07.960476 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.805826 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/32c4c811-3283-4b48-85ea-1ace503aa644-host-var-lib-kubelet\") pod \"multus-b8v6z\" (UID: \"32c4c811-3283-4b48-85ea-1ace503aa644\") " pod="openshift-multus/multus-b8v6z" Jul 06 13:45:07.960476 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.805854 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/163581f7-7372-4f70-be9b-5a2aabaac5ed-device-dir\") pod \"aws-ebs-csi-driver-node-mnbsk\" (UID: \"163581f7-7372-4f70-be9b-5a2aabaac5ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnbsk" Jul 06 13:45:07.960476 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.805884 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/52c0b86f-6d49-489b-ae17-4167edbc66d8-systemd-units\") pod \"ovnkube-node-hsbqp\" (UID: \"52c0b86f-6d49-489b-ae17-4167edbc66d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:45:07.960476 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.805929 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rht7\" (UniqueName: \"kubernetes.io/projected/b1c8c2d7-c914-4438-b4f4-80142ffc45c3-kube-api-access-9rht7\") pod \"iptables-alerter-rzflg\" (UID: \"b1c8c2d7-c914-4438-b4f4-80142ffc45c3\") " pod="openshift-network-operator/iptables-alerter-rzflg" Jul 06 13:45:07.960476 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.805990 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2f4f1d96-1e31-4efd-8569-e719707555e7-konnectivity-ca\") pod \"konnectivity-agent-266zj\" (UID: \"2f4f1d96-1e31-4efd-8569-e719707555e7\") " pod="kube-system/konnectivity-agent-266zj" Jul 06 13:45:07.960476 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.806012 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ec186ecf-a1ec-4c1f-a529-f5c101d3e604-etc-sysctl-conf\") pod \"tuned-dp8pp\" (UID: \"ec186ecf-a1ec-4c1f-a529-f5c101d3e604\") " pod="openshift-cluster-node-tuning-operator/tuned-dp8pp" Jul 06 13:45:07.960476 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.805898 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/32c4c811-3283-4b48-85ea-1ace503aa644-cni-binary-copy\") pod \"multus-b8v6z\" (UID: \"32c4c811-3283-4b48-85ea-1ace503aa644\") " pod="openshift-multus/multus-b8v6z" Jul 06 13:45:07.960476 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.806036 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t285x\" (UniqueName: \"kubernetes.io/projected/d9c6489d-fe7d-4af6-a03d-04488b5a20ac-kube-api-access-t285x\") pod \"node-resolver-jpdcl\" (UID: \"d9c6489d-fe7d-4af6-a03d-04488b5a20ac\") " pod="openshift-dns/node-resolver-jpdcl" Jul 06 13:45:07.960476 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.806062 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/32c4c811-3283-4b48-85ea-1ace503aa644-host-run-k8s-cni-cncf-io\") pod \"multus-b8v6z\" (UID: \"32c4c811-3283-4b48-85ea-1ace503aa644\") " pod="openshift-multus/multus-b8v6z" Jul 06 13:45:07.960476 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.806090 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/52c0b86f-6d49-489b-ae17-4167edbc66d8-run-systemd\") pod \"ovnkube-node-hsbqp\" (UID: \"52c0b86f-6d49-489b-ae17-4167edbc66d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:45:07.960476 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.806118 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/32c4c811-3283-4b48-85ea-1ace503aa644-host-var-lib-cni-bin\") pod \"multus-b8v6z\" (UID: \"32c4c811-3283-4b48-85ea-1ace503aa644\") " pod="openshift-multus/multus-b8v6z" Jul 06 13:45:07.960476 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.806124 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/52c0b86f-6d49-489b-ae17-4167edbc66d8-systemd-units\") pod \"ovnkube-node-hsbqp\" (UID: \"52c0b86f-6d49-489b-ae17-4167edbc66d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:45:07.960476 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.806143 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s6gk\" (UniqueName: \"kubernetes.io/projected/88c479d6-98eb-4c89-892c-eac6ac9629d0-kube-api-access-6s6gk\") pod \"network-check-target-nzf92\" (UID: \"88c479d6-98eb-4c89-892c-eac6ac9629d0\") " pod="openshift-network-diagnostics/network-check-target-nzf92" Jul 06 13:45:07.961819 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.806400 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/52c0b86f-6d49-489b-ae17-4167edbc66d8-ovnkube-config\") pod \"ovnkube-node-hsbqp\" (UID: \"52c0b86f-6d49-489b-ae17-4167edbc66d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:45:07.961819 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.806438 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ec186ecf-a1ec-4c1f-a529-f5c101d3e604-etc-sysctl-conf\") pod \"tuned-dp8pp\" (UID: \"ec186ecf-a1ec-4c1f-a529-f5c101d3e604\") " pod="openshift-cluster-node-tuning-operator/tuned-dp8pp" Jul 06 13:45:07.961819 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.806473 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/108cc216-aac3-41b5-b7c2-45d33ed8eef7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6krtq\" (UID: \"108cc216-aac3-41b5-b7c2-45d33ed8eef7\") " pod="openshift-multus/multus-additional-cni-plugins-6krtq" Jul 06 13:45:07.961819 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.806501 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/32c4c811-3283-4b48-85ea-1ace503aa644-host-run-k8s-cni-cncf-io\") pod \"multus-b8v6z\" (UID: \"32c4c811-3283-4b48-85ea-1ace503aa644\") " pod="openshift-multus/multus-b8v6z" Jul 06 13:45:07.961819 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.806503 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/52c0b86f-6d49-489b-ae17-4167edbc66d8-run-ovn\") pod \"ovnkube-node-hsbqp\" (UID: \"52c0b86f-6d49-489b-ae17-4167edbc66d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:45:07.961819 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.806535 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/52c0b86f-6d49-489b-ae17-4167edbc66d8-run-ovn\") pod \"ovnkube-node-hsbqp\" (UID: \"52c0b86f-6d49-489b-ae17-4167edbc66d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:45:07.961819 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.806621 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/52c0b86f-6d49-489b-ae17-4167edbc66d8-run-systemd\") pod \"ovnkube-node-hsbqp\" (UID: \"52c0b86f-6d49-489b-ae17-4167edbc66d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:45:07.961819 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.806092 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/32c4c811-3283-4b48-85ea-1ace503aa644-host-var-lib-kubelet\") pod \"multus-b8v6z\" (UID: \"32c4c811-3283-4b48-85ea-1ace503aa644\") " pod="openshift-multus/multus-b8v6z" Jul 06 13:45:07.961819 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.806711 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b400c7ed-fd28-44f0-802f-17b18fa21328-kubelet-config\") pod \"global-pull-secret-syncer-w5psk\" (UID: \"b400c7ed-fd28-44f0-802f-17b18fa21328\") " pod="kube-system/global-pull-secret-syncer-w5psk" Jul 06 13:45:07.961819 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.806721 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/32c4c811-3283-4b48-85ea-1ace503aa644-host-var-lib-cni-bin\") pod \"multus-b8v6z\" (UID: \"32c4c811-3283-4b48-85ea-1ace503aa644\") " pod="openshift-multus/multus-b8v6z" Jul 06 13:45:07.961819 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.806784 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/32c4c811-3283-4b48-85ea-1ace503aa644-host-var-lib-cni-multus\") pod \"multus-b8v6z\" (UID: \"32c4c811-3283-4b48-85ea-1ace503aa644\") " pod="openshift-multus/multus-b8v6z" Jul 06 13:45:07.961819 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.806797 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/52c0b86f-6d49-489b-ae17-4167edbc66d8-env-overrides\") pod \"ovnkube-node-hsbqp\" (UID: \"52c0b86f-6d49-489b-ae17-4167edbc66d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:45:07.961819 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.806814 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b400c7ed-fd28-44f0-802f-17b18fa21328-kubelet-config\") pod \"global-pull-secret-syncer-w5psk\" (UID: \"b400c7ed-fd28-44f0-802f-17b18fa21328\") " pod="kube-system/global-pull-secret-syncer-w5psk" Jul 06 13:45:07.961819 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.806812 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/32c4c811-3283-4b48-85ea-1ace503aa644-etc-kubernetes\") pod \"multus-b8v6z\" (UID: \"32c4c811-3283-4b48-85ea-1ace503aa644\") " pod="openshift-multus/multus-b8v6z" Jul 06 13:45:07.961819 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.806856 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/32c4c811-3283-4b48-85ea-1ace503aa644-host-var-lib-cni-multus\") pod \"multus-b8v6z\" (UID: \"32c4c811-3283-4b48-85ea-1ace503aa644\") " pod="openshift-multus/multus-b8v6z" Jul 06 13:45:07.961819 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.806856 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2f4f1d96-1e31-4efd-8569-e719707555e7-konnectivity-ca\") pod \"konnectivity-agent-266zj\" (UID: \"2f4f1d96-1e31-4efd-8569-e719707555e7\") " pod="kube-system/konnectivity-agent-266zj" Jul 06 13:45:07.961819 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.806886 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/73be228a-e09a-4ef2-9df5-b3ef9a8324fc-serviceca\") pod \"node-ca-wmfs6\" (UID: \"73be228a-e09a-4ef2-9df5-b3ef9a8324fc\") " pod="openshift-image-registry/node-ca-wmfs6" Jul 06 13:45:07.961819 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.806898 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/32c4c811-3283-4b48-85ea-1ace503aa644-etc-kubernetes\") pod \"multus-b8v6z\" (UID: \"32c4c811-3283-4b48-85ea-1ace503aa644\") " pod="openshift-multus/multus-b8v6z" Jul 06 13:45:07.962503 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.806918 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qz69s\" (UniqueName: \"kubernetes.io/projected/108cc216-aac3-41b5-b7c2-45d33ed8eef7-kube-api-access-qz69s\") pod \"multus-additional-cni-plugins-6krtq\" (UID: \"108cc216-aac3-41b5-b7c2-45d33ed8eef7\") " pod="openshift-multus/multus-additional-cni-plugins-6krtq" Jul 06 13:45:07.962503 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.806965 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/52c0b86f-6d49-489b-ae17-4167edbc66d8-run-openvswitch\") pod \"ovnkube-node-hsbqp\" (UID: \"52c0b86f-6d49-489b-ae17-4167edbc66d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:45:07.962503 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.806986 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/108cc216-aac3-41b5-b7c2-45d33ed8eef7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6krtq\" (UID: \"108cc216-aac3-41b5-b7c2-45d33ed8eef7\") " pod="openshift-multus/multus-additional-cni-plugins-6krtq" Jul 06 13:45:07.962503 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.807026 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/52c0b86f-6d49-489b-ae17-4167edbc66d8-host-cni-netd\") pod \"ovnkube-node-hsbqp\" (UID: \"52c0b86f-6d49-489b-ae17-4167edbc66d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:45:07.962503 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.807055 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/52c0b86f-6d49-489b-ae17-4167edbc66d8-ovnkube-script-lib\") pod \"ovnkube-node-hsbqp\" (UID: \"52c0b86f-6d49-489b-ae17-4167edbc66d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:45:07.962503 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.807097 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b400c7ed-fd28-44f0-802f-17b18fa21328-original-pull-secret\") pod \"global-pull-secret-syncer-w5psk\" (UID: \"b400c7ed-fd28-44f0-802f-17b18fa21328\") " pod="kube-system/global-pull-secret-syncer-w5psk" Jul 06 13:45:07.962503 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.807103 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/52c0b86f-6d49-489b-ae17-4167edbc66d8-run-openvswitch\") pod \"ovnkube-node-hsbqp\" (UID: \"52c0b86f-6d49-489b-ae17-4167edbc66d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:45:07.962503 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.807132 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ec186ecf-a1ec-4c1f-a529-f5c101d3e604-run\") pod \"tuned-dp8pp\" (UID: \"ec186ecf-a1ec-4c1f-a529-f5c101d3e604\") " pod="openshift-cluster-node-tuning-operator/tuned-dp8pp" Jul 06 13:45:07.962503 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.807151 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/52c0b86f-6d49-489b-ae17-4167edbc66d8-host-cni-netd\") pod \"ovnkube-node-hsbqp\" (UID: \"52c0b86f-6d49-489b-ae17-4167edbc66d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:45:07.962503 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.807158 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ec186ecf-a1ec-4c1f-a529-f5c101d3e604-lib-modules\") pod \"tuned-dp8pp\" (UID: \"ec186ecf-a1ec-4c1f-a529-f5c101d3e604\") " pod="openshift-cluster-node-tuning-operator/tuned-dp8pp" Jul 06 13:45:07.962503 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.807211 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/108cc216-aac3-41b5-b7c2-45d33ed8eef7-cnibin\") pod \"multus-additional-cni-plugins-6krtq\" (UID: \"108cc216-aac3-41b5-b7c2-45d33ed8eef7\") " pod="openshift-multus/multus-additional-cni-plugins-6krtq" Jul 06 13:45:07.962503 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:07.807229 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 13:45:07.962503 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.807238 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/52c0b86f-6d49-489b-ae17-4167edbc66d8-host-slash\") pod \"ovnkube-node-hsbqp\" (UID: \"52c0b86f-6d49-489b-ae17-4167edbc66d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:45:07.962503 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.807276 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/163581f7-7372-4f70-be9b-5a2aabaac5ed-socket-dir\") pod \"aws-ebs-csi-driver-node-mnbsk\" (UID: \"163581f7-7372-4f70-be9b-5a2aabaac5ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnbsk" Jul 06 13:45:07.962503 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.807314 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/73be228a-e09a-4ef2-9df5-b3ef9a8324fc-serviceca\") pod \"node-ca-wmfs6\" (UID: \"73be228a-e09a-4ef2-9df5-b3ef9a8324fc\") " pod="openshift-image-registry/node-ca-wmfs6" Jul 06 13:45:07.962503 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.807325 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/32c4c811-3283-4b48-85ea-1ace503aa644-multus-cni-dir\") pod \"multus-b8v6z\" (UID: \"32c4c811-3283-4b48-85ea-1ace503aa644\") " pod="openshift-multus/multus-b8v6z" Jul 06 13:45:07.962503 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.807351 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/32c4c811-3283-4b48-85ea-1ace503aa644-multus-socket-dir-parent\") pod \"multus-b8v6z\" (UID: \"32c4c811-3283-4b48-85ea-1ace503aa644\") " pod="openshift-multus/multus-b8v6z" Jul 06 13:45:07.962503 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.807379 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/32c4c811-3283-4b48-85ea-1ace503aa644-host-run-netns\") pod \"multus-b8v6z\" (UID: \"32c4c811-3283-4b48-85ea-1ace503aa644\") " pod="openshift-multus/multus-b8v6z" Jul 06 13:45:07.963454 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.807391 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/108cc216-aac3-41b5-b7c2-45d33ed8eef7-cnibin\") pod \"multus-additional-cni-plugins-6krtq\" (UID: \"108cc216-aac3-41b5-b7c2-45d33ed8eef7\") " pod="openshift-multus/multus-additional-cni-plugins-6krtq" Jul 06 13:45:07.963454 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.807404 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/52c0b86f-6d49-489b-ae17-4167edbc66d8-var-lib-openvswitch\") pod \"ovnkube-node-hsbqp\" (UID: \"52c0b86f-6d49-489b-ae17-4167edbc66d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:45:07.963454 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.807431 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/52c0b86f-6d49-489b-ae17-4167edbc66d8-host-run-ovn-kubernetes\") pod \"ovnkube-node-hsbqp\" (UID: \"52c0b86f-6d49-489b-ae17-4167edbc66d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:45:07.963454 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.807458 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b400c7ed-fd28-44f0-802f-17b18fa21328-dbus\") pod \"global-pull-secret-syncer-w5psk\" (UID: \"b400c7ed-fd28-44f0-802f-17b18fa21328\") " pod="kube-system/global-pull-secret-syncer-w5psk" Jul 06 13:45:07.963454 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.807483 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/163581f7-7372-4f70-be9b-5a2aabaac5ed-registration-dir\") pod \"aws-ebs-csi-driver-node-mnbsk\" (UID: \"163581f7-7372-4f70-be9b-5a2aabaac5ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnbsk" Jul 06 13:45:07.963454 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.807507 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ec186ecf-a1ec-4c1f-a529-f5c101d3e604-run\") pod \"tuned-dp8pp\" (UID: \"ec186ecf-a1ec-4c1f-a529-f5c101d3e604\") " pod="openshift-cluster-node-tuning-operator/tuned-dp8pp" Jul 06 13:45:07.963454 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.807517 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9b4m\" (UniqueName: \"kubernetes.io/projected/ec186ecf-a1ec-4c1f-a529-f5c101d3e604-kube-api-access-q9b4m\") pod \"tuned-dp8pp\" (UID: \"ec186ecf-a1ec-4c1f-a529-f5c101d3e604\") " pod="openshift-cluster-node-tuning-operator/tuned-dp8pp" Jul 06 13:45:07.963454 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.807544 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/32c4c811-3283-4b48-85ea-1ace503aa644-host-run-multus-certs\") pod \"multus-b8v6z\" (UID: \"32c4c811-3283-4b48-85ea-1ace503aa644\") " pod="openshift-multus/multus-b8v6z" Jul 06 13:45:07.963454 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.807569 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/52c0b86f-6d49-489b-ae17-4167edbc66d8-log-socket\") pod \"ovnkube-node-hsbqp\" (UID: \"52c0b86f-6d49-489b-ae17-4167edbc66d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:45:07.963454 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.807584 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ec186ecf-a1ec-4c1f-a529-f5c101d3e604-lib-modules\") pod \"tuned-dp8pp\" (UID: \"ec186ecf-a1ec-4c1f-a529-f5c101d3e604\") " pod="openshift-cluster-node-tuning-operator/tuned-dp8pp" Jul 06 13:45:07.963454 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.807611 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4p6k\" (UniqueName: \"kubernetes.io/projected/73be228a-e09a-4ef2-9df5-b3ef9a8324fc-kube-api-access-r4p6k\") pod \"node-ca-wmfs6\" (UID: \"73be228a-e09a-4ef2-9df5-b3ef9a8324fc\") " pod="openshift-image-registry/node-ca-wmfs6" Jul 06 13:45:07.963454 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.807631 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/52c0b86f-6d49-489b-ae17-4167edbc66d8-var-lib-openvswitch\") pod \"ovnkube-node-hsbqp\" (UID: \"52c0b86f-6d49-489b-ae17-4167edbc66d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:45:07.963454 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.807639 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/108cc216-aac3-41b5-b7c2-45d33ed8eef7-system-cni-dir\") pod \"multus-additional-cni-plugins-6krtq\" (UID: \"108cc216-aac3-41b5-b7c2-45d33ed8eef7\") " pod="openshift-multus/multus-additional-cni-plugins-6krtq" Jul 06 13:45:07.963454 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.807672 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/52c0b86f-6d49-489b-ae17-4167edbc66d8-host-slash\") pod \"ovnkube-node-hsbqp\" (UID: \"52c0b86f-6d49-489b-ae17-4167edbc66d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:45:07.963454 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.807699 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/52c0b86f-6d49-489b-ae17-4167edbc66d8-node-log\") pod \"ovnkube-node-hsbqp\" (UID: \"52c0b86f-6d49-489b-ae17-4167edbc66d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:45:07.963454 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.807727 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/163581f7-7372-4f70-be9b-5a2aabaac5ed-sys-fs\") pod \"aws-ebs-csi-driver-node-mnbsk\" (UID: \"163581f7-7372-4f70-be9b-5a2aabaac5ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnbsk" Jul 06 13:45:07.963454 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.807755 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wqfg\" (UniqueName: \"kubernetes.io/projected/163581f7-7372-4f70-be9b-5a2aabaac5ed-kube-api-access-7wqfg\") pod \"aws-ebs-csi-driver-node-mnbsk\" (UID: \"163581f7-7372-4f70-be9b-5a2aabaac5ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnbsk" Jul 06 13:45:07.964089 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.807801 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/163581f7-7372-4f70-be9b-5a2aabaac5ed-socket-dir\") pod \"aws-ebs-csi-driver-node-mnbsk\" (UID: \"163581f7-7372-4f70-be9b-5a2aabaac5ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnbsk" Jul 06 13:45:07.964089 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.807851 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/52c0b86f-6d49-489b-ae17-4167edbc66d8-host-run-ovn-kubernetes\") pod \"ovnkube-node-hsbqp\" (UID: \"52c0b86f-6d49-489b-ae17-4167edbc66d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:45:07.964089 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.807962 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/52c0b86f-6d49-489b-ae17-4167edbc66d8-ovnkube-script-lib\") pod \"ovnkube-node-hsbqp\" (UID: \"52c0b86f-6d49-489b-ae17-4167edbc66d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:45:07.964089 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.808001 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b400c7ed-fd28-44f0-802f-17b18fa21328-dbus\") pod \"global-pull-secret-syncer-w5psk\" (UID: \"b400c7ed-fd28-44f0-802f-17b18fa21328\") " pod="kube-system/global-pull-secret-syncer-w5psk" Jul 06 13:45:07.964089 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.808053 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/32c4c811-3283-4b48-85ea-1ace503aa644-multus-cni-dir\") pod \"multus-b8v6z\" (UID: \"32c4c811-3283-4b48-85ea-1ace503aa644\") " pod="openshift-multus/multus-b8v6z" Jul 06 13:45:07.964089 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.808062 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/163581f7-7372-4f70-be9b-5a2aabaac5ed-registration-dir\") pod \"aws-ebs-csi-driver-node-mnbsk\" (UID: \"163581f7-7372-4f70-be9b-5a2aabaac5ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnbsk" Jul 06 13:45:07.964089 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.808117 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/32c4c811-3283-4b48-85ea-1ace503aa644-multus-socket-dir-parent\") pod \"multus-b8v6z\" (UID: \"32c4c811-3283-4b48-85ea-1ace503aa644\") " pod="openshift-multus/multus-b8v6z" Jul 06 13:45:07.964089 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.808167 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/32c4c811-3283-4b48-85ea-1ace503aa644-host-run-netns\") pod \"multus-b8v6z\" (UID: \"32c4c811-3283-4b48-85ea-1ace503aa644\") " pod="openshift-multus/multus-b8v6z" Jul 06 13:45:07.964089 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.808225 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/108cc216-aac3-41b5-b7c2-45d33ed8eef7-system-cni-dir\") pod \"multus-additional-cni-plugins-6krtq\" (UID: \"108cc216-aac3-41b5-b7c2-45d33ed8eef7\") " pod="openshift-multus/multus-additional-cni-plugins-6krtq" Jul 06 13:45:07.964089 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.808278 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/32c4c811-3283-4b48-85ea-1ace503aa644-host-run-multus-certs\") pod \"multus-b8v6z\" (UID: \"32c4c811-3283-4b48-85ea-1ace503aa644\") " pod="openshift-multus/multus-b8v6z" Jul 06 13:45:07.964089 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.808293 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/52c0b86f-6d49-489b-ae17-4167edbc66d8-ovn-node-metrics-cert\") pod \"ovnkube-node-hsbqp\" (UID: \"52c0b86f-6d49-489b-ae17-4167edbc66d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:45:07.964089 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.808338 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ec186ecf-a1ec-4c1f-a529-f5c101d3e604-tmp\") pod \"tuned-dp8pp\" (UID: \"ec186ecf-a1ec-4c1f-a529-f5c101d3e604\") " pod="openshift-cluster-node-tuning-operator/tuned-dp8pp" Jul 06 13:45:07.964089 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.808337 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/52c0b86f-6d49-489b-ae17-4167edbc66d8-node-log\") pod \"ovnkube-node-hsbqp\" (UID: \"52c0b86f-6d49-489b-ae17-4167edbc66d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:45:07.964089 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.808426 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/52c0b86f-6d49-489b-ae17-4167edbc66d8-log-socket\") pod \"ovnkube-node-hsbqp\" (UID: \"52c0b86f-6d49-489b-ae17-4167edbc66d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:45:07.964089 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.808439 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/163581f7-7372-4f70-be9b-5a2aabaac5ed-sys-fs\") pod \"aws-ebs-csi-driver-node-mnbsk\" (UID: \"163581f7-7372-4f70-be9b-5a2aabaac5ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnbsk" Jul 06 13:45:07.964089 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:07.808633 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b400c7ed-fd28-44f0-802f-17b18fa21328-original-pull-secret podName:b400c7ed-fd28-44f0-802f-17b18fa21328 nodeName:}" failed. No retries permitted until 2026-07-06 13:45:08.308385634 +0000 UTC m=+2.108131322 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b400c7ed-fd28-44f0-802f-17b18fa21328-original-pull-secret") pod "global-pull-secret-syncer-w5psk" (UID: "b400c7ed-fd28-44f0-802f-17b18fa21328") : object "kube-system"/"original-pull-secret" not registered Jul 06 13:45:07.964089 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.808799 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2f4f1d96-1e31-4efd-8569-e719707555e7-agent-certs\") pod \"konnectivity-agent-266zj\" (UID: \"2f4f1d96-1e31-4efd-8569-e719707555e7\") " pod="kube-system/konnectivity-agent-266zj" Jul 06 13:45:07.965190 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.809458 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ec186ecf-a1ec-4c1f-a529-f5c101d3e604-etc-tuned\") pod \"tuned-dp8pp\" (UID: \"ec186ecf-a1ec-4c1f-a529-f5c101d3e604\") " pod="openshift-cluster-node-tuning-operator/tuned-dp8pp" Jul 06 13:45:07.965190 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.816336 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-82tkp\" (UniqueName: \"kubernetes.io/projected/d9712593-e5bd-42d1-bb8f-3e81c9c588f4-kube-api-access-82tkp\") pod \"network-metrics-daemon-jkhgk\" (UID: \"d9712593-e5bd-42d1-bb8f-3e81c9c588f4\") " pod="openshift-multus/network-metrics-daemon-jkhgk" Jul 06 13:45:07.965190 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:07.816824 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 13:45:07.965190 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:07.816844 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 13:45:07.965190 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:07.816859 2556 projected.go:196] Error preparing data for projected volume kube-api-access-6s6gk for pod openshift-network-diagnostics/network-check-target-nzf92: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 13:45:07.965190 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:07.816917 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/88c479d6-98eb-4c89-892c-eac6ac9629d0-kube-api-access-6s6gk podName:88c479d6-98eb-4c89-892c-eac6ac9629d0 nodeName:}" failed. No retries permitted until 2026-07-06 13:45:08.316900948 +0000 UTC m=+2.116646642 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6s6gk" (UniqueName: "kubernetes.io/projected/88c479d6-98eb-4c89-892c-eac6ac9629d0-kube-api-access-6s6gk") pod "network-check-target-nzf92" (UID: "88c479d6-98eb-4c89-892c-eac6ac9629d0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 13:45:07.965190 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.819491 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rht7\" (UniqueName: \"kubernetes.io/projected/b1c8c2d7-c914-4438-b4f4-80142ffc45c3-kube-api-access-9rht7\") pod \"iptables-alerter-rzflg\" (UID: \"b1c8c2d7-c914-4438-b4f4-80142ffc45c3\") " pod="openshift-network-operator/iptables-alerter-rzflg" Jul 06 13:45:07.965190 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.819751 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9b4m\" (UniqueName: \"kubernetes.io/projected/ec186ecf-a1ec-4c1f-a529-f5c101d3e604-kube-api-access-q9b4m\") pod \"tuned-dp8pp\" (UID: \"ec186ecf-a1ec-4c1f-a529-f5c101d3e604\") " pod="openshift-cluster-node-tuning-operator/tuned-dp8pp" Jul 06 13:45:07.965190 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.819762 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qz69s\" (UniqueName: \"kubernetes.io/projected/108cc216-aac3-41b5-b7c2-45d33ed8eef7-kube-api-access-qz69s\") pod \"multus-additional-cni-plugins-6krtq\" (UID: \"108cc216-aac3-41b5-b7c2-45d33ed8eef7\") " pod="openshift-multus/multus-additional-cni-plugins-6krtq" Jul 06 13:45:07.965190 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.819777 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4p6k\" (UniqueName: \"kubernetes.io/projected/73be228a-e09a-4ef2-9df5-b3ef9a8324fc-kube-api-access-r4p6k\") pod \"node-ca-wmfs6\" (UID: \"73be228a-e09a-4ef2-9df5-b3ef9a8324fc\") " pod="openshift-image-registry/node-ca-wmfs6" Jul 06 13:45:07.965190 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.820255 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t285x\" (UniqueName: \"kubernetes.io/projected/d9c6489d-fe7d-4af6-a03d-04488b5a20ac-kube-api-access-t285x\") pod \"node-resolver-jpdcl\" (UID: \"d9c6489d-fe7d-4af6-a03d-04488b5a20ac\") " pod="openshift-dns/node-resolver-jpdcl" Jul 06 13:45:07.965190 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.820349 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gc6wd\" (UniqueName: \"kubernetes.io/projected/52c0b86f-6d49-489b-ae17-4167edbc66d8-kube-api-access-gc6wd\") pod \"ovnkube-node-hsbqp\" (UID: \"52c0b86f-6d49-489b-ae17-4167edbc66d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:45:07.965190 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.820958 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2s8h5\" (UniqueName: \"kubernetes.io/projected/32c4c811-3283-4b48-85ea-1ace503aa644-kube-api-access-2s8h5\") pod \"multus-b8v6z\" (UID: \"32c4c811-3283-4b48-85ea-1ace503aa644\") " pod="openshift-multus/multus-b8v6z" Jul 06 13:45:07.965190 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.821245 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wqfg\" (UniqueName: \"kubernetes.io/projected/163581f7-7372-4f70-be9b-5a2aabaac5ed-kube-api-access-7wqfg\") pod \"aws-ebs-csi-driver-node-mnbsk\" (UID: \"163581f7-7372-4f70-be9b-5a2aabaac5ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnbsk" Jul 06 13:45:07.965190 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.850851 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnbsk" Jul 06 13:45:07.965190 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.874059 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dp8pp" Jul 06 13:45:07.965190 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.888727 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jpdcl" Jul 06 13:45:07.965190 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.894969 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-b8v6z" Jul 06 13:45:07.965190 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.940594 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:45:07.965190 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.949775 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wmfs6" Jul 06 13:45:07.999550 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:07.998584 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6krtq" Jul 06 13:45:08.001215 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:08.001182 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d4feb6891ad8edcfe276a6edcabbad7.slice/crio-987482f78fee3120c81e663a0fe5781ee3f0aa14dffc5ce4e33bd38540fe1e4b WatchSource:0}: Error finding container 987482f78fee3120c81e663a0fe5781ee3f0aa14dffc5ce4e33bd38540fe1e4b: Status 404 returned error can't find the container with id 987482f78fee3120c81e663a0fe5781ee3f0aa14dffc5ce4e33bd38540fe1e4b Jul 06 13:45:08.002024 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:08.001991 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod918473a18bd382b5ab12df4cdc26e303.slice/crio-6f2c5cb6fb7336b6d195a0c002bee850fb6ba244a3062843db378cc2491418b2 WatchSource:0}: Error finding container 6f2c5cb6fb7336b6d195a0c002bee850fb6ba244a3062843db378cc2491418b2: Status 404 returned error can't find the container with id 6f2c5cb6fb7336b6d195a0c002bee850fb6ba244a3062843db378cc2491418b2 Jul 06 13:45:08.007278 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:08.007260 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod108cc216_aac3_41b5_b7c2_45d33ed8eef7.slice/crio-9aab9f6ce8f68ec4bcbf3e0a76a2911cd4455747ab9eb3315e0a4736246f62bb WatchSource:0}: Error finding container 9aab9f6ce8f68ec4bcbf3e0a76a2911cd4455747ab9eb3315e0a4736246f62bb: Status 404 returned error can't find the container with id 9aab9f6ce8f68ec4bcbf3e0a76a2911cd4455747ab9eb3315e0a4736246f62bb Jul 06 13:45:08.008724 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:08.008702 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 13:45:08.054934 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:08.054905 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rzflg" Jul 06 13:45:08.065596 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:08.062929 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1c8c2d7_c914_4438_b4f4_80142ffc45c3.slice/crio-ed77862fe4d0c44471c46a7fe77de506fd657aff1fa0566b193d217c0bb126bc WatchSource:0}: Error finding container ed77862fe4d0c44471c46a7fe77de506fd657aff1fa0566b193d217c0bb126bc: Status 404 returned error can't find the container with id ed77862fe4d0c44471c46a7fe77de506fd657aff1fa0566b193d217c0bb126bc Jul 06 13:45:08.073662 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:08.073647 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-266zj" Jul 06 13:45:08.080656 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:08.080631 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f4f1d96_1e31_4efd_8569_e719707555e7.slice/crio-9a5cabd034c7e879503b85933c43c867699f140a271deda5484068a97a74276c WatchSource:0}: Error finding container 9a5cabd034c7e879503b85933c43c867699f140a271deda5484068a97a74276c: Status 404 returned error can't find the container with id 9a5cabd034c7e879503b85933c43c867699f140a271deda5484068a97a74276c Jul 06 13:45:08.282521 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:08.282486 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9c6489d_fe7d_4af6_a03d_04488b5a20ac.slice/crio-6bea36dc5de87d82b1d8d1dc532a9aa6acd07f883468ab18632c9cdc98e78855 WatchSource:0}: Error finding container 6bea36dc5de87d82b1d8d1dc532a9aa6acd07f883468ab18632c9cdc98e78855: Status 404 returned error can't find the container with id 6bea36dc5de87d82b1d8d1dc532a9aa6acd07f883468ab18632c9cdc98e78855 Jul 06 13:45:08.305903 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:08.305878 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec186ecf_a1ec_4c1f_a529_f5c101d3e604.slice/crio-f40520ba29863e27516db254bea536e31501bdff1505fbe55435fe651b3a7f46 WatchSource:0}: Error finding container f40520ba29863e27516db254bea536e31501bdff1505fbe55435fe651b3a7f46: Status 404 returned error can't find the container with id f40520ba29863e27516db254bea536e31501bdff1505fbe55435fe651b3a7f46 Jul 06 13:45:08.310731 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:08.310709 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9712593-e5bd-42d1-bb8f-3e81c9c588f4-metrics-certs\") pod \"network-metrics-daemon-jkhgk\" (UID: \"d9712593-e5bd-42d1-bb8f-3e81c9c588f4\") " pod="openshift-multus/network-metrics-daemon-jkhgk" Jul 06 13:45:08.310833 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:08.310783 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b400c7ed-fd28-44f0-802f-17b18fa21328-original-pull-secret\") pod \"global-pull-secret-syncer-w5psk\" (UID: \"b400c7ed-fd28-44f0-802f-17b18fa21328\") " pod="kube-system/global-pull-secret-syncer-w5psk" Jul 06 13:45:08.310893 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:08.310859 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 13:45:08.310944 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:08.310894 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 13:45:08.310944 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:08.310910 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9712593-e5bd-42d1-bb8f-3e81c9c588f4-metrics-certs podName:d9712593-e5bd-42d1-bb8f-3e81c9c588f4 nodeName:}" failed. No retries permitted until 2026-07-06 13:45:09.310896177 +0000 UTC m=+3.110641855 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d9712593-e5bd-42d1-bb8f-3e81c9c588f4-metrics-certs") pod "network-metrics-daemon-jkhgk" (UID: "d9712593-e5bd-42d1-bb8f-3e81c9c588f4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 13:45:08.311040 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:08.310948 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b400c7ed-fd28-44f0-802f-17b18fa21328-original-pull-secret podName:b400c7ed-fd28-44f0-802f-17b18fa21328 nodeName:}" failed. No retries permitted until 2026-07-06 13:45:09.310927593 +0000 UTC m=+3.110673269 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b400c7ed-fd28-44f0-802f-17b18fa21328-original-pull-secret") pod "global-pull-secret-syncer-w5psk" (UID: "b400c7ed-fd28-44f0-802f-17b18fa21328") : object "kube-system"/"original-pull-secret" not registered Jul 06 13:45:08.344361 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:08.344339 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod163581f7_7372_4f70_be9b_5a2aabaac5ed.slice/crio-556b56546d5083f887a40ab15827b33dc7d3eba1ea8ce025698d3d2c16fda9e3 WatchSource:0}: Error finding container 556b56546d5083f887a40ab15827b33dc7d3eba1ea8ce025698d3d2c16fda9e3: Status 404 returned error can't find the container with id 556b56546d5083f887a40ab15827b33dc7d3eba1ea8ce025698d3d2c16fda9e3 Jul 06 13:45:08.344941 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:08.344895 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32c4c811_3283_4b48_85ea_1ace503aa644.slice/crio-b7a168c528ac5b4075d0e7b1796791028b48cfac6b23fe09d8aed89a18a7afc1 WatchSource:0}: Error finding container b7a168c528ac5b4075d0e7b1796791028b48cfac6b23fe09d8aed89a18a7afc1: Status 404 returned error can't find the container with id b7a168c528ac5b4075d0e7b1796791028b48cfac6b23fe09d8aed89a18a7afc1 Jul 06 13:45:08.367387 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:08.367367 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52c0b86f_6d49_489b_ae17_4167edbc66d8.slice/crio-8b56c5a95c86fc5d1993d3778c2e82283094fbd573d1271fd32713f881862707 WatchSource:0}: Error finding container 8b56c5a95c86fc5d1993d3778c2e82283094fbd573d1271fd32713f881862707: Status 404 returned error can't find the container with id 8b56c5a95c86fc5d1993d3778c2e82283094fbd573d1271fd32713f881862707 Jul 06 13:45:08.399629 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:08.399608 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73be228a_e09a_4ef2_9df5_b3ef9a8324fc.slice/crio-c862062d2240fe23e0ba210efcaedb7d4d8bba5ea80118a3a92b4bb5eb9e8598 WatchSource:0}: Error finding container c862062d2240fe23e0ba210efcaedb7d4d8bba5ea80118a3a92b4bb5eb9e8598: Status 404 returned error can't find the container with id c862062d2240fe23e0ba210efcaedb7d4d8bba5ea80118a3a92b4bb5eb9e8598 Jul 06 13:45:08.411492 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:08.411466 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s6gk\" (UniqueName: \"kubernetes.io/projected/88c479d6-98eb-4c89-892c-eac6ac9629d0-kube-api-access-6s6gk\") pod \"network-check-target-nzf92\" (UID: \"88c479d6-98eb-4c89-892c-eac6ac9629d0\") " pod="openshift-network-diagnostics/network-check-target-nzf92" Jul 06 13:45:08.411658 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:08.411634 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 13:45:08.411658 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:08.411657 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 13:45:08.411750 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:08.411671 2556 projected.go:196] Error preparing data for projected volume kube-api-access-6s6gk for pod openshift-network-diagnostics/network-check-target-nzf92: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 13:45:08.411750 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:08.411747 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/88c479d6-98eb-4c89-892c-eac6ac9629d0-kube-api-access-6s6gk podName:88c479d6-98eb-4c89-892c-eac6ac9629d0 nodeName:}" failed. No retries permitted until 2026-07-06 13:45:09.411727099 +0000 UTC m=+3.211473039 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-6s6gk" (UniqueName: "kubernetes.io/projected/88c479d6-98eb-4c89-892c-eac6ac9629d0-kube-api-access-6s6gk") pod "network-check-target-nzf92" (UID: "88c479d6-98eb-4c89-892c-eac6ac9629d0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 13:45:08.638768 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:08.638668 2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 13:45:08.643404 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:08.643300 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 13:40:08 +0000 UTC" deadline="2028-01-16 21:56:56.30456599 +0000 UTC" Jul 06 13:45:08.643404 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:08.643357 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13424h11m47.661213555s" Jul 06 13:45:08.709822 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:08.709736 2556 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 13:45:08.797908 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:08.797836 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-85.ec2.internal" event={"ID":"918473a18bd382b5ab12df4cdc26e303","Type":"ContainerStarted","Data":"6f2c5cb6fb7336b6d195a0c002bee850fb6ba244a3062843db378cc2491418b2"} Jul 06 13:45:08.801296 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:08.801260 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wmfs6" event={"ID":"73be228a-e09a-4ef2-9df5-b3ef9a8324fc","Type":"ContainerStarted","Data":"c862062d2240fe23e0ba210efcaedb7d4d8bba5ea80118a3a92b4bb5eb9e8598"} Jul 06 13:45:08.807346 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:08.807288 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" event={"ID":"52c0b86f-6d49-489b-ae17-4167edbc66d8","Type":"ContainerStarted","Data":"8b56c5a95c86fc5d1993d3778c2e82283094fbd573d1271fd32713f881862707"} Jul 06 13:45:08.811810 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:08.811781 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-b8v6z" event={"ID":"32c4c811-3283-4b48-85ea-1ace503aa644","Type":"ContainerStarted","Data":"b7a168c528ac5b4075d0e7b1796791028b48cfac6b23fe09d8aed89a18a7afc1"} Jul 06 13:45:08.815158 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:08.815119 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jpdcl" event={"ID":"d9c6489d-fe7d-4af6-a03d-04488b5a20ac","Type":"ContainerStarted","Data":"6bea36dc5de87d82b1d8d1dc532a9aa6acd07f883468ab18632c9cdc98e78855"} Jul 06 13:45:08.827280 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:08.827251 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rzflg" event={"ID":"b1c8c2d7-c914-4438-b4f4-80142ffc45c3","Type":"ContainerStarted","Data":"ed77862fe4d0c44471c46a7fe77de506fd657aff1fa0566b193d217c0bb126bc"} Jul 06 13:45:08.829946 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:08.829857 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6krtq" event={"ID":"108cc216-aac3-41b5-b7c2-45d33ed8eef7","Type":"ContainerStarted","Data":"9aab9f6ce8f68ec4bcbf3e0a76a2911cd4455747ab9eb3315e0a4736246f62bb"} Jul 06 13:45:08.832911 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:08.832884 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnbsk" event={"ID":"163581f7-7372-4f70-be9b-5a2aabaac5ed","Type":"ContainerStarted","Data":"556b56546d5083f887a40ab15827b33dc7d3eba1ea8ce025698d3d2c16fda9e3"} Jul 06 13:45:08.835829 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:08.835753 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dp8pp" event={"ID":"ec186ecf-a1ec-4c1f-a529-f5c101d3e604","Type":"ContainerStarted","Data":"f40520ba29863e27516db254bea536e31501bdff1505fbe55435fe651b3a7f46"} Jul 06 13:45:08.843990 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:08.843963 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-266zj" event={"ID":"2f4f1d96-1e31-4efd-8569-e719707555e7","Type":"ContainerStarted","Data":"9a5cabd034c7e879503b85933c43c867699f140a271deda5484068a97a74276c"} Jul 06 13:45:08.847175 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:08.847087 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-85.ec2.internal" event={"ID":"6d4feb6891ad8edcfe276a6edcabbad7","Type":"ContainerStarted","Data":"987482f78fee3120c81e663a0fe5781ee3f0aa14dffc5ce4e33bd38540fe1e4b"} Jul 06 13:45:08.991023 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:08.990941 2556 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 13:45:09.318480 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:09.318393 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b400c7ed-fd28-44f0-802f-17b18fa21328-original-pull-secret\") pod \"global-pull-secret-syncer-w5psk\" (UID: \"b400c7ed-fd28-44f0-802f-17b18fa21328\") " pod="kube-system/global-pull-secret-syncer-w5psk" Jul 06 13:45:09.318480 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:09.318468 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9712593-e5bd-42d1-bb8f-3e81c9c588f4-metrics-certs\") pod \"network-metrics-daemon-jkhgk\" (UID: \"d9712593-e5bd-42d1-bb8f-3e81c9c588f4\") " pod="openshift-multus/network-metrics-daemon-jkhgk" Jul 06 13:45:09.318741 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:09.318612 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 13:45:09.318741 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:09.318696 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9712593-e5bd-42d1-bb8f-3e81c9c588f4-metrics-certs podName:d9712593-e5bd-42d1-bb8f-3e81c9c588f4 nodeName:}" failed. No retries permitted until 2026-07-06 13:45:11.318674266 +0000 UTC m=+5.118419954 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d9712593-e5bd-42d1-bb8f-3e81c9c588f4-metrics-certs") pod "network-metrics-daemon-jkhgk" (UID: "d9712593-e5bd-42d1-bb8f-3e81c9c588f4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 13:45:09.318864 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:09.318768 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 13:45:09.318864 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:09.318808 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b400c7ed-fd28-44f0-802f-17b18fa21328-original-pull-secret podName:b400c7ed-fd28-44f0-802f-17b18fa21328 nodeName:}" failed. No retries permitted until 2026-07-06 13:45:11.318794307 +0000 UTC m=+5.118539986 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b400c7ed-fd28-44f0-802f-17b18fa21328-original-pull-secret") pod "global-pull-secret-syncer-w5psk" (UID: "b400c7ed-fd28-44f0-802f-17b18fa21328") : object "kube-system"/"original-pull-secret" not registered Jul 06 13:45:09.419854 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:09.419813 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s6gk\" (UniqueName: \"kubernetes.io/projected/88c479d6-98eb-4c89-892c-eac6ac9629d0-kube-api-access-6s6gk\") pod \"network-check-target-nzf92\" (UID: \"88c479d6-98eb-4c89-892c-eac6ac9629d0\") " pod="openshift-network-diagnostics/network-check-target-nzf92" Jul 06 13:45:09.420050 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:09.420020 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 13:45:09.420050 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:09.420046 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 13:45:09.420176 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:09.420060 2556 projected.go:196] Error preparing data for projected volume kube-api-access-6s6gk for pod openshift-network-diagnostics/network-check-target-nzf92: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 13:45:09.420176 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:09.420123 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/88c479d6-98eb-4c89-892c-eac6ac9629d0-kube-api-access-6s6gk podName:88c479d6-98eb-4c89-892c-eac6ac9629d0 nodeName:}" failed. No retries permitted until 2026-07-06 13:45:11.420102916 +0000 UTC m=+5.219848591 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-6s6gk" (UniqueName: "kubernetes.io/projected/88c479d6-98eb-4c89-892c-eac6ac9629d0-kube-api-access-6s6gk") pod "network-check-target-nzf92" (UID: "88c479d6-98eb-4c89-892c-eac6ac9629d0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 13:45:09.644200 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:09.644063 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 13:40:08 +0000 UTC" deadline="2028-03-03 04:24:00.687700645 +0000 UTC" Jul 06 13:45:09.644200 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:09.644102 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14534h38m51.043603097s" Jul 06 13:45:09.781973 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:09.780986 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nzf92" Jul 06 13:45:09.781973 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:09.781130 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nzf92" podUID="88c479d6-98eb-4c89-892c-eac6ac9629d0" Jul 06 13:45:09.781973 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:09.781622 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkhgk" Jul 06 13:45:09.781973 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:09.781755 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkhgk" podUID="d9712593-e5bd-42d1-bb8f-3e81c9c588f4" Jul 06 13:45:09.781973 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:09.781844 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w5psk" Jul 06 13:45:09.781973 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:09.781922 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w5psk" podUID="b400c7ed-fd28-44f0-802f-17b18fa21328" Jul 06 13:45:11.338302 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:11.338210 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9712593-e5bd-42d1-bb8f-3e81c9c588f4-metrics-certs\") pod \"network-metrics-daemon-jkhgk\" (UID: \"d9712593-e5bd-42d1-bb8f-3e81c9c588f4\") " pod="openshift-multus/network-metrics-daemon-jkhgk" Jul 06 13:45:11.338835 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:11.338304 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b400c7ed-fd28-44f0-802f-17b18fa21328-original-pull-secret\") pod \"global-pull-secret-syncer-w5psk\" (UID: \"b400c7ed-fd28-44f0-802f-17b18fa21328\") " pod="kube-system/global-pull-secret-syncer-w5psk" Jul 06 13:45:11.338835 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:11.338439 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 13:45:11.338835 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:11.338500 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b400c7ed-fd28-44f0-802f-17b18fa21328-original-pull-secret podName:b400c7ed-fd28-44f0-802f-17b18fa21328 nodeName:}" failed. No retries permitted until 2026-07-06 13:45:15.338481314 +0000 UTC m=+9.138226994 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b400c7ed-fd28-44f0-802f-17b18fa21328-original-pull-secret") pod "global-pull-secret-syncer-w5psk" (UID: "b400c7ed-fd28-44f0-802f-17b18fa21328") : object "kube-system"/"original-pull-secret" not registered Jul 06 13:45:11.339032 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:11.338959 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 13:45:11.339032 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:11.339014 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9712593-e5bd-42d1-bb8f-3e81c9c588f4-metrics-certs podName:d9712593-e5bd-42d1-bb8f-3e81c9c588f4 nodeName:}" failed. No retries permitted until 2026-07-06 13:45:15.338996286 +0000 UTC m=+9.138741959 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d9712593-e5bd-42d1-bb8f-3e81c9c588f4-metrics-certs") pod "network-metrics-daemon-jkhgk" (UID: "d9712593-e5bd-42d1-bb8f-3e81c9c588f4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 13:45:11.439850 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:11.439207 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s6gk\" (UniqueName: \"kubernetes.io/projected/88c479d6-98eb-4c89-892c-eac6ac9629d0-kube-api-access-6s6gk\") pod \"network-check-target-nzf92\" (UID: \"88c479d6-98eb-4c89-892c-eac6ac9629d0\") " pod="openshift-network-diagnostics/network-check-target-nzf92" Jul 06 13:45:11.439850 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:11.439384 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 13:45:11.439850 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:11.439406 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 13:45:11.439850 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:11.439419 2556 projected.go:196] Error preparing data for projected volume kube-api-access-6s6gk for pod openshift-network-diagnostics/network-check-target-nzf92: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 13:45:11.439850 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:11.439476 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/88c479d6-98eb-4c89-892c-eac6ac9629d0-kube-api-access-6s6gk podName:88c479d6-98eb-4c89-892c-eac6ac9629d0 nodeName:}" failed. No retries permitted until 2026-07-06 13:45:15.439457224 +0000 UTC m=+9.239202904 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-6s6gk" (UniqueName: "kubernetes.io/projected/88c479d6-98eb-4c89-892c-eac6ac9629d0-kube-api-access-6s6gk") pod "network-check-target-nzf92" (UID: "88c479d6-98eb-4c89-892c-eac6ac9629d0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 13:45:11.781763 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:11.780936 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nzf92" Jul 06 13:45:11.781763 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:11.780979 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkhgk" Jul 06 13:45:11.781763 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:11.781072 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nzf92" podUID="88c479d6-98eb-4c89-892c-eac6ac9629d0" Jul 06 13:45:11.781763 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:11.781501 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkhgk" podUID="d9712593-e5bd-42d1-bb8f-3e81c9c588f4" Jul 06 13:45:11.781763 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:11.781571 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w5psk" Jul 06 13:45:11.781763 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:11.781656 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w5psk" podUID="b400c7ed-fd28-44f0-802f-17b18fa21328" Jul 06 13:45:13.781553 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:13.781523 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w5psk" Jul 06 13:45:13.782070 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:13.781523 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkhgk" Jul 06 13:45:13.782070 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:13.781671 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w5psk" podUID="b400c7ed-fd28-44f0-802f-17b18fa21328" Jul 06 13:45:13.782070 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:13.781523 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nzf92" Jul 06 13:45:13.782070 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:13.781796 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkhgk" podUID="d9712593-e5bd-42d1-bb8f-3e81c9c588f4" Jul 06 13:45:13.782070 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:13.781906 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nzf92" podUID="88c479d6-98eb-4c89-892c-eac6ac9629d0" Jul 06 13:45:15.375199 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:15.375156 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9712593-e5bd-42d1-bb8f-3e81c9c588f4-metrics-certs\") pod \"network-metrics-daemon-jkhgk\" (UID: \"d9712593-e5bd-42d1-bb8f-3e81c9c588f4\") " pod="openshift-multus/network-metrics-daemon-jkhgk" Jul 06 13:45:15.375676 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:15.375269 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b400c7ed-fd28-44f0-802f-17b18fa21328-original-pull-secret\") pod \"global-pull-secret-syncer-w5psk\" (UID: \"b400c7ed-fd28-44f0-802f-17b18fa21328\") " pod="kube-system/global-pull-secret-syncer-w5psk" Jul 06 13:45:15.375676 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:15.375459 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 13:45:15.375676 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:15.375541 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9712593-e5bd-42d1-bb8f-3e81c9c588f4-metrics-certs podName:d9712593-e5bd-42d1-bb8f-3e81c9c588f4 nodeName:}" failed. No retries permitted until 2026-07-06 13:45:23.375518809 +0000 UTC m=+17.175264494 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d9712593-e5bd-42d1-bb8f-3e81c9c588f4-metrics-certs") pod "network-metrics-daemon-jkhgk" (UID: "d9712593-e5bd-42d1-bb8f-3e81c9c588f4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 13:45:15.375930 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:15.375905 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 13:45:15.376008 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:15.375978 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b400c7ed-fd28-44f0-802f-17b18fa21328-original-pull-secret podName:b400c7ed-fd28-44f0-802f-17b18fa21328 nodeName:}" failed. No retries permitted until 2026-07-06 13:45:23.375960422 +0000 UTC m=+17.175706107 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b400c7ed-fd28-44f0-802f-17b18fa21328-original-pull-secret") pod "global-pull-secret-syncer-w5psk" (UID: "b400c7ed-fd28-44f0-802f-17b18fa21328") : object "kube-system"/"original-pull-secret" not registered Jul 06 13:45:15.476001 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:15.475962 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s6gk\" (UniqueName: \"kubernetes.io/projected/88c479d6-98eb-4c89-892c-eac6ac9629d0-kube-api-access-6s6gk\") pod \"network-check-target-nzf92\" (UID: \"88c479d6-98eb-4c89-892c-eac6ac9629d0\") " pod="openshift-network-diagnostics/network-check-target-nzf92" Jul 06 13:45:15.476194 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:15.476124 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 13:45:15.476194 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:15.476150 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 13:45:15.476194 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:15.476165 2556 projected.go:196] Error preparing data for projected volume kube-api-access-6s6gk for pod openshift-network-diagnostics/network-check-target-nzf92: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 13:45:15.476319 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:15.476232 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/88c479d6-98eb-4c89-892c-eac6ac9629d0-kube-api-access-6s6gk podName:88c479d6-98eb-4c89-892c-eac6ac9629d0 nodeName:}" failed. No retries permitted until 2026-07-06 13:45:23.47621299 +0000 UTC m=+17.275958663 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-6s6gk" (UniqueName: "kubernetes.io/projected/88c479d6-98eb-4c89-892c-eac6ac9629d0-kube-api-access-6s6gk") pod "network-check-target-nzf92" (UID: "88c479d6-98eb-4c89-892c-eac6ac9629d0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 13:45:15.781419 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:15.781384 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nzf92" Jul 06 13:45:15.781583 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:15.781432 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkhgk" Jul 06 13:45:15.781583 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:15.781432 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w5psk" Jul 06 13:45:15.781583 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:15.781513 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nzf92" podUID="88c479d6-98eb-4c89-892c-eac6ac9629d0" Jul 06 13:45:15.781765 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:15.781636 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkhgk" podUID="d9712593-e5bd-42d1-bb8f-3e81c9c588f4" Jul 06 13:45:15.781765 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:15.781722 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w5psk" podUID="b400c7ed-fd28-44f0-802f-17b18fa21328" Jul 06 13:45:17.781096 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:17.780910 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nzf92" Jul 06 13:45:17.781096 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:17.780910 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w5psk" Jul 06 13:45:17.781096 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:17.781053 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nzf92" podUID="88c479d6-98eb-4c89-892c-eac6ac9629d0" Jul 06 13:45:17.781687 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:17.781110 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w5psk" podUID="b400c7ed-fd28-44f0-802f-17b18fa21328" Jul 06 13:45:17.781687 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:17.781144 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkhgk" Jul 06 13:45:17.781687 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:17.781225 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkhgk" podUID="d9712593-e5bd-42d1-bb8f-3e81c9c588f4" Jul 06 13:45:19.780737 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:19.780707 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkhgk" Jul 06 13:45:19.781064 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:19.780714 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w5psk" Jul 06 13:45:19.781064 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:19.780801 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkhgk" podUID="d9712593-e5bd-42d1-bb8f-3e81c9c588f4" Jul 06 13:45:19.781064 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:19.780711 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nzf92" Jul 06 13:45:19.781064 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:19.780878 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w5psk" podUID="b400c7ed-fd28-44f0-802f-17b18fa21328" Jul 06 13:45:19.781064 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:19.780934 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nzf92" podUID="88c479d6-98eb-4c89-892c-eac6ac9629d0" Jul 06 13:45:21.781273 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:21.781213 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkhgk" Jul 06 13:45:21.781273 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:21.781271 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w5psk" Jul 06 13:45:21.781788 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:21.781230 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nzf92" Jul 06 13:45:21.781788 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:21.781371 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkhgk" podUID="d9712593-e5bd-42d1-bb8f-3e81c9c588f4" Jul 06 13:45:21.781788 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:21.781464 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w5psk" podUID="b400c7ed-fd28-44f0-802f-17b18fa21328" Jul 06 13:45:21.781788 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:21.781563 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nzf92" podUID="88c479d6-98eb-4c89-892c-eac6ac9629d0" Jul 06 13:45:23.437485 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:23.437446 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b400c7ed-fd28-44f0-802f-17b18fa21328-original-pull-secret\") pod \"global-pull-secret-syncer-w5psk\" (UID: \"b400c7ed-fd28-44f0-802f-17b18fa21328\") " pod="kube-system/global-pull-secret-syncer-w5psk" Jul 06 13:45:23.437925 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:23.437506 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9712593-e5bd-42d1-bb8f-3e81c9c588f4-metrics-certs\") pod \"network-metrics-daemon-jkhgk\" (UID: \"d9712593-e5bd-42d1-bb8f-3e81c9c588f4\") " pod="openshift-multus/network-metrics-daemon-jkhgk" Jul 06 13:45:23.437925 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:23.437594 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 13:45:23.437925 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:23.437646 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 13:45:23.437925 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:23.437667 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b400c7ed-fd28-44f0-802f-17b18fa21328-original-pull-secret podName:b400c7ed-fd28-44f0-802f-17b18fa21328 nodeName:}" failed. No retries permitted until 2026-07-06 13:45:39.437652486 +0000 UTC m=+33.237398160 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b400c7ed-fd28-44f0-802f-17b18fa21328-original-pull-secret") pod "global-pull-secret-syncer-w5psk" (UID: "b400c7ed-fd28-44f0-802f-17b18fa21328") : object "kube-system"/"original-pull-secret" not registered Jul 06 13:45:23.437925 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:23.437710 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9712593-e5bd-42d1-bb8f-3e81c9c588f4-metrics-certs podName:d9712593-e5bd-42d1-bb8f-3e81c9c588f4 nodeName:}" failed. No retries permitted until 2026-07-06 13:45:39.437692011 +0000 UTC m=+33.237437893 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d9712593-e5bd-42d1-bb8f-3e81c9c588f4-metrics-certs") pod "network-metrics-daemon-jkhgk" (UID: "d9712593-e5bd-42d1-bb8f-3e81c9c588f4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 13:45:23.538306 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:23.538270 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s6gk\" (UniqueName: \"kubernetes.io/projected/88c479d6-98eb-4c89-892c-eac6ac9629d0-kube-api-access-6s6gk\") pod \"network-check-target-nzf92\" (UID: \"88c479d6-98eb-4c89-892c-eac6ac9629d0\") " pod="openshift-network-diagnostics/network-check-target-nzf92" Jul 06 13:45:23.538462 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:23.538404 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 13:45:23.538462 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:23.538426 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 13:45:23.538462 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:23.538439 2556 projected.go:196] Error preparing data for projected volume kube-api-access-6s6gk for pod openshift-network-diagnostics/network-check-target-nzf92: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 13:45:23.538582 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:23.538495 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/88c479d6-98eb-4c89-892c-eac6ac9629d0-kube-api-access-6s6gk podName:88c479d6-98eb-4c89-892c-eac6ac9629d0 nodeName:}" failed. No retries permitted until 2026-07-06 13:45:39.538476463 +0000 UTC m=+33.338222149 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-6s6gk" (UniqueName: "kubernetes.io/projected/88c479d6-98eb-4c89-892c-eac6ac9629d0-kube-api-access-6s6gk") pod "network-check-target-nzf92" (UID: "88c479d6-98eb-4c89-892c-eac6ac9629d0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 13:45:23.781563 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:23.781531 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkhgk" Jul 06 13:45:23.781563 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:23.781562 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w5psk" Jul 06 13:45:23.781768 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:23.781562 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nzf92" Jul 06 13:45:23.781768 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:23.781689 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkhgk" podUID="d9712593-e5bd-42d1-bb8f-3e81c9c588f4" Jul 06 13:45:23.781849 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:23.781779 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w5psk" podUID="b400c7ed-fd28-44f0-802f-17b18fa21328" Jul 06 13:45:23.781889 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:23.781865 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nzf92" podUID="88c479d6-98eb-4c89-892c-eac6ac9629d0" Jul 06 13:45:25.781510 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:25.781284 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w5psk" Jul 06 13:45:25.781977 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:25.781341 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nzf92" Jul 06 13:45:25.781977 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:25.781604 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w5psk" podUID="b400c7ed-fd28-44f0-802f-17b18fa21328" Jul 06 13:45:25.781977 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:25.781727 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nzf92" podUID="88c479d6-98eb-4c89-892c-eac6ac9629d0" Jul 06 13:45:25.781977 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:25.781360 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkhgk" Jul 06 13:45:25.781977 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:25.781814 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkhgk" podUID="d9712593-e5bd-42d1-bb8f-3e81c9c588f4" Jul 06 13:45:27.781492 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:27.781457 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkhgk" Jul 06 13:45:27.781988 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:27.781470 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nzf92" Jul 06 13:45:27.781988 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:27.781600 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w5psk" Jul 06 13:45:27.781988 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:27.781580 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkhgk" podUID="d9712593-e5bd-42d1-bb8f-3e81c9c588f4" Jul 06 13:45:27.781988 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:27.781706 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nzf92" podUID="88c479d6-98eb-4c89-892c-eac6ac9629d0" Jul 06 13:45:27.781988 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:27.781763 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w5psk" podUID="b400c7ed-fd28-44f0-802f-17b18fa21328" Jul 06 13:45:28.891173 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:28.891121 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dp8pp" event={"ID":"ec186ecf-a1ec-4c1f-a529-f5c101d3e604","Type":"ContainerStarted","Data":"0cca415d1c382d271bfcb4710a4f9498e36b9a8c49cf478c49a5cd85419fefbb"} Jul 06 13:45:28.896879 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:28.896442 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-85.ec2.internal" event={"ID":"918473a18bd382b5ab12df4cdc26e303","Type":"ContainerStarted","Data":"f3219ad356c35863f793972c6823c17fe73d59e19888a709d6a01b842d50a76c"} Jul 06 13:45:28.913359 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:28.913303 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dp8pp" podStartSLOduration=1.528585307 podStartE2EDuration="21.913267272s" totalImagesPullingTime="20.384681965s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:45:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:45:28.913217585 +0000 UTC m=+22.712963323" watchObservedRunningTime="2026-07-06 13:45:28.913267272 +0000 UTC m=+22.713012962" Jul 06 13:45:28.927116 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:28.927077 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-85.ec2.internal" podStartSLOduration=21.927063271 podStartE2EDuration="21.927063271s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:45:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:45:28.926628724 +0000 UTC m=+22.726374410" watchObservedRunningTime="2026-07-06 13:45:28.927063271 +0000 UTC m=+22.726808963" Jul 06 13:45:29.781097 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:29.780928 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w5psk" Jul 06 13:45:29.781202 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:29.780943 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkhgk" Jul 06 13:45:29.781202 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:29.781177 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w5psk" podUID="b400c7ed-fd28-44f0-802f-17b18fa21328" Jul 06 13:45:29.781276 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:29.780982 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nzf92" Jul 06 13:45:29.781357 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:29.781256 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkhgk" podUID="d9712593-e5bd-42d1-bb8f-3e81c9c588f4" Jul 06 13:45:29.781410 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:29.781372 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nzf92" podUID="88c479d6-98eb-4c89-892c-eac6ac9629d0" Jul 06 13:45:29.899948 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:29.899760 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnbsk" event={"ID":"163581f7-7372-4f70-be9b-5a2aabaac5ed","Type":"ContainerStarted","Data":"d9ce81ba2c90bb6224122405c5ee0dab02bdea2a0f67568420d8ce5a5e795eea"} Jul 06 13:45:29.901244 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:29.901223 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-266zj" event={"ID":"2f4f1d96-1e31-4efd-8569-e719707555e7","Type":"ContainerStarted","Data":"c9f263510f58c48757c93e28aec1afe07737a6d6af438d527e4b4b9b1ea90900"} Jul 06 13:45:29.902735 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:29.902713 2556 generic.go:356] "Generic (PLEG): container finished" podID="6d4feb6891ad8edcfe276a6edcabbad7" containerID="44d845ba6943ff87ecf9be5af0b7a4df2d7f72f7c6b9d37780c881fed769196e" exitCode=0 Jul 06 13:45:29.902831 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:29.902791 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-85.ec2.internal" event={"ID":"6d4feb6891ad8edcfe276a6edcabbad7","Type":"ContainerDied","Data":"44d845ba6943ff87ecf9be5af0b7a4df2d7f72f7c6b9d37780c881fed769196e"} Jul 06 13:45:29.904099 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:29.904081 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wmfs6" event={"ID":"73be228a-e09a-4ef2-9df5-b3ef9a8324fc","Type":"ContainerStarted","Data":"cadcfbb2c42f21be7a197fe2e2266fa51b6cc5736260dc3d50681b9fb73d20da"} Jul 06 13:45:29.906991 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:29.906970 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" event={"ID":"52c0b86f-6d49-489b-ae17-4167edbc66d8","Type":"ContainerStarted","Data":"31f08537ab38c86fd9a91eea2e15b54ee06502c9be6768e3841906fabf56bfbc"} Jul 06 13:45:29.907082 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:29.907044 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" event={"ID":"52c0b86f-6d49-489b-ae17-4167edbc66d8","Type":"ContainerStarted","Data":"c16a3a50ddd6b73c915e359e0cd3d0328dbe71e445aeb49937dbe694818acf12"} Jul 06 13:45:29.907143 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:29.907096 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" event={"ID":"52c0b86f-6d49-489b-ae17-4167edbc66d8","Type":"ContainerStarted","Data":"5a6d71c7789742449d2f11f27b3f2551a8eb173ab7094cdc7e11b9b26978edfc"} Jul 06 13:45:29.907199 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:29.907145 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" event={"ID":"52c0b86f-6d49-489b-ae17-4167edbc66d8","Type":"ContainerStarted","Data":"22bf14e2083e1dff59457e47a34c82a4c3ca68e41aee9769b35b87353773f9a7"} Jul 06 13:45:29.907199 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:29.907191 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" event={"ID":"52c0b86f-6d49-489b-ae17-4167edbc66d8","Type":"ContainerStarted","Data":"ee2709bb6c9c6060bc450024e10eca125643b9298202d54ab3b17e82837b40bc"} Jul 06 13:45:29.907298 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:29.907239 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" event={"ID":"52c0b86f-6d49-489b-ae17-4167edbc66d8","Type":"ContainerStarted","Data":"bdfadf7edd2e44da360f1cd29a720f0276aaed6c3a939dbcb7ade0231cd75f31"} Jul 06 13:45:29.908700 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:29.908646 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-b8v6z" event={"ID":"32c4c811-3283-4b48-85ea-1ace503aa644","Type":"ContainerStarted","Data":"a83ce08b8e6893e457c71fa45b780e6b3f650bc3b53fbc19c5b62acd0bddaa35"} Jul 06 13:45:29.910272 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:29.910177 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jpdcl" event={"ID":"d9c6489d-fe7d-4af6-a03d-04488b5a20ac","Type":"ContainerStarted","Data":"25a7f49f77517f232ebd4e897516fb4f2f5c15a15f9970efeb2d60ef18647b45"} Jul 06 13:45:29.911805 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:29.911748 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6krtq" event={"ID":"108cc216-aac3-41b5-b7c2-45d33ed8eef7","Type":"ContainerStarted","Data":"785f47e9d5ff6f19fae189674f12b14a162d9acfcfeda390e27b272a174239d0"} Jul 06 13:45:29.943968 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:29.943917 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-266zj" podStartSLOduration=2.378220459 podStartE2EDuration="22.943899903s" totalImagesPullingTime="20.565679444s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:45:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:45:29.918386224 +0000 UTC m=+23.718131918" watchObservedRunningTime="2026-07-06 13:45:29.943899903 +0000 UTC m=+23.743645597" Jul 06 13:45:29.959503 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:29.959415 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-jpdcl" podStartSLOduration=2.547983981 podStartE2EDuration="22.959398178s" totalImagesPullingTime="20.411414197s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:45:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:45:29.959214574 +0000 UTC m=+23.758960264" watchObservedRunningTime="2026-07-06 13:45:29.959398178 +0000 UTC m=+23.759143871" Jul 06 13:45:29.978711 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:29.978674 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-b8v6z" podStartSLOduration=2.6099077040000003 podStartE2EDuration="22.978657306s" totalImagesPullingTime="20.368749602s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:45:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:45:29.978537988 +0000 UTC m=+23.778283681" watchObservedRunningTime="2026-07-06 13:45:29.978657306 +0000 UTC m=+23.778403000" Jul 06 13:45:30.005976 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:30.005901 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wmfs6" podStartSLOduration=2.713462468 podStartE2EDuration="23.005889739s" totalImagesPullingTime="20.292427271s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:45:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:45:30.005856241 +0000 UTC m=+23.805601924" watchObservedRunningTime="2026-07-06 13:45:30.005889739 +0000 UTC m=+23.805635414" Jul 06 13:45:30.915850 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:30.915818 2556 generic.go:356] "Generic (PLEG): container finished" podID="108cc216-aac3-41b5-b7c2-45d33ed8eef7" containerID="785f47e9d5ff6f19fae189674f12b14a162d9acfcfeda390e27b272a174239d0" exitCode=0 Jul 06 13:45:30.916238 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:30.915920 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6krtq" event={"ID":"108cc216-aac3-41b5-b7c2-45d33ed8eef7","Type":"ContainerDied","Data":"785f47e9d5ff6f19fae189674f12b14a162d9acfcfeda390e27b272a174239d0"} Jul 06 13:45:30.918076 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:30.918053 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-85.ec2.internal" event={"ID":"6d4feb6891ad8edcfe276a6edcabbad7","Type":"ContainerStarted","Data":"c674d1388ca26d4725edc0cfec0410fd561ef11a863560e3bb449d55c3b0c8dc"} Jul 06 13:45:30.919655 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:30.919629 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rzflg" event={"ID":"b1c8c2d7-c914-4438-b4f4-80142ffc45c3","Type":"ContainerStarted","Data":"204117e73b7501b528b5804b9de6f201c869e2bec7677c6a810b9fffeaf19ff6"} Jul 06 13:45:30.954072 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:30.954032 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rzflg" podStartSLOduration=3.326575421 podStartE2EDuration="23.954017984s" totalImagesPullingTime="20.627442563s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:45:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:45:30.953680124 +0000 UTC m=+24.753425817" watchObservedRunningTime="2026-07-06 13:45:30.954017984 +0000 UTC m=+24.753763677" Jul 06 13:45:30.969216 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:30.969057 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-85.ec2.internal" podStartSLOduration=23.969045479000002 podStartE2EDuration="23.969045479s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:45:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:45:30.968671866 +0000 UTC m=+24.768417553" watchObservedRunningTime="2026-07-06 13:45:30.969045479 +0000 UTC m=+24.768791171" Jul 06 13:45:31.017729 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:31.017701 2556 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 06 13:45:31.301747 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:31.301724 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-266zj" Jul 06 13:45:31.589563 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:31.589493 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-266zj" Jul 06 13:45:31.589974 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:31.589961 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-266zj" Jul 06 13:45:31.663924 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:31.663853 2556 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T13:45:31.017724911Z","UUID":"378fb244-b8ce-47df-863b-58b9d4604c42","Handler":null,"Name":"","Endpoint":""} Jul 06 13:45:31.665181 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:31.665165 2556 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 06 13:45:31.665275 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:31.665193 2556 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 06 13:45:31.781340 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:31.781308 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w5psk" Jul 06 13:45:31.781340 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:31.781341 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkhgk" Jul 06 13:45:31.781595 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:31.781501 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nzf92" Jul 06 13:45:31.781595 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:31.781466 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w5psk" podUID="b400c7ed-fd28-44f0-802f-17b18fa21328" Jul 06 13:45:31.781716 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:31.781607 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nzf92" podUID="88c479d6-98eb-4c89-892c-eac6ac9629d0" Jul 06 13:45:31.781760 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:31.781720 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkhgk" podUID="d9712593-e5bd-42d1-bb8f-3e81c9c588f4" Jul 06 13:45:31.925408 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:31.925326 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnbsk" event={"ID":"163581f7-7372-4f70-be9b-5a2aabaac5ed","Type":"ContainerStarted","Data":"dfe6da2a192aff1a0725a44771f1dc4aa58397bd447ba28c9f667f9a7a382fa3"} Jul 06 13:45:31.929638 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:31.929592 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" event={"ID":"52c0b86f-6d49-489b-ae17-4167edbc66d8","Type":"ContainerStarted","Data":"bd8590b26dde22ff26495c28f2979d96746de48ddfe5c98e75a6f00847fd5f23"} Jul 06 13:45:31.930686 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:31.930664 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-266zj" Jul 06 13:45:32.934215 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:32.934181 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnbsk" event={"ID":"163581f7-7372-4f70-be9b-5a2aabaac5ed","Type":"ContainerStarted","Data":"143299140e9baf673d27b0337237be42a5a878f6b7d29b84bb2b23ff5d052e21"} Jul 06 13:45:33.781222 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:33.781053 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nzf92" Jul 06 13:45:33.781350 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:33.781056 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w5psk" Jul 06 13:45:33.781350 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:33.781306 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nzf92" podUID="88c479d6-98eb-4c89-892c-eac6ac9629d0" Jul 06 13:45:33.781534 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:33.781386 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w5psk" podUID="b400c7ed-fd28-44f0-802f-17b18fa21328" Jul 06 13:45:33.781534 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:33.781073 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkhgk" Jul 06 13:45:33.781534 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:33.781492 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkhgk" podUID="d9712593-e5bd-42d1-bb8f-3e81c9c588f4" Jul 06 13:45:33.940858 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:33.940826 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" event={"ID":"52c0b86f-6d49-489b-ae17-4167edbc66d8","Type":"ContainerStarted","Data":"a961ee18aa157b739db6e75a0dc67c4c365868b2ea999f1eddd659505c399449"} Jul 06 13:45:33.976387 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:33.976337 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" podStartSLOduration=6.435256518 podStartE2EDuration="26.976323206s" totalImagesPullingTime="20.541066688s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:45:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:45:33.976320113 +0000 UTC m=+27.776065805" watchObservedRunningTime="2026-07-06 13:45:33.976323206 +0000 UTC m=+27.776068899" Jul 06 13:45:33.976814 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:33.976784 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnbsk" podStartSLOduration=4.265344909 podStartE2EDuration="26.976776813s" totalImagesPullingTime="22.711431904s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:45:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:45:32.953630223 +0000 UTC m=+26.753375916" watchObservedRunningTime="2026-07-06 13:45:33.976776813 +0000 UTC m=+27.776522520" Jul 06 13:45:34.943182 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:34.943015 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:45:34.943182 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:34.943113 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:45:34.943182 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:34.943162 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:45:34.959251 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:34.959224 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:45:34.959469 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:34.959446 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:45:35.781312 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:35.781130 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w5psk" Jul 06 13:45:35.781495 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:35.781130 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkhgk" Jul 06 13:45:35.781495 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:35.781409 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w5psk" podUID="b400c7ed-fd28-44f0-802f-17b18fa21328" Jul 06 13:45:35.781495 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:35.781147 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nzf92" Jul 06 13:45:35.781495 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:35.781482 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkhgk" podUID="d9712593-e5bd-42d1-bb8f-3e81c9c588f4" Jul 06 13:45:35.781737 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:35.781536 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nzf92" podUID="88c479d6-98eb-4c89-892c-eac6ac9629d0" Jul 06 13:45:35.893563 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:35.893528 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jkhgk"] Jul 06 13:45:35.896705 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:35.896601 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-w5psk"] Jul 06 13:45:35.897374 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:35.897340 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nzf92"] Jul 06 13:45:35.944469 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:35.944368 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nzf92" Jul 06 13:45:35.944469 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:35.944384 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkhgk" Jul 06 13:45:35.944469 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:35.944379 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w5psk" Jul 06 13:45:35.944965 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:35.944487 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nzf92" podUID="88c479d6-98eb-4c89-892c-eac6ac9629d0" Jul 06 13:45:35.944965 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:35.944545 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkhgk" podUID="d9712593-e5bd-42d1-bb8f-3e81c9c588f4" Jul 06 13:45:35.945060 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:35.945010 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w5psk" podUID="b400c7ed-fd28-44f0-802f-17b18fa21328" Jul 06 13:45:36.904634 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:36.904549 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:45:36.947730 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:36.947703 2556 generic.go:356] "Generic (PLEG): container finished" podID="108cc216-aac3-41b5-b7c2-45d33ed8eef7" containerID="3b6f1dfae622bcf78b459e8264416824e3557b3d8884543142f51d324a5461c7" exitCode=0 Jul 06 13:45:36.948097 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:36.947789 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6krtq" event={"ID":"108cc216-aac3-41b5-b7c2-45d33ed8eef7","Type":"ContainerDied","Data":"3b6f1dfae622bcf78b459e8264416824e3557b3d8884543142f51d324a5461c7"} Jul 06 13:45:37.051793 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:37.051762 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:45:37.781165 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:37.781129 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkhgk" Jul 06 13:45:37.781165 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:37.781151 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nzf92" Jul 06 13:45:37.781371 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:37.781151 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w5psk" Jul 06 13:45:37.781371 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:37.781273 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkhgk" podUID="d9712593-e5bd-42d1-bb8f-3e81c9c588f4" Jul 06 13:45:37.781467 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:37.781397 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nzf92" podUID="88c479d6-98eb-4c89-892c-eac6ac9629d0" Jul 06 13:45:37.781531 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:37.781488 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w5psk" podUID="b400c7ed-fd28-44f0-802f-17b18fa21328" Jul 06 13:45:38.953845 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:38.953800 2556 generic.go:356] "Generic (PLEG): container finished" podID="108cc216-aac3-41b5-b7c2-45d33ed8eef7" containerID="5b6e1256ebe53c76e0dfc9e47027e14b6dfe2bf9828eaea8d911a63b6136cbb1" exitCode=0 Jul 06 13:45:38.954205 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:38.953877 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6krtq" event={"ID":"108cc216-aac3-41b5-b7c2-45d33ed8eef7","Type":"ContainerDied","Data":"5b6e1256ebe53c76e0dfc9e47027e14b6dfe2bf9828eaea8d911a63b6136cbb1"} Jul 06 13:45:39.459673 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:39.459487 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b400c7ed-fd28-44f0-802f-17b18fa21328-original-pull-secret\") pod \"global-pull-secret-syncer-w5psk\" (UID: \"b400c7ed-fd28-44f0-802f-17b18fa21328\") " pod="kube-system/global-pull-secret-syncer-w5psk" Jul 06 13:45:39.459809 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:39.459699 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9712593-e5bd-42d1-bb8f-3e81c9c588f4-metrics-certs\") pod \"network-metrics-daemon-jkhgk\" (UID: \"d9712593-e5bd-42d1-bb8f-3e81c9c588f4\") " pod="openshift-multus/network-metrics-daemon-jkhgk" Jul 06 13:45:39.459809 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:39.459642 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 13:45:39.459809 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:39.459787 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b400c7ed-fd28-44f0-802f-17b18fa21328-original-pull-secret podName:b400c7ed-fd28-44f0-802f-17b18fa21328 nodeName:}" failed. No retries permitted until 2026-07-06 13:46:11.459773166 +0000 UTC m=+65.259518837 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b400c7ed-fd28-44f0-802f-17b18fa21328-original-pull-secret") pod "global-pull-secret-syncer-w5psk" (UID: "b400c7ed-fd28-44f0-802f-17b18fa21328") : object "kube-system"/"original-pull-secret" not registered Jul 06 13:45:39.459809 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:39.459789 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 13:45:39.459945 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:39.459828 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9712593-e5bd-42d1-bb8f-3e81c9c588f4-metrics-certs podName:d9712593-e5bd-42d1-bb8f-3e81c9c588f4 nodeName:}" failed. No retries permitted until 2026-07-06 13:46:11.459817275 +0000 UTC m=+65.259562946 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d9712593-e5bd-42d1-bb8f-3e81c9c588f4-metrics-certs") pod "network-metrics-daemon-jkhgk" (UID: "d9712593-e5bd-42d1-bb8f-3e81c9c588f4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 13:45:39.560409 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:39.560388 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s6gk\" (UniqueName: \"kubernetes.io/projected/88c479d6-98eb-4c89-892c-eac6ac9629d0-kube-api-access-6s6gk\") pod \"network-check-target-nzf92\" (UID: \"88c479d6-98eb-4c89-892c-eac6ac9629d0\") " pod="openshift-network-diagnostics/network-check-target-nzf92" Jul 06 13:45:39.560542 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:39.560527 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 13:45:39.560576 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:39.560545 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 13:45:39.560576 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:39.560555 2556 projected.go:196] Error preparing data for projected volume kube-api-access-6s6gk for pod openshift-network-diagnostics/network-check-target-nzf92: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 13:45:39.560644 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:39.560597 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/88c479d6-98eb-4c89-892c-eac6ac9629d0-kube-api-access-6s6gk podName:88c479d6-98eb-4c89-892c-eac6ac9629d0 nodeName:}" failed. No retries permitted until 2026-07-06 13:46:11.560581888 +0000 UTC m=+65.360327576 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-6s6gk" (UniqueName: "kubernetes.io/projected/88c479d6-98eb-4c89-892c-eac6ac9629d0-kube-api-access-6s6gk") pod "network-check-target-nzf92" (UID: "88c479d6-98eb-4c89-892c-eac6ac9629d0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 13:45:39.780849 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:39.780821 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w5psk" Jul 06 13:45:39.781066 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:39.780906 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nzf92" Jul 06 13:45:39.781066 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:39.780913 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w5psk" podUID="b400c7ed-fd28-44f0-802f-17b18fa21328" Jul 06 13:45:39.781066 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:39.780996 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkhgk" Jul 06 13:45:39.781182 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:39.780995 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nzf92" podUID="88c479d6-98eb-4c89-892c-eac6ac9629d0" Jul 06 13:45:39.781182 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:39.781071 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkhgk" podUID="d9712593-e5bd-42d1-bb8f-3e81c9c588f4" Jul 06 13:45:39.958497 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:39.958472 2556 generic.go:356] "Generic (PLEG): container finished" podID="108cc216-aac3-41b5-b7c2-45d33ed8eef7" containerID="22a545039e271c25b7b7af3db02b9f917077935c23cfe68121459da8d05ffb95" exitCode=0 Jul 06 13:45:39.958497 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:39.958508 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6krtq" event={"ID":"108cc216-aac3-41b5-b7c2-45d33ed8eef7","Type":"ContainerDied","Data":"22a545039e271c25b7b7af3db02b9f917077935c23cfe68121459da8d05ffb95"} Jul 06 13:45:40.893220 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:40.893176 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:45:40.959956 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:40.959924 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:45:41.024973 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:41.024939 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:45:41.113132 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:41.113099 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:45:41.484302 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:41.484279 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-85.ec2.internal" event="NodeReady" Jul 06 13:45:41.484448 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:41.484417 2556 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 06 13:45:41.528732 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:41.528705 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-zz5qt"] Jul 06 13:45:41.530825 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:41.530802 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zz5qt" Jul 06 13:45:41.531445 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:41.531422 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-crrkc"] Jul 06 13:45:41.533175 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:41.533157 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-crrkc" Jul 06 13:45:41.534045 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:41.533969 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 06 13:45:41.534136 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:41.534051 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5h29s\"" Jul 06 13:45:41.534272 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:41.534257 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 06 13:45:41.535707 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:41.535686 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 06 13:45:41.535847 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:41.535827 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-w8qbs\"" Jul 06 13:45:41.535957 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:41.535924 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 06 13:45:41.536060 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:41.536044 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 06 13:45:41.542080 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:41.541996 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zz5qt"] Jul 06 13:45:41.545248 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:41.545170 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-crrkc"] Jul 06 13:45:41.676176 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:41.676151 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/39f1f56d-ff91-4983-b7b1-602a2bf245d8-metrics-tls\") pod \"dns-default-zz5qt\" (UID: \"39f1f56d-ff91-4983-b7b1-602a2bf245d8\") " pod="openshift-dns/dns-default-zz5qt" Jul 06 13:45:41.676322 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:41.676188 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xz7kv\" (UniqueName: \"kubernetes.io/projected/f145985c-f05e-41c0-9f44-b6c230aa961c-kube-api-access-xz7kv\") pod \"ingress-canary-crrkc\" (UID: \"f145985c-f05e-41c0-9f44-b6c230aa961c\") " pod="openshift-ingress-canary/ingress-canary-crrkc" Jul 06 13:45:41.676322 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:41.676226 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39f1f56d-ff91-4983-b7b1-602a2bf245d8-tmp-dir\") pod \"dns-default-zz5qt\" (UID: \"39f1f56d-ff91-4983-b7b1-602a2bf245d8\") " pod="openshift-dns/dns-default-zz5qt" Jul 06 13:45:41.676322 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:41.676302 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/39f1f56d-ff91-4983-b7b1-602a2bf245d8-config-volume\") pod \"dns-default-zz5qt\" (UID: \"39f1f56d-ff91-4983-b7b1-602a2bf245d8\") " pod="openshift-dns/dns-default-zz5qt" Jul 06 13:45:41.676506 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:41.676339 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfz7p\" (UniqueName: \"kubernetes.io/projected/39f1f56d-ff91-4983-b7b1-602a2bf245d8-kube-api-access-vfz7p\") pod \"dns-default-zz5qt\" (UID: \"39f1f56d-ff91-4983-b7b1-602a2bf245d8\") " pod="openshift-dns/dns-default-zz5qt" Jul 06 13:45:41.676506 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:41.676362 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f145985c-f05e-41c0-9f44-b6c230aa961c-cert\") pod \"ingress-canary-crrkc\" (UID: \"f145985c-f05e-41c0-9f44-b6c230aa961c\") " pod="openshift-ingress-canary/ingress-canary-crrkc" Jul 06 13:45:41.777431 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:41.777405 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xz7kv\" (UniqueName: \"kubernetes.io/projected/f145985c-f05e-41c0-9f44-b6c230aa961c-kube-api-access-xz7kv\") pod \"ingress-canary-crrkc\" (UID: \"f145985c-f05e-41c0-9f44-b6c230aa961c\") " pod="openshift-ingress-canary/ingress-canary-crrkc" Jul 06 13:45:41.777547 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:41.777443 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39f1f56d-ff91-4983-b7b1-602a2bf245d8-tmp-dir\") pod \"dns-default-zz5qt\" (UID: \"39f1f56d-ff91-4983-b7b1-602a2bf245d8\") " pod="openshift-dns/dns-default-zz5qt" Jul 06 13:45:41.777547 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:41.777474 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/39f1f56d-ff91-4983-b7b1-602a2bf245d8-config-volume\") pod \"dns-default-zz5qt\" (UID: \"39f1f56d-ff91-4983-b7b1-602a2bf245d8\") " pod="openshift-dns/dns-default-zz5qt" Jul 06 13:45:41.777547 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:41.777505 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfz7p\" (UniqueName: \"kubernetes.io/projected/39f1f56d-ff91-4983-b7b1-602a2bf245d8-kube-api-access-vfz7p\") pod \"dns-default-zz5qt\" (UID: \"39f1f56d-ff91-4983-b7b1-602a2bf245d8\") " pod="openshift-dns/dns-default-zz5qt" Jul 06 13:45:41.777547 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:41.777528 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f145985c-f05e-41c0-9f44-b6c230aa961c-cert\") pod \"ingress-canary-crrkc\" (UID: \"f145985c-f05e-41c0-9f44-b6c230aa961c\") " pod="openshift-ingress-canary/ingress-canary-crrkc" Jul 06 13:45:41.777751 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:41.777581 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/39f1f56d-ff91-4983-b7b1-602a2bf245d8-metrics-tls\") pod \"dns-default-zz5qt\" (UID: \"39f1f56d-ff91-4983-b7b1-602a2bf245d8\") " pod="openshift-dns/dns-default-zz5qt" Jul 06 13:45:41.777751 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:41.777696 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 13:45:41.777823 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:41.777757 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39f1f56d-ff91-4983-b7b1-602a2bf245d8-metrics-tls podName:39f1f56d-ff91-4983-b7b1-602a2bf245d8 nodeName:}" failed. No retries permitted until 2026-07-06 13:45:42.277738188 +0000 UTC m=+36.077483861 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/39f1f56d-ff91-4983-b7b1-602a2bf245d8-metrics-tls") pod "dns-default-zz5qt" (UID: "39f1f56d-ff91-4983-b7b1-602a2bf245d8") : secret "dns-default-metrics-tls" not found Jul 06 13:45:41.777873 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:41.777839 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39f1f56d-ff91-4983-b7b1-602a2bf245d8-tmp-dir\") pod \"dns-default-zz5qt\" (UID: \"39f1f56d-ff91-4983-b7b1-602a2bf245d8\") " pod="openshift-dns/dns-default-zz5qt" Jul 06 13:45:41.778116 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:41.778100 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/39f1f56d-ff91-4983-b7b1-602a2bf245d8-config-volume\") pod \"dns-default-zz5qt\" (UID: \"39f1f56d-ff91-4983-b7b1-602a2bf245d8\") " pod="openshift-dns/dns-default-zz5qt" Jul 06 13:45:41.781365 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:41.781341 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkhgk" Jul 06 13:45:41.781464 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:41.781435 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w5psk" Jul 06 13:45:41.781650 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:41.781603 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nzf92" Jul 06 13:45:41.781739 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:41.781696 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f145985c-f05e-41c0-9f44-b6c230aa961c-cert\") pod \"ingress-canary-crrkc\" (UID: \"f145985c-f05e-41c0-9f44-b6c230aa961c\") " pod="openshift-ingress-canary/ingress-canary-crrkc" Jul 06 13:45:41.784344 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:41.784326 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 13:45:41.784859 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:41.784842 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 13:45:41.785702 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:41.785677 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 13:45:41.785962 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:41.785916 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 13:45:41.786058 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:41.785969 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jdk7g\"" Jul 06 13:45:41.786058 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:41.786043 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ztx5l\"" Jul 06 13:45:41.787995 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:41.787973 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfz7p\" (UniqueName: \"kubernetes.io/projected/39f1f56d-ff91-4983-b7b1-602a2bf245d8-kube-api-access-vfz7p\") pod \"dns-default-zz5qt\" (UID: \"39f1f56d-ff91-4983-b7b1-602a2bf245d8\") " pod="openshift-dns/dns-default-zz5qt" Jul 06 13:45:41.788545 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:41.788523 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xz7kv\" (UniqueName: \"kubernetes.io/projected/f145985c-f05e-41c0-9f44-b6c230aa961c-kube-api-access-xz7kv\") pod \"ingress-canary-crrkc\" (UID: \"f145985c-f05e-41c0-9f44-b6c230aa961c\") " pod="openshift-ingress-canary/ingress-canary-crrkc" Jul 06 13:45:41.849796 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:41.849772 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-crrkc" Jul 06 13:45:42.009097 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:42.009068 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-crrkc"] Jul 06 13:45:42.013073 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:45:42.013049 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf145985c_f05e_41c0_9f44_b6c230aa961c.slice/crio-b92c75564b51651083c9ee164a85f9d94ff00039be143cdb9ed7e5ec1b16a1aa WatchSource:0}: Error finding container b92c75564b51651083c9ee164a85f9d94ff00039be143cdb9ed7e5ec1b16a1aa: Status 404 returned error can't find the container with id b92c75564b51651083c9ee164a85f9d94ff00039be143cdb9ed7e5ec1b16a1aa Jul 06 13:45:42.163087 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:42.162995 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:45:42.218292 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:42.218266 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:45:42.281394 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:42.281356 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/39f1f56d-ff91-4983-b7b1-602a2bf245d8-metrics-tls\") pod \"dns-default-zz5qt\" (UID: \"39f1f56d-ff91-4983-b7b1-602a2bf245d8\") " pod="openshift-dns/dns-default-zz5qt" Jul 06 13:45:42.281543 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:42.281523 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 13:45:42.281609 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:42.281597 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39f1f56d-ff91-4983-b7b1-602a2bf245d8-metrics-tls podName:39f1f56d-ff91-4983-b7b1-602a2bf245d8 nodeName:}" failed. No retries permitted until 2026-07-06 13:45:43.281577147 +0000 UTC m=+37.081322822 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/39f1f56d-ff91-4983-b7b1-602a2bf245d8-metrics-tls") pod "dns-default-zz5qt" (UID: "39f1f56d-ff91-4983-b7b1-602a2bf245d8") : secret "dns-default-metrics-tls" not found Jul 06 13:45:42.292876 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:42.292850 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:45:42.967503 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:42.967472 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-crrkc" event={"ID":"f145985c-f05e-41c0-9f44-b6c230aa961c","Type":"ContainerStarted","Data":"b92c75564b51651083c9ee164a85f9d94ff00039be143cdb9ed7e5ec1b16a1aa"} Jul 06 13:45:43.291895 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:43.291858 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/39f1f56d-ff91-4983-b7b1-602a2bf245d8-metrics-tls\") pod \"dns-default-zz5qt\" (UID: \"39f1f56d-ff91-4983-b7b1-602a2bf245d8\") " pod="openshift-dns/dns-default-zz5qt" Jul 06 13:45:43.292278 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:43.292015 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 13:45:43.292278 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:43.292089 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39f1f56d-ff91-4983-b7b1-602a2bf245d8-metrics-tls podName:39f1f56d-ff91-4983-b7b1-602a2bf245d8 nodeName:}" failed. No retries permitted until 2026-07-06 13:45:45.292071081 +0000 UTC m=+39.091816761 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/39f1f56d-ff91-4983-b7b1-602a2bf245d8-metrics-tls") pod "dns-default-zz5qt" (UID: "39f1f56d-ff91-4983-b7b1-602a2bf245d8") : secret "dns-default-metrics-tls" not found Jul 06 13:45:44.975218 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:44.975146 2556 generic.go:356] "Generic (PLEG): container finished" podID="108cc216-aac3-41b5-b7c2-45d33ed8eef7" containerID="c2741c361999a16db46f315de1c0b850a645e0ed73a7fbf4e5d2e969c655e72b" exitCode=0 Jul 06 13:45:44.975218 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:44.975212 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6krtq" event={"ID":"108cc216-aac3-41b5-b7c2-45d33ed8eef7","Type":"ContainerDied","Data":"c2741c361999a16db46f315de1c0b850a645e0ed73a7fbf4e5d2e969c655e72b"} Jul 06 13:45:45.050257 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:45.050209 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:45:45.116756 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:45.116728 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:45:45.308799 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:45.308768 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/39f1f56d-ff91-4983-b7b1-602a2bf245d8-metrics-tls\") pod \"dns-default-zz5qt\" (UID: \"39f1f56d-ff91-4983-b7b1-602a2bf245d8\") " pod="openshift-dns/dns-default-zz5qt" Jul 06 13:45:45.308959 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:45.308902 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 13:45:45.309035 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:45.308979 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39f1f56d-ff91-4983-b7b1-602a2bf245d8-metrics-tls podName:39f1f56d-ff91-4983-b7b1-602a2bf245d8 nodeName:}" failed. No retries permitted until 2026-07-06 13:45:49.308957281 +0000 UTC m=+43.108702952 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/39f1f56d-ff91-4983-b7b1-602a2bf245d8-metrics-tls") pod "dns-default-zz5qt" (UID: "39f1f56d-ff91-4983-b7b1-602a2bf245d8") : secret "dns-default-metrics-tls" not found Jul 06 13:45:45.980916 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:45.980881 2556 generic.go:356] "Generic (PLEG): container finished" podID="108cc216-aac3-41b5-b7c2-45d33ed8eef7" containerID="28658d4d12e221413e71c6b7b546e284521d8fe11d37fb4a6da79c72f5e69dbc" exitCode=0 Jul 06 13:45:45.981432 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:45.980942 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6krtq" event={"ID":"108cc216-aac3-41b5-b7c2-45d33ed8eef7","Type":"ContainerDied","Data":"28658d4d12e221413e71c6b7b546e284521d8fe11d37fb4a6da79c72f5e69dbc"} Jul 06 13:45:46.720321 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:46.720278 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:45:46.821874 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:46.821787 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:45:46.984854 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:46.984808 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-crrkc" event={"ID":"f145985c-f05e-41c0-9f44-b6c230aa961c","Type":"ContainerStarted","Data":"0b4bf734afa005aedd799243c0e6bc24789c97aa9c4c3b6d7c3fcb09dacb93a8"} Jul 06 13:45:46.988272 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:46.988247 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6krtq" event={"ID":"108cc216-aac3-41b5-b7c2-45d33ed8eef7","Type":"ContainerStarted","Data":"efcd97f619900b527124f0d27056b95c16308b17249f5499cde4e3c2e3f058c1"} Jul 06 13:45:47.005693 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:47.005649 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-crrkc" podStartSLOduration=1.461879194 podStartE2EDuration="6.005635367s" totalImagesPullingTime="4.543756173s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:45:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:45:47.00482456 +0000 UTC m=+40.804570252" watchObservedRunningTime="2026-07-06 13:45:47.005635367 +0000 UTC m=+40.805381093" Jul 06 13:45:47.031959 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:47.031918 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-6krtq" podStartSLOduration=7.599890852 podStartE2EDuration="40.031904199s" totalImagesPullingTime="32.432013347s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:45:07 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:45:47.029685493 +0000 UTC m=+40.829431187" watchObservedRunningTime="2026-07-06 13:45:47.031904199 +0000 UTC m=+40.831649892" Jul 06 13:45:47.155938 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:47.155882 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:45:47.258972 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:47.258951 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:45:47.356096 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:47.356072 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:45:49.338254 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:49.338224 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/39f1f56d-ff91-4983-b7b1-602a2bf245d8-metrics-tls\") pod \"dns-default-zz5qt\" (UID: \"39f1f56d-ff91-4983-b7b1-602a2bf245d8\") " pod="openshift-dns/dns-default-zz5qt" Jul 06 13:45:49.338609 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:49.338348 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 13:45:49.338609 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:49.338406 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39f1f56d-ff91-4983-b7b1-602a2bf245d8-metrics-tls podName:39f1f56d-ff91-4983-b7b1-602a2bf245d8 nodeName:}" failed. No retries permitted until 2026-07-06 13:45:57.338392916 +0000 UTC m=+51.138138587 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/39f1f56d-ff91-4983-b7b1-602a2bf245d8-metrics-tls") pod "dns-default-zz5qt" (UID: "39f1f56d-ff91-4983-b7b1-602a2bf245d8") : secret "dns-default-metrics-tls" not found Jul 06 13:45:55.779018 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:55.778980 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:45:57.388025 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:45:57.387961 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/39f1f56d-ff91-4983-b7b1-602a2bf245d8-metrics-tls\") pod \"dns-default-zz5qt\" (UID: \"39f1f56d-ff91-4983-b7b1-602a2bf245d8\") " pod="openshift-dns/dns-default-zz5qt" Jul 06 13:45:57.388390 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:57.388111 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 13:45:57.388390 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:45:57.388181 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39f1f56d-ff91-4983-b7b1-602a2bf245d8-metrics-tls podName:39f1f56d-ff91-4983-b7b1-602a2bf245d8 nodeName:}" failed. No retries permitted until 2026-07-06 13:46:13.388165329 +0000 UTC m=+67.187910999 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/39f1f56d-ff91-4983-b7b1-602a2bf245d8-metrics-tls") pod "dns-default-zz5qt" (UID: "39f1f56d-ff91-4983-b7b1-602a2bf245d8") : secret "dns-default-metrics-tls" not found Jul 06 13:46:01.130926 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:01.130886 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:01.185220 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:01.185190 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:01.861668 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:01.861635 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:01.923224 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:01.923184 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:05.445463 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:05.445430 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gnsd2"] Jul 06 13:46:05.447464 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:05.447444 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gnsd2" Jul 06 13:46:05.450209 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:05.450179 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 06 13:46:05.450412 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:05.450398 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 06 13:46:05.451755 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:05.451739 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-vgk79\"" Jul 06 13:46:05.451842 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:05.451787 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 06 13:46:05.456161 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:05.456141 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 06 13:46:05.459595 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:05.459575 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gnsd2"] Jul 06 13:46:05.541694 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:05.541667 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/377826fd-f531-4a58-98a8-bc2b2e536fb7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-gnsd2\" (UID: \"377826fd-f531-4a58-98a8-bc2b2e536fb7\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gnsd2" Jul 06 13:46:05.541794 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:05.541707 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/377826fd-f531-4a58-98a8-bc2b2e536fb7-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-gnsd2\" (UID: \"377826fd-f531-4a58-98a8-bc2b2e536fb7\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gnsd2" Jul 06 13:46:05.541794 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:05.541726 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vbbm\" (UniqueName: \"kubernetes.io/projected/377826fd-f531-4a58-98a8-bc2b2e536fb7-kube-api-access-7vbbm\") pod \"cluster-monitoring-operator-64786d9cbb-gnsd2\" (UID: \"377826fd-f531-4a58-98a8-bc2b2e536fb7\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gnsd2" Jul 06 13:46:05.580676 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:05.580649 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-xg4z5"] Jul 06 13:46:05.582547 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:05.582529 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-vjl62"] Jul 06 13:46:05.582668 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:05.582652 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-xg4z5" Jul 06 13:46:05.584629 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:05.584601 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-vjl62" Jul 06 13:46:05.585610 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:05.585592 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 06 13:46:05.585808 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:05.585786 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 06 13:46:05.585904 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:05.585846 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-zpnbm\"" Jul 06 13:46:05.587071 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:05.587055 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 06 13:46:05.587169 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:05.587058 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 06 13:46:05.587437 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:05.587409 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-s9z6g\"" Jul 06 13:46:05.587679 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:05.587664 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 06 13:46:05.587757 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:05.587714 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 06 13:46:05.594023 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:05.594004 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 06 13:46:05.595424 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:05.595404 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-xg4z5"] Jul 06 13:46:05.596299 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:05.596272 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-vjl62"] Jul 06 13:46:05.612943 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:05.612899 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:05.642378 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:05.642352 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/377826fd-f531-4a58-98a8-bc2b2e536fb7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-gnsd2\" (UID: \"377826fd-f531-4a58-98a8-bc2b2e536fb7\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gnsd2" Jul 06 13:46:05.642474 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:05.642398 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/377826fd-f531-4a58-98a8-bc2b2e536fb7-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-gnsd2\" (UID: \"377826fd-f531-4a58-98a8-bc2b2e536fb7\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gnsd2" Jul 06 13:46:05.642474 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:05.642425 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vbbm\" (UniqueName: \"kubernetes.io/projected/377826fd-f531-4a58-98a8-bc2b2e536fb7-kube-api-access-7vbbm\") pod \"cluster-monitoring-operator-64786d9cbb-gnsd2\" (UID: \"377826fd-f531-4a58-98a8-bc2b2e536fb7\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gnsd2" Jul 06 13:46:05.642474 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:05.642455 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85hrz\" (UniqueName: \"kubernetes.io/projected/0cba18f9-762c-4a58-8b34-66a661b7094b-kube-api-access-85hrz\") pod \"volume-data-source-validator-5d456fdbcd-xg4z5\" (UID: \"0cba18f9-762c-4a58-8b34-66a661b7094b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-xg4z5" Jul 06 13:46:05.642607 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:46:05.642486 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 13:46:05.642607 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:05.642514 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2q44\" (UniqueName: \"kubernetes.io/projected/b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7-kube-api-access-r2q44\") pod \"console-operator-68b757fb67-vjl62\" (UID: \"b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7\") " pod="openshift-console-operator/console-operator-68b757fb67-vjl62" Jul 06 13:46:05.642607 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:46:05.642557 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/377826fd-f531-4a58-98a8-bc2b2e536fb7-cluster-monitoring-operator-tls podName:377826fd-f531-4a58-98a8-bc2b2e536fb7 nodeName:}" failed. No retries permitted until 2026-07-06 13:46:06.142537164 +0000 UTC m=+59.942282852 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/377826fd-f531-4a58-98a8-bc2b2e536fb7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-gnsd2" (UID: "377826fd-f531-4a58-98a8-bc2b2e536fb7") : secret "cluster-monitoring-operator-tls" not found Jul 06 13:46:05.642607 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:05.642579 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7-serving-cert\") pod \"console-operator-68b757fb67-vjl62\" (UID: \"b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7\") " pod="openshift-console-operator/console-operator-68b757fb67-vjl62" Jul 06 13:46:05.642789 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:05.642612 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7-trusted-ca\") pod \"console-operator-68b757fb67-vjl62\" (UID: \"b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7\") " pod="openshift-console-operator/console-operator-68b757fb67-vjl62" Jul 06 13:46:05.642789 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:05.642706 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7-config\") pod \"console-operator-68b757fb67-vjl62\" (UID: \"b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7\") " pod="openshift-console-operator/console-operator-68b757fb67-vjl62" Jul 06 13:46:05.643073 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:05.643057 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/377826fd-f531-4a58-98a8-bc2b2e536fb7-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-gnsd2\" (UID: \"377826fd-f531-4a58-98a8-bc2b2e536fb7\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gnsd2" Jul 06 13:46:05.656359 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:05.656333 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vbbm\" (UniqueName: \"kubernetes.io/projected/377826fd-f531-4a58-98a8-bc2b2e536fb7-kube-api-access-7vbbm\") pod \"cluster-monitoring-operator-64786d9cbb-gnsd2\" (UID: \"377826fd-f531-4a58-98a8-bc2b2e536fb7\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gnsd2" Jul 06 13:46:05.667954 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:05.667928 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:05.743314 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:05.743286 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85hrz\" (UniqueName: \"kubernetes.io/projected/0cba18f9-762c-4a58-8b34-66a661b7094b-kube-api-access-85hrz\") pod \"volume-data-source-validator-5d456fdbcd-xg4z5\" (UID: \"0cba18f9-762c-4a58-8b34-66a661b7094b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-xg4z5" Jul 06 13:46:05.743398 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:05.743336 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2q44\" (UniqueName: \"kubernetes.io/projected/b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7-kube-api-access-r2q44\") pod \"console-operator-68b757fb67-vjl62\" (UID: \"b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7\") " pod="openshift-console-operator/console-operator-68b757fb67-vjl62" Jul 06 13:46:05.743398 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:05.743355 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7-serving-cert\") pod \"console-operator-68b757fb67-vjl62\" (UID: \"b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7\") " pod="openshift-console-operator/console-operator-68b757fb67-vjl62" Jul 06 13:46:05.743398 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:05.743370 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7-trusted-ca\") pod \"console-operator-68b757fb67-vjl62\" (UID: \"b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7\") " pod="openshift-console-operator/console-operator-68b757fb67-vjl62" Jul 06 13:46:05.743398 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:05.743397 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7-config\") pod \"console-operator-68b757fb67-vjl62\" (UID: \"b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7\") " pod="openshift-console-operator/console-operator-68b757fb67-vjl62" Jul 06 13:46:05.743959 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:05.743940 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7-config\") pod \"console-operator-68b757fb67-vjl62\" (UID: \"b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7\") " pod="openshift-console-operator/console-operator-68b757fb67-vjl62" Jul 06 13:46:05.744136 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:05.744119 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7-trusted-ca\") pod \"console-operator-68b757fb67-vjl62\" (UID: \"b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7\") " pod="openshift-console-operator/console-operator-68b757fb67-vjl62" Jul 06 13:46:05.745556 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:05.745525 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7-serving-cert\") pod \"console-operator-68b757fb67-vjl62\" (UID: \"b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7\") " pod="openshift-console-operator/console-operator-68b757fb67-vjl62" Jul 06 13:46:05.751862 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:05.751841 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85hrz\" (UniqueName: \"kubernetes.io/projected/0cba18f9-762c-4a58-8b34-66a661b7094b-kube-api-access-85hrz\") pod \"volume-data-source-validator-5d456fdbcd-xg4z5\" (UID: \"0cba18f9-762c-4a58-8b34-66a661b7094b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-xg4z5" Jul 06 13:46:05.751966 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:05.751950 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2q44\" (UniqueName: \"kubernetes.io/projected/b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7-kube-api-access-r2q44\") pod \"console-operator-68b757fb67-vjl62\" (UID: \"b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7\") " pod="openshift-console-operator/console-operator-68b757fb67-vjl62" Jul 06 13:46:05.892222 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:05.892196 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-xg4z5" Jul 06 13:46:05.898654 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:05.898634 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-vjl62" Jul 06 13:46:06.018812 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:06.018734 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-xg4z5"] Jul 06 13:46:06.041703 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:06.036026 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-vjl62"] Jul 06 13:46:06.043529 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:46:06.043485 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cba18f9_762c_4a58_8b34_66a661b7094b.slice/crio-84998821675a0b97508d5f3c434ed3cef7e1398d782b2ca285716f5871ff2d66 WatchSource:0}: Error finding container 84998821675a0b97508d5f3c434ed3cef7e1398d782b2ca285716f5871ff2d66: Status 404 returned error can't find the container with id 84998821675a0b97508d5f3c434ed3cef7e1398d782b2ca285716f5871ff2d66 Jul 06 13:46:06.045811 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:46:06.045769 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2d4f8d0_dee7_4ceb_bd7e_691ebe8021e7.slice/crio-f94188c29f7800a2d3077f5e3247c25269710c229834e878337ee03d3043c1d9 WatchSource:0}: Error finding container f94188c29f7800a2d3077f5e3247c25269710c229834e878337ee03d3043c1d9: Status 404 returned error can't find the container with id f94188c29f7800a2d3077f5e3247c25269710c229834e878337ee03d3043c1d9 Jul 06 13:46:06.069219 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:06.069199 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-78d6c765fd-ljq5m"] Jul 06 13:46:06.071918 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:06.071904 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78d6c765fd-ljq5m" Jul 06 13:46:06.074641 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:06.074607 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 06 13:46:06.074832 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:06.074814 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 06 13:46:06.074902 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:06.074873 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-htv6h\"" Jul 06 13:46:06.074902 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:06.074890 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 06 13:46:06.083644 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:06.082904 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 06 13:46:06.085721 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:06.085696 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-78d6c765fd-ljq5m"] Jul 06 13:46:06.145826 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:06.145799 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/75c808a3-93be-4ff2-b136-d93a0cf085ff-image-registry-private-configuration\") pod \"image-registry-78d6c765fd-ljq5m\" (UID: \"75c808a3-93be-4ff2-b136-d93a0cf085ff\") " pod="openshift-image-registry/image-registry-78d6c765fd-ljq5m" Jul 06 13:46:06.145949 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:06.145829 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/75c808a3-93be-4ff2-b136-d93a0cf085ff-registry-certificates\") pod \"image-registry-78d6c765fd-ljq5m\" (UID: \"75c808a3-93be-4ff2-b136-d93a0cf085ff\") " pod="openshift-image-registry/image-registry-78d6c765fd-ljq5m" Jul 06 13:46:06.145949 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:06.145850 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/75c808a3-93be-4ff2-b136-d93a0cf085ff-trusted-ca\") pod \"image-registry-78d6c765fd-ljq5m\" (UID: \"75c808a3-93be-4ff2-b136-d93a0cf085ff\") " pod="openshift-image-registry/image-registry-78d6c765fd-ljq5m" Jul 06 13:46:06.145949 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:06.145874 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbtp2\" (UniqueName: \"kubernetes.io/projected/75c808a3-93be-4ff2-b136-d93a0cf085ff-kube-api-access-cbtp2\") pod \"image-registry-78d6c765fd-ljq5m\" (UID: \"75c808a3-93be-4ff2-b136-d93a0cf085ff\") " pod="openshift-image-registry/image-registry-78d6c765fd-ljq5m" Jul 06 13:46:06.146113 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:06.145945 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/75c808a3-93be-4ff2-b136-d93a0cf085ff-ca-trust-extracted\") pod \"image-registry-78d6c765fd-ljq5m\" (UID: \"75c808a3-93be-4ff2-b136-d93a0cf085ff\") " pod="openshift-image-registry/image-registry-78d6c765fd-ljq5m" Jul 06 13:46:06.146113 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:06.145979 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/75c808a3-93be-4ff2-b136-d93a0cf085ff-installation-pull-secrets\") pod \"image-registry-78d6c765fd-ljq5m\" (UID: \"75c808a3-93be-4ff2-b136-d93a0cf085ff\") " pod="openshift-image-registry/image-registry-78d6c765fd-ljq5m" Jul 06 13:46:06.146113 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:06.146032 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/377826fd-f531-4a58-98a8-bc2b2e536fb7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-gnsd2\" (UID: \"377826fd-f531-4a58-98a8-bc2b2e536fb7\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gnsd2" Jul 06 13:46:06.146113 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:06.146083 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/75c808a3-93be-4ff2-b136-d93a0cf085ff-registry-tls\") pod \"image-registry-78d6c765fd-ljq5m\" (UID: \"75c808a3-93be-4ff2-b136-d93a0cf085ff\") " pod="openshift-image-registry/image-registry-78d6c765fd-ljq5m" Jul 06 13:46:06.146113 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:06.146104 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/75c808a3-93be-4ff2-b136-d93a0cf085ff-bound-sa-token\") pod \"image-registry-78d6c765fd-ljq5m\" (UID: \"75c808a3-93be-4ff2-b136-d93a0cf085ff\") " pod="openshift-image-registry/image-registry-78d6c765fd-ljq5m" Jul 06 13:46:06.146282 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:46:06.146132 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 13:46:06.146282 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:46:06.146198 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/377826fd-f531-4a58-98a8-bc2b2e536fb7-cluster-monitoring-operator-tls podName:377826fd-f531-4a58-98a8-bc2b2e536fb7 nodeName:}" failed. No retries permitted until 2026-07-06 13:46:07.146183994 +0000 UTC m=+60.945929664 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/377826fd-f531-4a58-98a8-bc2b2e536fb7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-gnsd2" (UID: "377826fd-f531-4a58-98a8-bc2b2e536fb7") : secret "cluster-monitoring-operator-tls" not found Jul 06 13:46:06.246918 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:06.246896 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/75c808a3-93be-4ff2-b136-d93a0cf085ff-trusted-ca\") pod \"image-registry-78d6c765fd-ljq5m\" (UID: \"75c808a3-93be-4ff2-b136-d93a0cf085ff\") " pod="openshift-image-registry/image-registry-78d6c765fd-ljq5m" Jul 06 13:46:06.247038 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:06.246920 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbtp2\" (UniqueName: \"kubernetes.io/projected/75c808a3-93be-4ff2-b136-d93a0cf085ff-kube-api-access-cbtp2\") pod \"image-registry-78d6c765fd-ljq5m\" (UID: \"75c808a3-93be-4ff2-b136-d93a0cf085ff\") " pod="openshift-image-registry/image-registry-78d6c765fd-ljq5m" Jul 06 13:46:06.247038 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:06.246951 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/75c808a3-93be-4ff2-b136-d93a0cf085ff-ca-trust-extracted\") pod \"image-registry-78d6c765fd-ljq5m\" (UID: \"75c808a3-93be-4ff2-b136-d93a0cf085ff\") " pod="openshift-image-registry/image-registry-78d6c765fd-ljq5m" Jul 06 13:46:06.247038 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:06.246971 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/75c808a3-93be-4ff2-b136-d93a0cf085ff-installation-pull-secrets\") pod \"image-registry-78d6c765fd-ljq5m\" (UID: \"75c808a3-93be-4ff2-b136-d93a0cf085ff\") " pod="openshift-image-registry/image-registry-78d6c765fd-ljq5m" Jul 06 13:46:06.247038 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:06.247032 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/75c808a3-93be-4ff2-b136-d93a0cf085ff-registry-tls\") pod \"image-registry-78d6c765fd-ljq5m\" (UID: \"75c808a3-93be-4ff2-b136-d93a0cf085ff\") " pod="openshift-image-registry/image-registry-78d6c765fd-ljq5m" Jul 06 13:46:06.247218 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:06.247052 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/75c808a3-93be-4ff2-b136-d93a0cf085ff-bound-sa-token\") pod \"image-registry-78d6c765fd-ljq5m\" (UID: \"75c808a3-93be-4ff2-b136-d93a0cf085ff\") " pod="openshift-image-registry/image-registry-78d6c765fd-ljq5m" Jul 06 13:46:06.247218 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:06.247118 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/75c808a3-93be-4ff2-b136-d93a0cf085ff-image-registry-private-configuration\") pod \"image-registry-78d6c765fd-ljq5m\" (UID: \"75c808a3-93be-4ff2-b136-d93a0cf085ff\") " pod="openshift-image-registry/image-registry-78d6c765fd-ljq5m" Jul 06 13:46:06.247218 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:06.247141 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/75c808a3-93be-4ff2-b136-d93a0cf085ff-registry-certificates\") pod \"image-registry-78d6c765fd-ljq5m\" (UID: \"75c808a3-93be-4ff2-b136-d93a0cf085ff\") " pod="openshift-image-registry/image-registry-78d6c765fd-ljq5m" Jul 06 13:46:06.247218 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:46:06.247177 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 13:46:06.247218 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:46:06.247198 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78d6c765fd-ljq5m: secret "image-registry-tls" not found Jul 06 13:46:06.247454 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:46:06.247254 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75c808a3-93be-4ff2-b136-d93a0cf085ff-registry-tls podName:75c808a3-93be-4ff2-b136-d93a0cf085ff nodeName:}" failed. No retries permitted until 2026-07-06 13:46:06.747234214 +0000 UTC m=+60.546979890 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/75c808a3-93be-4ff2-b136-d93a0cf085ff-registry-tls") pod "image-registry-78d6c765fd-ljq5m" (UID: "75c808a3-93be-4ff2-b136-d93a0cf085ff") : secret "image-registry-tls" not found Jul 06 13:46:06.247454 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:06.247369 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/75c808a3-93be-4ff2-b136-d93a0cf085ff-ca-trust-extracted\") pod \"image-registry-78d6c765fd-ljq5m\" (UID: \"75c808a3-93be-4ff2-b136-d93a0cf085ff\") " pod="openshift-image-registry/image-registry-78d6c765fd-ljq5m" Jul 06 13:46:06.247708 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:06.247685 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/75c808a3-93be-4ff2-b136-d93a0cf085ff-registry-certificates\") pod \"image-registry-78d6c765fd-ljq5m\" (UID: \"75c808a3-93be-4ff2-b136-d93a0cf085ff\") " pod="openshift-image-registry/image-registry-78d6c765fd-ljq5m" Jul 06 13:46:06.247952 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:06.247930 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/75c808a3-93be-4ff2-b136-d93a0cf085ff-trusted-ca\") pod \"image-registry-78d6c765fd-ljq5m\" (UID: \"75c808a3-93be-4ff2-b136-d93a0cf085ff\") " pod="openshift-image-registry/image-registry-78d6c765fd-ljq5m" Jul 06 13:46:06.249416 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:06.249399 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/75c808a3-93be-4ff2-b136-d93a0cf085ff-image-registry-private-configuration\") pod \"image-registry-78d6c765fd-ljq5m\" (UID: \"75c808a3-93be-4ff2-b136-d93a0cf085ff\") " pod="openshift-image-registry/image-registry-78d6c765fd-ljq5m" Jul 06 13:46:06.249461 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:06.249449 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/75c808a3-93be-4ff2-b136-d93a0cf085ff-installation-pull-secrets\") pod \"image-registry-78d6c765fd-ljq5m\" (UID: \"75c808a3-93be-4ff2-b136-d93a0cf085ff\") " pod="openshift-image-registry/image-registry-78d6c765fd-ljq5m" Jul 06 13:46:06.255230 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:06.255205 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbtp2\" (UniqueName: \"kubernetes.io/projected/75c808a3-93be-4ff2-b136-d93a0cf085ff-kube-api-access-cbtp2\") pod \"image-registry-78d6c765fd-ljq5m\" (UID: \"75c808a3-93be-4ff2-b136-d93a0cf085ff\") " pod="openshift-image-registry/image-registry-78d6c765fd-ljq5m" Jul 06 13:46:06.255639 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:06.255601 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/75c808a3-93be-4ff2-b136-d93a0cf085ff-bound-sa-token\") pod \"image-registry-78d6c765fd-ljq5m\" (UID: \"75c808a3-93be-4ff2-b136-d93a0cf085ff\") " pod="openshift-image-registry/image-registry-78d6c765fd-ljq5m" Jul 06 13:46:06.750784 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:06.750756 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/75c808a3-93be-4ff2-b136-d93a0cf085ff-registry-tls\") pod \"image-registry-78d6c765fd-ljq5m\" (UID: \"75c808a3-93be-4ff2-b136-d93a0cf085ff\") " pod="openshift-image-registry/image-registry-78d6c765fd-ljq5m" Jul 06 13:46:06.751214 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:46:06.750928 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 13:46:06.751214 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:46:06.750950 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78d6c765fd-ljq5m: secret "image-registry-tls" not found Jul 06 13:46:06.751214 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:46:06.751011 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75c808a3-93be-4ff2-b136-d93a0cf085ff-registry-tls podName:75c808a3-93be-4ff2-b136-d93a0cf085ff nodeName:}" failed. No retries permitted until 2026-07-06 13:46:07.750991553 +0000 UTC m=+61.550737227 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/75c808a3-93be-4ff2-b136-d93a0cf085ff-registry-tls") pod "image-registry-78d6c765fd-ljq5m" (UID: "75c808a3-93be-4ff2-b136-d93a0cf085ff") : secret "image-registry-tls" not found Jul 06 13:46:06.969136 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:06.969113 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hsbqp" Jul 06 13:46:07.034748 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:07.034664 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-vjl62" event={"ID":"b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7","Type":"ContainerStarted","Data":"f94188c29f7800a2d3077f5e3247c25269710c229834e878337ee03d3043c1d9"} Jul 06 13:46:07.035988 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:07.035954 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-xg4z5" event={"ID":"0cba18f9-762c-4a58-8b34-66a661b7094b","Type":"ContainerStarted","Data":"84998821675a0b97508d5f3c434ed3cef7e1398d782b2ca285716f5871ff2d66"} Jul 06 13:46:07.093175 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:07.093131 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:07.154767 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:07.154729 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/377826fd-f531-4a58-98a8-bc2b2e536fb7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-gnsd2\" (UID: \"377826fd-f531-4a58-98a8-bc2b2e536fb7\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gnsd2" Jul 06 13:46:07.154921 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:46:07.154897 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 13:46:07.154988 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:46:07.154978 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/377826fd-f531-4a58-98a8-bc2b2e536fb7-cluster-monitoring-operator-tls podName:377826fd-f531-4a58-98a8-bc2b2e536fb7 nodeName:}" failed. No retries permitted until 2026-07-06 13:46:09.154957233 +0000 UTC m=+62.954702903 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/377826fd-f531-4a58-98a8-bc2b2e536fb7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-gnsd2" (UID: "377826fd-f531-4a58-98a8-bc2b2e536fb7") : secret "cluster-monitoring-operator-tls" not found Jul 06 13:46:07.197854 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:07.197820 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:07.297782 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:07.297705 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:07.759965 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:07.759931 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/75c808a3-93be-4ff2-b136-d93a0cf085ff-registry-tls\") pod \"image-registry-78d6c765fd-ljq5m\" (UID: \"75c808a3-93be-4ff2-b136-d93a0cf085ff\") " pod="openshift-image-registry/image-registry-78d6c765fd-ljq5m" Jul 06 13:46:07.760274 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:46:07.760055 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 13:46:07.760274 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:46:07.760071 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78d6c765fd-ljq5m: secret "image-registry-tls" not found Jul 06 13:46:07.760274 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:46:07.760133 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75c808a3-93be-4ff2-b136-d93a0cf085ff-registry-tls podName:75c808a3-93be-4ff2-b136-d93a0cf085ff nodeName:}" failed. No retries permitted until 2026-07-06 13:46:09.760118242 +0000 UTC m=+63.559863917 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/75c808a3-93be-4ff2-b136-d93a0cf085ff-registry-tls") pod "image-registry-78d6c765fd-ljq5m" (UID: "75c808a3-93be-4ff2-b136-d93a0cf085ff") : secret "image-registry-tls" not found Jul 06 13:46:08.442140 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:08.442108 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-j6clh"] Jul 06 13:46:08.443818 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:08.443801 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-j6clh" Jul 06 13:46:08.446502 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:08.446473 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 06 13:46:08.446502 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:08.446480 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 06 13:46:08.446799 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:08.446783 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 06 13:46:08.446885 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:08.446785 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 06 13:46:08.446885 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:08.446792 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-w7pt2\"" Jul 06 13:46:08.455443 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:08.455423 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-j6clh"] Jul 06 13:46:08.465955 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:08.465934 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d4ae4ed5-1e0d-4012-98bd-3c91d9d55dd1-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-j6clh\" (UID: \"d4ae4ed5-1e0d-4012-98bd-3c91d9d55dd1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-j6clh" Jul 06 13:46:08.466050 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:08.465973 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d4ae4ed5-1e0d-4012-98bd-3c91d9d55dd1-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-j6clh\" (UID: \"d4ae4ed5-1e0d-4012-98bd-3c91d9d55dd1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-j6clh" Jul 06 13:46:08.466050 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:08.465999 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ch5h5\" (UniqueName: \"kubernetes.io/projected/d4ae4ed5-1e0d-4012-98bd-3c91d9d55dd1-kube-api-access-ch5h5\") pod \"kube-storage-version-migrator-operator-846bf668f7-j6clh\" (UID: \"d4ae4ed5-1e0d-4012-98bd-3c91d9d55dd1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-j6clh" Jul 06 13:46:08.567065 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:08.567037 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d4ae4ed5-1e0d-4012-98bd-3c91d9d55dd1-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-j6clh\" (UID: \"d4ae4ed5-1e0d-4012-98bd-3c91d9d55dd1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-j6clh" Jul 06 13:46:08.567191 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:08.567076 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d4ae4ed5-1e0d-4012-98bd-3c91d9d55dd1-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-j6clh\" (UID: \"d4ae4ed5-1e0d-4012-98bd-3c91d9d55dd1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-j6clh" Jul 06 13:46:08.567191 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:08.567095 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ch5h5\" (UniqueName: \"kubernetes.io/projected/d4ae4ed5-1e0d-4012-98bd-3c91d9d55dd1-kube-api-access-ch5h5\") pod \"kube-storage-version-migrator-operator-846bf668f7-j6clh\" (UID: \"d4ae4ed5-1e0d-4012-98bd-3c91d9d55dd1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-j6clh" Jul 06 13:46:08.567595 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:08.567574 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d4ae4ed5-1e0d-4012-98bd-3c91d9d55dd1-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-j6clh\" (UID: \"d4ae4ed5-1e0d-4012-98bd-3c91d9d55dd1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-j6clh" Jul 06 13:46:08.569316 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:08.569300 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d4ae4ed5-1e0d-4012-98bd-3c91d9d55dd1-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-j6clh\" (UID: \"d4ae4ed5-1e0d-4012-98bd-3c91d9d55dd1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-j6clh" Jul 06 13:46:08.575838 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:08.575814 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ch5h5\" (UniqueName: \"kubernetes.io/projected/d4ae4ed5-1e0d-4012-98bd-3c91d9d55dd1-kube-api-access-ch5h5\") pod \"kube-storage-version-migrator-operator-846bf668f7-j6clh\" (UID: \"d4ae4ed5-1e0d-4012-98bd-3c91d9d55dd1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-j6clh" Jul 06 13:46:08.751980 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:08.751956 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-j6clh" Jul 06 13:46:08.866286 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:08.866262 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-j6clh"] Jul 06 13:46:08.869700 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:46:08.869678 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4ae4ed5_1e0d_4012_98bd_3c91d9d55dd1.slice/crio-2aac461cac5f6135d046931a0536204ccc2c3b18f644b23144228ca9c965a461 WatchSource:0}: Error finding container 2aac461cac5f6135d046931a0536204ccc2c3b18f644b23144228ca9c965a461: Status 404 returned error can't find the container with id 2aac461cac5f6135d046931a0536204ccc2c3b18f644b23144228ca9c965a461 Jul 06 13:46:09.042052 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:09.042032 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vjl62_b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7/console-operator/0.log" Jul 06 13:46:09.042161 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:09.042072 2556 generic.go:356] "Generic (PLEG): container finished" podID="b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7" containerID="a06b797421d7b6af9ee631b3f6843fa93330876b7829312c0d1ec3ef71fd1e38" exitCode=255 Jul 06 13:46:09.042161 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:09.042105 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-vjl62" event={"ID":"b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7","Type":"ContainerDied","Data":"a06b797421d7b6af9ee631b3f6843fa93330876b7829312c0d1ec3ef71fd1e38"} Jul 06 13:46:09.042339 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:09.042323 2556 scope.go:117] "RemoveContainer" containerID="a06b797421d7b6af9ee631b3f6843fa93330876b7829312c0d1ec3ef71fd1e38" Jul 06 13:46:09.043351 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:09.043328 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-j6clh" event={"ID":"d4ae4ed5-1e0d-4012-98bd-3c91d9d55dd1","Type":"ContainerStarted","Data":"2aac461cac5f6135d046931a0536204ccc2c3b18f644b23144228ca9c965a461"} Jul 06 13:46:09.044758 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:09.044738 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-xg4z5" event={"ID":"0cba18f9-762c-4a58-8b34-66a661b7094b","Type":"ContainerStarted","Data":"3d4fafaf9e57f480aa784719c72b950672825ce2a7a27d65480b2e9695f296e1"} Jul 06 13:46:09.073306 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:09.073261 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-xg4z5" podStartSLOduration=1.897852061 podStartE2EDuration="4.073243785s" totalImagesPullingTime="2.175391724s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:46:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:46:09.072552985 +0000 UTC m=+62.872298678" watchObservedRunningTime="2026-07-06 13:46:09.073243785 +0000 UTC m=+62.872989478" Jul 06 13:46:09.155860 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:09.155831 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:09.171707 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:09.171680 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/377826fd-f531-4a58-98a8-bc2b2e536fb7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-gnsd2\" (UID: \"377826fd-f531-4a58-98a8-bc2b2e536fb7\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gnsd2" Jul 06 13:46:09.171804 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:46:09.171792 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 13:46:09.171854 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:46:09.171846 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/377826fd-f531-4a58-98a8-bc2b2e536fb7-cluster-monitoring-operator-tls podName:377826fd-f531-4a58-98a8-bc2b2e536fb7 nodeName:}" failed. No retries permitted until 2026-07-06 13:46:13.171831234 +0000 UTC m=+66.971576906 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/377826fd-f531-4a58-98a8-bc2b2e536fb7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-gnsd2" (UID: "377826fd-f531-4a58-98a8-bc2b2e536fb7") : secret "cluster-monitoring-operator-tls" not found Jul 06 13:46:09.257136 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:09.257106 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:09.642040 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:09.641998 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2x68v"] Jul 06 13:46:09.645176 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:09.645145 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2x68v" Jul 06 13:46:09.651797 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:09.651723 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 06 13:46:09.651797 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:09.651786 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 06 13:46:09.651995 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:09.651807 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 06 13:46:09.652153 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:09.652127 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fqx8g\"" Jul 06 13:46:09.653832 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:09.653816 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 06 13:46:09.668808 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:09.668783 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2x68v"] Jul 06 13:46:09.674907 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:09.674883 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d72c5579-a74a-4fe9-8c89-75cff6c559ea-data-volume\") pod \"insights-runtime-extractor-2x68v\" (UID: \"d72c5579-a74a-4fe9-8c89-75cff6c559ea\") " pod="openshift-insights/insights-runtime-extractor-2x68v" Jul 06 13:46:09.674998 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:09.674937 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d72c5579-a74a-4fe9-8c89-75cff6c559ea-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2x68v\" (UID: \"d72c5579-a74a-4fe9-8c89-75cff6c559ea\") " pod="openshift-insights/insights-runtime-extractor-2x68v" Jul 06 13:46:09.675042 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:09.675020 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxd5t\" (UniqueName: \"kubernetes.io/projected/d72c5579-a74a-4fe9-8c89-75cff6c559ea-kube-api-access-bxd5t\") pod \"insights-runtime-extractor-2x68v\" (UID: \"d72c5579-a74a-4fe9-8c89-75cff6c559ea\") " pod="openshift-insights/insights-runtime-extractor-2x68v" Jul 06 13:46:09.675142 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:09.675126 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d72c5579-a74a-4fe9-8c89-75cff6c559ea-crio-socket\") pod \"insights-runtime-extractor-2x68v\" (UID: \"d72c5579-a74a-4fe9-8c89-75cff6c559ea\") " pod="openshift-insights/insights-runtime-extractor-2x68v" Jul 06 13:46:09.675185 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:09.675161 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d72c5579-a74a-4fe9-8c89-75cff6c559ea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2x68v\" (UID: \"d72c5579-a74a-4fe9-8c89-75cff6c559ea\") " pod="openshift-insights/insights-runtime-extractor-2x68v" Jul 06 13:46:09.685608 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:09.685580 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:09.775623 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:09.775598 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/75c808a3-93be-4ff2-b136-d93a0cf085ff-registry-tls\") pod \"image-registry-78d6c765fd-ljq5m\" (UID: \"75c808a3-93be-4ff2-b136-d93a0cf085ff\") " pod="openshift-image-registry/image-registry-78d6c765fd-ljq5m" Jul 06 13:46:09.775764 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:09.775640 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d72c5579-a74a-4fe9-8c89-75cff6c559ea-crio-socket\") pod \"insights-runtime-extractor-2x68v\" (UID: \"d72c5579-a74a-4fe9-8c89-75cff6c559ea\") " pod="openshift-insights/insights-runtime-extractor-2x68v" Jul 06 13:46:09.775764 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:09.775659 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d72c5579-a74a-4fe9-8c89-75cff6c559ea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2x68v\" (UID: \"d72c5579-a74a-4fe9-8c89-75cff6c559ea\") " pod="openshift-insights/insights-runtime-extractor-2x68v" Jul 06 13:46:09.775764 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:09.775708 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d72c5579-a74a-4fe9-8c89-75cff6c559ea-data-volume\") pod \"insights-runtime-extractor-2x68v\" (UID: \"d72c5579-a74a-4fe9-8c89-75cff6c559ea\") " pod="openshift-insights/insights-runtime-extractor-2x68v" Jul 06 13:46:09.775764 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:09.775742 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d72c5579-a74a-4fe9-8c89-75cff6c559ea-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2x68v\" (UID: \"d72c5579-a74a-4fe9-8c89-75cff6c559ea\") " pod="openshift-insights/insights-runtime-extractor-2x68v" Jul 06 13:46:09.775764 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:09.775750 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d72c5579-a74a-4fe9-8c89-75cff6c559ea-crio-socket\") pod \"insights-runtime-extractor-2x68v\" (UID: \"d72c5579-a74a-4fe9-8c89-75cff6c559ea\") " pod="openshift-insights/insights-runtime-extractor-2x68v" Jul 06 13:46:09.776003 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:46:09.775756 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 13:46:09.776003 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:46:09.775783 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78d6c765fd-ljq5m: secret "image-registry-tls" not found Jul 06 13:46:09.776003 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:09.775781 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxd5t\" (UniqueName: \"kubernetes.io/projected/d72c5579-a74a-4fe9-8c89-75cff6c559ea-kube-api-access-bxd5t\") pod \"insights-runtime-extractor-2x68v\" (UID: \"d72c5579-a74a-4fe9-8c89-75cff6c559ea\") " pod="openshift-insights/insights-runtime-extractor-2x68v" Jul 06 13:46:09.776003 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:46:09.775822 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 13:46:09.776003 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:46:09.775855 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75c808a3-93be-4ff2-b136-d93a0cf085ff-registry-tls podName:75c808a3-93be-4ff2-b136-d93a0cf085ff nodeName:}" failed. No retries permitted until 2026-07-06 13:46:13.775833454 +0000 UTC m=+67.575579140 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/75c808a3-93be-4ff2-b136-d93a0cf085ff-registry-tls") pod "image-registry-78d6c765fd-ljq5m" (UID: "75c808a3-93be-4ff2-b136-d93a0cf085ff") : secret "image-registry-tls" not found Jul 06 13:46:09.776003 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:46:09.775896 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d72c5579-a74a-4fe9-8c89-75cff6c559ea-kube-rbac-proxy-cm podName:d72c5579-a74a-4fe9-8c89-75cff6c559ea nodeName:}" failed. No retries permitted until 2026-07-06 13:46:10.275880113 +0000 UTC m=+64.075625807 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d72c5579-a74a-4fe9-8c89-75cff6c559ea-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2x68v" (UID: "d72c5579-a74a-4fe9-8c89-75cff6c559ea") : configmap "kube-rbac-proxy" not found Jul 06 13:46:09.776003 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:46:09.775898 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 13:46:09.776003 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:46:09.775957 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d72c5579-a74a-4fe9-8c89-75cff6c559ea-insights-runtime-extractor-tls podName:d72c5579-a74a-4fe9-8c89-75cff6c559ea nodeName:}" failed. No retries permitted until 2026-07-06 13:46:10.275942446 +0000 UTC m=+64.075688130 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d72c5579-a74a-4fe9-8c89-75cff6c559ea-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2x68v" (UID: "d72c5579-a74a-4fe9-8c89-75cff6c559ea") : secret "insights-runtime-extractor-tls" not found Jul 06 13:46:09.776330 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:09.776058 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d72c5579-a74a-4fe9-8c89-75cff6c559ea-data-volume\") pod \"insights-runtime-extractor-2x68v\" (UID: \"d72c5579-a74a-4fe9-8c89-75cff6c559ea\") " pod="openshift-insights/insights-runtime-extractor-2x68v" Jul 06 13:46:09.786246 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:09.786217 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxd5t\" (UniqueName: \"kubernetes.io/projected/d72c5579-a74a-4fe9-8c89-75cff6c559ea-kube-api-access-bxd5t\") pod \"insights-runtime-extractor-2x68v\" (UID: \"d72c5579-a74a-4fe9-8c89-75cff6c559ea\") " pod="openshift-insights/insights-runtime-extractor-2x68v" Jul 06 13:46:09.812595 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:09.812567 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:10.050070 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:10.050043 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vjl62_b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7/console-operator/1.log" Jul 06 13:46:10.050535 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:10.050521 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vjl62_b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7/console-operator/0.log" Jul 06 13:46:10.050595 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:10.050556 2556 generic.go:356] "Generic (PLEG): container finished" podID="b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7" containerID="06d40e475a164b15a4c2936394d81ac01cc089c4040501d6c3d062d399016db1" exitCode=255 Jul 06 13:46:10.050679 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:10.050649 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-vjl62" event={"ID":"b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7","Type":"ContainerDied","Data":"06d40e475a164b15a4c2936394d81ac01cc089c4040501d6c3d062d399016db1"} Jul 06 13:46:10.050729 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:10.050719 2556 scope.go:117] "RemoveContainer" containerID="a06b797421d7b6af9ee631b3f6843fa93330876b7829312c0d1ec3ef71fd1e38" Jul 06 13:46:10.050925 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:10.050908 2556 scope.go:117] "RemoveContainer" containerID="06d40e475a164b15a4c2936394d81ac01cc089c4040501d6c3d062d399016db1" Jul 06 13:46:10.051127 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:46:10.051106 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-vjl62_openshift-console-operator(b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7)\"" pod="openshift-console-operator/console-operator-68b757fb67-vjl62" podUID="b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7" Jul 06 13:46:10.279939 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:10.279905 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d72c5579-a74a-4fe9-8c89-75cff6c559ea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2x68v\" (UID: \"d72c5579-a74a-4fe9-8c89-75cff6c559ea\") " pod="openshift-insights/insights-runtime-extractor-2x68v" Jul 06 13:46:10.280086 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:10.279963 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d72c5579-a74a-4fe9-8c89-75cff6c559ea-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2x68v\" (UID: \"d72c5579-a74a-4fe9-8c89-75cff6c559ea\") " pod="openshift-insights/insights-runtime-extractor-2x68v" Jul 06 13:46:10.280086 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:46:10.280051 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 13:46:10.280086 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:46:10.280068 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 13:46:10.280186 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:46:10.280114 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d72c5579-a74a-4fe9-8c89-75cff6c559ea-insights-runtime-extractor-tls podName:d72c5579-a74a-4fe9-8c89-75cff6c559ea nodeName:}" failed. No retries permitted until 2026-07-06 13:46:11.280098965 +0000 UTC m=+65.079844641 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d72c5579-a74a-4fe9-8c89-75cff6c559ea-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2x68v" (UID: "d72c5579-a74a-4fe9-8c89-75cff6c559ea") : secret "insights-runtime-extractor-tls" not found Jul 06 13:46:10.280186 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:46:10.280128 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d72c5579-a74a-4fe9-8c89-75cff6c559ea-kube-rbac-proxy-cm podName:d72c5579-a74a-4fe9-8c89-75cff6c559ea nodeName:}" failed. No retries permitted until 2026-07-06 13:46:11.280121563 +0000 UTC m=+65.079867234 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d72c5579-a74a-4fe9-8c89-75cff6c559ea-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2x68v" (UID: "d72c5579-a74a-4fe9-8c89-75cff6c559ea") : configmap "kube-rbac-proxy" not found Jul 06 13:46:11.054739 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:11.054719 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vjl62_b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7/console-operator/1.log" Jul 06 13:46:11.055121 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:11.055084 2556 scope.go:117] "RemoveContainer" containerID="06d40e475a164b15a4c2936394d81ac01cc089c4040501d6c3d062d399016db1" Jul 06 13:46:11.055268 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:46:11.055243 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-vjl62_openshift-console-operator(b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7)\"" pod="openshift-console-operator/console-operator-68b757fb67-vjl62" podUID="b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7" Jul 06 13:46:11.088784 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:11.088732 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-j6clh" podStartSLOduration=0.954486209 podStartE2EDuration="3.088718393s" totalImagesPullingTime="2.134232184s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:46:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:46:11.08809072 +0000 UTC m=+64.887836738" watchObservedRunningTime="2026-07-06 13:46:11.088718393 +0000 UTC m=+64.888464105" Jul 06 13:46:11.288506 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:11.288426 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d72c5579-a74a-4fe9-8c89-75cff6c559ea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2x68v\" (UID: \"d72c5579-a74a-4fe9-8c89-75cff6c559ea\") " pod="openshift-insights/insights-runtime-extractor-2x68v" Jul 06 13:46:11.288690 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:11.288516 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d72c5579-a74a-4fe9-8c89-75cff6c559ea-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2x68v\" (UID: \"d72c5579-a74a-4fe9-8c89-75cff6c559ea\") " pod="openshift-insights/insights-runtime-extractor-2x68v" Jul 06 13:46:11.288690 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:46:11.288578 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 13:46:11.288690 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:46:11.288599 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 13:46:11.288690 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:46:11.288664 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d72c5579-a74a-4fe9-8c89-75cff6c559ea-insights-runtime-extractor-tls podName:d72c5579-a74a-4fe9-8c89-75cff6c559ea nodeName:}" failed. No retries permitted until 2026-07-06 13:46:13.288646574 +0000 UTC m=+67.088392246 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d72c5579-a74a-4fe9-8c89-75cff6c559ea-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2x68v" (UID: "d72c5579-a74a-4fe9-8c89-75cff6c559ea") : secret "insights-runtime-extractor-tls" not found Jul 06 13:46:11.288690 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:46:11.288682 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d72c5579-a74a-4fe9-8c89-75cff6c559ea-kube-rbac-proxy-cm podName:d72c5579-a74a-4fe9-8c89-75cff6c559ea nodeName:}" failed. No retries permitted until 2026-07-06 13:46:13.288673781 +0000 UTC m=+67.088419455 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d72c5579-a74a-4fe9-8c89-75cff6c559ea-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2x68v" (UID: "d72c5579-a74a-4fe9-8c89-75cff6c559ea") : configmap "kube-rbac-proxy" not found Jul 06 13:46:11.435273 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:11.435247 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-xwfjx"] Jul 06 13:46:11.437387 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:11.437368 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-xwfjx" Jul 06 13:46:11.441061 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:11.441040 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 06 13:46:11.441061 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:11.441047 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-ssbkr\"" Jul 06 13:46:11.441308 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:11.441087 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 06 13:46:11.441308 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:11.441160 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 06 13:46:11.441308 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:11.441294 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 06 13:46:11.449011 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:11.448983 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-xwfjx"] Jul 06 13:46:11.490654 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:11.490632 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9f95b1cc-319b-459f-b58f-133d60b4308b-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-xwfjx\" (UID: \"9f95b1cc-319b-459f-b58f-133d60b4308b\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-xwfjx" Jul 06 13:46:11.490769 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:11.490703 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9f95b1cc-319b-459f-b58f-133d60b4308b-config\") pod \"service-ca-operator-5d46d9ffd4-xwfjx\" (UID: \"9f95b1cc-319b-459f-b58f-133d60b4308b\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-xwfjx" Jul 06 13:46:11.490769 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:11.490732 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jc2pw\" (UniqueName: \"kubernetes.io/projected/9f95b1cc-319b-459f-b58f-133d60b4308b-kube-api-access-jc2pw\") pod \"service-ca-operator-5d46d9ffd4-xwfjx\" (UID: \"9f95b1cc-319b-459f-b58f-133d60b4308b\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-xwfjx" Jul 06 13:46:11.490885 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:11.490804 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b400c7ed-fd28-44f0-802f-17b18fa21328-original-pull-secret\") pod \"global-pull-secret-syncer-w5psk\" (UID: \"b400c7ed-fd28-44f0-802f-17b18fa21328\") " pod="kube-system/global-pull-secret-syncer-w5psk" Jul 06 13:46:11.490885 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:11.490857 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9712593-e5bd-42d1-bb8f-3e81c9c588f4-metrics-certs\") pod \"network-metrics-daemon-jkhgk\" (UID: \"d9712593-e5bd-42d1-bb8f-3e81c9c588f4\") " pod="openshift-multus/network-metrics-daemon-jkhgk" Jul 06 13:46:11.493349 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:11.493335 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 13:46:11.493349 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:11.493344 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 13:46:11.501593 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:46:11.501578 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 06 13:46:11.501667 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:46:11.501656 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9712593-e5bd-42d1-bb8f-3e81c9c588f4-metrics-certs podName:d9712593-e5bd-42d1-bb8f-3e81c9c588f4 nodeName:}" failed. No retries permitted until 2026-07-06 13:47:15.50163715 +0000 UTC m=+129.301382828 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d9712593-e5bd-42d1-bb8f-3e81c9c588f4-metrics-certs") pod "network-metrics-daemon-jkhgk" (UID: "d9712593-e5bd-42d1-bb8f-3e81c9c588f4") : secret "metrics-daemon-secret" not found Jul 06 13:46:11.503696 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:11.503673 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b400c7ed-fd28-44f0-802f-17b18fa21328-original-pull-secret\") pod \"global-pull-secret-syncer-w5psk\" (UID: \"b400c7ed-fd28-44f0-802f-17b18fa21328\") " pod="kube-system/global-pull-secret-syncer-w5psk" Jul 06 13:46:11.511700 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:11.511683 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w5psk" Jul 06 13:46:11.591299 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:11.591267 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s6gk\" (UniqueName: \"kubernetes.io/projected/88c479d6-98eb-4c89-892c-eac6ac9629d0-kube-api-access-6s6gk\") pod \"network-check-target-nzf92\" (UID: \"88c479d6-98eb-4c89-892c-eac6ac9629d0\") " pod="openshift-network-diagnostics/network-check-target-nzf92" Jul 06 13:46:11.591428 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:11.591315 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9f95b1cc-319b-459f-b58f-133d60b4308b-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-xwfjx\" (UID: \"9f95b1cc-319b-459f-b58f-133d60b4308b\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-xwfjx" Jul 06 13:46:11.591428 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:11.591378 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9f95b1cc-319b-459f-b58f-133d60b4308b-config\") pod \"service-ca-operator-5d46d9ffd4-xwfjx\" (UID: \"9f95b1cc-319b-459f-b58f-133d60b4308b\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-xwfjx" Jul 06 13:46:11.591428 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:11.591406 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jc2pw\" (UniqueName: \"kubernetes.io/projected/9f95b1cc-319b-459f-b58f-133d60b4308b-kube-api-access-jc2pw\") pod \"service-ca-operator-5d46d9ffd4-xwfjx\" (UID: \"9f95b1cc-319b-459f-b58f-133d60b4308b\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-xwfjx" Jul 06 13:46:11.592057 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:11.592032 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9f95b1cc-319b-459f-b58f-133d60b4308b-config\") pod \"service-ca-operator-5d46d9ffd4-xwfjx\" (UID: \"9f95b1cc-319b-459f-b58f-133d60b4308b\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-xwfjx" Jul 06 13:46:11.594140 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:11.594115 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9f95b1cc-319b-459f-b58f-133d60b4308b-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-xwfjx\" (UID: \"9f95b1cc-319b-459f-b58f-133d60b4308b\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-xwfjx" Jul 06 13:46:11.594242 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:11.594219 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 13:46:11.600595 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:11.600568 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jc2pw\" (UniqueName: \"kubernetes.io/projected/9f95b1cc-319b-459f-b58f-133d60b4308b-kube-api-access-jc2pw\") pod \"service-ca-operator-5d46d9ffd4-xwfjx\" (UID: \"9f95b1cc-319b-459f-b58f-133d60b4308b\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-xwfjx" Jul 06 13:46:11.605086 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:11.605067 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 13:46:11.614432 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:11.614412 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6s6gk\" (UniqueName: \"kubernetes.io/projected/88c479d6-98eb-4c89-892c-eac6ac9629d0-kube-api-access-6s6gk\") pod \"network-check-target-nzf92\" (UID: \"88c479d6-98eb-4c89-892c-eac6ac9629d0\") " pod="openshift-network-diagnostics/network-check-target-nzf92" Jul 06 13:46:11.637914 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:11.635378 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-w5psk"] Jul 06 13:46:11.638941 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:46:11.638917 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb400c7ed_fd28_44f0_802f_17b18fa21328.slice/crio-21ed96cb71736fea9b8a1a01aef9c7634d7e2941adda75011b497e325902eac7 WatchSource:0}: Error finding container 21ed96cb71736fea9b8a1a01aef9c7634d7e2941adda75011b497e325902eac7: Status 404 returned error can't find the container with id 21ed96cb71736fea9b8a1a01aef9c7634d7e2941adda75011b497e325902eac7 Jul 06 13:46:11.745784 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:11.745764 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-xwfjx" Jul 06 13:46:11.799700 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:11.799672 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jpdcl_d9c6489d-fe7d-4af6-a03d-04488b5a20ac/dns-node-resolver/0.log" Jul 06 13:46:11.819711 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:11.819648 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ztx5l\"" Jul 06 13:46:11.827366 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:11.827347 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nzf92" Jul 06 13:46:11.868432 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:11.868403 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-xwfjx"] Jul 06 13:46:11.872322 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:46:11.872292 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f95b1cc_319b_459f_b58f_133d60b4308b.slice/crio-4cef2e9d5865c30f87a050bdea3ec4a7ef0cef69611bbe7da905355bf87d4b71 WatchSource:0}: Error finding container 4cef2e9d5865c30f87a050bdea3ec4a7ef0cef69611bbe7da905355bf87d4b71: Status 404 returned error can't find the container with id 4cef2e9d5865c30f87a050bdea3ec4a7ef0cef69611bbe7da905355bf87d4b71 Jul 06 13:46:11.955349 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:11.955310 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nzf92"] Jul 06 13:46:11.957173 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:46:11.957149 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88c479d6_98eb_4c89_892c_eac6ac9629d0.slice/crio-be9df0c6621415c753a5dbf8c8df65a419b6d918fcf99a6eb0a1898bb3dadf13 WatchSource:0}: Error finding container be9df0c6621415c753a5dbf8c8df65a419b6d918fcf99a6eb0a1898bb3dadf13: Status 404 returned error can't find the container with id be9df0c6621415c753a5dbf8c8df65a419b6d918fcf99a6eb0a1898bb3dadf13 Jul 06 13:46:12.060083 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:12.060052 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-j6clh" event={"ID":"d4ae4ed5-1e0d-4012-98bd-3c91d9d55dd1","Type":"ContainerStarted","Data":"a8835089b35ec09ec4474731939b68f04938ac36c3ed811786451d5fc8f8b468"} Jul 06 13:46:12.061136 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:12.061112 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nzf92" event={"ID":"88c479d6-98eb-4c89-892c-eac6ac9629d0","Type":"ContainerStarted","Data":"be9df0c6621415c753a5dbf8c8df65a419b6d918fcf99a6eb0a1898bb3dadf13"} Jul 06 13:46:12.062177 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:12.062158 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-xwfjx" event={"ID":"9f95b1cc-319b-459f-b58f-133d60b4308b","Type":"ContainerStarted","Data":"4cef2e9d5865c30f87a050bdea3ec4a7ef0cef69611bbe7da905355bf87d4b71"} Jul 06 13:46:12.063219 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:12.063199 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-w5psk" event={"ID":"b400c7ed-fd28-44f0-802f-17b18fa21328","Type":"ContainerStarted","Data":"21ed96cb71736fea9b8a1a01aef9c7634d7e2941adda75011b497e325902eac7"} Jul 06 13:46:12.174184 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:12.174117 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:12.266229 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:12.266199 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:12.370067 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:12.370035 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:12.799512 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:12.799345 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wmfs6_73be228a-e09a-4ef2-9df5-b3ef9a8324fc/node-ca/0.log" Jul 06 13:46:13.206854 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:13.206705 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/377826fd-f531-4a58-98a8-bc2b2e536fb7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-gnsd2\" (UID: \"377826fd-f531-4a58-98a8-bc2b2e536fb7\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gnsd2" Jul 06 13:46:13.206854 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:46:13.206838 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 13:46:13.207259 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:46:13.206919 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/377826fd-f531-4a58-98a8-bc2b2e536fb7-cluster-monitoring-operator-tls podName:377826fd-f531-4a58-98a8-bc2b2e536fb7 nodeName:}" failed. No retries permitted until 2026-07-06 13:46:21.206896067 +0000 UTC m=+75.006641755 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/377826fd-f531-4a58-98a8-bc2b2e536fb7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-gnsd2" (UID: "377826fd-f531-4a58-98a8-bc2b2e536fb7") : secret "cluster-monitoring-operator-tls" not found Jul 06 13:46:13.308146 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:13.308111 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d72c5579-a74a-4fe9-8c89-75cff6c559ea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2x68v\" (UID: \"d72c5579-a74a-4fe9-8c89-75cff6c559ea\") " pod="openshift-insights/insights-runtime-extractor-2x68v" Jul 06 13:46:13.308333 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:13.308190 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d72c5579-a74a-4fe9-8c89-75cff6c559ea-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2x68v\" (UID: \"d72c5579-a74a-4fe9-8c89-75cff6c559ea\") " pod="openshift-insights/insights-runtime-extractor-2x68v" Jul 06 13:46:13.308333 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:46:13.308300 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 13:46:13.308438 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:46:13.308360 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d72c5579-a74a-4fe9-8c89-75cff6c559ea-kube-rbac-proxy-cm podName:d72c5579-a74a-4fe9-8c89-75cff6c559ea nodeName:}" failed. No retries permitted until 2026-07-06 13:46:17.308341869 +0000 UTC m=+71.108087545 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d72c5579-a74a-4fe9-8c89-75cff6c559ea-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2x68v" (UID: "d72c5579-a74a-4fe9-8c89-75cff6c559ea") : configmap "kube-rbac-proxy" not found Jul 06 13:46:13.308640 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:46:13.308597 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 13:46:13.308724 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:46:13.308675 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d72c5579-a74a-4fe9-8c89-75cff6c559ea-insights-runtime-extractor-tls podName:d72c5579-a74a-4fe9-8c89-75cff6c559ea nodeName:}" failed. No retries permitted until 2026-07-06 13:46:17.308657683 +0000 UTC m=+71.108403354 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d72c5579-a74a-4fe9-8c89-75cff6c559ea-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2x68v" (UID: "d72c5579-a74a-4fe9-8c89-75cff6c559ea") : secret "insights-runtime-extractor-tls" not found Jul 06 13:46:13.399711 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:13.399678 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-crrkc_f145985c-f05e-41c0-9f44-b6c230aa961c/serve-healthcheck-canary/0.log" Jul 06 13:46:13.408768 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:13.408743 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/39f1f56d-ff91-4983-b7b1-602a2bf245d8-metrics-tls\") pod \"dns-default-zz5qt\" (UID: \"39f1f56d-ff91-4983-b7b1-602a2bf245d8\") " pod="openshift-dns/dns-default-zz5qt" Jul 06 13:46:13.408970 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:46:13.408954 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 13:46:13.409046 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:46:13.409030 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39f1f56d-ff91-4983-b7b1-602a2bf245d8-metrics-tls podName:39f1f56d-ff91-4983-b7b1-602a2bf245d8 nodeName:}" failed. No retries permitted until 2026-07-06 13:46:45.409009634 +0000 UTC m=+99.208755305 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/39f1f56d-ff91-4983-b7b1-602a2bf245d8-metrics-tls") pod "dns-default-zz5qt" (UID: "39f1f56d-ff91-4983-b7b1-602a2bf245d8") : secret "dns-default-metrics-tls" not found Jul 06 13:46:13.812203 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:13.812164 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/75c808a3-93be-4ff2-b136-d93a0cf085ff-registry-tls\") pod \"image-registry-78d6c765fd-ljq5m\" (UID: \"75c808a3-93be-4ff2-b136-d93a0cf085ff\") " pod="openshift-image-registry/image-registry-78d6c765fd-ljq5m" Jul 06 13:46:13.812680 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:46:13.812397 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 13:46:13.812680 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:46:13.812425 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78d6c765fd-ljq5m: secret "image-registry-tls" not found Jul 06 13:46:13.812680 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:46:13.812504 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75c808a3-93be-4ff2-b136-d93a0cf085ff-registry-tls podName:75c808a3-93be-4ff2-b136-d93a0cf085ff nodeName:}" failed. No retries permitted until 2026-07-06 13:46:21.812473124 +0000 UTC m=+75.612218795 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/75c808a3-93be-4ff2-b136-d93a0cf085ff-registry-tls") pod "image-registry-78d6c765fd-ljq5m" (UID: "75c808a3-93be-4ff2-b136-d93a0cf085ff") : secret "image-registry-tls" not found Jul 06 13:46:15.195777 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:15.195737 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:15.296106 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:15.296076 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:15.899499 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:15.899463 2556 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-vjl62" Jul 06 13:46:15.899703 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:15.899528 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-vjl62" Jul 06 13:46:15.899930 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:15.899914 2556 scope.go:117] "RemoveContainer" containerID="06d40e475a164b15a4c2936394d81ac01cc089c4040501d6c3d062d399016db1" Jul 06 13:46:15.900098 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:46:15.900077 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-vjl62_openshift-console-operator(b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7)\"" pod="openshift-console-operator/console-operator-68b757fb67-vjl62" podUID="b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7" Jul 06 13:46:16.547765 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:16.547730 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:16.600415 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:16.600384 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:17.080397 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:17.080348 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nzf92" event={"ID":"88c479d6-98eb-4c89-892c-eac6ac9629d0","Type":"ContainerStarted","Data":"93ffd7df823c414937dd5b40589df0c0b1e050f477a31208b2f61c681f88c107"} Jul 06 13:46:17.080557 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:17.080458 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-nzf92" Jul 06 13:46:17.081954 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:17.081921 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-xwfjx" event={"ID":"9f95b1cc-319b-459f-b58f-133d60b4308b","Type":"ContainerStarted","Data":"178f98f5a16c5522dea81f2196f4230fedb79bcd103427614c175f29918f7b1b"} Jul 06 13:46:17.083397 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:17.083373 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-w5psk" event={"ID":"b400c7ed-fd28-44f0-802f-17b18fa21328","Type":"ContainerStarted","Data":"1a071c5cdd28c961df8f4d5fd3d503d2f0967b8524638818a95b7eba761af2a4"} Jul 06 13:46:17.098552 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:17.098467 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-nzf92" podStartSLOduration=65.200662704 podStartE2EDuration="1m10.098456637s" totalImagesPullingTime="4.897793933s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:45:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:46:17.096959247 +0000 UTC m=+70.896704956" watchObservedRunningTime="2026-07-06 13:46:17.098456637 +0000 UTC m=+70.898202330" Jul 06 13:46:17.113521 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:17.113477 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-w5psk" podStartSLOduration=64.896499068 podStartE2EDuration="1m10.113464002s" totalImagesPullingTime="5.216964934s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:45:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:46:17.113261404 +0000 UTC m=+70.913007107" watchObservedRunningTime="2026-07-06 13:46:17.113464002 +0000 UTC m=+70.913209694" Jul 06 13:46:17.129798 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:17.129758 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-xwfjx" podStartSLOduration=1.159305064 podStartE2EDuration="6.129746291s" totalImagesPullingTime="4.970441227s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:46:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:46:17.128840827 +0000 UTC m=+70.928586543" watchObservedRunningTime="2026-07-06 13:46:17.129746291 +0000 UTC m=+70.929491983" Jul 06 13:46:17.342125 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:17.342094 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d72c5579-a74a-4fe9-8c89-75cff6c559ea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2x68v\" (UID: \"d72c5579-a74a-4fe9-8c89-75cff6c559ea\") " pod="openshift-insights/insights-runtime-extractor-2x68v" Jul 06 13:46:17.342266 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:17.342146 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d72c5579-a74a-4fe9-8c89-75cff6c559ea-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2x68v\" (UID: \"d72c5579-a74a-4fe9-8c89-75cff6c559ea\") " pod="openshift-insights/insights-runtime-extractor-2x68v" Jul 06 13:46:17.342266 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:46:17.342195 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 13:46:17.342266 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:46:17.342218 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 13:46:17.342266 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:46:17.342249 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d72c5579-a74a-4fe9-8c89-75cff6c559ea-kube-rbac-proxy-cm podName:d72c5579-a74a-4fe9-8c89-75cff6c559ea nodeName:}" failed. No retries permitted until 2026-07-06 13:46:25.342236595 +0000 UTC m=+79.141982266 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d72c5579-a74a-4fe9-8c89-75cff6c559ea-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2x68v" (UID: "d72c5579-a74a-4fe9-8c89-75cff6c559ea") : configmap "kube-rbac-proxy" not found Jul 06 13:46:17.342266 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:46:17.342266 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d72c5579-a74a-4fe9-8c89-75cff6c559ea-insights-runtime-extractor-tls podName:d72c5579-a74a-4fe9-8c89-75cff6c559ea nodeName:}" failed. No retries permitted until 2026-07-06 13:46:25.342254175 +0000 UTC m=+79.141999847 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d72c5579-a74a-4fe9-8c89-75cff6c559ea-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2x68v" (UID: "d72c5579-a74a-4fe9-8c89-75cff6c559ea") : secret "insights-runtime-extractor-tls" not found Jul 06 13:46:17.954216 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:17.954178 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:18.021373 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:18.021337 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:18.656832 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:18.656797 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:18.757013 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:18.756987 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:20.253923 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:20.253891 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-rf8nl"] Jul 06 13:46:20.255995 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:20.255980 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-rf8nl" Jul 06 13:46:20.258727 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:20.258708 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 06 13:46:20.260252 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:20.260232 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-lhg4n\"" Jul 06 13:46:20.260343 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:20.260254 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 06 13:46:20.260343 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:20.260300 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 06 13:46:20.260509 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:20.260492 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 06 13:46:20.263997 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:20.263979 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-rf8nl"] Jul 06 13:46:20.288186 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:20.288153 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:20.364337 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:20.364313 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/550509ec-fdfc-45bd-95bc-5bd8ef32df5f-signing-cabundle\") pod \"service-ca-758f599c5-rf8nl\" (UID: \"550509ec-fdfc-45bd-95bc-5bd8ef32df5f\") " pod="openshift-service-ca/service-ca-758f599c5-rf8nl" Jul 06 13:46:20.364453 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:20.364354 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pn4p6\" (UniqueName: \"kubernetes.io/projected/550509ec-fdfc-45bd-95bc-5bd8ef32df5f-kube-api-access-pn4p6\") pod \"service-ca-758f599c5-rf8nl\" (UID: \"550509ec-fdfc-45bd-95bc-5bd8ef32df5f\") " pod="openshift-service-ca/service-ca-758f599c5-rf8nl" Jul 06 13:46:20.364453 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:20.364427 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/550509ec-fdfc-45bd-95bc-5bd8ef32df5f-signing-key\") pod \"service-ca-758f599c5-rf8nl\" (UID: \"550509ec-fdfc-45bd-95bc-5bd8ef32df5f\") " pod="openshift-service-ca/service-ca-758f599c5-rf8nl" Jul 06 13:46:20.464714 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:20.464691 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pn4p6\" (UniqueName: \"kubernetes.io/projected/550509ec-fdfc-45bd-95bc-5bd8ef32df5f-kube-api-access-pn4p6\") pod \"service-ca-758f599c5-rf8nl\" (UID: \"550509ec-fdfc-45bd-95bc-5bd8ef32df5f\") " pod="openshift-service-ca/service-ca-758f599c5-rf8nl" Jul 06 13:46:20.464817 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:20.464744 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/550509ec-fdfc-45bd-95bc-5bd8ef32df5f-signing-key\") pod \"service-ca-758f599c5-rf8nl\" (UID: \"550509ec-fdfc-45bd-95bc-5bd8ef32df5f\") " pod="openshift-service-ca/service-ca-758f599c5-rf8nl" Jul 06 13:46:20.464990 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:20.464972 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/550509ec-fdfc-45bd-95bc-5bd8ef32df5f-signing-cabundle\") pod \"service-ca-758f599c5-rf8nl\" (UID: \"550509ec-fdfc-45bd-95bc-5bd8ef32df5f\") " pod="openshift-service-ca/service-ca-758f599c5-rf8nl" Jul 06 13:46:20.465568 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:20.465544 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/550509ec-fdfc-45bd-95bc-5bd8ef32df5f-signing-cabundle\") pod \"service-ca-758f599c5-rf8nl\" (UID: \"550509ec-fdfc-45bd-95bc-5bd8ef32df5f\") " pod="openshift-service-ca/service-ca-758f599c5-rf8nl" Jul 06 13:46:20.467080 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:20.467063 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/550509ec-fdfc-45bd-95bc-5bd8ef32df5f-signing-key\") pod \"service-ca-758f599c5-rf8nl\" (UID: \"550509ec-fdfc-45bd-95bc-5bd8ef32df5f\") " pod="openshift-service-ca/service-ca-758f599c5-rf8nl" Jul 06 13:46:20.473656 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:20.473638 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pn4p6\" (UniqueName: \"kubernetes.io/projected/550509ec-fdfc-45bd-95bc-5bd8ef32df5f-kube-api-access-pn4p6\") pod \"service-ca-758f599c5-rf8nl\" (UID: \"550509ec-fdfc-45bd-95bc-5bd8ef32df5f\") " pod="openshift-service-ca/service-ca-758f599c5-rf8nl" Jul 06 13:46:20.565922 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:20.565855 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-rf8nl" Jul 06 13:46:20.685893 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:20.685842 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-rf8nl"] Jul 06 13:46:20.689164 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:46:20.689137 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod550509ec_fdfc_45bd_95bc_5bd8ef32df5f.slice/crio-c7cc13b7a53aa199e401acc90e0f7b54ca096ef2e9a773393d55ebcd8412a9fd WatchSource:0}: Error finding container c7cc13b7a53aa199e401acc90e0f7b54ca096ef2e9a773393d55ebcd8412a9fd: Status 404 returned error can't find the container with id c7cc13b7a53aa199e401acc90e0f7b54ca096ef2e9a773393d55ebcd8412a9fd Jul 06 13:46:21.101072 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:21.101036 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-rf8nl" event={"ID":"550509ec-fdfc-45bd-95bc-5bd8ef32df5f","Type":"ContainerStarted","Data":"69306d31baaac848fbe1849a149993a1ccdea54ae89741e4733a7ba608c997a6"} Jul 06 13:46:21.101207 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:21.101091 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-rf8nl" event={"ID":"550509ec-fdfc-45bd-95bc-5bd8ef32df5f","Type":"ContainerStarted","Data":"c7cc13b7a53aa199e401acc90e0f7b54ca096ef2e9a773393d55ebcd8412a9fd"} Jul 06 13:46:21.119215 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:21.119173 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-rf8nl" podStartSLOduration=1.119160091 podStartE2EDuration="1.119160091s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:46:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:46:21.117684038 +0000 UTC m=+74.917429731" watchObservedRunningTime="2026-07-06 13:46:21.119160091 +0000 UTC m=+74.918905784" Jul 06 13:46:21.261240 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:21.261210 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:21.273222 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:21.273191 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/377826fd-f531-4a58-98a8-bc2b2e536fb7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-gnsd2\" (UID: \"377826fd-f531-4a58-98a8-bc2b2e536fb7\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gnsd2" Jul 06 13:46:21.273347 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:46:21.273311 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 13:46:21.273391 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:46:21.273367 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/377826fd-f531-4a58-98a8-bc2b2e536fb7-cluster-monitoring-operator-tls podName:377826fd-f531-4a58-98a8-bc2b2e536fb7 nodeName:}" failed. No retries permitted until 2026-07-06 13:46:37.273350997 +0000 UTC m=+91.073096668 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/377826fd-f531-4a58-98a8-bc2b2e536fb7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-gnsd2" (UID: "377826fd-f531-4a58-98a8-bc2b2e536fb7") : secret "cluster-monitoring-operator-tls" not found Jul 06 13:46:21.879017 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:21.878984 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/75c808a3-93be-4ff2-b136-d93a0cf085ff-registry-tls\") pod \"image-registry-78d6c765fd-ljq5m\" (UID: \"75c808a3-93be-4ff2-b136-d93a0cf085ff\") " pod="openshift-image-registry/image-registry-78d6c765fd-ljq5m" Jul 06 13:46:21.879174 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:46:21.879113 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 13:46:21.879174 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:46:21.879131 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78d6c765fd-ljq5m: secret "image-registry-tls" not found Jul 06 13:46:21.879241 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:46:21.879178 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75c808a3-93be-4ff2-b136-d93a0cf085ff-registry-tls podName:75c808a3-93be-4ff2-b136-d93a0cf085ff nodeName:}" failed. No retries permitted until 2026-07-06 13:46:37.879165308 +0000 UTC m=+91.678910980 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/75c808a3-93be-4ff2-b136-d93a0cf085ff-registry-tls") pod "image-registry-78d6c765fd-ljq5m" (UID: "75c808a3-93be-4ff2-b136-d93a0cf085ff") : secret "image-registry-tls" not found Jul 06 13:46:22.528718 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:22.528676 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:22.771895 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:22.771860 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:22.872701 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:22.872599 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:22.972233 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:22.972205 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:23.072208 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:23.072184 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:23.221320 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:23.220863 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:24.327629 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:24.327577 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:24.428419 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:24.428385 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:24.618303 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:24.618230 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:24.819770 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:24.819742 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:25.017130 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:25.017100 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:25.229187 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:25.229155 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:25.413559 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:25.413488 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d72c5579-a74a-4fe9-8c89-75cff6c559ea-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2x68v\" (UID: \"d72c5579-a74a-4fe9-8c89-75cff6c559ea\") " pod="openshift-insights/insights-runtime-extractor-2x68v" Jul 06 13:46:25.413961 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:25.413560 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d72c5579-a74a-4fe9-8c89-75cff6c559ea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2x68v\" (UID: \"d72c5579-a74a-4fe9-8c89-75cff6c559ea\") " pod="openshift-insights/insights-runtime-extractor-2x68v" Jul 06 13:46:25.413961 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:46:25.413672 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 13:46:25.413961 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:46:25.413725 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d72c5579-a74a-4fe9-8c89-75cff6c559ea-insights-runtime-extractor-tls podName:d72c5579-a74a-4fe9-8c89-75cff6c559ea nodeName:}" failed. No retries permitted until 2026-07-06 13:46:41.413712084 +0000 UTC m=+95.213457754 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d72c5579-a74a-4fe9-8c89-75cff6c559ea-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2x68v" (UID: "d72c5579-a74a-4fe9-8c89-75cff6c559ea") : secret "insights-runtime-extractor-tls" not found Jul 06 13:46:25.414070 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:25.414055 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d72c5579-a74a-4fe9-8c89-75cff6c559ea-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2x68v\" (UID: \"d72c5579-a74a-4fe9-8c89-75cff6c559ea\") " pod="openshift-insights/insights-runtime-extractor-2x68v" Jul 06 13:46:25.911487 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:25.911432 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:25.962887 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:25.962860 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:26.217283 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:26.217214 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:26.425040 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:26.425011 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:26.626842 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:26.626810 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:26.686536 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:26.686505 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:26.783364 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:26.783334 2556 scope.go:117] "RemoveContainer" containerID="06d40e475a164b15a4c2936394d81ac01cc089c4040501d6c3d062d399016db1" Jul 06 13:46:26.826343 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:26.826317 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:27.019429 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:27.019392 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:27.121550 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:27.121520 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vjl62_b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7/console-operator/2.log" Jul 06 13:46:27.121993 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:27.121976 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vjl62_b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7/console-operator/1.log" Jul 06 13:46:27.122042 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:27.122011 2556 generic.go:356] "Generic (PLEG): container finished" podID="b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7" containerID="eaca6fdfe99505d5bc5552aaa200ac3ed9f98fd0128033956a8c8e512b11eebb" exitCode=255 Jul 06 13:46:27.122080 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:27.122067 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-vjl62" event={"ID":"b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7","Type":"ContainerDied","Data":"eaca6fdfe99505d5bc5552aaa200ac3ed9f98fd0128033956a8c8e512b11eebb"} Jul 06 13:46:27.122124 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:27.122114 2556 scope.go:117] "RemoveContainer" containerID="06d40e475a164b15a4c2936394d81ac01cc089c4040501d6c3d062d399016db1" Jul 06 13:46:27.122450 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:27.122432 2556 scope.go:117] "RemoveContainer" containerID="eaca6fdfe99505d5bc5552aaa200ac3ed9f98fd0128033956a8c8e512b11eebb" Jul 06 13:46:27.122639 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:46:27.122600 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-vjl62_openshift-console-operator(b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7)\"" pod="openshift-console-operator/console-operator-68b757fb67-vjl62" podUID="b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7" Jul 06 13:46:27.220946 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:27.220885 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:27.321080 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:27.321039 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:28.131159 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:28.131130 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vjl62_b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7/console-operator/2.log" Jul 06 13:46:28.249967 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:28.249929 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:28.415638 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:28.415467 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:28.821150 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:28.821122 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:29.009993 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:29.009961 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:29.077010 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:29.076944 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:29.414424 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:29.414354 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:30.017732 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:30.017698 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:30.627310 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:30.627281 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:30.818852 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:30.818825 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:31.227951 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:31.227925 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:31.422440 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:31.422405 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:31.822851 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:31.822821 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:32.229792 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:32.229703 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:32.411163 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:32.411130 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:32.820558 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:32.820528 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:33.017450 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:33.017420 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:33.219786 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:33.219712 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:35.898735 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:35.898708 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-vjl62" Jul 06 13:46:35.899073 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:35.898805 2556 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-vjl62" Jul 06 13:46:35.899073 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:35.898990 2556 scope.go:117] "RemoveContainer" containerID="eaca6fdfe99505d5bc5552aaa200ac3ed9f98fd0128033956a8c8e512b11eebb" Jul 06 13:46:35.899171 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:46:35.899121 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-vjl62_openshift-console-operator(b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7)\"" pod="openshift-console-operator/console-operator-68b757fb67-vjl62" podUID="b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7" Jul 06 13:46:36.154692 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:36.154600 2556 scope.go:117] "RemoveContainer" containerID="eaca6fdfe99505d5bc5552aaa200ac3ed9f98fd0128033956a8c8e512b11eebb" Jul 06 13:46:36.154849 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:46:36.154795 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-vjl62_openshift-console-operator(b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7)\"" pod="openshift-console-operator/console-operator-68b757fb67-vjl62" podUID="b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7" Jul 06 13:46:37.301218 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:37.301181 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/377826fd-f531-4a58-98a8-bc2b2e536fb7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-gnsd2\" (UID: \"377826fd-f531-4a58-98a8-bc2b2e536fb7\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gnsd2" Jul 06 13:46:37.303686 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:37.303658 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/377826fd-f531-4a58-98a8-bc2b2e536fb7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-gnsd2\" (UID: \"377826fd-f531-4a58-98a8-bc2b2e536fb7\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gnsd2" Jul 06 13:46:37.559025 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:37.558961 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-vgk79\"" Jul 06 13:46:37.567349 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:37.567324 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gnsd2" Jul 06 13:46:37.688899 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:37.688873 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gnsd2"] Jul 06 13:46:37.692072 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:46:37.692049 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod377826fd_f531_4a58_98a8_bc2b2e536fb7.slice/crio-9feeb8a658594f6ed128921f58370d201bc87ce92a7403e1dcab2f33c6f9ee87 WatchSource:0}: Error finding container 9feeb8a658594f6ed128921f58370d201bc87ce92a7403e1dcab2f33c6f9ee87: Status 404 returned error can't find the container with id 9feeb8a658594f6ed128921f58370d201bc87ce92a7403e1dcab2f33c6f9ee87 Jul 06 13:46:37.904789 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:37.904725 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/75c808a3-93be-4ff2-b136-d93a0cf085ff-registry-tls\") pod \"image-registry-78d6c765fd-ljq5m\" (UID: \"75c808a3-93be-4ff2-b136-d93a0cf085ff\") " pod="openshift-image-registry/image-registry-78d6c765fd-ljq5m" Jul 06 13:46:37.906927 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:37.906905 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/75c808a3-93be-4ff2-b136-d93a0cf085ff-registry-tls\") pod \"image-registry-78d6c765fd-ljq5m\" (UID: \"75c808a3-93be-4ff2-b136-d93a0cf085ff\") " pod="openshift-image-registry/image-registry-78d6c765fd-ljq5m" Jul 06 13:46:38.161948 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:38.161861 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gnsd2" event={"ID":"377826fd-f531-4a58-98a8-bc2b2e536fb7","Type":"ContainerStarted","Data":"9feeb8a658594f6ed128921f58370d201bc87ce92a7403e1dcab2f33c6f9ee87"} Jul 06 13:46:38.183801 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:38.183779 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-htv6h\"" Jul 06 13:46:38.192091 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:38.192066 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78d6c765fd-ljq5m" Jul 06 13:46:38.312462 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:38.312432 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-78d6c765fd-ljq5m"] Jul 06 13:46:38.315268 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:46:38.315247 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75c808a3_93be_4ff2_b136_d93a0cf085ff.slice/crio-f33927ad1b6ef7a46947816af2d510b3c9142985fa436dc9f33be17d58a40668 WatchSource:0}: Error finding container f33927ad1b6ef7a46947816af2d510b3c9142985fa436dc9f33be17d58a40668: Status 404 returned error can't find the container with id f33927ad1b6ef7a46947816af2d510b3c9142985fa436dc9f33be17d58a40668 Jul 06 13:46:39.166244 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:39.166212 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78d6c765fd-ljq5m" event={"ID":"75c808a3-93be-4ff2-b136-d93a0cf085ff","Type":"ContainerStarted","Data":"ce5abd325bb131bb4a5b2d48f5253ac3542d0e7d6b97ccb11c0c319c823e91fe"} Jul 06 13:46:39.166422 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:39.166261 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78d6c765fd-ljq5m" event={"ID":"75c808a3-93be-4ff2-b136-d93a0cf085ff","Type":"ContainerStarted","Data":"f33927ad1b6ef7a46947816af2d510b3c9142985fa436dc9f33be17d58a40668"} Jul 06 13:46:39.166422 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:39.166296 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-78d6c765fd-ljq5m" Jul 06 13:46:39.189385 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:39.189329 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-78d6c765fd-ljq5m" podStartSLOduration=33.189309591 podStartE2EDuration="33.189309591s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:46:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:46:39.187943328 +0000 UTC m=+92.987689023" watchObservedRunningTime="2026-07-06 13:46:39.189309591 +0000 UTC m=+92.989055286" Jul 06 13:46:40.036785 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:40.036743 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:40.136236 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:40.136205 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:40.171293 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:40.171256 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gnsd2" event={"ID":"377826fd-f531-4a58-98a8-bc2b2e536fb7","Type":"ContainerStarted","Data":"f2e46a6d3d133d120428c4b606706881e17d58a43d8545976ae09fb4b4ba104a"} Jul 06 13:46:40.189437 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:40.189384 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gnsd2" podStartSLOduration=33.153414977 podStartE2EDuration="35.189366303s" totalImagesPullingTime="2.035951326s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:46:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:46:40.187919441 +0000 UTC m=+93.987665135" watchObservedRunningTime="2026-07-06 13:46:40.189366303 +0000 UTC m=+93.989111998" Jul 06 13:46:40.199037 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:40.199014 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:40.725228 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:40.725193 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:40.896866 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:40.896839 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:40.956154 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:40.956125 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:41.436180 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:41.436137 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d72c5579-a74a-4fe9-8c89-75cff6c559ea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2x68v\" (UID: \"d72c5579-a74a-4fe9-8c89-75cff6c559ea\") " pod="openshift-insights/insights-runtime-extractor-2x68v" Jul 06 13:46:41.438404 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:41.438381 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d72c5579-a74a-4fe9-8c89-75cff6c559ea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2x68v\" (UID: \"d72c5579-a74a-4fe9-8c89-75cff6c559ea\") " pod="openshift-insights/insights-runtime-extractor-2x68v" Jul 06 13:46:41.456378 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:41.456354 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2x68v" Jul 06 13:46:41.579323 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:41.579297 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2x68v"] Jul 06 13:46:41.582431 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:46:41.582407 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd72c5579_a74a_4fe9_8c89_75cff6c559ea.slice/crio-6d3328bc947d7ac658989e349916b8e15982ba276dc6df8a226313afcc6062c5 WatchSource:0}: Error finding container 6d3328bc947d7ac658989e349916b8e15982ba276dc6df8a226313afcc6062c5: Status 404 returned error can't find the container with id 6d3328bc947d7ac658989e349916b8e15982ba276dc6df8a226313afcc6062c5 Jul 06 13:46:42.179767 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:42.179726 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2x68v" event={"ID":"d72c5579-a74a-4fe9-8c89-75cff6c559ea","Type":"ContainerStarted","Data":"6d3328bc947d7ac658989e349916b8e15982ba276dc6df8a226313afcc6062c5"} Jul 06 13:46:42.789996 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:42.789965 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-78d6c765fd-ljq5m"] Jul 06 13:46:42.929292 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:42.929263 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-59959bf766-kn9ns"] Jul 06 13:46:42.931750 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:42.931729 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59959bf766-kn9ns" Jul 06 13:46:42.943934 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:42.943912 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59959bf766-kn9ns"] Jul 06 13:46:42.951800 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:42.951774 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:43.030806 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:43.030737 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:43.049176 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:43.049116 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e15f7474-ae11-4486-9feb-d6ca49655405-ca-trust-extracted\") pod \"image-registry-59959bf766-kn9ns\" (UID: \"e15f7474-ae11-4486-9feb-d6ca49655405\") " pod="openshift-image-registry/image-registry-59959bf766-kn9ns" Jul 06 13:46:43.049176 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:43.049155 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e15f7474-ae11-4486-9feb-d6ca49655405-registry-certificates\") pod \"image-registry-59959bf766-kn9ns\" (UID: \"e15f7474-ae11-4486-9feb-d6ca49655405\") " pod="openshift-image-registry/image-registry-59959bf766-kn9ns" Jul 06 13:46:43.049346 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:43.049191 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e15f7474-ae11-4486-9feb-d6ca49655405-image-registry-private-configuration\") pod \"image-registry-59959bf766-kn9ns\" (UID: \"e15f7474-ae11-4486-9feb-d6ca49655405\") " pod="openshift-image-registry/image-registry-59959bf766-kn9ns" Jul 06 13:46:43.049346 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:43.049215 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e15f7474-ae11-4486-9feb-d6ca49655405-trusted-ca\") pod \"image-registry-59959bf766-kn9ns\" (UID: \"e15f7474-ae11-4486-9feb-d6ca49655405\") " pod="openshift-image-registry/image-registry-59959bf766-kn9ns" Jul 06 13:46:43.049346 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:43.049249 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e15f7474-ae11-4486-9feb-d6ca49655405-registry-tls\") pod \"image-registry-59959bf766-kn9ns\" (UID: \"e15f7474-ae11-4486-9feb-d6ca49655405\") " pod="openshift-image-registry/image-registry-59959bf766-kn9ns" Jul 06 13:46:43.049346 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:43.049324 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cspgm\" (UniqueName: \"kubernetes.io/projected/e15f7474-ae11-4486-9feb-d6ca49655405-kube-api-access-cspgm\") pod \"image-registry-59959bf766-kn9ns\" (UID: \"e15f7474-ae11-4486-9feb-d6ca49655405\") " pod="openshift-image-registry/image-registry-59959bf766-kn9ns" Jul 06 13:46:43.049504 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:43.049371 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e15f7474-ae11-4486-9feb-d6ca49655405-installation-pull-secrets\") pod \"image-registry-59959bf766-kn9ns\" (UID: \"e15f7474-ae11-4486-9feb-d6ca49655405\") " pod="openshift-image-registry/image-registry-59959bf766-kn9ns" Jul 06 13:46:43.049504 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:43.049403 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e15f7474-ae11-4486-9feb-d6ca49655405-bound-sa-token\") pod \"image-registry-59959bf766-kn9ns\" (UID: \"e15f7474-ae11-4486-9feb-d6ca49655405\") " pod="openshift-image-registry/image-registry-59959bf766-kn9ns" Jul 06 13:46:43.150137 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:43.150105 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e15f7474-ae11-4486-9feb-d6ca49655405-registry-tls\") pod \"image-registry-59959bf766-kn9ns\" (UID: \"e15f7474-ae11-4486-9feb-d6ca49655405\") " pod="openshift-image-registry/image-registry-59959bf766-kn9ns" Jul 06 13:46:43.150296 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:43.150188 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cspgm\" (UniqueName: \"kubernetes.io/projected/e15f7474-ae11-4486-9feb-d6ca49655405-kube-api-access-cspgm\") pod \"image-registry-59959bf766-kn9ns\" (UID: \"e15f7474-ae11-4486-9feb-d6ca49655405\") " pod="openshift-image-registry/image-registry-59959bf766-kn9ns" Jul 06 13:46:43.150296 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:43.150235 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e15f7474-ae11-4486-9feb-d6ca49655405-installation-pull-secrets\") pod \"image-registry-59959bf766-kn9ns\" (UID: \"e15f7474-ae11-4486-9feb-d6ca49655405\") " pod="openshift-image-registry/image-registry-59959bf766-kn9ns" Jul 06 13:46:43.150296 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:43.150273 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e15f7474-ae11-4486-9feb-d6ca49655405-bound-sa-token\") pod \"image-registry-59959bf766-kn9ns\" (UID: \"e15f7474-ae11-4486-9feb-d6ca49655405\") " pod="openshift-image-registry/image-registry-59959bf766-kn9ns" Jul 06 13:46:43.150466 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:43.150333 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e15f7474-ae11-4486-9feb-d6ca49655405-ca-trust-extracted\") pod \"image-registry-59959bf766-kn9ns\" (UID: \"e15f7474-ae11-4486-9feb-d6ca49655405\") " pod="openshift-image-registry/image-registry-59959bf766-kn9ns" Jul 06 13:46:43.150466 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:43.150372 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e15f7474-ae11-4486-9feb-d6ca49655405-registry-certificates\") pod \"image-registry-59959bf766-kn9ns\" (UID: \"e15f7474-ae11-4486-9feb-d6ca49655405\") " pod="openshift-image-registry/image-registry-59959bf766-kn9ns" Jul 06 13:46:43.150466 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:43.150408 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e15f7474-ae11-4486-9feb-d6ca49655405-image-registry-private-configuration\") pod \"image-registry-59959bf766-kn9ns\" (UID: \"e15f7474-ae11-4486-9feb-d6ca49655405\") " pod="openshift-image-registry/image-registry-59959bf766-kn9ns" Jul 06 13:46:43.150466 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:43.150433 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e15f7474-ae11-4486-9feb-d6ca49655405-trusted-ca\") pod \"image-registry-59959bf766-kn9ns\" (UID: \"e15f7474-ae11-4486-9feb-d6ca49655405\") " pod="openshift-image-registry/image-registry-59959bf766-kn9ns" Jul 06 13:46:43.150925 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:43.150876 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e15f7474-ae11-4486-9feb-d6ca49655405-ca-trust-extracted\") pod \"image-registry-59959bf766-kn9ns\" (UID: \"e15f7474-ae11-4486-9feb-d6ca49655405\") " pod="openshift-image-registry/image-registry-59959bf766-kn9ns" Jul 06 13:46:43.151476 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:43.151444 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e15f7474-ae11-4486-9feb-d6ca49655405-trusted-ca\") pod \"image-registry-59959bf766-kn9ns\" (UID: \"e15f7474-ae11-4486-9feb-d6ca49655405\") " pod="openshift-image-registry/image-registry-59959bf766-kn9ns" Jul 06 13:46:43.151564 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:43.151523 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e15f7474-ae11-4486-9feb-d6ca49655405-registry-certificates\") pod \"image-registry-59959bf766-kn9ns\" (UID: \"e15f7474-ae11-4486-9feb-d6ca49655405\") " pod="openshift-image-registry/image-registry-59959bf766-kn9ns" Jul 06 13:46:43.153032 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:43.153009 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e15f7474-ae11-4486-9feb-d6ca49655405-installation-pull-secrets\") pod \"image-registry-59959bf766-kn9ns\" (UID: \"e15f7474-ae11-4486-9feb-d6ca49655405\") " pod="openshift-image-registry/image-registry-59959bf766-kn9ns" Jul 06 13:46:43.153220 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:43.153199 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e15f7474-ae11-4486-9feb-d6ca49655405-registry-tls\") pod \"image-registry-59959bf766-kn9ns\" (UID: \"e15f7474-ae11-4486-9feb-d6ca49655405\") " pod="openshift-image-registry/image-registry-59959bf766-kn9ns" Jul 06 13:46:43.153548 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:43.153528 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e15f7474-ae11-4486-9feb-d6ca49655405-image-registry-private-configuration\") pod \"image-registry-59959bf766-kn9ns\" (UID: \"e15f7474-ae11-4486-9feb-d6ca49655405\") " pod="openshift-image-registry/image-registry-59959bf766-kn9ns" Jul 06 13:46:43.158765 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:43.158744 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e15f7474-ae11-4486-9feb-d6ca49655405-bound-sa-token\") pod \"image-registry-59959bf766-kn9ns\" (UID: \"e15f7474-ae11-4486-9feb-d6ca49655405\") " pod="openshift-image-registry/image-registry-59959bf766-kn9ns" Jul 06 13:46:43.158765 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:43.158751 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cspgm\" (UniqueName: \"kubernetes.io/projected/e15f7474-ae11-4486-9feb-d6ca49655405-kube-api-access-cspgm\") pod \"image-registry-59959bf766-kn9ns\" (UID: \"e15f7474-ae11-4486-9feb-d6ca49655405\") " pod="openshift-image-registry/image-registry-59959bf766-kn9ns" Jul 06 13:46:43.242983 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:43.242946 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59959bf766-kn9ns" Jul 06 13:46:45.395772 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:45.395746 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59959bf766-kn9ns"] Jul 06 13:46:45.399165 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:46:45.399142 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode15f7474_ae11_4486_9feb_d6ca49655405.slice/crio-6ce1d7fcce34fe0a5cec74be662f4033121c6927b24666612956ba2fd8274361 WatchSource:0}: Error finding container 6ce1d7fcce34fe0a5cec74be662f4033121c6927b24666612956ba2fd8274361: Status 404 returned error can't find the container with id 6ce1d7fcce34fe0a5cec74be662f4033121c6927b24666612956ba2fd8274361 Jul 06 13:46:45.470394 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:45.470369 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/39f1f56d-ff91-4983-b7b1-602a2bf245d8-metrics-tls\") pod \"dns-default-zz5qt\" (UID: \"39f1f56d-ff91-4983-b7b1-602a2bf245d8\") " pod="openshift-dns/dns-default-zz5qt" Jul 06 13:46:45.472383 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:45.472359 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/39f1f56d-ff91-4983-b7b1-602a2bf245d8-metrics-tls\") pod \"dns-default-zz5qt\" (UID: \"39f1f56d-ff91-4983-b7b1-602a2bf245d8\") " pod="openshift-dns/dns-default-zz5qt" Jul 06 13:46:45.745275 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:45.745239 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5h29s\"" Jul 06 13:46:45.752491 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:45.752471 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zz5qt" Jul 06 13:46:45.904671 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:45.904574 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zz5qt"] Jul 06 13:46:45.907044 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:46:45.907019 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39f1f56d_ff91_4983_b7b1_602a2bf245d8.slice/crio-0f1f1ca08e967dcaaaf6a2b7d436cddc1784df23c5d5f332d92e6071bd8ae1e0 WatchSource:0}: Error finding container 0f1f1ca08e967dcaaaf6a2b7d436cddc1784df23c5d5f332d92e6071bd8ae1e0: Status 404 returned error can't find the container with id 0f1f1ca08e967dcaaaf6a2b7d436cddc1784df23c5d5f332d92e6071bd8ae1e0 Jul 06 13:46:46.195657 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:46.195629 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zz5qt" event={"ID":"39f1f56d-ff91-4983-b7b1-602a2bf245d8","Type":"ContainerStarted","Data":"0f1f1ca08e967dcaaaf6a2b7d436cddc1784df23c5d5f332d92e6071bd8ae1e0"} Jul 06 13:46:46.197282 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:46.197256 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2x68v" event={"ID":"d72c5579-a74a-4fe9-8c89-75cff6c559ea","Type":"ContainerStarted","Data":"17e8381a1110183cde83834d98ee2fe3564a437b72922e4344714ab6ad284e74"} Jul 06 13:46:46.197378 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:46.197316 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2x68v" event={"ID":"d72c5579-a74a-4fe9-8c89-75cff6c559ea","Type":"ContainerStarted","Data":"d97f146a7ba4b29f8ca5a641525eebdf9228c81e84cf31f8024817dc7fe90fd8"} Jul 06 13:46:46.198655 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:46.198633 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59959bf766-kn9ns" event={"ID":"e15f7474-ae11-4486-9feb-d6ca49655405","Type":"ContainerStarted","Data":"a41610069d249c1bf3c64d907cc038dd0b56300d376f6fabc5229f424304417f"} Jul 06 13:46:46.198740 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:46.198671 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59959bf766-kn9ns" event={"ID":"e15f7474-ae11-4486-9feb-d6ca49655405","Type":"ContainerStarted","Data":"6ce1d7fcce34fe0a5cec74be662f4033121c6927b24666612956ba2fd8274361"} Jul 06 13:46:46.198781 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:46.198758 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-59959bf766-kn9ns" Jul 06 13:46:46.219980 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:46.219934 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-59959bf766-kn9ns" podStartSLOduration=4.219921659 podStartE2EDuration="4.219921659s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:46:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:46:46.219275448 +0000 UTC m=+100.019021142" watchObservedRunningTime="2026-07-06 13:46:46.219921659 +0000 UTC m=+100.019667351" Jul 06 13:46:47.781734 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:47.781612 2556 scope.go:117] "RemoveContainer" containerID="eaca6fdfe99505d5bc5552aaa200ac3ed9f98fd0128033956a8c8e512b11eebb" Jul 06 13:46:48.090100 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:48.090068 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-nzf92" Jul 06 13:46:48.206876 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:48.206842 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zz5qt" event={"ID":"39f1f56d-ff91-4983-b7b1-602a2bf245d8","Type":"ContainerStarted","Data":"38cb52347c69b4ebd835279f088ed3ba1ad7e2a429ae1be7800ea47c11bc56ed"} Jul 06 13:46:48.364035 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:48.363957 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:48.465036 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:48.464997 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:49.154995 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:49.154958 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:49.213016 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:49.212934 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2x68v" event={"ID":"d72c5579-a74a-4fe9-8c89-75cff6c559ea","Type":"ContainerStarted","Data":"93115b3975c0d66dcf45ef4141c60537bc492000ddfb2d5debc4563711b1bc14"} Jul 06 13:46:49.214848 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:49.214821 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vjl62_b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7/console-operator/2.log" Jul 06 13:46:49.214961 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:49.214936 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-vjl62" event={"ID":"b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7","Type":"ContainerStarted","Data":"45c3830240bcc5f8d879b782891b9c2313bcb63344325ba6687053806ec5dd98"} Jul 06 13:46:49.215243 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:49.215183 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-vjl62" Jul 06 13:46:49.216882 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:49.216842 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zz5qt" event={"ID":"39f1f56d-ff91-4983-b7b1-602a2bf245d8","Type":"ContainerStarted","Data":"99a27f7116616977007c93c0ef0e033a9cb562b26ea86dc9dbaca93a48a38cf1"} Jul 06 13:46:49.216989 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:49.216973 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-zz5qt" Jul 06 13:46:49.220525 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:49.220506 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-vjl62" Jul 06 13:46:49.233477 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:49.233439 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2x68v" podStartSLOduration=33.027523119 podStartE2EDuration="40.23342379s" totalImagesPullingTime="7.205900671s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:46:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:46:49.231841883 +0000 UTC m=+103.031587590" watchObservedRunningTime="2026-07-06 13:46:49.23342379 +0000 UTC m=+103.033169512" Jul 06 13:46:49.237472 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:49.237447 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:49.252457 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:49.252422 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-zz5qt" podStartSLOduration=66.594613035 podStartE2EDuration="1m8.252408767s" totalImagesPullingTime="1.657795732s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:45:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:46:49.251161638 +0000 UTC m=+103.050907331" watchObservedRunningTime="2026-07-06 13:46:49.252408767 +0000 UTC m=+103.052154460" Jul 06 13:46:49.268291 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:49.268248 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-vjl62" podStartSLOduration=42.06280222 podStartE2EDuration="44.268237811s" totalImagesPullingTime="2.205435591s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:46:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:46:49.267872741 +0000 UTC m=+103.067618436" watchObservedRunningTime="2026-07-06 13:46:49.268237811 +0000 UTC m=+103.067983507" Jul 06 13:46:49.315003 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:49.314975 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:49.460975 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:49.460941 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:49.517558 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:49.517529 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:49.830644 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:49.830556 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:49.898523 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:49.898489 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:50.227496 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:50.227423 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:50.301001 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:50.300975 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:50.457253 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:50.457220 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:50.514311 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:50.514282 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:50.635673 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:50.635639 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:50.836131 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:50.836054 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:50.936169 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:50.936142 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:52.084884 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:52.084850 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:52.183703 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:52.183675 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:52.316536 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:52.316508 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:54.375911 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.375877 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:54.482132 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.482094 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-c9c94fb85-q7ksk"] Jul 06 13:46:54.485167 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.485146 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c9c94fb85-q7ksk" Jul 06 13:46:54.488014 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.487995 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 06 13:46:54.488238 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.488225 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 06 13:46:54.489324 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.489305 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 06 13:46:54.489527 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.489513 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 06 13:46:54.489645 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.489594 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 06 13:46:54.489645 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.489640 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 06 13:46:54.489763 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.489712 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 06 13:46:54.489821 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.489766 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-kgjzc\"" Jul 06 13:46:54.493017 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.492991 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:54.498672 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.498652 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c9c94fb85-q7ksk"] Jul 06 13:46:54.605612 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.605579 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:54.629262 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.629203 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2ftx5"] Jul 06 13:46:54.631473 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.631457 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2ftx5" Jul 06 13:46:54.634595 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.634570 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 06 13:46:54.634759 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.634740 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 06 13:46:54.634988 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.634970 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 06 13:46:54.636069 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.636048 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-pzqr7\"" Jul 06 13:46:54.636069 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.636064 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 06 13:46:54.640260 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.640229 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-njffn"] Jul 06 13:46:54.642342 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.642325 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-njffn" Jul 06 13:46:54.643514 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.643490 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2ftx5"] Jul 06 13:46:54.644702 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.644676 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/922fdb62-3242-4730-b74d-cf50e3687fb0-console-serving-cert\") pod \"console-c9c94fb85-q7ksk\" (UID: \"922fdb62-3242-4730-b74d-cf50e3687fb0\") " pod="openshift-console/console-c9c94fb85-q7ksk" Jul 06 13:46:54.644811 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.644721 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/922fdb62-3242-4730-b74d-cf50e3687fb0-oauth-serving-cert\") pod \"console-c9c94fb85-q7ksk\" (UID: \"922fdb62-3242-4730-b74d-cf50e3687fb0\") " pod="openshift-console/console-c9c94fb85-q7ksk" Jul 06 13:46:54.644811 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.644755 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ps5hq\" (UniqueName: \"kubernetes.io/projected/922fdb62-3242-4730-b74d-cf50e3687fb0-kube-api-access-ps5hq\") pod \"console-c9c94fb85-q7ksk\" (UID: \"922fdb62-3242-4730-b74d-cf50e3687fb0\") " pod="openshift-console/console-c9c94fb85-q7ksk" Jul 06 13:46:54.644919 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.644843 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/922fdb62-3242-4730-b74d-cf50e3687fb0-console-oauth-config\") pod \"console-c9c94fb85-q7ksk\" (UID: \"922fdb62-3242-4730-b74d-cf50e3687fb0\") " pod="openshift-console/console-c9c94fb85-q7ksk" Jul 06 13:46:54.644919 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.644876 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/922fdb62-3242-4730-b74d-cf50e3687fb0-console-config\") pod \"console-c9c94fb85-q7ksk\" (UID: \"922fdb62-3242-4730-b74d-cf50e3687fb0\") " pod="openshift-console/console-c9c94fb85-q7ksk" Jul 06 13:46:54.644919 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.644911 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/922fdb62-3242-4730-b74d-cf50e3687fb0-service-ca\") pod \"console-c9c94fb85-q7ksk\" (UID: \"922fdb62-3242-4730-b74d-cf50e3687fb0\") " pod="openshift-console/console-c9c94fb85-q7ksk" Jul 06 13:46:54.645571 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.645550 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 06 13:46:54.645806 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.645786 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-lqf4q\"" Jul 06 13:46:54.646067 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.646050 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 06 13:46:54.646190 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.646171 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 06 13:46:54.701748 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.701710 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:54.746165 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.746144 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/922fdb62-3242-4730-b74d-cf50e3687fb0-oauth-serving-cert\") pod \"console-c9c94fb85-q7ksk\" (UID: \"922fdb62-3242-4730-b74d-cf50e3687fb0\") " pod="openshift-console/console-c9c94fb85-q7ksk" Jul 06 13:46:54.746278 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.746172 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ps5hq\" (UniqueName: \"kubernetes.io/projected/922fdb62-3242-4730-b74d-cf50e3687fb0-kube-api-access-ps5hq\") pod \"console-c9c94fb85-q7ksk\" (UID: \"922fdb62-3242-4730-b74d-cf50e3687fb0\") " pod="openshift-console/console-c9c94fb85-q7ksk" Jul 06 13:46:54.746278 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.746195 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/30395750-6592-40d0-ac24-8573d4e55d6b-root\") pod \"node-exporter-njffn\" (UID: \"30395750-6592-40d0-ac24-8573d4e55d6b\") " pod="openshift-monitoring/node-exporter-njffn" Jul 06 13:46:54.746278 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.746215 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c132506e-d653-4be7-ba5c-0f3a74ca7b82-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-2ftx5\" (UID: \"c132506e-d653-4be7-ba5c-0f3a74ca7b82\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2ftx5" Jul 06 13:46:54.746278 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.746248 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkqwm\" (UniqueName: \"kubernetes.io/projected/c132506e-d653-4be7-ba5c-0f3a74ca7b82-kube-api-access-tkqwm\") pod \"kube-state-metrics-7c9dbb8b7d-2ftx5\" (UID: \"c132506e-d653-4be7-ba5c-0f3a74ca7b82\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2ftx5" Jul 06 13:46:54.746498 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.746288 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c132506e-d653-4be7-ba5c-0f3a74ca7b82-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-2ftx5\" (UID: \"c132506e-d653-4be7-ba5c-0f3a74ca7b82\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2ftx5" Jul 06 13:46:54.746498 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.746314 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c132506e-d653-4be7-ba5c-0f3a74ca7b82-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-2ftx5\" (UID: \"c132506e-d653-4be7-ba5c-0f3a74ca7b82\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2ftx5" Jul 06 13:46:54.746498 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.746342 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/922fdb62-3242-4730-b74d-cf50e3687fb0-console-oauth-config\") pod \"console-c9c94fb85-q7ksk\" (UID: \"922fdb62-3242-4730-b74d-cf50e3687fb0\") " pod="openshift-console/console-c9c94fb85-q7ksk" Jul 06 13:46:54.746498 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.746367 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/30395750-6592-40d0-ac24-8573d4e55d6b-node-exporter-tls\") pod \"node-exporter-njffn\" (UID: \"30395750-6592-40d0-ac24-8573d4e55d6b\") " pod="openshift-monitoring/node-exporter-njffn" Jul 06 13:46:54.746498 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.746390 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30395750-6592-40d0-ac24-8573d4e55d6b-metrics-client-ca\") pod \"node-exporter-njffn\" (UID: \"30395750-6592-40d0-ac24-8573d4e55d6b\") " pod="openshift-monitoring/node-exporter-njffn" Jul 06 13:46:54.746498 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.746418 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/922fdb62-3242-4730-b74d-cf50e3687fb0-console-config\") pod \"console-c9c94fb85-q7ksk\" (UID: \"922fdb62-3242-4730-b74d-cf50e3687fb0\") " pod="openshift-console/console-c9c94fb85-q7ksk" Jul 06 13:46:54.746498 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.746441 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/30395750-6592-40d0-ac24-8573d4e55d6b-node-exporter-textfile\") pod \"node-exporter-njffn\" (UID: \"30395750-6592-40d0-ac24-8573d4e55d6b\") " pod="openshift-monitoring/node-exporter-njffn" Jul 06 13:46:54.746498 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.746468 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c132506e-d653-4be7-ba5c-0f3a74ca7b82-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-2ftx5\" (UID: \"c132506e-d653-4be7-ba5c-0f3a74ca7b82\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2ftx5" Jul 06 13:46:54.746930 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.746509 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/30395750-6592-40d0-ac24-8573d4e55d6b-node-exporter-accelerators-collector-config\") pod \"node-exporter-njffn\" (UID: \"30395750-6592-40d0-ac24-8573d4e55d6b\") " pod="openshift-monitoring/node-exporter-njffn" Jul 06 13:46:54.746930 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.746538 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gbdb\" (UniqueName: \"kubernetes.io/projected/30395750-6592-40d0-ac24-8573d4e55d6b-kube-api-access-4gbdb\") pod \"node-exporter-njffn\" (UID: \"30395750-6592-40d0-ac24-8573d4e55d6b\") " pod="openshift-monitoring/node-exporter-njffn" Jul 06 13:46:54.746930 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.746568 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/30395750-6592-40d0-ac24-8573d4e55d6b-node-exporter-wtmp\") pod \"node-exporter-njffn\" (UID: \"30395750-6592-40d0-ac24-8573d4e55d6b\") " pod="openshift-monitoring/node-exporter-njffn" Jul 06 13:46:54.746930 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.746597 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/922fdb62-3242-4730-b74d-cf50e3687fb0-service-ca\") pod \"console-c9c94fb85-q7ksk\" (UID: \"922fdb62-3242-4730-b74d-cf50e3687fb0\") " pod="openshift-console/console-c9c94fb85-q7ksk" Jul 06 13:46:54.746930 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.746645 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/30395750-6592-40d0-ac24-8573d4e55d6b-sys\") pod \"node-exporter-njffn\" (UID: \"30395750-6592-40d0-ac24-8573d4e55d6b\") " pod="openshift-monitoring/node-exporter-njffn" Jul 06 13:46:54.746930 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.746695 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c132506e-d653-4be7-ba5c-0f3a74ca7b82-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-2ftx5\" (UID: \"c132506e-d653-4be7-ba5c-0f3a74ca7b82\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2ftx5" Jul 06 13:46:54.746930 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.746725 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/922fdb62-3242-4730-b74d-cf50e3687fb0-console-serving-cert\") pod \"console-c9c94fb85-q7ksk\" (UID: \"922fdb62-3242-4730-b74d-cf50e3687fb0\") " pod="openshift-console/console-c9c94fb85-q7ksk" Jul 06 13:46:54.746930 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.746749 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/30395750-6592-40d0-ac24-8573d4e55d6b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-njffn\" (UID: \"30395750-6592-40d0-ac24-8573d4e55d6b\") " pod="openshift-monitoring/node-exporter-njffn" Jul 06 13:46:54.747308 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.747042 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/922fdb62-3242-4730-b74d-cf50e3687fb0-oauth-serving-cert\") pod \"console-c9c94fb85-q7ksk\" (UID: \"922fdb62-3242-4730-b74d-cf50e3687fb0\") " pod="openshift-console/console-c9c94fb85-q7ksk" Jul 06 13:46:54.747308 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.747178 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/922fdb62-3242-4730-b74d-cf50e3687fb0-console-config\") pod \"console-c9c94fb85-q7ksk\" (UID: \"922fdb62-3242-4730-b74d-cf50e3687fb0\") " pod="openshift-console/console-c9c94fb85-q7ksk" Jul 06 13:46:54.747417 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.747305 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/922fdb62-3242-4730-b74d-cf50e3687fb0-service-ca\") pod \"console-c9c94fb85-q7ksk\" (UID: \"922fdb62-3242-4730-b74d-cf50e3687fb0\") " pod="openshift-console/console-c9c94fb85-q7ksk" Jul 06 13:46:54.749029 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.749006 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/922fdb62-3242-4730-b74d-cf50e3687fb0-console-oauth-config\") pod \"console-c9c94fb85-q7ksk\" (UID: \"922fdb62-3242-4730-b74d-cf50e3687fb0\") " pod="openshift-console/console-c9c94fb85-q7ksk" Jul 06 13:46:54.749269 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.749246 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/922fdb62-3242-4730-b74d-cf50e3687fb0-console-serving-cert\") pod \"console-c9c94fb85-q7ksk\" (UID: \"922fdb62-3242-4730-b74d-cf50e3687fb0\") " pod="openshift-console/console-c9c94fb85-q7ksk" Jul 06 13:46:54.760194 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.760172 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ps5hq\" (UniqueName: \"kubernetes.io/projected/922fdb62-3242-4730-b74d-cf50e3687fb0-kube-api-access-ps5hq\") pod \"console-c9c94fb85-q7ksk\" (UID: \"922fdb62-3242-4730-b74d-cf50e3687fb0\") " pod="openshift-console/console-c9c94fb85-q7ksk" Jul 06 13:46:54.794515 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.794492 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c9c94fb85-q7ksk" Jul 06 13:46:54.798831 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.798790 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:54.848637 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.848271 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/30395750-6592-40d0-ac24-8573d4e55d6b-sys\") pod \"node-exporter-njffn\" (UID: \"30395750-6592-40d0-ac24-8573d4e55d6b\") " pod="openshift-monitoring/node-exporter-njffn" Jul 06 13:46:54.848637 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.848333 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c132506e-d653-4be7-ba5c-0f3a74ca7b82-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-2ftx5\" (UID: \"c132506e-d653-4be7-ba5c-0f3a74ca7b82\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2ftx5" Jul 06 13:46:54.848637 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.848367 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/30395750-6592-40d0-ac24-8573d4e55d6b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-njffn\" (UID: \"30395750-6592-40d0-ac24-8573d4e55d6b\") " pod="openshift-monitoring/node-exporter-njffn" Jul 06 13:46:54.848637 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.848405 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/30395750-6592-40d0-ac24-8573d4e55d6b-root\") pod \"node-exporter-njffn\" (UID: \"30395750-6592-40d0-ac24-8573d4e55d6b\") " pod="openshift-monitoring/node-exporter-njffn" Jul 06 13:46:54.848637 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.848430 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c132506e-d653-4be7-ba5c-0f3a74ca7b82-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-2ftx5\" (UID: \"c132506e-d653-4be7-ba5c-0f3a74ca7b82\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2ftx5" Jul 06 13:46:54.848637 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.848463 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkqwm\" (UniqueName: \"kubernetes.io/projected/c132506e-d653-4be7-ba5c-0f3a74ca7b82-kube-api-access-tkqwm\") pod \"kube-state-metrics-7c9dbb8b7d-2ftx5\" (UID: \"c132506e-d653-4be7-ba5c-0f3a74ca7b82\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2ftx5" Jul 06 13:46:54.848637 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.848506 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c132506e-d653-4be7-ba5c-0f3a74ca7b82-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-2ftx5\" (UID: \"c132506e-d653-4be7-ba5c-0f3a74ca7b82\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2ftx5" Jul 06 13:46:54.848637 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.848550 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c132506e-d653-4be7-ba5c-0f3a74ca7b82-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-2ftx5\" (UID: \"c132506e-d653-4be7-ba5c-0f3a74ca7b82\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2ftx5" Jul 06 13:46:54.848637 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.848578 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/30395750-6592-40d0-ac24-8573d4e55d6b-node-exporter-tls\") pod \"node-exporter-njffn\" (UID: \"30395750-6592-40d0-ac24-8573d4e55d6b\") " pod="openshift-monitoring/node-exporter-njffn" Jul 06 13:46:54.848637 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.848601 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30395750-6592-40d0-ac24-8573d4e55d6b-metrics-client-ca\") pod \"node-exporter-njffn\" (UID: \"30395750-6592-40d0-ac24-8573d4e55d6b\") " pod="openshift-monitoring/node-exporter-njffn" Jul 06 13:46:54.849216 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.848648 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/30395750-6592-40d0-ac24-8573d4e55d6b-node-exporter-textfile\") pod \"node-exporter-njffn\" (UID: \"30395750-6592-40d0-ac24-8573d4e55d6b\") " pod="openshift-monitoring/node-exporter-njffn" Jul 06 13:46:54.849216 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.848686 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c132506e-d653-4be7-ba5c-0f3a74ca7b82-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-2ftx5\" (UID: \"c132506e-d653-4be7-ba5c-0f3a74ca7b82\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2ftx5" Jul 06 13:46:54.849216 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.848711 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/30395750-6592-40d0-ac24-8573d4e55d6b-node-exporter-accelerators-collector-config\") pod \"node-exporter-njffn\" (UID: \"30395750-6592-40d0-ac24-8573d4e55d6b\") " pod="openshift-monitoring/node-exporter-njffn" Jul 06 13:46:54.849216 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.848732 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gbdb\" (UniqueName: \"kubernetes.io/projected/30395750-6592-40d0-ac24-8573d4e55d6b-kube-api-access-4gbdb\") pod \"node-exporter-njffn\" (UID: \"30395750-6592-40d0-ac24-8573d4e55d6b\") " pod="openshift-monitoring/node-exporter-njffn" Jul 06 13:46:54.849216 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.848760 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/30395750-6592-40d0-ac24-8573d4e55d6b-node-exporter-wtmp\") pod \"node-exporter-njffn\" (UID: \"30395750-6592-40d0-ac24-8573d4e55d6b\") " pod="openshift-monitoring/node-exporter-njffn" Jul 06 13:46:54.849216 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.848941 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/30395750-6592-40d0-ac24-8573d4e55d6b-node-exporter-wtmp\") pod \"node-exporter-njffn\" (UID: \"30395750-6592-40d0-ac24-8573d4e55d6b\") " pod="openshift-monitoring/node-exporter-njffn" Jul 06 13:46:54.849216 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.848996 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/30395750-6592-40d0-ac24-8573d4e55d6b-sys\") pod \"node-exporter-njffn\" (UID: \"30395750-6592-40d0-ac24-8573d4e55d6b\") " pod="openshift-monitoring/node-exporter-njffn" Jul 06 13:46:54.853104 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.852925 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c132506e-d653-4be7-ba5c-0f3a74ca7b82-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-2ftx5\" (UID: \"c132506e-d653-4be7-ba5c-0f3a74ca7b82\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2ftx5" Jul 06 13:46:54.856415 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.854767 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30395750-6592-40d0-ac24-8573d4e55d6b-metrics-client-ca\") pod \"node-exporter-njffn\" (UID: \"30395750-6592-40d0-ac24-8573d4e55d6b\") " pod="openshift-monitoring/node-exporter-njffn" Jul 06 13:46:54.856415 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.855214 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/30395750-6592-40d0-ac24-8573d4e55d6b-node-exporter-accelerators-collector-config\") pod \"node-exporter-njffn\" (UID: \"30395750-6592-40d0-ac24-8573d4e55d6b\") " pod="openshift-monitoring/node-exporter-njffn" Jul 06 13:46:54.856415 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.855367 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/30395750-6592-40d0-ac24-8573d4e55d6b-root\") pod \"node-exporter-njffn\" (UID: \"30395750-6592-40d0-ac24-8573d4e55d6b\") " pod="openshift-monitoring/node-exporter-njffn" Jul 06 13:46:54.856415 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.855791 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c132506e-d653-4be7-ba5c-0f3a74ca7b82-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-2ftx5\" (UID: \"c132506e-d653-4be7-ba5c-0f3a74ca7b82\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2ftx5" Jul 06 13:46:54.856415 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.856092 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/30395750-6592-40d0-ac24-8573d4e55d6b-node-exporter-textfile\") pod \"node-exporter-njffn\" (UID: \"30395750-6592-40d0-ac24-8573d4e55d6b\") " pod="openshift-monitoring/node-exporter-njffn" Jul 06 13:46:54.856415 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.856377 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c132506e-d653-4be7-ba5c-0f3a74ca7b82-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-2ftx5\" (UID: \"c132506e-d653-4be7-ba5c-0f3a74ca7b82\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2ftx5" Jul 06 13:46:54.861698 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.859432 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c132506e-d653-4be7-ba5c-0f3a74ca7b82-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-2ftx5\" (UID: \"c132506e-d653-4be7-ba5c-0f3a74ca7b82\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2ftx5" Jul 06 13:46:54.861698 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.861558 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/30395750-6592-40d0-ac24-8573d4e55d6b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-njffn\" (UID: \"30395750-6592-40d0-ac24-8573d4e55d6b\") " pod="openshift-monitoring/node-exporter-njffn" Jul 06 13:46:54.861883 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.861850 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c132506e-d653-4be7-ba5c-0f3a74ca7b82-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-2ftx5\" (UID: \"c132506e-d653-4be7-ba5c-0f3a74ca7b82\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2ftx5" Jul 06 13:46:54.869634 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.864010 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/30395750-6592-40d0-ac24-8573d4e55d6b-node-exporter-tls\") pod \"node-exporter-njffn\" (UID: \"30395750-6592-40d0-ac24-8573d4e55d6b\") " pod="openshift-monitoring/node-exporter-njffn" Jul 06 13:46:54.869634 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.865134 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkqwm\" (UniqueName: \"kubernetes.io/projected/c132506e-d653-4be7-ba5c-0f3a74ca7b82-kube-api-access-tkqwm\") pod \"kube-state-metrics-7c9dbb8b7d-2ftx5\" (UID: \"c132506e-d653-4be7-ba5c-0f3a74ca7b82\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2ftx5" Jul 06 13:46:54.869634 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.866276 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gbdb\" (UniqueName: \"kubernetes.io/projected/30395750-6592-40d0-ac24-8573d4e55d6b-kube-api-access-4gbdb\") pod \"node-exporter-njffn\" (UID: \"30395750-6592-40d0-ac24-8573d4e55d6b\") " pod="openshift-monitoring/node-exporter-njffn" Jul 06 13:46:54.899266 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.899187 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:54.941945 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.941908 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2ftx5" Jul 06 13:46:54.951988 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.951915 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c9c94fb85-q7ksk"] Jul 06 13:46:54.953091 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:54.953055 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-njffn" Jul 06 13:46:54.956930 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:46:54.956135 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod922fdb62_3242_4730_b74d_cf50e3687fb0.slice/crio-2fcad0ed8617a4870059c4b99cc52ed39ea86ed34b6178991e2b5ee648934b15 WatchSource:0}: Error finding container 2fcad0ed8617a4870059c4b99cc52ed39ea86ed34b6178991e2b5ee648934b15: Status 404 returned error can't find the container with id 2fcad0ed8617a4870059c4b99cc52ed39ea86ed34b6178991e2b5ee648934b15 Jul 06 13:46:54.967267 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:46:54.967241 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30395750_6592_40d0_ac24_8573d4e55d6b.slice/crio-eb832d7df0f355917389a1d9af733c2b125cc374016895a392f163008a3ddb3b WatchSource:0}: Error finding container eb832d7df0f355917389a1d9af733c2b125cc374016895a392f163008a3ddb3b: Status 404 returned error can't find the container with id eb832d7df0f355917389a1d9af733c2b125cc374016895a392f163008a3ddb3b Jul 06 13:46:55.035441 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:55.035410 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:55.089687 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:55.089584 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2ftx5"] Jul 06 13:46:55.092581 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:46:55.092551 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc132506e_d653_4be7_ba5c_0f3a74ca7b82.slice/crio-fa15dc79d69ea7d15b574a40097e9fbb0fa29d08899c3e81dabfe3ecb94a29c1 WatchSource:0}: Error finding container fa15dc79d69ea7d15b574a40097e9fbb0fa29d08899c3e81dabfe3ecb94a29c1: Status 404 returned error can't find the container with id fa15dc79d69ea7d15b574a40097e9fbb0fa29d08899c3e81dabfe3ecb94a29c1 Jul 06 13:46:55.227662 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:55.227574 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:55.240116 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:55.240089 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-njffn" event={"ID":"30395750-6592-40d0-ac24-8573d4e55d6b","Type":"ContainerStarted","Data":"eb832d7df0f355917389a1d9af733c2b125cc374016895a392f163008a3ddb3b"} Jul 06 13:46:55.241291 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:55.241266 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2ftx5" event={"ID":"c132506e-d653-4be7-ba5c-0f3a74ca7b82","Type":"ContainerStarted","Data":"fa15dc79d69ea7d15b574a40097e9fbb0fa29d08899c3e81dabfe3ecb94a29c1"} Jul 06 13:46:55.242395 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:55.242374 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c9c94fb85-q7ksk" event={"ID":"922fdb62-3242-4730-b74d-cf50e3687fb0","Type":"ContainerStarted","Data":"2fcad0ed8617a4870059c4b99cc52ed39ea86ed34b6178991e2b5ee648934b15"} Jul 06 13:46:55.392922 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:55.392883 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:55.589223 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:55.589189 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:55.688692 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:55.688658 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:55.896552 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:55.896456 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:57.251762 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:57.251724 2556 generic.go:356] "Generic (PLEG): container finished" podID="30395750-6592-40d0-ac24-8573d4e55d6b" containerID="9d681ad33cb4fe7a4020cfd9720e6a80f3d10f460b612da7be624daca741da7a" exitCode=0 Jul 06 13:46:57.252187 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:57.251819 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-njffn" event={"ID":"30395750-6592-40d0-ac24-8573d4e55d6b","Type":"ContainerDied","Data":"9d681ad33cb4fe7a4020cfd9720e6a80f3d10f460b612da7be624daca741da7a"} Jul 06 13:46:57.254018 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:57.253986 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2ftx5" event={"ID":"c132506e-d653-4be7-ba5c-0f3a74ca7b82","Type":"ContainerStarted","Data":"a52e396bc2d7f5f96945c39562d8c37e46a4fa8fb6f5f05299137fcae0e0dc21"} Jul 06 13:46:57.254138 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:57.254051 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2ftx5" event={"ID":"c132506e-d653-4be7-ba5c-0f3a74ca7b82","Type":"ContainerStarted","Data":"9a5b07f2347301b039d1cd0d87ceea6cbc713368f316d2d3b184d101cf29f409"} Jul 06 13:46:57.254138 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:57.254076 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2ftx5" event={"ID":"c132506e-d653-4be7-ba5c-0f3a74ca7b82","Type":"ContainerStarted","Data":"6790e65b0f24d393cbc31deb97e593fda721b41c96237fef52c00b82863fb78d"} Jul 06 13:46:57.293089 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:57.293032 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2ftx5" podStartSLOduration=1.6951797979999998 podStartE2EDuration="3.293011488s" totalImagesPullingTime="1.59783169s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:46:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:46:57.291632961 +0000 UTC m=+111.091378648" watchObservedRunningTime="2026-07-06 13:46:57.293011488 +0000 UTC m=+111.092757181" Jul 06 13:46:57.575291 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:57.575198 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:57.674518 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:57.674443 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:57.780688 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:57.780656 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:57.839408 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:57.839294 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:58.261075 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:58.261035 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-njffn" event={"ID":"30395750-6592-40d0-ac24-8573d4e55d6b","Type":"ContainerStarted","Data":"14e9dc989c240ffc31fffc9f6b1ff26d9a8d89dda996a1bfa152b7da1f836baf"} Jul 06 13:46:58.261576 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:58.261108 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-njffn" event={"ID":"30395750-6592-40d0-ac24-8573d4e55d6b","Type":"ContainerStarted","Data":"f00ee170cf754c57e479f648768d02ad429a4b408ebd77c8e25ce8c5829e6b58"} Jul 06 13:46:58.288402 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:58.288352 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-njffn" podStartSLOduration=2.902639432 podStartE2EDuration="4.288336204s" totalImagesPullingTime="1.304039927s" totalInitContainerRuntime="81.656845ms" isStatefulPod=true podCreationTimestamp="2026-07-06 13:46:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:46:58.28654375 +0000 UTC m=+112.086289446" watchObservedRunningTime="2026-07-06 13:46:58.288336204 +0000 UTC m=+112.088081935" Jul 06 13:46:58.920988 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:58.920954 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5875c5dd9d-97pfx"] Jul 06 13:46:58.923013 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:58.922995 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5875c5dd9d-97pfx" Jul 06 13:46:58.926807 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:58.926745 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-fdei9jf7vfh13\"" Jul 06 13:46:58.927146 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:58.926836 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 06 13:46:58.927146 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:58.926879 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 06 13:46:58.927146 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:58.926953 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-hxrqf\"" Jul 06 13:46:58.927146 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:58.926859 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 06 13:46:58.927146 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:58.926859 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 06 13:46:58.933439 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:58.933415 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5875c5dd9d-97pfx"] Jul 06 13:46:58.987052 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:58.987031 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/59d49927-745f-4803-a410-9456251924fc-secret-metrics-server-client-certs\") pod \"metrics-server-5875c5dd9d-97pfx\" (UID: \"59d49927-745f-4803-a410-9456251924fc\") " pod="openshift-monitoring/metrics-server-5875c5dd9d-97pfx" Jul 06 13:46:58.987155 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:58.987062 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/59d49927-745f-4803-a410-9456251924fc-audit-log\") pod \"metrics-server-5875c5dd9d-97pfx\" (UID: \"59d49927-745f-4803-a410-9456251924fc\") " pod="openshift-monitoring/metrics-server-5875c5dd9d-97pfx" Jul 06 13:46:58.987155 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:58.987088 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/59d49927-745f-4803-a410-9456251924fc-metrics-server-audit-profiles\") pod \"metrics-server-5875c5dd9d-97pfx\" (UID: \"59d49927-745f-4803-a410-9456251924fc\") " pod="openshift-monitoring/metrics-server-5875c5dd9d-97pfx" Jul 06 13:46:58.987155 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:58.987103 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcskd\" (UniqueName: \"kubernetes.io/projected/59d49927-745f-4803-a410-9456251924fc-kube-api-access-hcskd\") pod \"metrics-server-5875c5dd9d-97pfx\" (UID: \"59d49927-745f-4803-a410-9456251924fc\") " pod="openshift-monitoring/metrics-server-5875c5dd9d-97pfx" Jul 06 13:46:58.987270 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:58.987176 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59d49927-745f-4803-a410-9456251924fc-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5875c5dd9d-97pfx\" (UID: \"59d49927-745f-4803-a410-9456251924fc\") " pod="openshift-monitoring/metrics-server-5875c5dd9d-97pfx" Jul 06 13:46:58.987270 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:58.987214 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/59d49927-745f-4803-a410-9456251924fc-secret-metrics-server-tls\") pod \"metrics-server-5875c5dd9d-97pfx\" (UID: \"59d49927-745f-4803-a410-9456251924fc\") " pod="openshift-monitoring/metrics-server-5875c5dd9d-97pfx" Jul 06 13:46:58.987270 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:58.987245 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/59d49927-745f-4803-a410-9456251924fc-client-ca-bundle\") pod \"metrics-server-5875c5dd9d-97pfx\" (UID: \"59d49927-745f-4803-a410-9456251924fc\") " pod="openshift-monitoring/metrics-server-5875c5dd9d-97pfx" Jul 06 13:46:59.088111 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:59.088085 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/59d49927-745f-4803-a410-9456251924fc-secret-metrics-server-client-certs\") pod \"metrics-server-5875c5dd9d-97pfx\" (UID: \"59d49927-745f-4803-a410-9456251924fc\") " pod="openshift-monitoring/metrics-server-5875c5dd9d-97pfx" Jul 06 13:46:59.088218 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:59.088124 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/59d49927-745f-4803-a410-9456251924fc-audit-log\") pod \"metrics-server-5875c5dd9d-97pfx\" (UID: \"59d49927-745f-4803-a410-9456251924fc\") " pod="openshift-monitoring/metrics-server-5875c5dd9d-97pfx" Jul 06 13:46:59.088218 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:59.088166 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/59d49927-745f-4803-a410-9456251924fc-metrics-server-audit-profiles\") pod \"metrics-server-5875c5dd9d-97pfx\" (UID: \"59d49927-745f-4803-a410-9456251924fc\") " pod="openshift-monitoring/metrics-server-5875c5dd9d-97pfx" Jul 06 13:46:59.088218 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:59.088193 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcskd\" (UniqueName: \"kubernetes.io/projected/59d49927-745f-4803-a410-9456251924fc-kube-api-access-hcskd\") pod \"metrics-server-5875c5dd9d-97pfx\" (UID: \"59d49927-745f-4803-a410-9456251924fc\") " pod="openshift-monitoring/metrics-server-5875c5dd9d-97pfx" Jul 06 13:46:59.088370 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:59.088296 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59d49927-745f-4803-a410-9456251924fc-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5875c5dd9d-97pfx\" (UID: \"59d49927-745f-4803-a410-9456251924fc\") " pod="openshift-monitoring/metrics-server-5875c5dd9d-97pfx" Jul 06 13:46:59.088370 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:59.088351 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/59d49927-745f-4803-a410-9456251924fc-secret-metrics-server-tls\") pod \"metrics-server-5875c5dd9d-97pfx\" (UID: \"59d49927-745f-4803-a410-9456251924fc\") " pod="openshift-monitoring/metrics-server-5875c5dd9d-97pfx" Jul 06 13:46:59.088463 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:59.088403 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/59d49927-745f-4803-a410-9456251924fc-client-ca-bundle\") pod \"metrics-server-5875c5dd9d-97pfx\" (UID: \"59d49927-745f-4803-a410-9456251924fc\") " pod="openshift-monitoring/metrics-server-5875c5dd9d-97pfx" Jul 06 13:46:59.088695 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:59.088669 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/59d49927-745f-4803-a410-9456251924fc-audit-log\") pod \"metrics-server-5875c5dd9d-97pfx\" (UID: \"59d49927-745f-4803-a410-9456251924fc\") " pod="openshift-monitoring/metrics-server-5875c5dd9d-97pfx" Jul 06 13:46:59.089066 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:59.089037 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59d49927-745f-4803-a410-9456251924fc-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5875c5dd9d-97pfx\" (UID: \"59d49927-745f-4803-a410-9456251924fc\") " pod="openshift-monitoring/metrics-server-5875c5dd9d-97pfx" Jul 06 13:46:59.089232 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:59.089208 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/59d49927-745f-4803-a410-9456251924fc-metrics-server-audit-profiles\") pod \"metrics-server-5875c5dd9d-97pfx\" (UID: \"59d49927-745f-4803-a410-9456251924fc\") " pod="openshift-monitoring/metrics-server-5875c5dd9d-97pfx" Jul 06 13:46:59.090634 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:59.090595 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/59d49927-745f-4803-a410-9456251924fc-secret-metrics-server-client-certs\") pod \"metrics-server-5875c5dd9d-97pfx\" (UID: \"59d49927-745f-4803-a410-9456251924fc\") " pod="openshift-monitoring/metrics-server-5875c5dd9d-97pfx" Jul 06 13:46:59.090798 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:59.090776 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/59d49927-745f-4803-a410-9456251924fc-secret-metrics-server-tls\") pod \"metrics-server-5875c5dd9d-97pfx\" (UID: \"59d49927-745f-4803-a410-9456251924fc\") " pod="openshift-monitoring/metrics-server-5875c5dd9d-97pfx" Jul 06 13:46:59.090858 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:59.090784 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/59d49927-745f-4803-a410-9456251924fc-client-ca-bundle\") pod \"metrics-server-5875c5dd9d-97pfx\" (UID: \"59d49927-745f-4803-a410-9456251924fc\") " pod="openshift-monitoring/metrics-server-5875c5dd9d-97pfx" Jul 06 13:46:59.096986 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:59.096966 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcskd\" (UniqueName: \"kubernetes.io/projected/59d49927-745f-4803-a410-9456251924fc-kube-api-access-hcskd\") pod \"metrics-server-5875c5dd9d-97pfx\" (UID: \"59d49927-745f-4803-a410-9456251924fc\") " pod="openshift-monitoring/metrics-server-5875c5dd9d-97pfx" Jul 06 13:46:59.222501 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:59.222439 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-zz5qt" Jul 06 13:46:59.232533 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:59.232517 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5875c5dd9d-97pfx" Jul 06 13:46:59.266133 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:59.266052 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c9c94fb85-q7ksk" event={"ID":"922fdb62-3242-4730-b74d-cf50e3687fb0","Type":"ContainerStarted","Data":"d4ff2693d6fff015702c7ae0a4d40fa259876a204a2bea5f808ee2a3e21ebc03"} Jul 06 13:46:59.288586 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:59.288534 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-c9c94fb85-q7ksk" podStartSLOduration=1.5723332490000002 podStartE2EDuration="5.288506436s" totalImagesPullingTime="3.716173187s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:46:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:46:59.286562796 +0000 UTC m=+113.086308491" watchObservedRunningTime="2026-07-06 13:46:59.288506436 +0000 UTC m=+113.088252132" Jul 06 13:46:59.379844 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:59.376169 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5875c5dd9d-97pfx"] Jul 06 13:46:59.396376 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:59.396348 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:59.497839 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:59.497808 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:59.598040 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:59.598005 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:46:59.893769 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:59.893686 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7bbff69f4f-scjnw"] Jul 06 13:46:59.896689 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:59.896665 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7bbff69f4f-scjnw" Jul 06 13:46:59.900452 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:59.900431 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 06 13:46:59.900584 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:59.900572 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 06 13:46:59.900683 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:59.900591 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-r8vxb\"" Jul 06 13:46:59.900683 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:59.900612 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 06 13:46:59.900798 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:59.900738 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 06 13:46:59.903664 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:59.903641 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 06 13:46:59.906420 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:59.906398 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 06 13:46:59.915471 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:59.915442 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7bbff69f4f-scjnw"] Jul 06 13:46:59.996007 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:59.995974 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b409a175-cf7a-4f84-81f4-b6d8c48769c7-federate-client-tls\") pod \"telemeter-client-7bbff69f4f-scjnw\" (UID: \"b409a175-cf7a-4f84-81f4-b6d8c48769c7\") " pod="openshift-monitoring/telemeter-client-7bbff69f4f-scjnw" Jul 06 13:46:59.996147 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:59.996036 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b409a175-cf7a-4f84-81f4-b6d8c48769c7-metrics-client-ca\") pod \"telemeter-client-7bbff69f4f-scjnw\" (UID: \"b409a175-cf7a-4f84-81f4-b6d8c48769c7\") " pod="openshift-monitoring/telemeter-client-7bbff69f4f-scjnw" Jul 06 13:46:59.996147 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:59.996074 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b409a175-cf7a-4f84-81f4-b6d8c48769c7-secret-telemeter-client\") pod \"telemeter-client-7bbff69f4f-scjnw\" (UID: \"b409a175-cf7a-4f84-81f4-b6d8c48769c7\") " pod="openshift-monitoring/telemeter-client-7bbff69f4f-scjnw" Jul 06 13:46:59.996147 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:59.996099 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5gxp\" (UniqueName: \"kubernetes.io/projected/b409a175-cf7a-4f84-81f4-b6d8c48769c7-kube-api-access-x5gxp\") pod \"telemeter-client-7bbff69f4f-scjnw\" (UID: \"b409a175-cf7a-4f84-81f4-b6d8c48769c7\") " pod="openshift-monitoring/telemeter-client-7bbff69f4f-scjnw" Jul 06 13:46:59.996147 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:59.996126 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b409a175-cf7a-4f84-81f4-b6d8c48769c7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7bbff69f4f-scjnw\" (UID: \"b409a175-cf7a-4f84-81f4-b6d8c48769c7\") " pod="openshift-monitoring/telemeter-client-7bbff69f4f-scjnw" Jul 06 13:46:59.996345 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:59.996238 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b409a175-cf7a-4f84-81f4-b6d8c48769c7-serving-certs-ca-bundle\") pod \"telemeter-client-7bbff69f4f-scjnw\" (UID: \"b409a175-cf7a-4f84-81f4-b6d8c48769c7\") " pod="openshift-monitoring/telemeter-client-7bbff69f4f-scjnw" Jul 06 13:46:59.996345 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:59.996276 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b409a175-cf7a-4f84-81f4-b6d8c48769c7-telemeter-client-tls\") pod \"telemeter-client-7bbff69f4f-scjnw\" (UID: \"b409a175-cf7a-4f84-81f4-b6d8c48769c7\") " pod="openshift-monitoring/telemeter-client-7bbff69f4f-scjnw" Jul 06 13:46:59.996345 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:46:59.996303 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b409a175-cf7a-4f84-81f4-b6d8c48769c7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7bbff69f4f-scjnw\" (UID: \"b409a175-cf7a-4f84-81f4-b6d8c48769c7\") " pod="openshift-monitoring/telemeter-client-7bbff69f4f-scjnw" Jul 06 13:47:00.097670 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:00.097630 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b409a175-cf7a-4f84-81f4-b6d8c48769c7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7bbff69f4f-scjnw\" (UID: \"b409a175-cf7a-4f84-81f4-b6d8c48769c7\") " pod="openshift-monitoring/telemeter-client-7bbff69f4f-scjnw" Jul 06 13:47:00.097846 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:00.097712 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b409a175-cf7a-4f84-81f4-b6d8c48769c7-serving-certs-ca-bundle\") pod \"telemeter-client-7bbff69f4f-scjnw\" (UID: \"b409a175-cf7a-4f84-81f4-b6d8c48769c7\") " pod="openshift-monitoring/telemeter-client-7bbff69f4f-scjnw" Jul 06 13:47:00.097846 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:00.097739 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b409a175-cf7a-4f84-81f4-b6d8c48769c7-telemeter-client-tls\") pod \"telemeter-client-7bbff69f4f-scjnw\" (UID: \"b409a175-cf7a-4f84-81f4-b6d8c48769c7\") " pod="openshift-monitoring/telemeter-client-7bbff69f4f-scjnw" Jul 06 13:47:00.097846 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:00.097825 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b409a175-cf7a-4f84-81f4-b6d8c48769c7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7bbff69f4f-scjnw\" (UID: \"b409a175-cf7a-4f84-81f4-b6d8c48769c7\") " pod="openshift-monitoring/telemeter-client-7bbff69f4f-scjnw" Jul 06 13:47:00.098021 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:00.097892 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b409a175-cf7a-4f84-81f4-b6d8c48769c7-federate-client-tls\") pod \"telemeter-client-7bbff69f4f-scjnw\" (UID: \"b409a175-cf7a-4f84-81f4-b6d8c48769c7\") " pod="openshift-monitoring/telemeter-client-7bbff69f4f-scjnw" Jul 06 13:47:00.098021 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:00.097956 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b409a175-cf7a-4f84-81f4-b6d8c48769c7-metrics-client-ca\") pod \"telemeter-client-7bbff69f4f-scjnw\" (UID: \"b409a175-cf7a-4f84-81f4-b6d8c48769c7\") " pod="openshift-monitoring/telemeter-client-7bbff69f4f-scjnw" Jul 06 13:47:00.098021 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:00.097993 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b409a175-cf7a-4f84-81f4-b6d8c48769c7-secret-telemeter-client\") pod \"telemeter-client-7bbff69f4f-scjnw\" (UID: \"b409a175-cf7a-4f84-81f4-b6d8c48769c7\") " pod="openshift-monitoring/telemeter-client-7bbff69f4f-scjnw" Jul 06 13:47:00.098021 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:00.098018 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5gxp\" (UniqueName: \"kubernetes.io/projected/b409a175-cf7a-4f84-81f4-b6d8c48769c7-kube-api-access-x5gxp\") pod \"telemeter-client-7bbff69f4f-scjnw\" (UID: \"b409a175-cf7a-4f84-81f4-b6d8c48769c7\") " pod="openshift-monitoring/telemeter-client-7bbff69f4f-scjnw" Jul 06 13:47:00.098560 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:00.098535 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b409a175-cf7a-4f84-81f4-b6d8c48769c7-serving-certs-ca-bundle\") pod \"telemeter-client-7bbff69f4f-scjnw\" (UID: \"b409a175-cf7a-4f84-81f4-b6d8c48769c7\") " pod="openshift-monitoring/telemeter-client-7bbff69f4f-scjnw" Jul 06 13:47:00.098847 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:00.098772 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b409a175-cf7a-4f84-81f4-b6d8c48769c7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7bbff69f4f-scjnw\" (UID: \"b409a175-cf7a-4f84-81f4-b6d8c48769c7\") " pod="openshift-monitoring/telemeter-client-7bbff69f4f-scjnw" Jul 06 13:47:00.098957 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:00.098927 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b409a175-cf7a-4f84-81f4-b6d8c48769c7-metrics-client-ca\") pod \"telemeter-client-7bbff69f4f-scjnw\" (UID: \"b409a175-cf7a-4f84-81f4-b6d8c48769c7\") " pod="openshift-monitoring/telemeter-client-7bbff69f4f-scjnw" Jul 06 13:47:00.100941 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:00.100916 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b409a175-cf7a-4f84-81f4-b6d8c48769c7-secret-telemeter-client\") pod \"telemeter-client-7bbff69f4f-scjnw\" (UID: \"b409a175-cf7a-4f84-81f4-b6d8c48769c7\") " pod="openshift-monitoring/telemeter-client-7bbff69f4f-scjnw" Jul 06 13:47:00.101038 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:00.100944 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b409a175-cf7a-4f84-81f4-b6d8c48769c7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7bbff69f4f-scjnw\" (UID: \"b409a175-cf7a-4f84-81f4-b6d8c48769c7\") " pod="openshift-monitoring/telemeter-client-7bbff69f4f-scjnw" Jul 06 13:47:00.101038 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:00.100991 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b409a175-cf7a-4f84-81f4-b6d8c48769c7-federate-client-tls\") pod \"telemeter-client-7bbff69f4f-scjnw\" (UID: \"b409a175-cf7a-4f84-81f4-b6d8c48769c7\") " pod="openshift-monitoring/telemeter-client-7bbff69f4f-scjnw" Jul 06 13:47:00.101164 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:00.101111 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b409a175-cf7a-4f84-81f4-b6d8c48769c7-telemeter-client-tls\") pod \"telemeter-client-7bbff69f4f-scjnw\" (UID: \"b409a175-cf7a-4f84-81f4-b6d8c48769c7\") " pod="openshift-monitoring/telemeter-client-7bbff69f4f-scjnw" Jul 06 13:47:00.107302 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:00.107279 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5gxp\" (UniqueName: \"kubernetes.io/projected/b409a175-cf7a-4f84-81f4-b6d8c48769c7-kube-api-access-x5gxp\") pod \"telemeter-client-7bbff69f4f-scjnw\" (UID: \"b409a175-cf7a-4f84-81f4-b6d8c48769c7\") " pod="openshift-monitoring/telemeter-client-7bbff69f4f-scjnw" Jul 06 13:47:00.208327 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:00.208263 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7bbff69f4f-scjnw" Jul 06 13:47:00.272840 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:00.272797 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5875c5dd9d-97pfx" event={"ID":"59d49927-745f-4803-a410-9456251924fc","Type":"ContainerStarted","Data":"ced6a6128b6decae2cc0b43ad25df2dc1608654f9d813b79f53bf427a513321c"} Jul 06 13:47:00.366565 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:00.364357 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7bbff69f4f-scjnw"] Jul 06 13:47:00.370961 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:47:00.370921 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb409a175_cf7a_4f84_81f4_b6d8c48769c7.slice/crio-ba7508a4e495bf2115c94fd1a8fbd2f18707e9c6feecaf49305ee0f82d3fe8d6 WatchSource:0}: Error finding container ba7508a4e495bf2115c94fd1a8fbd2f18707e9c6feecaf49305ee0f82d3fe8d6: Status 404 returned error can't find the container with id ba7508a4e495bf2115c94fd1a8fbd2f18707e9c6feecaf49305ee0f82d3fe8d6 Jul 06 13:47:00.891295 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:00.891262 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:47:01.278971 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:01.278938 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5875c5dd9d-97pfx" event={"ID":"59d49927-745f-4803-a410-9456251924fc","Type":"ContainerStarted","Data":"fa89ed626a6acb499928cfd85d21ea26d6fc9839d46317b1615705a3bab80019"} Jul 06 13:47:01.280188 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:01.280167 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7bbff69f4f-scjnw" event={"ID":"b409a175-cf7a-4f84-81f4-b6d8c48769c7","Type":"ContainerStarted","Data":"ba7508a4e495bf2115c94fd1a8fbd2f18707e9c6feecaf49305ee0f82d3fe8d6"} Jul 06 13:47:01.302471 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:01.302421 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5875c5dd9d-97pfx" podStartSLOduration=1.87661051 podStartE2EDuration="3.30240353s" totalImagesPullingTime="1.42579302s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:46:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:47:01.301613594 +0000 UTC m=+115.101359286" watchObservedRunningTime="2026-07-06 13:47:01.30240353 +0000 UTC m=+115.102149224" Jul 06 13:47:02.146599 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:02.146559 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:47:02.265078 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:02.265047 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:47:02.284995 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:02.284962 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7bbff69f4f-scjnw" event={"ID":"b409a175-cf7a-4f84-81f4-b6d8c48769c7","Type":"ContainerStarted","Data":"068854b1b80ce87c3b2e3f7ff9553288bc0d1172118b599e686bcd5b3fe7f136"} Jul 06 13:47:02.360106 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:02.360067 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:47:02.797527 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:02.797497 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-78d6c765fd-ljq5m" Jul 06 13:47:02.913864 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:02.913834 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:47:03.014348 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:03.014310 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:47:03.268384 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:03.268363 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6fb9dd44f7-nvlxf"] Jul 06 13:47:03.270973 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:03.270954 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fb9dd44f7-nvlxf" Jul 06 13:47:03.279237 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:03.279214 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 06 13:47:03.284586 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:03.284566 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fb9dd44f7-nvlxf"] Jul 06 13:47:03.326868 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:03.326843 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/16483390-304b-4174-9867-8a2193c20230-oauth-serving-cert\") pod \"console-6fb9dd44f7-nvlxf\" (UID: \"16483390-304b-4174-9867-8a2193c20230\") " pod="openshift-console/console-6fb9dd44f7-nvlxf" Jul 06 13:47:03.327195 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:03.326915 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/16483390-304b-4174-9867-8a2193c20230-console-oauth-config\") pod \"console-6fb9dd44f7-nvlxf\" (UID: \"16483390-304b-4174-9867-8a2193c20230\") " pod="openshift-console/console-6fb9dd44f7-nvlxf" Jul 06 13:47:03.327195 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:03.326948 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/16483390-304b-4174-9867-8a2193c20230-console-config\") pod \"console-6fb9dd44f7-nvlxf\" (UID: \"16483390-304b-4174-9867-8a2193c20230\") " pod="openshift-console/console-6fb9dd44f7-nvlxf" Jul 06 13:47:03.327195 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:03.327018 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxrm6\" (UniqueName: \"kubernetes.io/projected/16483390-304b-4174-9867-8a2193c20230-kube-api-access-fxrm6\") pod \"console-6fb9dd44f7-nvlxf\" (UID: \"16483390-304b-4174-9867-8a2193c20230\") " pod="openshift-console/console-6fb9dd44f7-nvlxf" Jul 06 13:47:03.327195 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:03.327060 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16483390-304b-4174-9867-8a2193c20230-trusted-ca-bundle\") pod \"console-6fb9dd44f7-nvlxf\" (UID: \"16483390-304b-4174-9867-8a2193c20230\") " pod="openshift-console/console-6fb9dd44f7-nvlxf" Jul 06 13:47:03.327195 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:03.327099 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/16483390-304b-4174-9867-8a2193c20230-console-serving-cert\") pod \"console-6fb9dd44f7-nvlxf\" (UID: \"16483390-304b-4174-9867-8a2193c20230\") " pod="openshift-console/console-6fb9dd44f7-nvlxf" Jul 06 13:47:03.327195 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:03.327130 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/16483390-304b-4174-9867-8a2193c20230-service-ca\") pod \"console-6fb9dd44f7-nvlxf\" (UID: \"16483390-304b-4174-9867-8a2193c20230\") " pod="openshift-console/console-6fb9dd44f7-nvlxf" Jul 06 13:47:03.428239 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:03.428207 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16483390-304b-4174-9867-8a2193c20230-trusted-ca-bundle\") pod \"console-6fb9dd44f7-nvlxf\" (UID: \"16483390-304b-4174-9867-8a2193c20230\") " pod="openshift-console/console-6fb9dd44f7-nvlxf" Jul 06 13:47:03.428377 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:03.428250 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/16483390-304b-4174-9867-8a2193c20230-console-serving-cert\") pod \"console-6fb9dd44f7-nvlxf\" (UID: \"16483390-304b-4174-9867-8a2193c20230\") " pod="openshift-console/console-6fb9dd44f7-nvlxf" Jul 06 13:47:03.428377 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:03.428277 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/16483390-304b-4174-9867-8a2193c20230-service-ca\") pod \"console-6fb9dd44f7-nvlxf\" (UID: \"16483390-304b-4174-9867-8a2193c20230\") " pod="openshift-console/console-6fb9dd44f7-nvlxf" Jul 06 13:47:03.428377 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:03.428303 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/16483390-304b-4174-9867-8a2193c20230-oauth-serving-cert\") pod \"console-6fb9dd44f7-nvlxf\" (UID: \"16483390-304b-4174-9867-8a2193c20230\") " pod="openshift-console/console-6fb9dd44f7-nvlxf" Jul 06 13:47:03.428377 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:03.428346 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/16483390-304b-4174-9867-8a2193c20230-console-oauth-config\") pod \"console-6fb9dd44f7-nvlxf\" (UID: \"16483390-304b-4174-9867-8a2193c20230\") " pod="openshift-console/console-6fb9dd44f7-nvlxf" Jul 06 13:47:03.428377 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:03.428366 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/16483390-304b-4174-9867-8a2193c20230-console-config\") pod \"console-6fb9dd44f7-nvlxf\" (UID: \"16483390-304b-4174-9867-8a2193c20230\") " pod="openshift-console/console-6fb9dd44f7-nvlxf" Jul 06 13:47:03.428657 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:03.428399 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxrm6\" (UniqueName: \"kubernetes.io/projected/16483390-304b-4174-9867-8a2193c20230-kube-api-access-fxrm6\") pod \"console-6fb9dd44f7-nvlxf\" (UID: \"16483390-304b-4174-9867-8a2193c20230\") " pod="openshift-console/console-6fb9dd44f7-nvlxf" Jul 06 13:47:03.429169 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:03.429147 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16483390-304b-4174-9867-8a2193c20230-trusted-ca-bundle\") pod \"console-6fb9dd44f7-nvlxf\" (UID: \"16483390-304b-4174-9867-8a2193c20230\") " pod="openshift-console/console-6fb9dd44f7-nvlxf" Jul 06 13:47:03.429277 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:03.429187 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/16483390-304b-4174-9867-8a2193c20230-service-ca\") pod \"console-6fb9dd44f7-nvlxf\" (UID: \"16483390-304b-4174-9867-8a2193c20230\") " pod="openshift-console/console-6fb9dd44f7-nvlxf" Jul 06 13:47:03.429277 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:03.429243 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/16483390-304b-4174-9867-8a2193c20230-console-config\") pod \"console-6fb9dd44f7-nvlxf\" (UID: \"16483390-304b-4174-9867-8a2193c20230\") " pod="openshift-console/console-6fb9dd44f7-nvlxf" Jul 06 13:47:03.429340 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:03.429302 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/16483390-304b-4174-9867-8a2193c20230-oauth-serving-cert\") pod \"console-6fb9dd44f7-nvlxf\" (UID: \"16483390-304b-4174-9867-8a2193c20230\") " pod="openshift-console/console-6fb9dd44f7-nvlxf" Jul 06 13:47:03.430735 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:03.430708 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/16483390-304b-4174-9867-8a2193c20230-console-serving-cert\") pod \"console-6fb9dd44f7-nvlxf\" (UID: \"16483390-304b-4174-9867-8a2193c20230\") " pod="openshift-console/console-6fb9dd44f7-nvlxf" Jul 06 13:47:03.430818 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:03.430788 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/16483390-304b-4174-9867-8a2193c20230-console-oauth-config\") pod \"console-6fb9dd44f7-nvlxf\" (UID: \"16483390-304b-4174-9867-8a2193c20230\") " pod="openshift-console/console-6fb9dd44f7-nvlxf" Jul 06 13:47:03.448752 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:03.448731 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxrm6\" (UniqueName: \"kubernetes.io/projected/16483390-304b-4174-9867-8a2193c20230-kube-api-access-fxrm6\") pod \"console-6fb9dd44f7-nvlxf\" (UID: \"16483390-304b-4174-9867-8a2193c20230\") " pod="openshift-console/console-6fb9dd44f7-nvlxf" Jul 06 13:47:03.600495 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:03.600472 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fb9dd44f7-nvlxf" Jul 06 13:47:03.675263 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:03.675232 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:47:03.729534 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:03.729513 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fb9dd44f7-nvlxf"] Jul 06 13:47:03.731582 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:47:03.731558 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16483390_304b_4174_9867_8a2193c20230.slice/crio-b97858c70fe571adc1f098af3fcfdfc7f64174525bf70fc67b912771a6b2bee4 WatchSource:0}: Error finding container b97858c70fe571adc1f098af3fcfdfc7f64174525bf70fc67b912771a6b2bee4: Status 404 returned error can't find the container with id b97858c70fe571adc1f098af3fcfdfc7f64174525bf70fc67b912771a6b2bee4 Jul 06 13:47:03.739424 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:03.739381 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:47:04.294025 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:04.293990 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fb9dd44f7-nvlxf" event={"ID":"16483390-304b-4174-9867-8a2193c20230","Type":"ContainerStarted","Data":"0a1dd2ce32172a83116ee0076997cfb4e5355f64c9f543cc8422c8e4c96b71eb"} Jul 06 13:47:04.294198 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:04.294052 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fb9dd44f7-nvlxf" event={"ID":"16483390-304b-4174-9867-8a2193c20230","Type":"ContainerStarted","Data":"b97858c70fe571adc1f098af3fcfdfc7f64174525bf70fc67b912771a6b2bee4"} Jul 06 13:47:04.295873 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:04.295848 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7bbff69f4f-scjnw" event={"ID":"b409a175-cf7a-4f84-81f4-b6d8c48769c7","Type":"ContainerStarted","Data":"5b8486984b03121d1917239cfa8baf61d551c5438eacd5c7de827b9fce4c311d"} Jul 06 13:47:04.295960 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:04.295898 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7bbff69f4f-scjnw" event={"ID":"b409a175-cf7a-4f84-81f4-b6d8c48769c7","Type":"ContainerStarted","Data":"a3d4192b9fdea0753b1dce74cd940d48597da66128e463fb41aecb1a12d2ca44"} Jul 06 13:47:04.313961 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:04.313917 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6fb9dd44f7-nvlxf" podStartSLOduration=1.3139027859999999 podStartE2EDuration="1.313902786s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:47:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:47:04.313544853 +0000 UTC m=+118.113290544" watchObservedRunningTime="2026-07-06 13:47:04.313902786 +0000 UTC m=+118.113648543" Jul 06 13:47:04.336130 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:04.336073 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7bbff69f4f-scjnw" podStartSLOduration=2.538030916 podStartE2EDuration="5.336055008s" totalImagesPullingTime="2.798024092s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:46:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:47:04.334649155 +0000 UTC m=+118.134394849" watchObservedRunningTime="2026-07-06 13:47:04.336055008 +0000 UTC m=+118.135800712" Jul 06 13:47:04.795298 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:04.795271 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c9c94fb85-q7ksk" Jul 06 13:47:04.795552 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:04.795527 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-c9c94fb85-q7ksk" Jul 06 13:47:04.800089 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:04.800069 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-c9c94fb85-q7ksk" Jul 06 13:47:05.304098 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:05.304071 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-c9c94fb85-q7ksk" Jul 06 13:47:07.206344 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:07.206312 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-59959bf766-kn9ns" Jul 06 13:47:07.364969 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:07.364941 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:47:07.514277 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:07.514244 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:47:07.614736 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:07.614705 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:47:07.814380 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:07.814309 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-78d6c765fd-ljq5m" podUID="75c808a3-93be-4ff2-b136-d93a0cf085ff" containerName="registry" containerID="cri-o://ce5abd325bb131bb4a5b2d48f5253ac3542d0e7d6b97ccb11c0c319c823e91fe" gracePeriod=30 Jul 06 13:47:08.051013 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:08.050992 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78d6c765fd-ljq5m" Jul 06 13:47:08.166481 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:08.166419 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/75c808a3-93be-4ff2-b136-d93a0cf085ff-registry-certificates\") pod \"75c808a3-93be-4ff2-b136-d93a0cf085ff\" (UID: \"75c808a3-93be-4ff2-b136-d93a0cf085ff\") " Jul 06 13:47:08.166481 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:08.166453 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/75c808a3-93be-4ff2-b136-d93a0cf085ff-image-registry-private-configuration\") pod \"75c808a3-93be-4ff2-b136-d93a0cf085ff\" (UID: \"75c808a3-93be-4ff2-b136-d93a0cf085ff\") " Jul 06 13:47:08.166481 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:08.166472 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cbtp2\" (UniqueName: \"kubernetes.io/projected/75c808a3-93be-4ff2-b136-d93a0cf085ff-kube-api-access-cbtp2\") pod \"75c808a3-93be-4ff2-b136-d93a0cf085ff\" (UID: \"75c808a3-93be-4ff2-b136-d93a0cf085ff\") " Jul 06 13:47:08.166699 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:08.166488 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/75c808a3-93be-4ff2-b136-d93a0cf085ff-installation-pull-secrets\") pod \"75c808a3-93be-4ff2-b136-d93a0cf085ff\" (UID: \"75c808a3-93be-4ff2-b136-d93a0cf085ff\") " Jul 06 13:47:08.166699 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:08.166553 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/75c808a3-93be-4ff2-b136-d93a0cf085ff-registry-tls\") pod \"75c808a3-93be-4ff2-b136-d93a0cf085ff\" (UID: \"75c808a3-93be-4ff2-b136-d93a0cf085ff\") " Jul 06 13:47:08.166699 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:08.166583 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/75c808a3-93be-4ff2-b136-d93a0cf085ff-bound-sa-token\") pod \"75c808a3-93be-4ff2-b136-d93a0cf085ff\" (UID: \"75c808a3-93be-4ff2-b136-d93a0cf085ff\") " Jul 06 13:47:08.166699 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:08.166664 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/75c808a3-93be-4ff2-b136-d93a0cf085ff-ca-trust-extracted\") pod \"75c808a3-93be-4ff2-b136-d93a0cf085ff\" (UID: \"75c808a3-93be-4ff2-b136-d93a0cf085ff\") " Jul 06 13:47:08.166699 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:08.166697 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/75c808a3-93be-4ff2-b136-d93a0cf085ff-trusted-ca\") pod \"75c808a3-93be-4ff2-b136-d93a0cf085ff\" (UID: \"75c808a3-93be-4ff2-b136-d93a0cf085ff\") " Jul 06 13:47:08.166933 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:08.166854 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75c808a3-93be-4ff2-b136-d93a0cf085ff-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "75c808a3-93be-4ff2-b136-d93a0cf085ff" (UID: "75c808a3-93be-4ff2-b136-d93a0cf085ff"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 13:47:08.166933 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:08.166923 2556 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/75c808a3-93be-4ff2-b136-d93a0cf085ff-registry-certificates\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:47:08.167322 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:08.167296 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75c808a3-93be-4ff2-b136-d93a0cf085ff-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "75c808a3-93be-4ff2-b136-d93a0cf085ff" (UID: "75c808a3-93be-4ff2-b136-d93a0cf085ff"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 13:47:08.169176 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:08.168981 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75c808a3-93be-4ff2-b136-d93a0cf085ff-kube-api-access-cbtp2" (OuterVolumeSpecName: "kube-api-access-cbtp2") pod "75c808a3-93be-4ff2-b136-d93a0cf085ff" (UID: "75c808a3-93be-4ff2-b136-d93a0cf085ff"). InnerVolumeSpecName "kube-api-access-cbtp2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 13:47:08.169176 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:08.169134 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75c808a3-93be-4ff2-b136-d93a0cf085ff-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "75c808a3-93be-4ff2-b136-d93a0cf085ff" (UID: "75c808a3-93be-4ff2-b136-d93a0cf085ff"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 13:47:08.169176 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:08.169146 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75c808a3-93be-4ff2-b136-d93a0cf085ff-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "75c808a3-93be-4ff2-b136-d93a0cf085ff" (UID: "75c808a3-93be-4ff2-b136-d93a0cf085ff"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 13:47:08.169176 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:08.169147 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75c808a3-93be-4ff2-b136-d93a0cf085ff-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "75c808a3-93be-4ff2-b136-d93a0cf085ff" (UID: "75c808a3-93be-4ff2-b136-d93a0cf085ff"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 13:47:08.169434 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:08.169221 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75c808a3-93be-4ff2-b136-d93a0cf085ff-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "75c808a3-93be-4ff2-b136-d93a0cf085ff" (UID: "75c808a3-93be-4ff2-b136-d93a0cf085ff"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 13:47:08.175486 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:08.175464 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75c808a3-93be-4ff2-b136-d93a0cf085ff-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "75c808a3-93be-4ff2-b136-d93a0cf085ff" (UID: "75c808a3-93be-4ff2-b136-d93a0cf085ff"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 13:47:08.267523 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:08.267494 2556 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/75c808a3-93be-4ff2-b136-d93a0cf085ff-registry-tls\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:47:08.267523 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:08.267517 2556 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/75c808a3-93be-4ff2-b136-d93a0cf085ff-bound-sa-token\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:47:08.267870 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:08.267531 2556 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/75c808a3-93be-4ff2-b136-d93a0cf085ff-ca-trust-extracted\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:47:08.267870 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:08.267544 2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/75c808a3-93be-4ff2-b136-d93a0cf085ff-trusted-ca\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:47:08.267870 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:08.267558 2556 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/75c808a3-93be-4ff2-b136-d93a0cf085ff-image-registry-private-configuration\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:47:08.267870 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:08.267572 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cbtp2\" (UniqueName: \"kubernetes.io/projected/75c808a3-93be-4ff2-b136-d93a0cf085ff-kube-api-access-cbtp2\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:47:08.267870 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:08.267586 2556 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/75c808a3-93be-4ff2-b136-d93a0cf085ff-installation-pull-secrets\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:47:08.313995 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:08.313968 2556 generic.go:356] "Generic (PLEG): container finished" podID="75c808a3-93be-4ff2-b136-d93a0cf085ff" containerID="ce5abd325bb131bb4a5b2d48f5253ac3542d0e7d6b97ccb11c0c319c823e91fe" exitCode=0 Jul 06 13:47:08.314087 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:08.314016 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78d6c765fd-ljq5m" Jul 06 13:47:08.314087 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:08.314052 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78d6c765fd-ljq5m" event={"ID":"75c808a3-93be-4ff2-b136-d93a0cf085ff","Type":"ContainerDied","Data":"ce5abd325bb131bb4a5b2d48f5253ac3542d0e7d6b97ccb11c0c319c823e91fe"} Jul 06 13:47:08.314157 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:08.314108 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78d6c765fd-ljq5m" event={"ID":"75c808a3-93be-4ff2-b136-d93a0cf085ff","Type":"ContainerDied","Data":"f33927ad1b6ef7a46947816af2d510b3c9142985fa436dc9f33be17d58a40668"} Jul 06 13:47:08.314157 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:08.314136 2556 scope.go:117] "RemoveContainer" containerID="ce5abd325bb131bb4a5b2d48f5253ac3542d0e7d6b97ccb11c0c319c823e91fe" Jul 06 13:47:08.322397 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:08.322381 2556 scope.go:117] "RemoveContainer" containerID="ce5abd325bb131bb4a5b2d48f5253ac3542d0e7d6b97ccb11c0c319c823e91fe" Jul 06 13:47:08.322678 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:47:08.322659 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce5abd325bb131bb4a5b2d48f5253ac3542d0e7d6b97ccb11c0c319c823e91fe\": container with ID starting with ce5abd325bb131bb4a5b2d48f5253ac3542d0e7d6b97ccb11c0c319c823e91fe not found: ID does not exist" containerID="ce5abd325bb131bb4a5b2d48f5253ac3542d0e7d6b97ccb11c0c319c823e91fe" Jul 06 13:47:08.322745 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:08.322685 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce5abd325bb131bb4a5b2d48f5253ac3542d0e7d6b97ccb11c0c319c823e91fe"} err="failed to get container status \"ce5abd325bb131bb4a5b2d48f5253ac3542d0e7d6b97ccb11c0c319c823e91fe\": rpc error: code = NotFound desc = could not find container \"ce5abd325bb131bb4a5b2d48f5253ac3542d0e7d6b97ccb11c0c319c823e91fe\": container with ID starting with ce5abd325bb131bb4a5b2d48f5253ac3542d0e7d6b97ccb11c0c319c823e91fe not found: ID does not exist" Jul 06 13:47:08.336301 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:08.336281 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-78d6c765fd-ljq5m"] Jul 06 13:47:08.339961 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:08.339943 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-78d6c765fd-ljq5m"] Jul 06 13:47:08.789870 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:08.789840 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75c808a3-93be-4ff2-b136-d93a0cf085ff" path="/var/lib/kubelet/pods/75c808a3-93be-4ff2-b136-d93a0cf085ff/volumes" Jul 06 13:47:09.174015 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:09.173933 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:47:09.298024 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:09.297994 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:47:11.058799 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:11.058768 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:47:11.159843 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:11.159813 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:47:12.061433 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:12.061379 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:47:12.161232 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:12.161197 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:47:12.299742 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:12.299711 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fb9dd44f7-nvlxf"] Jul 06 13:47:12.330670 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:12.330599 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b95784997-ffdnd"] Jul 06 13:47:12.330881 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:12.330868 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75c808a3-93be-4ff2-b136-d93a0cf085ff" containerName="registry" Jul 06 13:47:12.330917 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:12.330883 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="75c808a3-93be-4ff2-b136-d93a0cf085ff" containerName="registry" Jul 06 13:47:12.330956 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:12.330947 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="75c808a3-93be-4ff2-b136-d93a0cf085ff" containerName="registry" Jul 06 13:47:12.334313 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:12.334293 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b95784997-ffdnd" Jul 06 13:47:12.343689 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:12.343668 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b95784997-ffdnd"] Jul 06 13:47:12.404445 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:12.404421 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjrrw\" (UniqueName: \"kubernetes.io/projected/11954715-9c26-48e7-9010-4ef90d6f36c2-kube-api-access-bjrrw\") pod \"console-b95784997-ffdnd\" (UID: \"11954715-9c26-48e7-9010-4ef90d6f36c2\") " pod="openshift-console/console-b95784997-ffdnd" Jul 06 13:47:12.404557 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:12.404452 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11954715-9c26-48e7-9010-4ef90d6f36c2-oauth-serving-cert\") pod \"console-b95784997-ffdnd\" (UID: \"11954715-9c26-48e7-9010-4ef90d6f36c2\") " pod="openshift-console/console-b95784997-ffdnd" Jul 06 13:47:12.404557 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:12.404485 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11954715-9c26-48e7-9010-4ef90d6f36c2-console-oauth-config\") pod \"console-b95784997-ffdnd\" (UID: \"11954715-9c26-48e7-9010-4ef90d6f36c2\") " pod="openshift-console/console-b95784997-ffdnd" Jul 06 13:47:12.404557 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:12.404514 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11954715-9c26-48e7-9010-4ef90d6f36c2-service-ca\") pod \"console-b95784997-ffdnd\" (UID: \"11954715-9c26-48e7-9010-4ef90d6f36c2\") " pod="openshift-console/console-b95784997-ffdnd" Jul 06 13:47:12.404557 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:12.404542 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11954715-9c26-48e7-9010-4ef90d6f36c2-trusted-ca-bundle\") pod \"console-b95784997-ffdnd\" (UID: \"11954715-9c26-48e7-9010-4ef90d6f36c2\") " pod="openshift-console/console-b95784997-ffdnd" Jul 06 13:47:12.404738 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:12.404609 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11954715-9c26-48e7-9010-4ef90d6f36c2-console-config\") pod \"console-b95784997-ffdnd\" (UID: \"11954715-9c26-48e7-9010-4ef90d6f36c2\") " pod="openshift-console/console-b95784997-ffdnd" Jul 06 13:47:12.404738 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:12.404657 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11954715-9c26-48e7-9010-4ef90d6f36c2-console-serving-cert\") pod \"console-b95784997-ffdnd\" (UID: \"11954715-9c26-48e7-9010-4ef90d6f36c2\") " pod="openshift-console/console-b95784997-ffdnd" Jul 06 13:47:12.505891 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:12.505863 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjrrw\" (UniqueName: \"kubernetes.io/projected/11954715-9c26-48e7-9010-4ef90d6f36c2-kube-api-access-bjrrw\") pod \"console-b95784997-ffdnd\" (UID: \"11954715-9c26-48e7-9010-4ef90d6f36c2\") " pod="openshift-console/console-b95784997-ffdnd" Jul 06 13:47:12.506029 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:12.505903 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11954715-9c26-48e7-9010-4ef90d6f36c2-oauth-serving-cert\") pod \"console-b95784997-ffdnd\" (UID: \"11954715-9c26-48e7-9010-4ef90d6f36c2\") " pod="openshift-console/console-b95784997-ffdnd" Jul 06 13:47:12.506029 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:12.505940 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11954715-9c26-48e7-9010-4ef90d6f36c2-console-oauth-config\") pod \"console-b95784997-ffdnd\" (UID: \"11954715-9c26-48e7-9010-4ef90d6f36c2\") " pod="openshift-console/console-b95784997-ffdnd" Jul 06 13:47:12.506029 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:12.505961 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11954715-9c26-48e7-9010-4ef90d6f36c2-service-ca\") pod \"console-b95784997-ffdnd\" (UID: \"11954715-9c26-48e7-9010-4ef90d6f36c2\") " pod="openshift-console/console-b95784997-ffdnd" Jul 06 13:47:12.506029 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:12.506003 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11954715-9c26-48e7-9010-4ef90d6f36c2-trusted-ca-bundle\") pod \"console-b95784997-ffdnd\" (UID: \"11954715-9c26-48e7-9010-4ef90d6f36c2\") " pod="openshift-console/console-b95784997-ffdnd" Jul 06 13:47:12.506229 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:12.506050 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11954715-9c26-48e7-9010-4ef90d6f36c2-console-config\") pod \"console-b95784997-ffdnd\" (UID: \"11954715-9c26-48e7-9010-4ef90d6f36c2\") " pod="openshift-console/console-b95784997-ffdnd" Jul 06 13:47:12.506229 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:12.506091 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11954715-9c26-48e7-9010-4ef90d6f36c2-console-serving-cert\") pod \"console-b95784997-ffdnd\" (UID: \"11954715-9c26-48e7-9010-4ef90d6f36c2\") " pod="openshift-console/console-b95784997-ffdnd" Jul 06 13:47:12.506793 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:12.506758 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11954715-9c26-48e7-9010-4ef90d6f36c2-service-ca\") pod \"console-b95784997-ffdnd\" (UID: \"11954715-9c26-48e7-9010-4ef90d6f36c2\") " pod="openshift-console/console-b95784997-ffdnd" Jul 06 13:47:12.506892 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:12.506791 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11954715-9c26-48e7-9010-4ef90d6f36c2-oauth-serving-cert\") pod \"console-b95784997-ffdnd\" (UID: \"11954715-9c26-48e7-9010-4ef90d6f36c2\") " pod="openshift-console/console-b95784997-ffdnd" Jul 06 13:47:12.506892 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:12.506807 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11954715-9c26-48e7-9010-4ef90d6f36c2-console-config\") pod \"console-b95784997-ffdnd\" (UID: \"11954715-9c26-48e7-9010-4ef90d6f36c2\") " pod="openshift-console/console-b95784997-ffdnd" Jul 06 13:47:12.507041 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:12.506983 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11954715-9c26-48e7-9010-4ef90d6f36c2-trusted-ca-bundle\") pod \"console-b95784997-ffdnd\" (UID: \"11954715-9c26-48e7-9010-4ef90d6f36c2\") " pod="openshift-console/console-b95784997-ffdnd" Jul 06 13:47:12.508424 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:12.508398 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11954715-9c26-48e7-9010-4ef90d6f36c2-console-oauth-config\") pod \"console-b95784997-ffdnd\" (UID: \"11954715-9c26-48e7-9010-4ef90d6f36c2\") " pod="openshift-console/console-b95784997-ffdnd" Jul 06 13:47:12.508567 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:12.508549 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11954715-9c26-48e7-9010-4ef90d6f36c2-console-serving-cert\") pod \"console-b95784997-ffdnd\" (UID: \"11954715-9c26-48e7-9010-4ef90d6f36c2\") " pod="openshift-console/console-b95784997-ffdnd" Jul 06 13:47:12.516280 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:12.516259 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjrrw\" (UniqueName: \"kubernetes.io/projected/11954715-9c26-48e7-9010-4ef90d6f36c2-kube-api-access-bjrrw\") pod \"console-b95784997-ffdnd\" (UID: \"11954715-9c26-48e7-9010-4ef90d6f36c2\") " pod="openshift-console/console-b95784997-ffdnd" Jul 06 13:47:12.643284 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:12.643219 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b95784997-ffdnd" Jul 06 13:47:12.776230 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:12.776132 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b95784997-ffdnd"] Jul 06 13:47:12.778651 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:47:12.778629 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11954715_9c26_48e7_9010_4ef90d6f36c2.slice/crio-4d53c365ab068cb87a9ac3b0e8a44b681cf93d80678ade36d4b11de8c6aab686 WatchSource:0}: Error finding container 4d53c365ab068cb87a9ac3b0e8a44b681cf93d80678ade36d4b11de8c6aab686: Status 404 returned error can't find the container with id 4d53c365ab068cb87a9ac3b0e8a44b681cf93d80678ade36d4b11de8c6aab686 Jul 06 13:47:13.336807 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:13.336769 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b95784997-ffdnd" event={"ID":"11954715-9c26-48e7-9010-4ef90d6f36c2","Type":"ContainerStarted","Data":"320da5f31f6643781a1271988c253b59ea7363636f41ccaa5cc45d315e2acfed"} Jul 06 13:47:13.337188 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:13.336845 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b95784997-ffdnd" event={"ID":"11954715-9c26-48e7-9010-4ef90d6f36c2","Type":"ContainerStarted","Data":"4d53c365ab068cb87a9ac3b0e8a44b681cf93d80678ade36d4b11de8c6aab686"} Jul 06 13:47:13.359337 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:13.359282 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b95784997-ffdnd" podStartSLOduration=1.359268576 podStartE2EDuration="1.359268576s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:47:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:47:13.358267308 +0000 UTC m=+127.158013001" watchObservedRunningTime="2026-07-06 13:47:13.359268576 +0000 UTC m=+127.159014268" Jul 06 13:47:13.572185 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:13.572146 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:47:13.601047 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:13.600971 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6fb9dd44f7-nvlxf" Jul 06 13:47:13.630987 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:13.630962 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:47:13.692412 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:13.692392 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:47:15.534939 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:15.534903 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9712593-e5bd-42d1-bb8f-3e81c9c588f4-metrics-certs\") pod \"network-metrics-daemon-jkhgk\" (UID: \"d9712593-e5bd-42d1-bb8f-3e81c9c588f4\") " pod="openshift-multus/network-metrics-daemon-jkhgk" Jul 06 13:47:15.537204 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:15.537181 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9712593-e5bd-42d1-bb8f-3e81c9c588f4-metrics-certs\") pod \"network-metrics-daemon-jkhgk\" (UID: \"d9712593-e5bd-42d1-bb8f-3e81c9c588f4\") " pod="openshift-multus/network-metrics-daemon-jkhgk" Jul 06 13:47:15.707045 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:15.707019 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jdk7g\"" Jul 06 13:47:15.714522 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:15.714505 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkhgk" Jul 06 13:47:15.998461 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:15.998425 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jkhgk"] Jul 06 13:47:16.001431 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:47:16.001408 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9712593_e5bd_42d1_bb8f_3e81c9c588f4.slice/crio-9a7ce2c04f8af1be0cf21858dcc756549e6dfca07813b5eb8112cee7875734ad WatchSource:0}: Error finding container 9a7ce2c04f8af1be0cf21858dcc756549e6dfca07813b5eb8112cee7875734ad: Status 404 returned error can't find the container with id 9a7ce2c04f8af1be0cf21858dcc756549e6dfca07813b5eb8112cee7875734ad Jul 06 13:47:16.349324 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:16.349293 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jkhgk" event={"ID":"d9712593-e5bd-42d1-bb8f-3e81c9c588f4","Type":"ContainerStarted","Data":"9a7ce2c04f8af1be0cf21858dcc756549e6dfca07813b5eb8112cee7875734ad"} Jul 06 13:47:17.354560 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:17.354525 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jkhgk" event={"ID":"d9712593-e5bd-42d1-bb8f-3e81c9c588f4","Type":"ContainerStarted","Data":"19ad87794923eb714e29ba0eda6775d3bb2605e7b184aee51844d23ef817cf2f"} Jul 06 13:47:17.354937 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:17.354579 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jkhgk" event={"ID":"d9712593-e5bd-42d1-bb8f-3e81c9c588f4","Type":"ContainerStarted","Data":"3a104c5b0003e0bb643db248251ebcf9df4f13ba3dc648ebeb0f14410f52ffb3"} Jul 06 13:47:17.373440 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:17.373394 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-jkhgk" podStartSLOduration=129.497587895 podStartE2EDuration="2m10.373381253s" totalImagesPullingTime="875.793358ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:45:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:47:17.372418435 +0000 UTC m=+131.172164129" watchObservedRunningTime="2026-07-06 13:47:17.373381253 +0000 UTC m=+131.173127009" Jul 06 13:47:17.512714 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:17.512686 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:47:17.581480 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:17.581454 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:47:17.665730 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:17.665648 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:47:18.352229 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:18.352196 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:47:18.448188 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:18.448162 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:47:18.542567 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:18.542537 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:47:19.064421 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:19.064388 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:47:19.122178 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:19.122145 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:47:19.232690 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:19.232666 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5875c5dd9d-97pfx" Jul 06 13:47:19.232820 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:19.232742 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5875c5dd9d-97pfx" Jul 06 13:47:22.644214 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:22.644171 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b95784997-ffdnd" Jul 06 13:47:22.644673 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:22.644235 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b95784997-ffdnd" Jul 06 13:47:22.649296 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:22.649274 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-b95784997-ffdnd" Jul 06 13:47:23.380395 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:23.380367 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-b95784997-ffdnd" Jul 06 13:47:23.460946 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:23.460917 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c9c94fb85-q7ksk"] Jul 06 13:47:23.660458 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:23.660372 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:47:23.751912 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:23.751880 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:47:23.851533 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:23.851510 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:47:25.903904 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:25.903868 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:47:26.005650 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:26.005605 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:47:37.319412 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:37.319371 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6fb9dd44f7-nvlxf" podUID="16483390-304b-4174-9867-8a2193c20230" containerName="console" containerID="cri-o://0a1dd2ce32172a83116ee0076997cfb4e5355f64c9f543cc8422c8e4c96b71eb" gracePeriod=15 Jul 06 13:47:37.558174 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:37.558154 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fb9dd44f7-nvlxf" Jul 06 13:47:37.702207 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:37.702142 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/16483390-304b-4174-9867-8a2193c20230-oauth-serving-cert\") pod \"16483390-304b-4174-9867-8a2193c20230\" (UID: \"16483390-304b-4174-9867-8a2193c20230\") " Jul 06 13:47:37.702207 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:37.702174 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16483390-304b-4174-9867-8a2193c20230-trusted-ca-bundle\") pod \"16483390-304b-4174-9867-8a2193c20230\" (UID: \"16483390-304b-4174-9867-8a2193c20230\") " Jul 06 13:47:37.702207 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:37.702189 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/16483390-304b-4174-9867-8a2193c20230-service-ca\") pod \"16483390-304b-4174-9867-8a2193c20230\" (UID: \"16483390-304b-4174-9867-8a2193c20230\") " Jul 06 13:47:37.702207 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:37.702208 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fxrm6\" (UniqueName: \"kubernetes.io/projected/16483390-304b-4174-9867-8a2193c20230-kube-api-access-fxrm6\") pod \"16483390-304b-4174-9867-8a2193c20230\" (UID: \"16483390-304b-4174-9867-8a2193c20230\") " Jul 06 13:47:37.702492 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:37.702231 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/16483390-304b-4174-9867-8a2193c20230-console-config\") pod \"16483390-304b-4174-9867-8a2193c20230\" (UID: \"16483390-304b-4174-9867-8a2193c20230\") " Jul 06 13:47:37.702492 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:37.702284 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/16483390-304b-4174-9867-8a2193c20230-console-oauth-config\") pod \"16483390-304b-4174-9867-8a2193c20230\" (UID: \"16483390-304b-4174-9867-8a2193c20230\") " Jul 06 13:47:37.702492 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:37.702338 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/16483390-304b-4174-9867-8a2193c20230-console-serving-cert\") pod \"16483390-304b-4174-9867-8a2193c20230\" (UID: \"16483390-304b-4174-9867-8a2193c20230\") " Jul 06 13:47:37.702744 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:37.702713 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16483390-304b-4174-9867-8a2193c20230-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "16483390-304b-4174-9867-8a2193c20230" (UID: "16483390-304b-4174-9867-8a2193c20230"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 13:47:37.702744 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:37.702722 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16483390-304b-4174-9867-8a2193c20230-console-config" (OuterVolumeSpecName: "console-config") pod "16483390-304b-4174-9867-8a2193c20230" (UID: "16483390-304b-4174-9867-8a2193c20230"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 13:47:37.702926 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:37.702747 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16483390-304b-4174-9867-8a2193c20230-service-ca" (OuterVolumeSpecName: "service-ca") pod "16483390-304b-4174-9867-8a2193c20230" (UID: "16483390-304b-4174-9867-8a2193c20230"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 13:47:37.702926 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:37.702875 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16483390-304b-4174-9867-8a2193c20230-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "16483390-304b-4174-9867-8a2193c20230" (UID: "16483390-304b-4174-9867-8a2193c20230"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 13:47:37.704397 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:37.704368 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16483390-304b-4174-9867-8a2193c20230-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "16483390-304b-4174-9867-8a2193c20230" (UID: "16483390-304b-4174-9867-8a2193c20230"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 13:47:37.704495 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:37.704413 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16483390-304b-4174-9867-8a2193c20230-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "16483390-304b-4174-9867-8a2193c20230" (UID: "16483390-304b-4174-9867-8a2193c20230"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 13:47:37.704495 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:37.704455 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16483390-304b-4174-9867-8a2193c20230-kube-api-access-fxrm6" (OuterVolumeSpecName: "kube-api-access-fxrm6") pod "16483390-304b-4174-9867-8a2193c20230" (UID: "16483390-304b-4174-9867-8a2193c20230"). InnerVolumeSpecName "kube-api-access-fxrm6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 13:47:37.803801 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:37.803779 2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/16483390-304b-4174-9867-8a2193c20230-console-serving-cert\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:47:37.803801 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:37.803798 2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/16483390-304b-4174-9867-8a2193c20230-oauth-serving-cert\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:47:37.803924 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:37.803807 2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16483390-304b-4174-9867-8a2193c20230-trusted-ca-bundle\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:47:37.803924 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:37.803817 2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/16483390-304b-4174-9867-8a2193c20230-service-ca\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:47:37.803924 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:37.803825 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fxrm6\" (UniqueName: \"kubernetes.io/projected/16483390-304b-4174-9867-8a2193c20230-kube-api-access-fxrm6\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:47:37.803924 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:37.803835 2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/16483390-304b-4174-9867-8a2193c20230-console-config\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:47:37.803924 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:37.803843 2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/16483390-304b-4174-9867-8a2193c20230-console-oauth-config\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:47:38.437160 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:38.437110 2556 generic.go:356] "Generic (PLEG): container finished" podID="16483390-304b-4174-9867-8a2193c20230" containerID="0a1dd2ce32172a83116ee0076997cfb4e5355f64c9f543cc8422c8e4c96b71eb" exitCode=0 Jul 06 13:47:38.437160 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:38.437169 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fb9dd44f7-nvlxf" event={"ID":"16483390-304b-4174-9867-8a2193c20230","Type":"ContainerDied","Data":"0a1dd2ce32172a83116ee0076997cfb4e5355f64c9f543cc8422c8e4c96b71eb"} Jul 06 13:47:38.437160 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:38.437175 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fb9dd44f7-nvlxf" Jul 06 13:47:38.437797 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:38.437217 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fb9dd44f7-nvlxf" event={"ID":"16483390-304b-4174-9867-8a2193c20230","Type":"ContainerDied","Data":"b97858c70fe571adc1f098af3fcfdfc7f64174525bf70fc67b912771a6b2bee4"} Jul 06 13:47:38.437797 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:38.437239 2556 scope.go:117] "RemoveContainer" containerID="0a1dd2ce32172a83116ee0076997cfb4e5355f64c9f543cc8422c8e4c96b71eb" Jul 06 13:47:38.446925 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:38.446906 2556 scope.go:117] "RemoveContainer" containerID="0a1dd2ce32172a83116ee0076997cfb4e5355f64c9f543cc8422c8e4c96b71eb" Jul 06 13:47:38.447209 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:47:38.447187 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a1dd2ce32172a83116ee0076997cfb4e5355f64c9f543cc8422c8e4c96b71eb\": container with ID starting with 0a1dd2ce32172a83116ee0076997cfb4e5355f64c9f543cc8422c8e4c96b71eb not found: ID does not exist" containerID="0a1dd2ce32172a83116ee0076997cfb4e5355f64c9f543cc8422c8e4c96b71eb" Jul 06 13:47:38.447274 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:38.447218 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a1dd2ce32172a83116ee0076997cfb4e5355f64c9f543cc8422c8e4c96b71eb"} err="failed to get container status \"0a1dd2ce32172a83116ee0076997cfb4e5355f64c9f543cc8422c8e4c96b71eb\": rpc error: code = NotFound desc = could not find container \"0a1dd2ce32172a83116ee0076997cfb4e5355f64c9f543cc8422c8e4c96b71eb\": container with ID starting with 0a1dd2ce32172a83116ee0076997cfb4e5355f64c9f543cc8422c8e4c96b71eb not found: ID does not exist" Jul 06 13:47:38.458417 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:38.458387 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fb9dd44f7-nvlxf"] Jul 06 13:47:38.462003 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:38.461978 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6fb9dd44f7-nvlxf"] Jul 06 13:47:38.785585 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:38.785555 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16483390-304b-4174-9867-8a2193c20230" path="/var/lib/kubelet/pods/16483390-304b-4174-9867-8a2193c20230/volumes" Jul 06 13:47:39.238341 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:39.238315 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5875c5dd9d-97pfx" Jul 06 13:47:39.241967 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:39.241942 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5875c5dd9d-97pfx" Jul 06 13:47:40.918764 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:40.918725 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:47:40.971234 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:40.971203 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:47:42.453790 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:42.453758 2556 generic.go:356] "Generic (PLEG): container finished" podID="d4ae4ed5-1e0d-4012-98bd-3c91d9d55dd1" containerID="a8835089b35ec09ec4474731939b68f04938ac36c3ed811786451d5fc8f8b468" exitCode=0 Jul 06 13:47:42.454149 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:42.453827 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-j6clh" event={"ID":"d4ae4ed5-1e0d-4012-98bd-3c91d9d55dd1","Type":"ContainerDied","Data":"a8835089b35ec09ec4474731939b68f04938ac36c3ed811786451d5fc8f8b468"} Jul 06 13:47:42.454149 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:42.454136 2556 scope.go:117] "RemoveContainer" containerID="a8835089b35ec09ec4474731939b68f04938ac36c3ed811786451d5fc8f8b468" Jul 06 13:47:43.458922 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:43.458888 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-j6clh" event={"ID":"d4ae4ed5-1e0d-4012-98bd-3c91d9d55dd1","Type":"ContainerStarted","Data":"dc93c5145d89f81a1995b07e604bb72cb3513d28849b156feaf6acdb401b4561"} Jul 06 13:47:46.000198 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:46.000164 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:47:48.481213 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:48.481156 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-c9c94fb85-q7ksk" podUID="922fdb62-3242-4730-b74d-cf50e3687fb0" containerName="console" containerID="cri-o://d4ff2693d6fff015702c7ae0a4d40fa259876a204a2bea5f808ee2a3e21ebc03" gracePeriod=15 Jul 06 13:47:48.720266 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:48.720243 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c9c94fb85-q7ksk" Jul 06 13:47:48.888950 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:48.888921 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/922fdb62-3242-4730-b74d-cf50e3687fb0-service-ca\") pod \"922fdb62-3242-4730-b74d-cf50e3687fb0\" (UID: \"922fdb62-3242-4730-b74d-cf50e3687fb0\") " Jul 06 13:47:48.889148 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:48.888972 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/922fdb62-3242-4730-b74d-cf50e3687fb0-oauth-serving-cert\") pod \"922fdb62-3242-4730-b74d-cf50e3687fb0\" (UID: \"922fdb62-3242-4730-b74d-cf50e3687fb0\") " Jul 06 13:47:48.889148 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:48.888996 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/922fdb62-3242-4730-b74d-cf50e3687fb0-console-oauth-config\") pod \"922fdb62-3242-4730-b74d-cf50e3687fb0\" (UID: \"922fdb62-3242-4730-b74d-cf50e3687fb0\") " Jul 06 13:47:48.889148 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:48.889033 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/922fdb62-3242-4730-b74d-cf50e3687fb0-console-config\") pod \"922fdb62-3242-4730-b74d-cf50e3687fb0\" (UID: \"922fdb62-3242-4730-b74d-cf50e3687fb0\") " Jul 06 13:47:48.889148 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:48.889082 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/922fdb62-3242-4730-b74d-cf50e3687fb0-console-serving-cert\") pod \"922fdb62-3242-4730-b74d-cf50e3687fb0\" (UID: \"922fdb62-3242-4730-b74d-cf50e3687fb0\") " Jul 06 13:47:48.889148 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:48.889115 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ps5hq\" (UniqueName: \"kubernetes.io/projected/922fdb62-3242-4730-b74d-cf50e3687fb0-kube-api-access-ps5hq\") pod \"922fdb62-3242-4730-b74d-cf50e3687fb0\" (UID: \"922fdb62-3242-4730-b74d-cf50e3687fb0\") " Jul 06 13:47:48.889454 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:48.889426 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/922fdb62-3242-4730-b74d-cf50e3687fb0-service-ca" (OuterVolumeSpecName: "service-ca") pod "922fdb62-3242-4730-b74d-cf50e3687fb0" (UID: "922fdb62-3242-4730-b74d-cf50e3687fb0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 13:47:48.889496 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:48.889431 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/922fdb62-3242-4730-b74d-cf50e3687fb0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "922fdb62-3242-4730-b74d-cf50e3687fb0" (UID: "922fdb62-3242-4730-b74d-cf50e3687fb0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 13:47:48.889530 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:48.889474 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/922fdb62-3242-4730-b74d-cf50e3687fb0-console-config" (OuterVolumeSpecName: "console-config") pod "922fdb62-3242-4730-b74d-cf50e3687fb0" (UID: "922fdb62-3242-4730-b74d-cf50e3687fb0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 13:47:48.891197 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:48.891166 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/922fdb62-3242-4730-b74d-cf50e3687fb0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "922fdb62-3242-4730-b74d-cf50e3687fb0" (UID: "922fdb62-3242-4730-b74d-cf50e3687fb0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 13:47:48.891197 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:48.891173 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/922fdb62-3242-4730-b74d-cf50e3687fb0-kube-api-access-ps5hq" (OuterVolumeSpecName: "kube-api-access-ps5hq") pod "922fdb62-3242-4730-b74d-cf50e3687fb0" (UID: "922fdb62-3242-4730-b74d-cf50e3687fb0"). InnerVolumeSpecName "kube-api-access-ps5hq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 13:47:48.891326 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:48.891238 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/922fdb62-3242-4730-b74d-cf50e3687fb0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "922fdb62-3242-4730-b74d-cf50e3687fb0" (UID: "922fdb62-3242-4730-b74d-cf50e3687fb0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 13:47:48.990529 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:48.990504 2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/922fdb62-3242-4730-b74d-cf50e3687fb0-oauth-serving-cert\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:47:48.990529 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:48.990526 2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/922fdb62-3242-4730-b74d-cf50e3687fb0-console-oauth-config\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:47:48.990687 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:48.990537 2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/922fdb62-3242-4730-b74d-cf50e3687fb0-console-config\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:47:48.990687 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:48.990547 2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/922fdb62-3242-4730-b74d-cf50e3687fb0-console-serving-cert\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:47:48.990687 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:48.990556 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ps5hq\" (UniqueName: \"kubernetes.io/projected/922fdb62-3242-4730-b74d-cf50e3687fb0-kube-api-access-ps5hq\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:47:48.990687 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:48.990564 2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/922fdb62-3242-4730-b74d-cf50e3687fb0-service-ca\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:47:49.491085 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:49.491051 2556 generic.go:356] "Generic (PLEG): container finished" podID="922fdb62-3242-4730-b74d-cf50e3687fb0" containerID="d4ff2693d6fff015702c7ae0a4d40fa259876a204a2bea5f808ee2a3e21ebc03" exitCode=0 Jul 06 13:47:49.491509 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:49.491102 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c9c94fb85-q7ksk" Jul 06 13:47:49.491509 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:49.491109 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c9c94fb85-q7ksk" event={"ID":"922fdb62-3242-4730-b74d-cf50e3687fb0","Type":"ContainerDied","Data":"d4ff2693d6fff015702c7ae0a4d40fa259876a204a2bea5f808ee2a3e21ebc03"} Jul 06 13:47:49.491509 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:49.491169 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c9c94fb85-q7ksk" event={"ID":"922fdb62-3242-4730-b74d-cf50e3687fb0","Type":"ContainerDied","Data":"2fcad0ed8617a4870059c4b99cc52ed39ea86ed34b6178991e2b5ee648934b15"} Jul 06 13:47:49.491509 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:49.491188 2556 scope.go:117] "RemoveContainer" containerID="d4ff2693d6fff015702c7ae0a4d40fa259876a204a2bea5f808ee2a3e21ebc03" Jul 06 13:47:49.499982 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:49.499966 2556 scope.go:117] "RemoveContainer" containerID="d4ff2693d6fff015702c7ae0a4d40fa259876a204a2bea5f808ee2a3e21ebc03" Jul 06 13:47:49.500212 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:47:49.500194 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4ff2693d6fff015702c7ae0a4d40fa259876a204a2bea5f808ee2a3e21ebc03\": container with ID starting with d4ff2693d6fff015702c7ae0a4d40fa259876a204a2bea5f808ee2a3e21ebc03 not found: ID does not exist" containerID="d4ff2693d6fff015702c7ae0a4d40fa259876a204a2bea5f808ee2a3e21ebc03" Jul 06 13:47:49.500271 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:49.500224 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4ff2693d6fff015702c7ae0a4d40fa259876a204a2bea5f808ee2a3e21ebc03"} err="failed to get container status \"d4ff2693d6fff015702c7ae0a4d40fa259876a204a2bea5f808ee2a3e21ebc03\": rpc error: code = NotFound desc = could not find container \"d4ff2693d6fff015702c7ae0a4d40fa259876a204a2bea5f808ee2a3e21ebc03\": container with ID starting with d4ff2693d6fff015702c7ae0a4d40fa259876a204a2bea5f808ee2a3e21ebc03 not found: ID does not exist" Jul 06 13:47:49.512107 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:49.512078 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c9c94fb85-q7ksk"] Jul 06 13:47:49.515834 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:49.515813 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-c9c94fb85-q7ksk"] Jul 06 13:47:50.785906 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:50.785871 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="922fdb62-3242-4730-b74d-cf50e3687fb0" path="/var/lib/kubelet/pods/922fdb62-3242-4730-b74d-cf50e3687fb0/volumes" Jul 06 13:47:52.504432 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:52.504407 2556 generic.go:356] "Generic (PLEG): container finished" podID="9f95b1cc-319b-459f-b58f-133d60b4308b" containerID="178f98f5a16c5522dea81f2196f4230fedb79bcd103427614c175f29918f7b1b" exitCode=0 Jul 06 13:47:52.504742 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:52.504461 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-xwfjx" event={"ID":"9f95b1cc-319b-459f-b58f-133d60b4308b","Type":"ContainerDied","Data":"178f98f5a16c5522dea81f2196f4230fedb79bcd103427614c175f29918f7b1b"} Jul 06 13:47:52.504783 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:52.504769 2556 scope.go:117] "RemoveContainer" containerID="178f98f5a16c5522dea81f2196f4230fedb79bcd103427614c175f29918f7b1b" Jul 06 13:47:53.509675 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:47:53.509641 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-xwfjx" event={"ID":"9f95b1cc-319b-459f-b58f-133d60b4308b","Type":"ContainerStarted","Data":"48e98b1039071a77ba26dea6c3cc476360633e481da0e586678f371291639216"} Jul 06 13:48:10.741571 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:10.741515 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:48:10.793447 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:10.793417 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:48:11.305921 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:11.305867 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b94bb86cb-wc47x"] Jul 06 13:48:11.306354 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:11.306325 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16483390-304b-4174-9867-8a2193c20230" containerName="console" Jul 06 13:48:11.306354 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:11.306350 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="16483390-304b-4174-9867-8a2193c20230" containerName="console" Jul 06 13:48:11.306542 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:11.306367 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="922fdb62-3242-4730-b74d-cf50e3687fb0" containerName="console" Jul 06 13:48:11.306542 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:11.306376 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="922fdb62-3242-4730-b74d-cf50e3687fb0" containerName="console" Jul 06 13:48:11.306542 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:11.306462 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="922fdb62-3242-4730-b74d-cf50e3687fb0" containerName="console" Jul 06 13:48:11.306542 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:11.306473 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="16483390-304b-4174-9867-8a2193c20230" containerName="console" Jul 06 13:48:11.310896 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:11.310874 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b94bb86cb-wc47x" Jul 06 13:48:11.324688 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:11.324658 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b94bb86cb-wc47x"] Jul 06 13:48:11.348002 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:11.347977 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0d53be34-f43c-499c-a628-2c78365f752d-service-ca\") pod \"console-7b94bb86cb-wc47x\" (UID: \"0d53be34-f43c-499c-a628-2c78365f752d\") " pod="openshift-console/console-7b94bb86cb-wc47x" Jul 06 13:48:11.348130 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:11.348026 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0d53be34-f43c-499c-a628-2c78365f752d-console-serving-cert\") pod \"console-7b94bb86cb-wc47x\" (UID: \"0d53be34-f43c-499c-a628-2c78365f752d\") " pod="openshift-console/console-7b94bb86cb-wc47x" Jul 06 13:48:11.348130 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:11.348096 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0d53be34-f43c-499c-a628-2c78365f752d-oauth-serving-cert\") pod \"console-7b94bb86cb-wc47x\" (UID: \"0d53be34-f43c-499c-a628-2c78365f752d\") " pod="openshift-console/console-7b94bb86cb-wc47x" Jul 06 13:48:11.348199 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:11.348151 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d53be34-f43c-499c-a628-2c78365f752d-trusted-ca-bundle\") pod \"console-7b94bb86cb-wc47x\" (UID: \"0d53be34-f43c-499c-a628-2c78365f752d\") " pod="openshift-console/console-7b94bb86cb-wc47x" Jul 06 13:48:11.348199 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:11.348174 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0d53be34-f43c-499c-a628-2c78365f752d-console-config\") pod \"console-7b94bb86cb-wc47x\" (UID: \"0d53be34-f43c-499c-a628-2c78365f752d\") " pod="openshift-console/console-7b94bb86cb-wc47x" Jul 06 13:48:11.348199 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:11.348193 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0d53be34-f43c-499c-a628-2c78365f752d-console-oauth-config\") pod \"console-7b94bb86cb-wc47x\" (UID: \"0d53be34-f43c-499c-a628-2c78365f752d\") " pod="openshift-console/console-7b94bb86cb-wc47x" Jul 06 13:48:11.348292 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:11.348208 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2t67\" (UniqueName: \"kubernetes.io/projected/0d53be34-f43c-499c-a628-2c78365f752d-kube-api-access-h2t67\") pod \"console-7b94bb86cb-wc47x\" (UID: \"0d53be34-f43c-499c-a628-2c78365f752d\") " pod="openshift-console/console-7b94bb86cb-wc47x" Jul 06 13:48:11.370279 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:11.370255 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:48:11.434592 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:11.434561 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:48:11.448839 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:11.448817 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0d53be34-f43c-499c-a628-2c78365f752d-console-oauth-config\") pod \"console-7b94bb86cb-wc47x\" (UID: \"0d53be34-f43c-499c-a628-2c78365f752d\") " pod="openshift-console/console-7b94bb86cb-wc47x" Jul 06 13:48:11.448934 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:11.448844 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2t67\" (UniqueName: \"kubernetes.io/projected/0d53be34-f43c-499c-a628-2c78365f752d-kube-api-access-h2t67\") pod \"console-7b94bb86cb-wc47x\" (UID: \"0d53be34-f43c-499c-a628-2c78365f752d\") " pod="openshift-console/console-7b94bb86cb-wc47x" Jul 06 13:48:11.448934 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:11.448869 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0d53be34-f43c-499c-a628-2c78365f752d-service-ca\") pod \"console-7b94bb86cb-wc47x\" (UID: \"0d53be34-f43c-499c-a628-2c78365f752d\") " pod="openshift-console/console-7b94bb86cb-wc47x" Jul 06 13:48:11.448934 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:11.448926 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0d53be34-f43c-499c-a628-2c78365f752d-console-serving-cert\") pod \"console-7b94bb86cb-wc47x\" (UID: \"0d53be34-f43c-499c-a628-2c78365f752d\") " pod="openshift-console/console-7b94bb86cb-wc47x" Jul 06 13:48:11.449084 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:11.449064 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0d53be34-f43c-499c-a628-2c78365f752d-oauth-serving-cert\") pod \"console-7b94bb86cb-wc47x\" (UID: \"0d53be34-f43c-499c-a628-2c78365f752d\") " pod="openshift-console/console-7b94bb86cb-wc47x" Jul 06 13:48:11.449141 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:11.449116 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d53be34-f43c-499c-a628-2c78365f752d-trusted-ca-bundle\") pod \"console-7b94bb86cb-wc47x\" (UID: \"0d53be34-f43c-499c-a628-2c78365f752d\") " pod="openshift-console/console-7b94bb86cb-wc47x" Jul 06 13:48:11.449203 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:11.449158 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0d53be34-f43c-499c-a628-2c78365f752d-console-config\") pod \"console-7b94bb86cb-wc47x\" (UID: \"0d53be34-f43c-499c-a628-2c78365f752d\") " pod="openshift-console/console-7b94bb86cb-wc47x" Jul 06 13:48:11.449798 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:11.449772 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0d53be34-f43c-499c-a628-2c78365f752d-service-ca\") pod \"console-7b94bb86cb-wc47x\" (UID: \"0d53be34-f43c-499c-a628-2c78365f752d\") " pod="openshift-console/console-7b94bb86cb-wc47x" Jul 06 13:48:11.449908 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:11.449802 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0d53be34-f43c-499c-a628-2c78365f752d-oauth-serving-cert\") pod \"console-7b94bb86cb-wc47x\" (UID: \"0d53be34-f43c-499c-a628-2c78365f752d\") " pod="openshift-console/console-7b94bb86cb-wc47x" Jul 06 13:48:11.449908 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:11.449819 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0d53be34-f43c-499c-a628-2c78365f752d-console-config\") pod \"console-7b94bb86cb-wc47x\" (UID: \"0d53be34-f43c-499c-a628-2c78365f752d\") " pod="openshift-console/console-7b94bb86cb-wc47x" Jul 06 13:48:11.450024 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:11.449932 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d53be34-f43c-499c-a628-2c78365f752d-trusted-ca-bundle\") pod \"console-7b94bb86cb-wc47x\" (UID: \"0d53be34-f43c-499c-a628-2c78365f752d\") " pod="openshift-console/console-7b94bb86cb-wc47x" Jul 06 13:48:11.451374 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:11.451348 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0d53be34-f43c-499c-a628-2c78365f752d-console-serving-cert\") pod \"console-7b94bb86cb-wc47x\" (UID: \"0d53be34-f43c-499c-a628-2c78365f752d\") " pod="openshift-console/console-7b94bb86cb-wc47x" Jul 06 13:48:11.451374 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:11.451364 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0d53be34-f43c-499c-a628-2c78365f752d-console-oauth-config\") pod \"console-7b94bb86cb-wc47x\" (UID: \"0d53be34-f43c-499c-a628-2c78365f752d\") " pod="openshift-console/console-7b94bb86cb-wc47x" Jul 06 13:48:11.457548 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:11.457523 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2t67\" (UniqueName: \"kubernetes.io/projected/0d53be34-f43c-499c-a628-2c78365f752d-kube-api-access-h2t67\") pod \"console-7b94bb86cb-wc47x\" (UID: \"0d53be34-f43c-499c-a628-2c78365f752d\") " pod="openshift-console/console-7b94bb86cb-wc47x" Jul 06 13:48:11.620267 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:11.620177 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b94bb86cb-wc47x" Jul 06 13:48:11.745473 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:11.745450 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b94bb86cb-wc47x"] Jul 06 13:48:11.747933 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:48:11.747906 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d53be34_f43c_499c_a628_2c78365f752d.slice/crio-22fe69bcd997ce8e0e97b7f056b3ffcf7a362a114409dff4e7bd7d784ef60028 WatchSource:0}: Error finding container 22fe69bcd997ce8e0e97b7f056b3ffcf7a362a114409dff4e7bd7d784ef60028: Status 404 returned error can't find the container with id 22fe69bcd997ce8e0e97b7f056b3ffcf7a362a114409dff4e7bd7d784ef60028 Jul 06 13:48:12.579904 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:12.579870 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b94bb86cb-wc47x" event={"ID":"0d53be34-f43c-499c-a628-2c78365f752d","Type":"ContainerStarted","Data":"178f3e407c8804b835fad4139d67a6f823af172cae41539b5f104a589bad569f"} Jul 06 13:48:12.580076 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:12.579922 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b94bb86cb-wc47x" event={"ID":"0d53be34-f43c-499c-a628-2c78365f752d","Type":"ContainerStarted","Data":"22fe69bcd997ce8e0e97b7f056b3ffcf7a362a114409dff4e7bd7d784ef60028"} Jul 06 13:48:12.599807 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:12.599757 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7b94bb86cb-wc47x" podStartSLOduration=1.599743919 podStartE2EDuration="1.599743919s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:48:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:48:12.598778122 +0000 UTC m=+186.398523816" watchObservedRunningTime="2026-07-06 13:48:12.599743919 +0000 UTC m=+186.399489611" Jul 06 13:48:16.749701 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:16.749668 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 13:48:16.753509 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:16.753489 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 13:48:16.756925 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:16.756893 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 06 13:48:16.757034 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:16.756953 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 06 13:48:16.757034 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:16.756953 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 06 13:48:16.757034 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:16.757022 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 06 13:48:16.757265 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:16.757246 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 06 13:48:16.757331 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:16.757247 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 06 13:48:16.757331 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:16.757288 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 06 13:48:16.757513 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:16.757496 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 06 13:48:16.757565 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:16.757546 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-qx6n7\"" Jul 06 13:48:16.762481 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:16.762463 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 06 13:48:16.769011 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:16.768989 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 13:48:16.793197 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:16.793172 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0340b7c7-bd42-4aec-81e7-8bceaa11cf0b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0340b7c7-bd42-4aec-81e7-8bceaa11cf0b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 13:48:16.793316 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:16.793211 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cljch\" (UniqueName: \"kubernetes.io/projected/0340b7c7-bd42-4aec-81e7-8bceaa11cf0b-kube-api-access-cljch\") pod \"alertmanager-main-0\" (UID: \"0340b7c7-bd42-4aec-81e7-8bceaa11cf0b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 13:48:16.793316 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:16.793246 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0340b7c7-bd42-4aec-81e7-8bceaa11cf0b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0340b7c7-bd42-4aec-81e7-8bceaa11cf0b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 13:48:16.793316 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:16.793278 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0340b7c7-bd42-4aec-81e7-8bceaa11cf0b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0340b7c7-bd42-4aec-81e7-8bceaa11cf0b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 13:48:16.793316 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:16.793303 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0340b7c7-bd42-4aec-81e7-8bceaa11cf0b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0340b7c7-bd42-4aec-81e7-8bceaa11cf0b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 13:48:16.793478 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:16.793325 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0340b7c7-bd42-4aec-81e7-8bceaa11cf0b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0340b7c7-bd42-4aec-81e7-8bceaa11cf0b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 13:48:16.793478 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:16.793386 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0340b7c7-bd42-4aec-81e7-8bceaa11cf0b-config-volume\") pod \"alertmanager-main-0\" (UID: \"0340b7c7-bd42-4aec-81e7-8bceaa11cf0b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 13:48:16.793549 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:16.793484 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0340b7c7-bd42-4aec-81e7-8bceaa11cf0b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0340b7c7-bd42-4aec-81e7-8bceaa11cf0b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 13:48:16.793549 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:16.793510 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0340b7c7-bd42-4aec-81e7-8bceaa11cf0b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0340b7c7-bd42-4aec-81e7-8bceaa11cf0b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 13:48:16.793549 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:16.793542 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0340b7c7-bd42-4aec-81e7-8bceaa11cf0b-web-config\") pod \"alertmanager-main-0\" (UID: \"0340b7c7-bd42-4aec-81e7-8bceaa11cf0b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 13:48:16.793691 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:16.793580 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0340b7c7-bd42-4aec-81e7-8bceaa11cf0b-config-out\") pod \"alertmanager-main-0\" (UID: \"0340b7c7-bd42-4aec-81e7-8bceaa11cf0b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 13:48:16.793691 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:16.793609 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0340b7c7-bd42-4aec-81e7-8bceaa11cf0b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0340b7c7-bd42-4aec-81e7-8bceaa11cf0b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 13:48:16.793691 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:16.793661 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0340b7c7-bd42-4aec-81e7-8bceaa11cf0b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0340b7c7-bd42-4aec-81e7-8bceaa11cf0b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 13:48:16.894855 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:16.894833 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0340b7c7-bd42-4aec-81e7-8bceaa11cf0b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0340b7c7-bd42-4aec-81e7-8bceaa11cf0b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 13:48:16.894944 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:16.894859 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0340b7c7-bd42-4aec-81e7-8bceaa11cf0b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0340b7c7-bd42-4aec-81e7-8bceaa11cf0b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 13:48:16.894944 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:16.894883 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0340b7c7-bd42-4aec-81e7-8bceaa11cf0b-web-config\") pod \"alertmanager-main-0\" (UID: \"0340b7c7-bd42-4aec-81e7-8bceaa11cf0b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 13:48:16.894944 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:16.894909 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0340b7c7-bd42-4aec-81e7-8bceaa11cf0b-config-out\") pod \"alertmanager-main-0\" (UID: \"0340b7c7-bd42-4aec-81e7-8bceaa11cf0b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 13:48:16.894944 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:16.894936 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0340b7c7-bd42-4aec-81e7-8bceaa11cf0b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0340b7c7-bd42-4aec-81e7-8bceaa11cf0b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 13:48:16.895135 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:16.894968 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0340b7c7-bd42-4aec-81e7-8bceaa11cf0b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0340b7c7-bd42-4aec-81e7-8bceaa11cf0b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 13:48:16.895135 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:16.895028 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0340b7c7-bd42-4aec-81e7-8bceaa11cf0b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0340b7c7-bd42-4aec-81e7-8bceaa11cf0b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 13:48:16.895135 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:16.895054 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cljch\" (UniqueName: \"kubernetes.io/projected/0340b7c7-bd42-4aec-81e7-8bceaa11cf0b-kube-api-access-cljch\") pod \"alertmanager-main-0\" (UID: \"0340b7c7-bd42-4aec-81e7-8bceaa11cf0b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 13:48:16.895135 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:16.895081 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0340b7c7-bd42-4aec-81e7-8bceaa11cf0b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0340b7c7-bd42-4aec-81e7-8bceaa11cf0b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 13:48:16.895135 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:16.895107 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0340b7c7-bd42-4aec-81e7-8bceaa11cf0b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0340b7c7-bd42-4aec-81e7-8bceaa11cf0b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 13:48:16.895135 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:16.895128 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0340b7c7-bd42-4aec-81e7-8bceaa11cf0b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0340b7c7-bd42-4aec-81e7-8bceaa11cf0b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 13:48:16.895433 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:16.895148 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0340b7c7-bd42-4aec-81e7-8bceaa11cf0b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0340b7c7-bd42-4aec-81e7-8bceaa11cf0b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 13:48:16.895433 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:16.895178 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0340b7c7-bd42-4aec-81e7-8bceaa11cf0b-config-volume\") pod \"alertmanager-main-0\" (UID: \"0340b7c7-bd42-4aec-81e7-8bceaa11cf0b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 13:48:16.895928 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:16.895857 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0340b7c7-bd42-4aec-81e7-8bceaa11cf0b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0340b7c7-bd42-4aec-81e7-8bceaa11cf0b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 13:48:16.895928 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:16.895866 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0340b7c7-bd42-4aec-81e7-8bceaa11cf0b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0340b7c7-bd42-4aec-81e7-8bceaa11cf0b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 13:48:16.895928 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:16.895916 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0340b7c7-bd42-4aec-81e7-8bceaa11cf0b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0340b7c7-bd42-4aec-81e7-8bceaa11cf0b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 13:48:16.897990 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:16.897948 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0340b7c7-bd42-4aec-81e7-8bceaa11cf0b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0340b7c7-bd42-4aec-81e7-8bceaa11cf0b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 13:48:16.898252 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:16.898235 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0340b7c7-bd42-4aec-81e7-8bceaa11cf0b-web-config\") pod \"alertmanager-main-0\" (UID: \"0340b7c7-bd42-4aec-81e7-8bceaa11cf0b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 13:48:16.898342 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:16.898269 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0340b7c7-bd42-4aec-81e7-8bceaa11cf0b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0340b7c7-bd42-4aec-81e7-8bceaa11cf0b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 13:48:16.898665 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:16.898644 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0340b7c7-bd42-4aec-81e7-8bceaa11cf0b-config-out\") pod \"alertmanager-main-0\" (UID: \"0340b7c7-bd42-4aec-81e7-8bceaa11cf0b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 13:48:16.898973 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:16.898949 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0340b7c7-bd42-4aec-81e7-8bceaa11cf0b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0340b7c7-bd42-4aec-81e7-8bceaa11cf0b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 13:48:16.899063 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:16.898961 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0340b7c7-bd42-4aec-81e7-8bceaa11cf0b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0340b7c7-bd42-4aec-81e7-8bceaa11cf0b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 13:48:16.899063 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:16.898995 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0340b7c7-bd42-4aec-81e7-8bceaa11cf0b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0340b7c7-bd42-4aec-81e7-8bceaa11cf0b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 13:48:16.899164 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:16.899149 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0340b7c7-bd42-4aec-81e7-8bceaa11cf0b-config-volume\") pod \"alertmanager-main-0\" (UID: \"0340b7c7-bd42-4aec-81e7-8bceaa11cf0b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 13:48:16.900110 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:16.900093 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0340b7c7-bd42-4aec-81e7-8bceaa11cf0b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0340b7c7-bd42-4aec-81e7-8bceaa11cf0b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 13:48:16.903906 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:16.903886 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cljch\" (UniqueName: \"kubernetes.io/projected/0340b7c7-bd42-4aec-81e7-8bceaa11cf0b-kube-api-access-cljch\") pod \"alertmanager-main-0\" (UID: \"0340b7c7-bd42-4aec-81e7-8bceaa11cf0b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 13:48:17.063088 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:17.063021 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 13:48:17.209647 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:17.209594 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 13:48:17.212043 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:48:17.212015 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0340b7c7_bd42_4aec_81e7_8bceaa11cf0b.slice/crio-d87c6f5e71f5f54e383f13b48fecb52914918ed09fd6cc4acac126a13afc9136 WatchSource:0}: Error finding container d87c6f5e71f5f54e383f13b48fecb52914918ed09fd6cc4acac126a13afc9136: Status 404 returned error can't find the container with id d87c6f5e71f5f54e383f13b48fecb52914918ed09fd6cc4acac126a13afc9136 Jul 06 13:48:17.600219 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:17.600188 2556 generic.go:356] "Generic (PLEG): container finished" podID="0340b7c7-bd42-4aec-81e7-8bceaa11cf0b" containerID="53dbfd83541580bbeb6446e4edea9627f88ca4769cfbf8188305a63ca258372d" exitCode=0 Jul 06 13:48:17.600345 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:17.600251 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0340b7c7-bd42-4aec-81e7-8bceaa11cf0b","Type":"ContainerDied","Data":"53dbfd83541580bbeb6446e4edea9627f88ca4769cfbf8188305a63ca258372d"} Jul 06 13:48:17.600345 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:17.600309 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0340b7c7-bd42-4aec-81e7-8bceaa11cf0b","Type":"ContainerStarted","Data":"d87c6f5e71f5f54e383f13b48fecb52914918ed09fd6cc4acac126a13afc9136"} Jul 06 13:48:19.617070 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:19.617043 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0340b7c7-bd42-4aec-81e7-8bceaa11cf0b","Type":"ContainerStarted","Data":"3f090ffd8668da7c52f058e6e45756d4614a0b95d01c65eadc157187dbed2002"} Jul 06 13:48:19.617388 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:19.617106 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0340b7c7-bd42-4aec-81e7-8bceaa11cf0b","Type":"ContainerStarted","Data":"7beb3660d28c62110eb3f46082e3c8064547ef84185f24fb8b7c1872c264f4ec"} Jul 06 13:48:19.617388 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:19.617132 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0340b7c7-bd42-4aec-81e7-8bceaa11cf0b","Type":"ContainerStarted","Data":"df63b5f8f70fde03197855cdb8a6e704ef0a6b52bb389c390ef7fa1d4a1620bc"} Jul 06 13:48:19.617388 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:19.617154 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0340b7c7-bd42-4aec-81e7-8bceaa11cf0b","Type":"ContainerStarted","Data":"e305b4edbed89706b18ffce841a9227272783d2b41dd9323cc28d3b40f4be207"} Jul 06 13:48:19.617388 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:19.617187 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0340b7c7-bd42-4aec-81e7-8bceaa11cf0b","Type":"ContainerStarted","Data":"014db97ad3a28644fd883b93ac20e0d01e5fe2db4ed7a40916bfc9979d0d932e"} Jul 06 13:48:20.623830 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:20.623795 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0340b7c7-bd42-4aec-81e7-8bceaa11cf0b","Type":"ContainerStarted","Data":"f8e6d8d7f4651b78baf8060240060fb3bf1d700df7c5c2ed15b2387b6b5a4189"} Jul 06 13:48:20.653052 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:20.652952 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.134438249 podStartE2EDuration="4.652934733s" totalImagesPullingTime="2.503703897s" totalInitContainerRuntime="14.792587ms" isStatefulPod=false podCreationTimestamp="2026-07-06 13:48:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:48:20.652268466 +0000 UTC m=+194.452014158" watchObservedRunningTime="2026-07-06 13:48:20.652934733 +0000 UTC m=+194.452680427" Jul 06 13:48:21.620431 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:21.620400 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7b94bb86cb-wc47x" Jul 06 13:48:21.620595 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:21.620446 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b94bb86cb-wc47x" Jul 06 13:48:21.625966 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:21.625944 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7b94bb86cb-wc47x" Jul 06 13:48:21.632133 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:21.632117 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7b94bb86cb-wc47x" Jul 06 13:48:21.696955 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:21.696928 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b95784997-ffdnd"] Jul 06 13:48:21.826020 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:21.825985 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:48:21.906131 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:21.906050 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:48:21.955669 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:21.955642 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:48:22.630971 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:22.630939 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:48:22.687981 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:22.687954 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:48:25.902733 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:25.902698 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:48:26.003109 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:26.003050 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:48:26.103806 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:26.103776 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:48:46.718350 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:46.718309 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-b95784997-ffdnd" podUID="11954715-9c26-48e7-9010-4ef90d6f36c2" containerName="console" containerID="cri-o://320da5f31f6643781a1271988c253b59ea7363636f41ccaa5cc45d315e2acfed" gracePeriod=15 Jul 06 13:48:46.959271 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:46.959241 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b95784997-ffdnd" Jul 06 13:48:47.032451 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:47.032422 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11954715-9c26-48e7-9010-4ef90d6f36c2-console-oauth-config\") pod \"11954715-9c26-48e7-9010-4ef90d6f36c2\" (UID: \"11954715-9c26-48e7-9010-4ef90d6f36c2\") " Jul 06 13:48:47.032635 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:47.032458 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11954715-9c26-48e7-9010-4ef90d6f36c2-service-ca\") pod \"11954715-9c26-48e7-9010-4ef90d6f36c2\" (UID: \"11954715-9c26-48e7-9010-4ef90d6f36c2\") " Jul 06 13:48:47.032635 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:47.032501 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bjrrw\" (UniqueName: \"kubernetes.io/projected/11954715-9c26-48e7-9010-4ef90d6f36c2-kube-api-access-bjrrw\") pod \"11954715-9c26-48e7-9010-4ef90d6f36c2\" (UID: \"11954715-9c26-48e7-9010-4ef90d6f36c2\") " Jul 06 13:48:47.032635 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:47.032556 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11954715-9c26-48e7-9010-4ef90d6f36c2-console-config\") pod \"11954715-9c26-48e7-9010-4ef90d6f36c2\" (UID: \"11954715-9c26-48e7-9010-4ef90d6f36c2\") " Jul 06 13:48:47.032858 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:47.032650 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11954715-9c26-48e7-9010-4ef90d6f36c2-oauth-serving-cert\") pod \"11954715-9c26-48e7-9010-4ef90d6f36c2\" (UID: \"11954715-9c26-48e7-9010-4ef90d6f36c2\") " Jul 06 13:48:47.032858 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:47.032709 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11954715-9c26-48e7-9010-4ef90d6f36c2-console-serving-cert\") pod \"11954715-9c26-48e7-9010-4ef90d6f36c2\" (UID: \"11954715-9c26-48e7-9010-4ef90d6f36c2\") " Jul 06 13:48:47.032858 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:47.032737 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11954715-9c26-48e7-9010-4ef90d6f36c2-trusted-ca-bundle\") pod \"11954715-9c26-48e7-9010-4ef90d6f36c2\" (UID: \"11954715-9c26-48e7-9010-4ef90d6f36c2\") " Jul 06 13:48:47.033023 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:47.032990 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11954715-9c26-48e7-9010-4ef90d6f36c2-service-ca" (OuterVolumeSpecName: "service-ca") pod "11954715-9c26-48e7-9010-4ef90d6f36c2" (UID: "11954715-9c26-48e7-9010-4ef90d6f36c2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 13:48:47.033094 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:47.033002 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11954715-9c26-48e7-9010-4ef90d6f36c2-console-config" (OuterVolumeSpecName: "console-config") pod "11954715-9c26-48e7-9010-4ef90d6f36c2" (UID: "11954715-9c26-48e7-9010-4ef90d6f36c2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 13:48:47.033094 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:47.033041 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11954715-9c26-48e7-9010-4ef90d6f36c2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "11954715-9c26-48e7-9010-4ef90d6f36c2" (UID: "11954715-9c26-48e7-9010-4ef90d6f36c2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 13:48:47.033308 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:47.033283 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11954715-9c26-48e7-9010-4ef90d6f36c2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "11954715-9c26-48e7-9010-4ef90d6f36c2" (UID: "11954715-9c26-48e7-9010-4ef90d6f36c2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 13:48:47.034668 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:47.034640 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11954715-9c26-48e7-9010-4ef90d6f36c2-kube-api-access-bjrrw" (OuterVolumeSpecName: "kube-api-access-bjrrw") pod "11954715-9c26-48e7-9010-4ef90d6f36c2" (UID: "11954715-9c26-48e7-9010-4ef90d6f36c2"). InnerVolumeSpecName "kube-api-access-bjrrw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 13:48:47.034748 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:47.034689 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11954715-9c26-48e7-9010-4ef90d6f36c2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "11954715-9c26-48e7-9010-4ef90d6f36c2" (UID: "11954715-9c26-48e7-9010-4ef90d6f36c2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 13:48:47.034811 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:47.034793 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11954715-9c26-48e7-9010-4ef90d6f36c2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "11954715-9c26-48e7-9010-4ef90d6f36c2" (UID: "11954715-9c26-48e7-9010-4ef90d6f36c2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 13:48:47.133509 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:47.133476 2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11954715-9c26-48e7-9010-4ef90d6f36c2-console-oauth-config\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:48:47.133509 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:47.133512 2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11954715-9c26-48e7-9010-4ef90d6f36c2-service-ca\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:48:47.133708 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:47.133530 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bjrrw\" (UniqueName: \"kubernetes.io/projected/11954715-9c26-48e7-9010-4ef90d6f36c2-kube-api-access-bjrrw\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:48:47.133708 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:47.133545 2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11954715-9c26-48e7-9010-4ef90d6f36c2-console-config\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:48:47.133708 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:47.133560 2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11954715-9c26-48e7-9010-4ef90d6f36c2-oauth-serving-cert\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:48:47.133708 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:47.133574 2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11954715-9c26-48e7-9010-4ef90d6f36c2-console-serving-cert\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:48:47.133708 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:47.133588 2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11954715-9c26-48e7-9010-4ef90d6f36c2-trusted-ca-bundle\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:48:47.729369 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:47.729331 2556 generic.go:356] "Generic (PLEG): container finished" podID="11954715-9c26-48e7-9010-4ef90d6f36c2" containerID="320da5f31f6643781a1271988c253b59ea7363636f41ccaa5cc45d315e2acfed" exitCode=0 Jul 06 13:48:47.729776 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:47.729380 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b95784997-ffdnd" Jul 06 13:48:47.729776 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:47.729398 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b95784997-ffdnd" event={"ID":"11954715-9c26-48e7-9010-4ef90d6f36c2","Type":"ContainerDied","Data":"320da5f31f6643781a1271988c253b59ea7363636f41ccaa5cc45d315e2acfed"} Jul 06 13:48:47.729776 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:47.729482 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b95784997-ffdnd" event={"ID":"11954715-9c26-48e7-9010-4ef90d6f36c2","Type":"ContainerDied","Data":"4d53c365ab068cb87a9ac3b0e8a44b681cf93d80678ade36d4b11de8c6aab686"} Jul 06 13:48:47.729776 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:47.729508 2556 scope.go:117] "RemoveContainer" containerID="320da5f31f6643781a1271988c253b59ea7363636f41ccaa5cc45d315e2acfed" Jul 06 13:48:47.739101 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:47.739086 2556 scope.go:117] "RemoveContainer" containerID="320da5f31f6643781a1271988c253b59ea7363636f41ccaa5cc45d315e2acfed" Jul 06 13:48:47.739355 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:48:47.739327 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"320da5f31f6643781a1271988c253b59ea7363636f41ccaa5cc45d315e2acfed\": container with ID starting with 320da5f31f6643781a1271988c253b59ea7363636f41ccaa5cc45d315e2acfed not found: ID does not exist" containerID="320da5f31f6643781a1271988c253b59ea7363636f41ccaa5cc45d315e2acfed" Jul 06 13:48:47.739447 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:47.739359 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"320da5f31f6643781a1271988c253b59ea7363636f41ccaa5cc45d315e2acfed"} err="failed to get container status \"320da5f31f6643781a1271988c253b59ea7363636f41ccaa5cc45d315e2acfed\": rpc error: code = NotFound desc = could not find container \"320da5f31f6643781a1271988c253b59ea7363636f41ccaa5cc45d315e2acfed\": container with ID starting with 320da5f31f6643781a1271988c253b59ea7363636f41ccaa5cc45d315e2acfed not found: ID does not exist" Jul 06 13:48:47.751556 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:47.751534 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b95784997-ffdnd"] Jul 06 13:48:47.755062 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:47.755039 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b95784997-ffdnd"] Jul 06 13:48:48.785311 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:48:48.785279 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11954715-9c26-48e7-9010-4ef90d6f36c2" path="/var/lib/kubelet/pods/11954715-9c26-48e7-9010-4ef90d6f36c2/volumes" Jul 06 13:49:22.541718 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:22.541680 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:49:22.641284 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:22.641257 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:49:23.132064 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:23.132030 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q4kpc"] Jul 06 13:49:23.132364 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:23.132352 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11954715-9c26-48e7-9010-4ef90d6f36c2" containerName="console" Jul 06 13:49:23.132405 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:23.132366 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="11954715-9c26-48e7-9010-4ef90d6f36c2" containerName="console" Jul 06 13:49:23.132438 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:23.132417 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="11954715-9c26-48e7-9010-4ef90d6f36c2" containerName="console" Jul 06 13:49:23.136795 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:23.136779 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q4kpc" Jul 06 13:49:23.139859 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:23.139836 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 13:49:23.139992 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:23.139915 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 13:49:23.141000 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:23.140988 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-w4754\"" Jul 06 13:49:23.144048 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:23.144023 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q4kpc"] Jul 06 13:49:23.203210 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:23.203186 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ll9d\" (UniqueName: \"kubernetes.io/projected/f89fae4c-d8dc-4670-8469-08b1aa7c2ec5-kube-api-access-7ll9d\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q4kpc\" (UID: \"f89fae4c-d8dc-4670-8469-08b1aa7c2ec5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q4kpc" Jul 06 13:49:23.203371 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:23.203230 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f89fae4c-d8dc-4670-8469-08b1aa7c2ec5-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q4kpc\" (UID: \"f89fae4c-d8dc-4670-8469-08b1aa7c2ec5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q4kpc" Jul 06 13:49:23.203371 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:23.203255 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f89fae4c-d8dc-4670-8469-08b1aa7c2ec5-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q4kpc\" (UID: \"f89fae4c-d8dc-4670-8469-08b1aa7c2ec5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q4kpc" Jul 06 13:49:23.303820 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:23.303794 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f89fae4c-d8dc-4670-8469-08b1aa7c2ec5-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q4kpc\" (UID: \"f89fae4c-d8dc-4670-8469-08b1aa7c2ec5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q4kpc" Jul 06 13:49:23.303959 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:23.303839 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f89fae4c-d8dc-4670-8469-08b1aa7c2ec5-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q4kpc\" (UID: \"f89fae4c-d8dc-4670-8469-08b1aa7c2ec5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q4kpc" Jul 06 13:49:23.303959 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:23.303926 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ll9d\" (UniqueName: \"kubernetes.io/projected/f89fae4c-d8dc-4670-8469-08b1aa7c2ec5-kube-api-access-7ll9d\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q4kpc\" (UID: \"f89fae4c-d8dc-4670-8469-08b1aa7c2ec5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q4kpc" Jul 06 13:49:23.304211 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:23.304190 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f89fae4c-d8dc-4670-8469-08b1aa7c2ec5-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q4kpc\" (UID: \"f89fae4c-d8dc-4670-8469-08b1aa7c2ec5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q4kpc" Jul 06 13:49:23.304249 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:23.304190 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f89fae4c-d8dc-4670-8469-08b1aa7c2ec5-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q4kpc\" (UID: \"f89fae4c-d8dc-4670-8469-08b1aa7c2ec5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q4kpc" Jul 06 13:49:23.312650 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:23.312611 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ll9d\" (UniqueName: \"kubernetes.io/projected/f89fae4c-d8dc-4670-8469-08b1aa7c2ec5-kube-api-access-7ll9d\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q4kpc\" (UID: \"f89fae4c-d8dc-4670-8469-08b1aa7c2ec5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q4kpc" Jul 06 13:49:23.446810 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:23.446746 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q4kpc" Jul 06 13:49:23.577415 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:23.577391 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q4kpc"] Jul 06 13:49:23.579289 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:49:23.579262 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf89fae4c_d8dc_4670_8469_08b1aa7c2ec5.slice/crio-827eb5a779f8688b10247e2897e2b617f285d180a4ac38722b9302f55ebf8d0d WatchSource:0}: Error finding container 827eb5a779f8688b10247e2897e2b617f285d180a4ac38722b9302f55ebf8d0d: Status 404 returned error can't find the container with id 827eb5a779f8688b10247e2897e2b617f285d180a4ac38722b9302f55ebf8d0d Jul 06 13:49:23.871629 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:23.871596 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q4kpc" event={"ID":"f89fae4c-d8dc-4670-8469-08b1aa7c2ec5","Type":"ContainerStarted","Data":"827eb5a779f8688b10247e2897e2b617f285d180a4ac38722b9302f55ebf8d0d"} Jul 06 13:49:30.903188 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:30.903119 2556 generic.go:356] "Generic (PLEG): container finished" podID="f89fae4c-d8dc-4670-8469-08b1aa7c2ec5" containerID="1a500d6af30b0cf42867f7ec4e14f3cd7b76db683dfbac0e9bf535c0addaf820" exitCode=0 Jul 06 13:49:30.903188 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:30.903180 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q4kpc" event={"ID":"f89fae4c-d8dc-4670-8469-08b1aa7c2ec5","Type":"ContainerDied","Data":"1a500d6af30b0cf42867f7ec4e14f3cd7b76db683dfbac0e9bf535c0addaf820"} Jul 06 13:49:33.916942 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:33.916900 2556 generic.go:356] "Generic (PLEG): container finished" podID="f89fae4c-d8dc-4670-8469-08b1aa7c2ec5" containerID="ee31e7c6322f1f45151324f148c580166f46340b7872a677048f9e36fa26b7b7" exitCode=0 Jul 06 13:49:33.916942 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:33.916940 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q4kpc" event={"ID":"f89fae4c-d8dc-4670-8469-08b1aa7c2ec5","Type":"ContainerDied","Data":"ee31e7c6322f1f45151324f148c580166f46340b7872a677048f9e36fa26b7b7"} Jul 06 13:49:43.962978 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:43.962946 2556 generic.go:356] "Generic (PLEG): container finished" podID="f89fae4c-d8dc-4670-8469-08b1aa7c2ec5" containerID="2cea8e4ee1b99aa31ef46f81f3d184275f92deb0c25b087fd1a57f6d80fcae65" exitCode=0 Jul 06 13:49:43.963385 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:43.963008 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q4kpc" event={"ID":"f89fae4c-d8dc-4670-8469-08b1aa7c2ec5","Type":"ContainerDied","Data":"2cea8e4ee1b99aa31ef46f81f3d184275f92deb0c25b087fd1a57f6d80fcae65"} Jul 06 13:49:45.091053 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:45.091031 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q4kpc" Jul 06 13:49:45.197267 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:45.197239 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f89fae4c-d8dc-4670-8469-08b1aa7c2ec5-bundle\") pod \"f89fae4c-d8dc-4670-8469-08b1aa7c2ec5\" (UID: \"f89fae4c-d8dc-4670-8469-08b1aa7c2ec5\") " Jul 06 13:49:45.197403 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:45.197287 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f89fae4c-d8dc-4670-8469-08b1aa7c2ec5-util\") pod \"f89fae4c-d8dc-4670-8469-08b1aa7c2ec5\" (UID: \"f89fae4c-d8dc-4670-8469-08b1aa7c2ec5\") " Jul 06 13:49:45.197403 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:45.197343 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7ll9d\" (UniqueName: \"kubernetes.io/projected/f89fae4c-d8dc-4670-8469-08b1aa7c2ec5-kube-api-access-7ll9d\") pod \"f89fae4c-d8dc-4670-8469-08b1aa7c2ec5\" (UID: \"f89fae4c-d8dc-4670-8469-08b1aa7c2ec5\") " Jul 06 13:49:45.197873 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:45.197848 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f89fae4c-d8dc-4670-8469-08b1aa7c2ec5-bundle" (OuterVolumeSpecName: "bundle") pod "f89fae4c-d8dc-4670-8469-08b1aa7c2ec5" (UID: "f89fae4c-d8dc-4670-8469-08b1aa7c2ec5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 13:49:45.199412 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:45.199392 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f89fae4c-d8dc-4670-8469-08b1aa7c2ec5-kube-api-access-7ll9d" (OuterVolumeSpecName: "kube-api-access-7ll9d") pod "f89fae4c-d8dc-4670-8469-08b1aa7c2ec5" (UID: "f89fae4c-d8dc-4670-8469-08b1aa7c2ec5"). InnerVolumeSpecName "kube-api-access-7ll9d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 13:49:45.201487 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:45.201463 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f89fae4c-d8dc-4670-8469-08b1aa7c2ec5-util" (OuterVolumeSpecName: "util") pod "f89fae4c-d8dc-4670-8469-08b1aa7c2ec5" (UID: "f89fae4c-d8dc-4670-8469-08b1aa7c2ec5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 13:49:45.298740 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:45.298703 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7ll9d\" (UniqueName: \"kubernetes.io/projected/f89fae4c-d8dc-4670-8469-08b1aa7c2ec5-kube-api-access-7ll9d\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:49:45.298740 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:45.298738 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f89fae4c-d8dc-4670-8469-08b1aa7c2ec5-bundle\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:49:45.298874 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:45.298753 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f89fae4c-d8dc-4670-8469-08b1aa7c2ec5-util\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:49:45.973991 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:45.973961 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q4kpc" event={"ID":"f89fae4c-d8dc-4670-8469-08b1aa7c2ec5","Type":"ContainerDied","Data":"827eb5a779f8688b10247e2897e2b617f285d180a4ac38722b9302f55ebf8d0d"} Jul 06 13:49:45.974147 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:45.974001 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q4kpc" Jul 06 13:49:45.974147 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:45.974011 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="827eb5a779f8688b10247e2897e2b617f285d180a4ac38722b9302f55ebf8d0d" Jul 06 13:49:49.188720 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:49.188688 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:49:50.058769 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:50.058736 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:49:51.153982 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:51.153945 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-krx6v"] Jul 06 13:49:51.154404 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:51.154376 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f89fae4c-d8dc-4670-8469-08b1aa7c2ec5" containerName="util" Jul 06 13:49:51.154404 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:51.154394 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f89fae4c-d8dc-4670-8469-08b1aa7c2ec5" containerName="util" Jul 06 13:49:51.154536 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:51.154412 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f89fae4c-d8dc-4670-8469-08b1aa7c2ec5" containerName="pull" Jul 06 13:49:51.154536 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:51.154422 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f89fae4c-d8dc-4670-8469-08b1aa7c2ec5" containerName="pull" Jul 06 13:49:51.154536 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:51.154441 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f89fae4c-d8dc-4670-8469-08b1aa7c2ec5" containerName="extract" Jul 06 13:49:51.154536 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:51.154450 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f89fae4c-d8dc-4670-8469-08b1aa7c2ec5" containerName="extract" Jul 06 13:49:51.154536 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:51.154531 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="f89fae4c-d8dc-4670-8469-08b1aa7c2ec5" containerName="extract" Jul 06 13:49:51.156569 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:51.156546 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-krx6v" Jul 06 13:49:51.159379 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:51.159326 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 06 13:49:51.159469 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:51.159412 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 06 13:49:51.159469 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:51.159424 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-7zfj9\"" Jul 06 13:49:51.167259 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:51.167231 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-krx6v"] Jul 06 13:49:51.345909 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:51.345873 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6dcf\" (UniqueName: \"kubernetes.io/projected/eb42d160-5539-49f7-8c1b-5e661791449f-kube-api-access-s6dcf\") pod \"cert-manager-operator-controller-manager-55c444bf86-krx6v\" (UID: \"eb42d160-5539-49f7-8c1b-5e661791449f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-krx6v" Jul 06 13:49:51.346075 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:51.345913 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb42d160-5539-49f7-8c1b-5e661791449f-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-krx6v\" (UID: \"eb42d160-5539-49f7-8c1b-5e661791449f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-krx6v" Jul 06 13:49:51.446632 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:51.446547 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6dcf\" (UniqueName: \"kubernetes.io/projected/eb42d160-5539-49f7-8c1b-5e661791449f-kube-api-access-s6dcf\") pod \"cert-manager-operator-controller-manager-55c444bf86-krx6v\" (UID: \"eb42d160-5539-49f7-8c1b-5e661791449f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-krx6v" Jul 06 13:49:51.446632 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:51.446584 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb42d160-5539-49f7-8c1b-5e661791449f-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-krx6v\" (UID: \"eb42d160-5539-49f7-8c1b-5e661791449f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-krx6v" Jul 06 13:49:51.447039 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:51.447020 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb42d160-5539-49f7-8c1b-5e661791449f-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-krx6v\" (UID: \"eb42d160-5539-49f7-8c1b-5e661791449f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-krx6v" Jul 06 13:49:51.455701 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:51.455680 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6dcf\" (UniqueName: \"kubernetes.io/projected/eb42d160-5539-49f7-8c1b-5e661791449f-kube-api-access-s6dcf\") pod \"cert-manager-operator-controller-manager-55c444bf86-krx6v\" (UID: \"eb42d160-5539-49f7-8c1b-5e661791449f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-krx6v" Jul 06 13:49:51.465329 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:51.465304 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-krx6v" Jul 06 13:49:51.627882 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:51.627851 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-krx6v"] Jul 06 13:49:51.634371 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:49:51.634347 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb42d160_5539_49f7_8c1b_5e661791449f.slice/crio-00fa849981181b13041ee2cc51232bca6053faeb9b2dc7be809fc0404e0f2689 WatchSource:0}: Error finding container 00fa849981181b13041ee2cc51232bca6053faeb9b2dc7be809fc0404e0f2689: Status 404 returned error can't find the container with id 00fa849981181b13041ee2cc51232bca6053faeb9b2dc7be809fc0404e0f2689 Jul 06 13:49:52.002697 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:52.002653 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-krx6v" event={"ID":"eb42d160-5539-49f7-8c1b-5e661791449f","Type":"ContainerStarted","Data":"00fa849981181b13041ee2cc51232bca6053faeb9b2dc7be809fc0404e0f2689"} Jul 06 13:49:52.799884 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:52.799848 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:49:52.900344 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:52.900309 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:49:54.014743 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:54.014704 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-krx6v" event={"ID":"eb42d160-5539-49f7-8c1b-5e661791449f","Type":"ContainerStarted","Data":"3df7eadb9f864c58063ab2e58fb9460a1168581cf167ffac27e40295c39f0aa9"} Jul 06 13:49:54.039493 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:54.039446 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-krx6v" podStartSLOduration=1.274924844 podStartE2EDuration="3.039431787s" totalImagesPullingTime="1.764506943s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:49:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:49:54.037296925 +0000 UTC m=+287.837042644" watchObservedRunningTime="2026-07-06 13:49:54.039431787 +0000 UTC m=+287.839177480" Jul 06 13:49:54.437199 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:54.437103 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:49:54.588117 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:54.588068 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:49:55.021122 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:55.021093 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd6g8k"] Jul 06 13:49:55.023551 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:55.023530 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd6g8k" Jul 06 13:49:55.026172 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:55.026143 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 13:49:55.026278 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:55.026202 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-w4754\"" Jul 06 13:49:55.027521 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:55.027503 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 13:49:55.032758 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:55.032740 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd6g8k"] Jul 06 13:49:55.157917 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:55.157885 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:49:55.180671 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:55.180649 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea09335f-36e7-4494-bb86-7ddb88555387-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd6g8k\" (UID: \"ea09335f-36e7-4494-bb86-7ddb88555387\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd6g8k" Jul 06 13:49:55.180786 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:55.180676 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99ccl\" (UniqueName: \"kubernetes.io/projected/ea09335f-36e7-4494-bb86-7ddb88555387-kube-api-access-99ccl\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd6g8k\" (UID: \"ea09335f-36e7-4494-bb86-7ddb88555387\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd6g8k" Jul 06 13:49:55.180786 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:55.180711 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea09335f-36e7-4494-bb86-7ddb88555387-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd6g8k\" (UID: \"ea09335f-36e7-4494-bb86-7ddb88555387\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd6g8k" Jul 06 13:49:55.277933 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:55.277866 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:49:55.281922 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:55.281899 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea09335f-36e7-4494-bb86-7ddb88555387-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd6g8k\" (UID: \"ea09335f-36e7-4494-bb86-7ddb88555387\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd6g8k" Jul 06 13:49:55.282021 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:55.281927 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99ccl\" (UniqueName: \"kubernetes.io/projected/ea09335f-36e7-4494-bb86-7ddb88555387-kube-api-access-99ccl\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd6g8k\" (UID: \"ea09335f-36e7-4494-bb86-7ddb88555387\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd6g8k" Jul 06 13:49:55.282021 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:55.281957 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea09335f-36e7-4494-bb86-7ddb88555387-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd6g8k\" (UID: \"ea09335f-36e7-4494-bb86-7ddb88555387\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd6g8k" Jul 06 13:49:55.282255 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:55.282239 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea09335f-36e7-4494-bb86-7ddb88555387-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd6g8k\" (UID: \"ea09335f-36e7-4494-bb86-7ddb88555387\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd6g8k" Jul 06 13:49:55.282293 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:55.282265 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea09335f-36e7-4494-bb86-7ddb88555387-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd6g8k\" (UID: \"ea09335f-36e7-4494-bb86-7ddb88555387\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd6g8k" Jul 06 13:49:55.299864 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:55.299841 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99ccl\" (UniqueName: \"kubernetes.io/projected/ea09335f-36e7-4494-bb86-7ddb88555387-kube-api-access-99ccl\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd6g8k\" (UID: \"ea09335f-36e7-4494-bb86-7ddb88555387\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd6g8k" Jul 06 13:49:55.333681 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:55.333659 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd6g8k" Jul 06 13:49:55.462477 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:55.462453 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd6g8k"] Jul 06 13:49:55.464943 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:49:55.464916 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea09335f_36e7_4494_bb86_7ddb88555387.slice/crio-198372f644c98bf2012daf7f349c33f1d1099d0840cc7fc709251b6012ec9d26 WatchSource:0}: Error finding container 198372f644c98bf2012daf7f349c33f1d1099d0840cc7fc709251b6012ec9d26: Status 404 returned error can't find the container with id 198372f644c98bf2012daf7f349c33f1d1099d0840cc7fc709251b6012ec9d26 Jul 06 13:49:55.653825 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:55.653797 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-hmnpm"] Jul 06 13:49:55.660206 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:55.660179 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-hmnpm" Jul 06 13:49:55.663361 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:55.663341 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 06 13:49:55.663486 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:55.663364 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-mlvqk\"" Jul 06 13:49:55.663486 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:55.663397 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 06 13:49:55.667762 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:55.667737 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-hmnpm"] Jul 06 13:49:55.686569 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:55.686531 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/11e6deac-fff5-4ac7-ae05-11fbb8b2e0ec-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-hmnpm\" (UID: \"11e6deac-fff5-4ac7-ae05-11fbb8b2e0ec\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hmnpm" Jul 06 13:49:55.686696 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:55.686614 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzx4l\" (UniqueName: \"kubernetes.io/projected/11e6deac-fff5-4ac7-ae05-11fbb8b2e0ec-kube-api-access-qzx4l\") pod \"cert-manager-webhook-6486ffd997-hmnpm\" (UID: \"11e6deac-fff5-4ac7-ae05-11fbb8b2e0ec\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hmnpm" Jul 06 13:49:55.787580 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:55.787558 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/11e6deac-fff5-4ac7-ae05-11fbb8b2e0ec-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-hmnpm\" (UID: \"11e6deac-fff5-4ac7-ae05-11fbb8b2e0ec\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hmnpm" Jul 06 13:49:55.787698 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:55.787614 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzx4l\" (UniqueName: \"kubernetes.io/projected/11e6deac-fff5-4ac7-ae05-11fbb8b2e0ec-kube-api-access-qzx4l\") pod \"cert-manager-webhook-6486ffd997-hmnpm\" (UID: \"11e6deac-fff5-4ac7-ae05-11fbb8b2e0ec\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hmnpm" Jul 06 13:49:55.796158 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:55.796135 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/11e6deac-fff5-4ac7-ae05-11fbb8b2e0ec-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-hmnpm\" (UID: \"11e6deac-fff5-4ac7-ae05-11fbb8b2e0ec\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hmnpm" Jul 06 13:49:55.796251 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:55.796232 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzx4l\" (UniqueName: \"kubernetes.io/projected/11e6deac-fff5-4ac7-ae05-11fbb8b2e0ec-kube-api-access-qzx4l\") pod \"cert-manager-webhook-6486ffd997-hmnpm\" (UID: \"11e6deac-fff5-4ac7-ae05-11fbb8b2e0ec\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hmnpm" Jul 06 13:49:55.984053 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:55.983991 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-hmnpm" Jul 06 13:49:56.024896 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:56.024869 2556 generic.go:356] "Generic (PLEG): container finished" podID="ea09335f-36e7-4494-bb86-7ddb88555387" containerID="48400dd7f8a585e86617c1c9d9d9e1f7a2a8c0f45e72e39a867cb9b9d2a256c8" exitCode=0 Jul 06 13:49:56.025335 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:56.024950 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd6g8k" event={"ID":"ea09335f-36e7-4494-bb86-7ddb88555387","Type":"ContainerDied","Data":"48400dd7f8a585e86617c1c9d9d9e1f7a2a8c0f45e72e39a867cb9b9d2a256c8"} Jul 06 13:49:56.025335 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:56.025001 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd6g8k" event={"ID":"ea09335f-36e7-4494-bb86-7ddb88555387","Type":"ContainerStarted","Data":"198372f644c98bf2012daf7f349c33f1d1099d0840cc7fc709251b6012ec9d26"} Jul 06 13:49:56.108805 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:56.108782 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-hmnpm"] Jul 06 13:49:56.110748 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:49:56.110727 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod11e6deac_fff5_4ac7_ae05_11fbb8b2e0ec.slice/crio-7a68b835afcd48d601239f7d82ac4e311228c8bff4743f6d09717ac6eba9c89d WatchSource:0}: Error finding container 7a68b835afcd48d601239f7d82ac4e311228c8bff4743f6d09717ac6eba9c89d: Status 404 returned error can't find the container with id 7a68b835afcd48d601239f7d82ac4e311228c8bff4743f6d09717ac6eba9c89d Jul 06 13:49:57.032198 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:57.032160 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-hmnpm" event={"ID":"11e6deac-fff5-4ac7-ae05-11fbb8b2e0ec","Type":"ContainerStarted","Data":"7a68b835afcd48d601239f7d82ac4e311228c8bff4743f6d09717ac6eba9c89d"} Jul 06 13:49:57.174865 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:57.174831 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:49:57.550920 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:57.550881 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:49:58.255476 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:58.255442 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-z7vv6"] Jul 06 13:49:58.262444 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:58.262415 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-z7vv6" Jul 06 13:49:58.265361 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:58.265339 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-x7z5j\"" Jul 06 13:49:58.268671 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:58.268650 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-z7vv6"] Jul 06 13:49:58.307562 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:58.307533 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a3db086f-cbf6-4563-a866-3cfeffc3fc8b-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-z7vv6\" (UID: \"a3db086f-cbf6-4563-a866-3cfeffc3fc8b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-z7vv6" Jul 06 13:49:58.307730 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:58.307711 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhsvp\" (UniqueName: \"kubernetes.io/projected/a3db086f-cbf6-4563-a866-3cfeffc3fc8b-kube-api-access-xhsvp\") pod \"cert-manager-cainjector-559cdd8c87-z7vv6\" (UID: \"a3db086f-cbf6-4563-a866-3cfeffc3fc8b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-z7vv6" Jul 06 13:49:58.408840 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:58.408799 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhsvp\" (UniqueName: \"kubernetes.io/projected/a3db086f-cbf6-4563-a866-3cfeffc3fc8b-kube-api-access-xhsvp\") pod \"cert-manager-cainjector-559cdd8c87-z7vv6\" (UID: \"a3db086f-cbf6-4563-a866-3cfeffc3fc8b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-z7vv6" Jul 06 13:49:58.409002 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:58.408878 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a3db086f-cbf6-4563-a866-3cfeffc3fc8b-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-z7vv6\" (UID: \"a3db086f-cbf6-4563-a866-3cfeffc3fc8b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-z7vv6" Jul 06 13:49:58.417082 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:58.417054 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a3db086f-cbf6-4563-a866-3cfeffc3fc8b-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-z7vv6\" (UID: \"a3db086f-cbf6-4563-a866-3cfeffc3fc8b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-z7vv6" Jul 06 13:49:58.417339 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:58.417316 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhsvp\" (UniqueName: \"kubernetes.io/projected/a3db086f-cbf6-4563-a866-3cfeffc3fc8b-kube-api-access-xhsvp\") pod \"cert-manager-cainjector-559cdd8c87-z7vv6\" (UID: \"a3db086f-cbf6-4563-a866-3cfeffc3fc8b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-z7vv6" Jul 06 13:49:58.573665 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:58.573566 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-z7vv6" Jul 06 13:49:59.438519 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:59.438490 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-z7vv6"] Jul 06 13:49:59.440580 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:49:59.440556 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda3db086f_cbf6_4563_a866_3cfeffc3fc8b.slice/crio-5d81a21cca71d3cc3929ea4e13cfa8f2056d18ae731e2ee666f59520910a35b8 WatchSource:0}: Error finding container 5d81a21cca71d3cc3929ea4e13cfa8f2056d18ae731e2ee666f59520910a35b8: Status 404 returned error can't find the container with id 5d81a21cca71d3cc3929ea4e13cfa8f2056d18ae731e2ee666f59520910a35b8 Jul 06 13:49:59.798198 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:59.798159 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:49:59.898603 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:49:59.898565 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:50:00.050364 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:00.050282 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-hmnpm" event={"ID":"11e6deac-fff5-4ac7-ae05-11fbb8b2e0ec","Type":"ContainerStarted","Data":"8078601dec3841dded9b0bf3f5f7b84cd587a21d159db81383cf9b7072fe94b3"} Jul 06 13:50:00.050364 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:00.050343 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-hmnpm" Jul 06 13:50:00.057756 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:00.057719 2556 generic.go:356] "Generic (PLEG): container finished" podID="ea09335f-36e7-4494-bb86-7ddb88555387" containerID="bd38f07ec9829662b748c013edbcee75ecef8f5921626143d93445e0acd26681" exitCode=0 Jul 06 13:50:00.057896 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:00.057809 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd6g8k" event={"ID":"ea09335f-36e7-4494-bb86-7ddb88555387","Type":"ContainerDied","Data":"bd38f07ec9829662b748c013edbcee75ecef8f5921626143d93445e0acd26681"} Jul 06 13:50:00.059444 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:00.059421 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-z7vv6" event={"ID":"a3db086f-cbf6-4563-a866-3cfeffc3fc8b","Type":"ContainerStarted","Data":"ba41d4a0aa07ded0218546e27dd60982c9b98dd5ce56118c9693ae08c38fe8e4"} Jul 06 13:50:00.059541 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:00.059449 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-z7vv6" event={"ID":"a3db086f-cbf6-4563-a866-3cfeffc3fc8b","Type":"ContainerStarted","Data":"5d81a21cca71d3cc3929ea4e13cfa8f2056d18ae731e2ee666f59520910a35b8"} Jul 06 13:50:00.068152 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:00.068115 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-hmnpm" podStartSLOduration=1.868442943 podStartE2EDuration="5.068103877s" totalImagesPullingTime="3.199660934s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:49:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:50:00.066955089 +0000 UTC m=+293.866700807" watchObservedRunningTime="2026-07-06 13:50:00.068103877 +0000 UTC m=+293.867849569" Jul 06 13:50:00.098974 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:00.098935 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-z7vv6" podStartSLOduration=2.098923093 podStartE2EDuration="2.098923093s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:49:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:50:00.09832151 +0000 UTC m=+293.898067204" watchObservedRunningTime="2026-07-06 13:50:00.098923093 +0000 UTC m=+293.898668792" Jul 06 13:50:01.066086 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:01.066051 2556 generic.go:356] "Generic (PLEG): container finished" podID="ea09335f-36e7-4494-bb86-7ddb88555387" containerID="ae784612480bea6f5a2bb546835edefcb676cb216ad25cf483064c72ae82212f" exitCode=0 Jul 06 13:50:01.066449 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:01.066128 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd6g8k" event={"ID":"ea09335f-36e7-4494-bb86-7ddb88555387","Type":"ContainerDied","Data":"ae784612480bea6f5a2bb546835edefcb676cb216ad25cf483064c72ae82212f"} Jul 06 13:50:02.206330 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:02.206308 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd6g8k" Jul 06 13:50:02.243404 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:02.243378 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea09335f-36e7-4494-bb86-7ddb88555387-bundle\") pod \"ea09335f-36e7-4494-bb86-7ddb88555387\" (UID: \"ea09335f-36e7-4494-bb86-7ddb88555387\") " Jul 06 13:50:02.243564 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:02.243425 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-99ccl\" (UniqueName: \"kubernetes.io/projected/ea09335f-36e7-4494-bb86-7ddb88555387-kube-api-access-99ccl\") pod \"ea09335f-36e7-4494-bb86-7ddb88555387\" (UID: \"ea09335f-36e7-4494-bb86-7ddb88555387\") " Jul 06 13:50:02.243564 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:02.243503 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea09335f-36e7-4494-bb86-7ddb88555387-util\") pod \"ea09335f-36e7-4494-bb86-7ddb88555387\" (UID: \"ea09335f-36e7-4494-bb86-7ddb88555387\") " Jul 06 13:50:02.243835 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:02.243813 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea09335f-36e7-4494-bb86-7ddb88555387-bundle" (OuterVolumeSpecName: "bundle") pod "ea09335f-36e7-4494-bb86-7ddb88555387" (UID: "ea09335f-36e7-4494-bb86-7ddb88555387"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 13:50:02.245465 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:02.245447 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea09335f-36e7-4494-bb86-7ddb88555387-kube-api-access-99ccl" (OuterVolumeSpecName: "kube-api-access-99ccl") pod "ea09335f-36e7-4494-bb86-7ddb88555387" (UID: "ea09335f-36e7-4494-bb86-7ddb88555387"). InnerVolumeSpecName "kube-api-access-99ccl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 13:50:02.249791 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:02.249771 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea09335f-36e7-4494-bb86-7ddb88555387-util" (OuterVolumeSpecName: "util") pod "ea09335f-36e7-4494-bb86-7ddb88555387" (UID: "ea09335f-36e7-4494-bb86-7ddb88555387"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 13:50:02.344097 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:02.344024 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea09335f-36e7-4494-bb86-7ddb88555387-bundle\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:50:02.344097 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:02.344052 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-99ccl\" (UniqueName: \"kubernetes.io/projected/ea09335f-36e7-4494-bb86-7ddb88555387-kube-api-access-99ccl\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:50:02.344097 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:02.344063 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea09335f-36e7-4494-bb86-7ddb88555387-util\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:50:03.077737 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:03.077669 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd6g8k" Jul 06 13:50:03.077737 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:03.077680 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd6g8k" event={"ID":"ea09335f-36e7-4494-bb86-7ddb88555387","Type":"ContainerDied","Data":"198372f644c98bf2012daf7f349c33f1d1099d0840cc7fc709251b6012ec9d26"} Jul 06 13:50:03.077737 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:03.077729 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="198372f644c98bf2012daf7f349c33f1d1099d0840cc7fc709251b6012ec9d26" Jul 06 13:50:04.730846 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:04.730816 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:50:06.069239 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:06.069205 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-hmnpm" Jul 06 13:50:06.364526 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:06.364443 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:50:06.594198 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:06.594165 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vjl62_b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7/console-operator/2.log" Jul 06 13:50:06.597603 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:06.597581 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vjl62_b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7/console-operator/2.log" Jul 06 13:50:06.604755 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:06.604736 2556 kubelet.go:1648] "Image garbage collection succeeded" Jul 06 13:50:11.012659 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:11.012602 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:50:11.111342 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:11.111307 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:50:15.662776 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:15.662743 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-j8ldl"] Jul 06 13:50:15.663199 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:15.663085 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea09335f-36e7-4494-bb86-7ddb88555387" containerName="util" Jul 06 13:50:15.663199 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:15.663096 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea09335f-36e7-4494-bb86-7ddb88555387" containerName="util" Jul 06 13:50:15.663199 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:15.663111 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea09335f-36e7-4494-bb86-7ddb88555387" containerName="pull" Jul 06 13:50:15.663199 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:15.663116 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea09335f-36e7-4494-bb86-7ddb88555387" containerName="pull" Jul 06 13:50:15.663199 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:15.663128 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea09335f-36e7-4494-bb86-7ddb88555387" containerName="extract" Jul 06 13:50:15.663199 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:15.663134 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea09335f-36e7-4494-bb86-7ddb88555387" containerName="extract" Jul 06 13:50:15.663199 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:15.663196 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea09335f-36e7-4494-bb86-7ddb88555387" containerName="extract" Jul 06 13:50:15.675331 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:15.675310 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-j8ldl"] Jul 06 13:50:15.675462 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:15.675390 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-j8ldl" Jul 06 13:50:15.678152 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:15.678117 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-ndh8q\"" Jul 06 13:50:15.761479 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:15.761452 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cc140807-7564-49b8-b823-f00e41ab9dc4-bound-sa-token\") pod \"cert-manager-55b4d954d5-j8ldl\" (UID: \"cc140807-7564-49b8-b823-f00e41ab9dc4\") " pod="cert-manager/cert-manager-55b4d954d5-j8ldl" Jul 06 13:50:15.761589 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:15.761482 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vl27h\" (UniqueName: \"kubernetes.io/projected/cc140807-7564-49b8-b823-f00e41ab9dc4-kube-api-access-vl27h\") pod \"cert-manager-55b4d954d5-j8ldl\" (UID: \"cc140807-7564-49b8-b823-f00e41ab9dc4\") " pod="cert-manager/cert-manager-55b4d954d5-j8ldl" Jul 06 13:50:15.861931 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:15.861905 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cc140807-7564-49b8-b823-f00e41ab9dc4-bound-sa-token\") pod \"cert-manager-55b4d954d5-j8ldl\" (UID: \"cc140807-7564-49b8-b823-f00e41ab9dc4\") " pod="cert-manager/cert-manager-55b4d954d5-j8ldl" Jul 06 13:50:15.861931 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:15.861934 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vl27h\" (UniqueName: \"kubernetes.io/projected/cc140807-7564-49b8-b823-f00e41ab9dc4-kube-api-access-vl27h\") pod \"cert-manager-55b4d954d5-j8ldl\" (UID: \"cc140807-7564-49b8-b823-f00e41ab9dc4\") " pod="cert-manager/cert-manager-55b4d954d5-j8ldl" Jul 06 13:50:15.870078 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:15.870049 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cc140807-7564-49b8-b823-f00e41ab9dc4-bound-sa-token\") pod \"cert-manager-55b4d954d5-j8ldl\" (UID: \"cc140807-7564-49b8-b823-f00e41ab9dc4\") " pod="cert-manager/cert-manager-55b4d954d5-j8ldl" Jul 06 13:50:15.870241 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:15.870225 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vl27h\" (UniqueName: \"kubernetes.io/projected/cc140807-7564-49b8-b823-f00e41ab9dc4-kube-api-access-vl27h\") pod \"cert-manager-55b4d954d5-j8ldl\" (UID: \"cc140807-7564-49b8-b823-f00e41ab9dc4\") " pod="cert-manager/cert-manager-55b4d954d5-j8ldl" Jul 06 13:50:15.985151 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:15.985125 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-j8ldl" Jul 06 13:50:16.129528 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:16.129505 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-j8ldl"] Jul 06 13:50:16.131876 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:50:16.131847 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcc140807_7564_49b8_b823_f00e41ab9dc4.slice/crio-ecc5ebd378011a2007c631ec92a40ae97584d8589839b598c326904ff3be1181 WatchSource:0}: Error finding container ecc5ebd378011a2007c631ec92a40ae97584d8589839b598c326904ff3be1181: Status 404 returned error can't find the container with id ecc5ebd378011a2007c631ec92a40ae97584d8589839b598c326904ff3be1181 Jul 06 13:50:17.141368 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:17.141334 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-j8ldl" event={"ID":"cc140807-7564-49b8-b823-f00e41ab9dc4","Type":"ContainerStarted","Data":"47ead5277f74cf876af3b1a5ed767606ef965175c71b1a574c069d260b0f09cd"} Jul 06 13:50:17.141805 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:17.141377 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-j8ldl" event={"ID":"cc140807-7564-49b8-b823-f00e41ab9dc4","Type":"ContainerStarted","Data":"ecc5ebd378011a2007c631ec92a40ae97584d8589839b598c326904ff3be1181"} Jul 06 13:50:17.159526 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:17.159478 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-j8ldl" podStartSLOduration=2.159464629 podStartE2EDuration="2.159464629s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:50:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:50:17.158089146 +0000 UTC m=+310.957834839" watchObservedRunningTime="2026-07-06 13:50:17.159464629 +0000 UTC m=+310.959210321" Jul 06 13:50:17.380665 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:17.380584 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:50:17.482113 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:17.482039 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:50:19.251748 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:19.251713 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:50:19.478314 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:19.478280 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgwngj"] Jul 06 13:50:19.480758 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:19.480741 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgwngj" Jul 06 13:50:19.483361 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:19.483341 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 13:50:19.483465 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:19.483368 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 13:50:19.484751 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:19.484734 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-w4754\"" Jul 06 13:50:19.490790 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:19.490762 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgwngj"] Jul 06 13:50:19.598063 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:19.597979 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7158bc7b-8078-4ba3-ab82-cbb36e99e13c-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgwngj\" (UID: \"7158bc7b-8078-4ba3-ab82-cbb36e99e13c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgwngj" Jul 06 13:50:19.598063 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:19.598020 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7158bc7b-8078-4ba3-ab82-cbb36e99e13c-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgwngj\" (UID: \"7158bc7b-8078-4ba3-ab82-cbb36e99e13c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgwngj" Jul 06 13:50:19.598063 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:19.598056 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwl6s\" (UniqueName: \"kubernetes.io/projected/7158bc7b-8078-4ba3-ab82-cbb36e99e13c-kube-api-access-fwl6s\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgwngj\" (UID: \"7158bc7b-8078-4ba3-ab82-cbb36e99e13c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgwngj" Jul 06 13:50:19.698433 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:19.698402 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7158bc7b-8078-4ba3-ab82-cbb36e99e13c-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgwngj\" (UID: \"7158bc7b-8078-4ba3-ab82-cbb36e99e13c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgwngj" Jul 06 13:50:19.698558 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:19.698438 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7158bc7b-8078-4ba3-ab82-cbb36e99e13c-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgwngj\" (UID: \"7158bc7b-8078-4ba3-ab82-cbb36e99e13c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgwngj" Jul 06 13:50:19.698558 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:19.698462 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwl6s\" (UniqueName: \"kubernetes.io/projected/7158bc7b-8078-4ba3-ab82-cbb36e99e13c-kube-api-access-fwl6s\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgwngj\" (UID: \"7158bc7b-8078-4ba3-ab82-cbb36e99e13c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgwngj" Jul 06 13:50:19.698857 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:19.698837 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7158bc7b-8078-4ba3-ab82-cbb36e99e13c-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgwngj\" (UID: \"7158bc7b-8078-4ba3-ab82-cbb36e99e13c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgwngj" Jul 06 13:50:19.698919 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:19.698864 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7158bc7b-8078-4ba3-ab82-cbb36e99e13c-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgwngj\" (UID: \"7158bc7b-8078-4ba3-ab82-cbb36e99e13c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgwngj" Jul 06 13:50:19.709817 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:19.709794 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwl6s\" (UniqueName: \"kubernetes.io/projected/7158bc7b-8078-4ba3-ab82-cbb36e99e13c-kube-api-access-fwl6s\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgwngj\" (UID: \"7158bc7b-8078-4ba3-ab82-cbb36e99e13c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgwngj" Jul 06 13:50:19.791320 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:19.791301 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgwngj" Jul 06 13:50:19.922272 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:19.922195 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgwngj"] Jul 06 13:50:19.924934 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:50:19.924905 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7158bc7b_8078_4ba3_ab82_cbb36e99e13c.slice/crio-7846a0183131e499237c8678e24656cf2a8d8d253fa17f3a52d2ce3025c6df5a WatchSource:0}: Error finding container 7846a0183131e499237c8678e24656cf2a8d8d253fa17f3a52d2ce3025c6df5a: Status 404 returned error can't find the container with id 7846a0183131e499237c8678e24656cf2a8d8d253fa17f3a52d2ce3025c6df5a Jul 06 13:50:20.156808 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:20.156742 2556 generic.go:356] "Generic (PLEG): container finished" podID="7158bc7b-8078-4ba3-ab82-cbb36e99e13c" containerID="68f152b161399441f429eccb964fec09036bf840cff5856b5489adaf01dbbf77" exitCode=0 Jul 06 13:50:20.156923 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:20.156831 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgwngj" event={"ID":"7158bc7b-8078-4ba3-ab82-cbb36e99e13c","Type":"ContainerDied","Data":"68f152b161399441f429eccb964fec09036bf840cff5856b5489adaf01dbbf77"} Jul 06 13:50:20.156923 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:20.156884 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgwngj" event={"ID":"7158bc7b-8078-4ba3-ab82-cbb36e99e13c","Type":"ContainerStarted","Data":"7846a0183131e499237c8678e24656cf2a8d8d253fa17f3a52d2ce3025c6df5a"} Jul 06 13:50:20.157306 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:20.157289 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 13:50:21.163904 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:21.163873 2556 generic.go:356] "Generic (PLEG): container finished" podID="7158bc7b-8078-4ba3-ab82-cbb36e99e13c" containerID="5e4e0f96315e2551058aa599802d089f75ad7cad6b7735be1e9a937ca3ec2a76" exitCode=0 Jul 06 13:50:21.164267 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:21.163948 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgwngj" event={"ID":"7158bc7b-8078-4ba3-ab82-cbb36e99e13c","Type":"ContainerDied","Data":"5e4e0f96315e2551058aa599802d089f75ad7cad6b7735be1e9a937ca3ec2a76"} Jul 06 13:50:22.170502 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:22.170471 2556 generic.go:356] "Generic (PLEG): container finished" podID="7158bc7b-8078-4ba3-ab82-cbb36e99e13c" containerID="d933af87f18ce0a98fff879702dc523f0f6f88ffa68786343115badfba5db2d0" exitCode=0 Jul 06 13:50:22.170908 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:22.170528 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgwngj" event={"ID":"7158bc7b-8078-4ba3-ab82-cbb36e99e13c","Type":"ContainerDied","Data":"d933af87f18ce0a98fff879702dc523f0f6f88ffa68786343115badfba5db2d0"} Jul 06 13:50:23.131201 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:23.131167 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:50:23.197311 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:23.197278 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:50:23.304762 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:23.304735 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgwngj" Jul 06 13:50:23.430567 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:23.430499 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7158bc7b-8078-4ba3-ab82-cbb36e99e13c-util\") pod \"7158bc7b-8078-4ba3-ab82-cbb36e99e13c\" (UID: \"7158bc7b-8078-4ba3-ab82-cbb36e99e13c\") " Jul 06 13:50:23.430567 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:23.430536 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fwl6s\" (UniqueName: \"kubernetes.io/projected/7158bc7b-8078-4ba3-ab82-cbb36e99e13c-kube-api-access-fwl6s\") pod \"7158bc7b-8078-4ba3-ab82-cbb36e99e13c\" (UID: \"7158bc7b-8078-4ba3-ab82-cbb36e99e13c\") " Jul 06 13:50:23.430567 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:23.430553 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7158bc7b-8078-4ba3-ab82-cbb36e99e13c-bundle\") pod \"7158bc7b-8078-4ba3-ab82-cbb36e99e13c\" (UID: \"7158bc7b-8078-4ba3-ab82-cbb36e99e13c\") " Jul 06 13:50:23.431263 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:23.431237 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7158bc7b-8078-4ba3-ab82-cbb36e99e13c-bundle" (OuterVolumeSpecName: "bundle") pod "7158bc7b-8078-4ba3-ab82-cbb36e99e13c" (UID: "7158bc7b-8078-4ba3-ab82-cbb36e99e13c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 13:50:23.432610 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:23.432575 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7158bc7b-8078-4ba3-ab82-cbb36e99e13c-kube-api-access-fwl6s" (OuterVolumeSpecName: "kube-api-access-fwl6s") pod "7158bc7b-8078-4ba3-ab82-cbb36e99e13c" (UID: "7158bc7b-8078-4ba3-ab82-cbb36e99e13c"). InnerVolumeSpecName "kube-api-access-fwl6s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 13:50:23.436507 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:23.436473 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7158bc7b-8078-4ba3-ab82-cbb36e99e13c-util" (OuterVolumeSpecName: "util") pod "7158bc7b-8078-4ba3-ab82-cbb36e99e13c" (UID: "7158bc7b-8078-4ba3-ab82-cbb36e99e13c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 13:50:23.531268 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:23.531243 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7158bc7b-8078-4ba3-ab82-cbb36e99e13c-util\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:50:23.531268 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:23.531270 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fwl6s\" (UniqueName: \"kubernetes.io/projected/7158bc7b-8078-4ba3-ab82-cbb36e99e13c-kube-api-access-fwl6s\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:50:23.531422 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:23.531279 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7158bc7b-8078-4ba3-ab82-cbb36e99e13c-bundle\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:50:24.180295 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:24.180253 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgwngj" event={"ID":"7158bc7b-8078-4ba3-ab82-cbb36e99e13c","Type":"ContainerDied","Data":"7846a0183131e499237c8678e24656cf2a8d8d253fa17f3a52d2ce3025c6df5a"} Jul 06 13:50:24.180295 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:24.180297 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgwngj" Jul 06 13:50:24.180485 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:24.180308 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7846a0183131e499237c8678e24656cf2a8d8d253fa17f3a52d2ce3025c6df5a" Jul 06 13:50:33.242364 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:33.242323 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:50:34.187778 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:34.187735 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-whnwf"] Jul 06 13:50:34.188141 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:34.188122 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7158bc7b-8078-4ba3-ab82-cbb36e99e13c" containerName="extract" Jul 06 13:50:34.188295 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:34.188143 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="7158bc7b-8078-4ba3-ab82-cbb36e99e13c" containerName="extract" Jul 06 13:50:34.188295 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:34.188165 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7158bc7b-8078-4ba3-ab82-cbb36e99e13c" containerName="util" Jul 06 13:50:34.188295 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:34.188173 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="7158bc7b-8078-4ba3-ab82-cbb36e99e13c" containerName="util" Jul 06 13:50:34.188295 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:34.188188 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7158bc7b-8078-4ba3-ab82-cbb36e99e13c" containerName="pull" Jul 06 13:50:34.188295 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:34.188195 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="7158bc7b-8078-4ba3-ab82-cbb36e99e13c" containerName="pull" Jul 06 13:50:34.188599 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:34.188323 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="7158bc7b-8078-4ba3-ab82-cbb36e99e13c" containerName="extract" Jul 06 13:50:34.192639 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:34.192608 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-whnwf" Jul 06 13:50:34.195889 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:34.195858 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 06 13:50:34.195889 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:34.195859 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 06 13:50:34.196047 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:34.195899 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 06 13:50:34.196047 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:34.195923 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-kc44z\"" Jul 06 13:50:34.196047 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:34.195901 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 06 13:50:34.206607 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:34.206586 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-whnwf"] Jul 06 13:50:34.322224 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:34.322193 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/90bf4f2a-d6cf-46fa-b36f-512130b1dc91-tmp\") pod \"opendatahub-operator-controller-manager-69bb6cc6d7-whnwf\" (UID: \"90bf4f2a-d6cf-46fa-b36f-512130b1dc91\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-whnwf" Jul 06 13:50:34.322564 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:34.322229 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27swr\" (UniqueName: \"kubernetes.io/projected/90bf4f2a-d6cf-46fa-b36f-512130b1dc91-kube-api-access-27swr\") pod \"opendatahub-operator-controller-manager-69bb6cc6d7-whnwf\" (UID: \"90bf4f2a-d6cf-46fa-b36f-512130b1dc91\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-whnwf" Jul 06 13:50:34.322564 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:34.322334 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/90bf4f2a-d6cf-46fa-b36f-512130b1dc91-manifests\") pod \"opendatahub-operator-controller-manager-69bb6cc6d7-whnwf\" (UID: \"90bf4f2a-d6cf-46fa-b36f-512130b1dc91\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-whnwf" Jul 06 13:50:34.322564 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:34.322377 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/90bf4f2a-d6cf-46fa-b36f-512130b1dc91-webhook-cert\") pod \"opendatahub-operator-controller-manager-69bb6cc6d7-whnwf\" (UID: \"90bf4f2a-d6cf-46fa-b36f-512130b1dc91\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-whnwf" Jul 06 13:50:34.322564 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:34.322438 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/90bf4f2a-d6cf-46fa-b36f-512130b1dc91-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69bb6cc6d7-whnwf\" (UID: \"90bf4f2a-d6cf-46fa-b36f-512130b1dc91\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-whnwf" Jul 06 13:50:34.350900 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:34.350877 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:50:34.423823 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:34.423802 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/90bf4f2a-d6cf-46fa-b36f-512130b1dc91-webhook-cert\") pod \"opendatahub-operator-controller-manager-69bb6cc6d7-whnwf\" (UID: \"90bf4f2a-d6cf-46fa-b36f-512130b1dc91\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-whnwf" Jul 06 13:50:34.423934 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:34.423842 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/90bf4f2a-d6cf-46fa-b36f-512130b1dc91-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69bb6cc6d7-whnwf\" (UID: \"90bf4f2a-d6cf-46fa-b36f-512130b1dc91\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-whnwf" Jul 06 13:50:34.423934 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:34.423879 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/90bf4f2a-d6cf-46fa-b36f-512130b1dc91-tmp\") pod \"opendatahub-operator-controller-manager-69bb6cc6d7-whnwf\" (UID: \"90bf4f2a-d6cf-46fa-b36f-512130b1dc91\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-whnwf" Jul 06 13:50:34.423934 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:34.423905 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27swr\" (UniqueName: \"kubernetes.io/projected/90bf4f2a-d6cf-46fa-b36f-512130b1dc91-kube-api-access-27swr\") pod \"opendatahub-operator-controller-manager-69bb6cc6d7-whnwf\" (UID: \"90bf4f2a-d6cf-46fa-b36f-512130b1dc91\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-whnwf" Jul 06 13:50:34.424087 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:34.423954 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/90bf4f2a-d6cf-46fa-b36f-512130b1dc91-manifests\") pod \"opendatahub-operator-controller-manager-69bb6cc6d7-whnwf\" (UID: \"90bf4f2a-d6cf-46fa-b36f-512130b1dc91\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-whnwf" Jul 06 13:50:34.424343 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:34.424316 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/90bf4f2a-d6cf-46fa-b36f-512130b1dc91-manifests\") pod \"opendatahub-operator-controller-manager-69bb6cc6d7-whnwf\" (UID: \"90bf4f2a-d6cf-46fa-b36f-512130b1dc91\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-whnwf" Jul 06 13:50:34.426188 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:34.426162 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/90bf4f2a-d6cf-46fa-b36f-512130b1dc91-tmp\") pod \"opendatahub-operator-controller-manager-69bb6cc6d7-whnwf\" (UID: \"90bf4f2a-d6cf-46fa-b36f-512130b1dc91\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-whnwf" Jul 06 13:50:34.426286 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:34.426209 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/90bf4f2a-d6cf-46fa-b36f-512130b1dc91-webhook-cert\") pod \"opendatahub-operator-controller-manager-69bb6cc6d7-whnwf\" (UID: \"90bf4f2a-d6cf-46fa-b36f-512130b1dc91\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-whnwf" Jul 06 13:50:34.426349 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:34.426288 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/90bf4f2a-d6cf-46fa-b36f-512130b1dc91-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69bb6cc6d7-whnwf\" (UID: \"90bf4f2a-d6cf-46fa-b36f-512130b1dc91\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-whnwf" Jul 06 13:50:34.437062 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:34.437042 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27swr\" (UniqueName: \"kubernetes.io/projected/90bf4f2a-d6cf-46fa-b36f-512130b1dc91-kube-api-access-27swr\") pod \"opendatahub-operator-controller-manager-69bb6cc6d7-whnwf\" (UID: \"90bf4f2a-d6cf-46fa-b36f-512130b1dc91\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-whnwf" Jul 06 13:50:34.451533 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:34.451475 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:50:34.502918 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:34.502897 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-whnwf" Jul 06 13:50:34.574639 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:34.572209 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:50:34.654878 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:34.654848 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-whnwf"] Jul 06 13:50:34.655051 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:34.655024 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:50:34.659389 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:50:34.659367 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90bf4f2a_d6cf_46fa_b36f_512130b1dc91.slice/crio-8c3626a5f8f0b02399c06303556c6255d9955561a13f7e0e93c9d19f4ff4ec49 WatchSource:0}: Error finding container 8c3626a5f8f0b02399c06303556c6255d9955561a13f7e0e93c9d19f4ff4ec49: Status 404 returned error can't find the container with id 8c3626a5f8f0b02399c06303556c6255d9955561a13f7e0e93c9d19f4ff4ec49 Jul 06 13:50:34.757567 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:34.757540 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:50:34.869452 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:34.869423 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:50:35.231238 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:35.231164 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-whnwf" event={"ID":"90bf4f2a-d6cf-46fa-b36f-512130b1dc91","Type":"ContainerStarted","Data":"8c3626a5f8f0b02399c06303556c6255d9955561a13f7e0e93c9d19f4ff4ec49"} Jul 06 13:50:38.247979 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:38.247944 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-whnwf" event={"ID":"90bf4f2a-d6cf-46fa-b36f-512130b1dc91","Type":"ContainerStarted","Data":"6c8ecd37a3b329f61a6157f628f86060515d54f19d1859a872ca0e1fe59cf8cc"} Jul 06 13:50:39.254459 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:39.254423 2556 generic.go:356] "Generic (PLEG): container finished" podID="90bf4f2a-d6cf-46fa-b36f-512130b1dc91" containerID="6c8ecd37a3b329f61a6157f628f86060515d54f19d1859a872ca0e1fe59cf8cc" exitCode=0 Jul 06 13:50:39.254861 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:39.254470 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-whnwf" event={"ID":"90bf4f2a-d6cf-46fa-b36f-512130b1dc91","Type":"ContainerDied","Data":"6c8ecd37a3b329f61a6157f628f86060515d54f19d1859a872ca0e1fe59cf8cc"} Jul 06 13:50:40.260850 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:40.260813 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-whnwf" event={"ID":"90bf4f2a-d6cf-46fa-b36f-512130b1dc91","Type":"ContainerStarted","Data":"05e12fdd99dfc4583a768470d1f5f7e4f717d414d469611ae1cb5e62fa3998d1"} Jul 06 13:50:40.261251 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:40.260897 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-whnwf" Jul 06 13:50:40.284890 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:40.284839 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-whnwf" podStartSLOduration=1.966441074 podStartE2EDuration="6.2848236s" totalImagesPullingTime="3.285925166s" totalInitContainerRuntime="1.03245736s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:50:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:50:40.281840407 +0000 UTC m=+334.081586123" watchObservedRunningTime="2026-07-06 13:50:40.2848236 +0000 UTC m=+334.084569292" Jul 06 13:50:41.512782 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:41.512743 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:50:41.609797 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:41.609757 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:50:42.021185 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:42.021145 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:50:42.122998 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:42.122964 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:50:43.887130 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:43.887093 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:50:43.951272 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:43.951234 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:50:45.979234 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:45.979203 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:50:46.078008 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:46.077982 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:50:51.269553 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:51.269519 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-whnwf" Jul 06 13:50:52.970645 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:52.970594 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:50:53.167403 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:53.167373 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:50:53.552647 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:53.551197 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-wx677"] Jul 06 13:50:53.560845 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:53.560816 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-wx677" Jul 06 13:50:53.566391 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:53.566363 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 06 13:50:53.566526 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:53.566416 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-gpvxv\"" Jul 06 13:50:53.597140 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:53.597109 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-wx677"] Jul 06 13:50:53.664825 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:53.664794 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:50:53.688777 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:53.688752 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/21b366ba-2179-4321-a7ca-fdde9daebb5a-cert\") pod \"odh-model-controller-7998c67dc4-wx677\" (UID: \"21b366ba-2179-4321-a7ca-fdde9daebb5a\") " pod="opendatahub/odh-model-controller-7998c67dc4-wx677" Jul 06 13:50:53.688901 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:53.688821 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssjzr\" (UniqueName: \"kubernetes.io/projected/21b366ba-2179-4321-a7ca-fdde9daebb5a-kube-api-access-ssjzr\") pod \"odh-model-controller-7998c67dc4-wx677\" (UID: \"21b366ba-2179-4321-a7ca-fdde9daebb5a\") " pod="opendatahub/odh-model-controller-7998c67dc4-wx677" Jul 06 13:50:53.779019 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:53.778989 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:50:53.789361 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:53.789339 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssjzr\" (UniqueName: \"kubernetes.io/projected/21b366ba-2179-4321-a7ca-fdde9daebb5a-kube-api-access-ssjzr\") pod \"odh-model-controller-7998c67dc4-wx677\" (UID: \"21b366ba-2179-4321-a7ca-fdde9daebb5a\") " pod="opendatahub/odh-model-controller-7998c67dc4-wx677" Jul 06 13:50:53.789447 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:53.789386 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/21b366ba-2179-4321-a7ca-fdde9daebb5a-cert\") pod \"odh-model-controller-7998c67dc4-wx677\" (UID: \"21b366ba-2179-4321-a7ca-fdde9daebb5a\") " pod="opendatahub/odh-model-controller-7998c67dc4-wx677" Jul 06 13:50:53.789493 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:50:53.789485 2556 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 06 13:50:53.789549 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:50:53.789540 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21b366ba-2179-4321-a7ca-fdde9daebb5a-cert podName:21b366ba-2179-4321-a7ca-fdde9daebb5a nodeName:}" failed. No retries permitted until 2026-07-06 13:50:54.289526015 +0000 UTC m=+348.089271686 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/21b366ba-2179-4321-a7ca-fdde9daebb5a-cert") pod "odh-model-controller-7998c67dc4-wx677" (UID: "21b366ba-2179-4321-a7ca-fdde9daebb5a") : secret "odh-model-controller-webhook-cert" not found Jul 06 13:50:53.801452 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:53.801433 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssjzr\" (UniqueName: \"kubernetes.io/projected/21b366ba-2179-4321-a7ca-fdde9daebb5a-kube-api-access-ssjzr\") pod \"odh-model-controller-7998c67dc4-wx677\" (UID: \"21b366ba-2179-4321-a7ca-fdde9daebb5a\") " pod="opendatahub/odh-model-controller-7998c67dc4-wx677" Jul 06 13:50:53.924543 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:53.924460 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:50:54.153337 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:54.153308 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-wzv7k"] Jul 06 13:50:54.156683 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:54.156661 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-wzv7k" Jul 06 13:50:54.159831 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:54.159811 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 06 13:50:54.168068 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:54.168049 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-wzv7k"] Jul 06 13:50:54.180761 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:54.180688 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:50:54.194203 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:54.194182 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c9b87b4-4ae4-439a-8644-d6839d74b15c-tls-certs\") pod \"model-serving-api-54d89bd5fc-wzv7k\" (UID: \"1c9b87b4-4ae4-439a-8644-d6839d74b15c\") " pod="opendatahub/model-serving-api-54d89bd5fc-wzv7k" Jul 06 13:50:54.194302 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:54.194254 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxgqd\" (UniqueName: \"kubernetes.io/projected/1c9b87b4-4ae4-439a-8644-d6839d74b15c-kube-api-access-nxgqd\") pod \"model-serving-api-54d89bd5fc-wzv7k\" (UID: \"1c9b87b4-4ae4-439a-8644-d6839d74b15c\") " pod="opendatahub/model-serving-api-54d89bd5fc-wzv7k" Jul 06 13:50:54.295601 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:54.295568 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/21b366ba-2179-4321-a7ca-fdde9daebb5a-cert\") pod \"odh-model-controller-7998c67dc4-wx677\" (UID: \"21b366ba-2179-4321-a7ca-fdde9daebb5a\") " pod="opendatahub/odh-model-controller-7998c67dc4-wx677" Jul 06 13:50:54.295752 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:54.295647 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c9b87b4-4ae4-439a-8644-d6839d74b15c-tls-certs\") pod \"model-serving-api-54d89bd5fc-wzv7k\" (UID: \"1c9b87b4-4ae4-439a-8644-d6839d74b15c\") " pod="opendatahub/model-serving-api-54d89bd5fc-wzv7k" Jul 06 13:50:54.295752 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:50:54.295739 2556 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 06 13:50:54.295858 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:54.295754 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxgqd\" (UniqueName: \"kubernetes.io/projected/1c9b87b4-4ae4-439a-8644-d6839d74b15c-kube-api-access-nxgqd\") pod \"model-serving-api-54d89bd5fc-wzv7k\" (UID: \"1c9b87b4-4ae4-439a-8644-d6839d74b15c\") " pod="opendatahub/model-serving-api-54d89bd5fc-wzv7k" Jul 06 13:50:54.295858 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:50:54.295796 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c9b87b4-4ae4-439a-8644-d6839d74b15c-tls-certs podName:1c9b87b4-4ae4-439a-8644-d6839d74b15c nodeName:}" failed. No retries permitted until 2026-07-06 13:50:54.795781024 +0000 UTC m=+348.595526700 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/1c9b87b4-4ae4-439a-8644-d6839d74b15c-tls-certs") pod "model-serving-api-54d89bd5fc-wzv7k" (UID: "1c9b87b4-4ae4-439a-8644-d6839d74b15c") : secret "model-serving-api-tls" not found Jul 06 13:50:54.297996 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:54.297972 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/21b366ba-2179-4321-a7ca-fdde9daebb5a-cert\") pod \"odh-model-controller-7998c67dc4-wx677\" (UID: \"21b366ba-2179-4321-a7ca-fdde9daebb5a\") " pod="opendatahub/odh-model-controller-7998c67dc4-wx677" Jul 06 13:50:54.307420 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:54.307398 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxgqd\" (UniqueName: \"kubernetes.io/projected/1c9b87b4-4ae4-439a-8644-d6839d74b15c-kube-api-access-nxgqd\") pod \"model-serving-api-54d89bd5fc-wzv7k\" (UID: \"1c9b87b4-4ae4-439a-8644-d6839d74b15c\") " pod="opendatahub/model-serving-api-54d89bd5fc-wzv7k" Jul 06 13:50:54.392017 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:54.391987 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:50:54.473741 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:54.473681 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-wx677" Jul 06 13:50:54.606371 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:54.606349 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-wx677"] Jul 06 13:50:54.608520 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:50:54.608495 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21b366ba_2179_4321_a7ca_fdde9daebb5a.slice/crio-a9e147c9b1461531e3718a817a953dec9e3c6d62bb7a08ba46b4d73ba357ec06 WatchSource:0}: Error finding container a9e147c9b1461531e3718a817a953dec9e3c6d62bb7a08ba46b4d73ba357ec06: Status 404 returned error can't find the container with id a9e147c9b1461531e3718a817a953dec9e3c6d62bb7a08ba46b4d73ba357ec06 Jul 06 13:50:54.800036 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:54.800010 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c9b87b4-4ae4-439a-8644-d6839d74b15c-tls-certs\") pod \"model-serving-api-54d89bd5fc-wzv7k\" (UID: \"1c9b87b4-4ae4-439a-8644-d6839d74b15c\") " pod="opendatahub/model-serving-api-54d89bd5fc-wzv7k" Jul 06 13:50:54.802402 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:54.802376 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c9b87b4-4ae4-439a-8644-d6839d74b15c-tls-certs\") pod \"model-serving-api-54d89bd5fc-wzv7k\" (UID: \"1c9b87b4-4ae4-439a-8644-d6839d74b15c\") " pod="opendatahub/model-serving-api-54d89bd5fc-wzv7k" Jul 06 13:50:55.069694 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:55.069569 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-wzv7k" Jul 06 13:50:55.201316 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:55.201284 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-wzv7k"] Jul 06 13:50:55.205595 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:50:55.205567 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c9b87b4_4ae4_439a_8644_d6839d74b15c.slice/crio-4946a49d9da3799958b6f5a8489e190bf86cc2be816c6fd277d7b02f910e545e WatchSource:0}: Error finding container 4946a49d9da3799958b6f5a8489e190bf86cc2be816c6fd277d7b02f910e545e: Status 404 returned error can't find the container with id 4946a49d9da3799958b6f5a8489e190bf86cc2be816c6fd277d7b02f910e545e Jul 06 13:50:55.337548 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:55.337461 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-wx677" event={"ID":"21b366ba-2179-4321-a7ca-fdde9daebb5a","Type":"ContainerStarted","Data":"a9e147c9b1461531e3718a817a953dec9e3c6d62bb7a08ba46b4d73ba357ec06"} Jul 06 13:50:55.339383 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:55.339356 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-wzv7k" event={"ID":"1c9b87b4-4ae4-439a-8644-d6839d74b15c","Type":"ContainerStarted","Data":"4946a49d9da3799958b6f5a8489e190bf86cc2be816c6fd277d7b02f910e545e"} Jul 06 13:50:56.325016 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:56.324967 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:50:56.415550 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:56.415080 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-cf46d7698-7mgvt"] Jul 06 13:50:56.425248 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:56.425215 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-cf46d7698-7mgvt" Jul 06 13:50:56.428016 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:56.427959 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-cf46d7698-7mgvt"] Jul 06 13:50:56.428334 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:56.428260 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 06 13:50:56.428651 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:56.428261 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-tp2wj\"" Jul 06 13:50:56.429835 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:56.429556 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 06 13:50:56.429835 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:56.429602 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 06 13:50:56.429835 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:56.429564 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 06 13:50:56.516255 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:56.516223 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ccfcc8fe-0f38-4027-8152-30c716737aaf-tls-certs\") pod \"kube-auth-proxy-cf46d7698-7mgvt\" (UID: \"ccfcc8fe-0f38-4027-8152-30c716737aaf\") " pod="openshift-ingress/kube-auth-proxy-cf46d7698-7mgvt" Jul 06 13:50:56.516425 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:56.516280 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2t6b\" (UniqueName: \"kubernetes.io/projected/ccfcc8fe-0f38-4027-8152-30c716737aaf-kube-api-access-d2t6b\") pod \"kube-auth-proxy-cf46d7698-7mgvt\" (UID: \"ccfcc8fe-0f38-4027-8152-30c716737aaf\") " pod="openshift-ingress/kube-auth-proxy-cf46d7698-7mgvt" Jul 06 13:50:56.516481 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:56.516444 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ccfcc8fe-0f38-4027-8152-30c716737aaf-tmp\") pod \"kube-auth-proxy-cf46d7698-7mgvt\" (UID: \"ccfcc8fe-0f38-4027-8152-30c716737aaf\") " pod="openshift-ingress/kube-auth-proxy-cf46d7698-7mgvt" Jul 06 13:50:56.617269 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:56.617186 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ccfcc8fe-0f38-4027-8152-30c716737aaf-tmp\") pod \"kube-auth-proxy-cf46d7698-7mgvt\" (UID: \"ccfcc8fe-0f38-4027-8152-30c716737aaf\") " pod="openshift-ingress/kube-auth-proxy-cf46d7698-7mgvt" Jul 06 13:50:56.617411 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:56.617282 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ccfcc8fe-0f38-4027-8152-30c716737aaf-tls-certs\") pod \"kube-auth-proxy-cf46d7698-7mgvt\" (UID: \"ccfcc8fe-0f38-4027-8152-30c716737aaf\") " pod="openshift-ingress/kube-auth-proxy-cf46d7698-7mgvt" Jul 06 13:50:56.617411 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:56.617337 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2t6b\" (UniqueName: \"kubernetes.io/projected/ccfcc8fe-0f38-4027-8152-30c716737aaf-kube-api-access-d2t6b\") pod \"kube-auth-proxy-cf46d7698-7mgvt\" (UID: \"ccfcc8fe-0f38-4027-8152-30c716737aaf\") " pod="openshift-ingress/kube-auth-proxy-cf46d7698-7mgvt" Jul 06 13:50:56.619805 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:56.619776 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ccfcc8fe-0f38-4027-8152-30c716737aaf-tmp\") pod \"kube-auth-proxy-cf46d7698-7mgvt\" (UID: \"ccfcc8fe-0f38-4027-8152-30c716737aaf\") " pod="openshift-ingress/kube-auth-proxy-cf46d7698-7mgvt" Jul 06 13:50:56.620144 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:56.620105 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ccfcc8fe-0f38-4027-8152-30c716737aaf-tls-certs\") pod \"kube-auth-proxy-cf46d7698-7mgvt\" (UID: \"ccfcc8fe-0f38-4027-8152-30c716737aaf\") " pod="openshift-ingress/kube-auth-proxy-cf46d7698-7mgvt" Jul 06 13:50:56.625883 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:56.625860 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2t6b\" (UniqueName: \"kubernetes.io/projected/ccfcc8fe-0f38-4027-8152-30c716737aaf-kube-api-access-d2t6b\") pod \"kube-auth-proxy-cf46d7698-7mgvt\" (UID: \"ccfcc8fe-0f38-4027-8152-30c716737aaf\") " pod="openshift-ingress/kube-auth-proxy-cf46d7698-7mgvt" Jul 06 13:50:56.645321 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:56.645291 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:50:56.739374 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:56.739351 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-cf46d7698-7mgvt" Jul 06 13:50:57.470649 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:57.470600 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-d2l22"] Jul 06 13:50:57.474333 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:57.474312 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-d2l22" Jul 06 13:50:57.476992 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:57.476966 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 06 13:50:57.477135 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:57.476984 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 06 13:50:57.477223 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:57.476988 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 06 13:50:57.477223 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:57.476989 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 06 13:50:57.477330 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:57.477026 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-tfdst\"" Jul 06 13:50:57.488216 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:57.488196 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-d2l22"] Jul 06 13:50:57.525077 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:57.525038 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1174733c-b49e-4dfe-8f73-c7366fc4b592-local-certs\") pod \"istiod-openshift-gateway-7574459656-d2l22\" (UID: \"1174733c-b49e-4dfe-8f73-c7366fc4b592\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-d2l22" Jul 06 13:50:57.525221 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:57.525088 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1174733c-b49e-4dfe-8f73-c7366fc4b592-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-d2l22\" (UID: \"1174733c-b49e-4dfe-8f73-c7366fc4b592\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-d2l22" Jul 06 13:50:57.525221 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:57.525148 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjrr4\" (UniqueName: \"kubernetes.io/projected/1174733c-b49e-4dfe-8f73-c7366fc4b592-kube-api-access-kjrr4\") pod \"istiod-openshift-gateway-7574459656-d2l22\" (UID: \"1174733c-b49e-4dfe-8f73-c7366fc4b592\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-d2l22" Jul 06 13:50:57.525333 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:57.525234 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1174733c-b49e-4dfe-8f73-c7366fc4b592-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-d2l22\" (UID: \"1174733c-b49e-4dfe-8f73-c7366fc4b592\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-d2l22" Jul 06 13:50:57.525333 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:57.525275 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1174733c-b49e-4dfe-8f73-c7366fc4b592-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-d2l22\" (UID: \"1174733c-b49e-4dfe-8f73-c7366fc4b592\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-d2l22" Jul 06 13:50:57.525333 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:57.525323 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1174733c-b49e-4dfe-8f73-c7366fc4b592-istio-token\") pod \"istiod-openshift-gateway-7574459656-d2l22\" (UID: \"1174733c-b49e-4dfe-8f73-c7366fc4b592\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-d2l22" Jul 06 13:50:57.525475 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:57.525350 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1174733c-b49e-4dfe-8f73-c7366fc4b592-cacerts\") pod \"istiod-openshift-gateway-7574459656-d2l22\" (UID: \"1174733c-b49e-4dfe-8f73-c7366fc4b592\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-d2l22" Jul 06 13:50:57.542575 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:57.542550 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:50:57.600944 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:57.600904 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:50:57.626930 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:57.626900 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1174733c-b49e-4dfe-8f73-c7366fc4b592-local-certs\") pod \"istiod-openshift-gateway-7574459656-d2l22\" (UID: \"1174733c-b49e-4dfe-8f73-c7366fc4b592\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-d2l22" Jul 06 13:50:57.627072 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:57.626940 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1174733c-b49e-4dfe-8f73-c7366fc4b592-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-d2l22\" (UID: \"1174733c-b49e-4dfe-8f73-c7366fc4b592\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-d2l22" Jul 06 13:50:57.627072 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:57.626964 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjrr4\" (UniqueName: \"kubernetes.io/projected/1174733c-b49e-4dfe-8f73-c7366fc4b592-kube-api-access-kjrr4\") pod \"istiod-openshift-gateway-7574459656-d2l22\" (UID: \"1174733c-b49e-4dfe-8f73-c7366fc4b592\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-d2l22" Jul 06 13:50:57.627072 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:57.627013 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1174733c-b49e-4dfe-8f73-c7366fc4b592-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-d2l22\" (UID: \"1174733c-b49e-4dfe-8f73-c7366fc4b592\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-d2l22" Jul 06 13:50:57.627072 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:57.627044 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1174733c-b49e-4dfe-8f73-c7366fc4b592-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-d2l22\" (UID: \"1174733c-b49e-4dfe-8f73-c7366fc4b592\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-d2l22" Jul 06 13:50:57.627283 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:57.627083 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1174733c-b49e-4dfe-8f73-c7366fc4b592-istio-token\") pod \"istiod-openshift-gateway-7574459656-d2l22\" (UID: \"1174733c-b49e-4dfe-8f73-c7366fc4b592\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-d2l22" Jul 06 13:50:57.627283 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:57.627111 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1174733c-b49e-4dfe-8f73-c7366fc4b592-cacerts\") pod \"istiod-openshift-gateway-7574459656-d2l22\" (UID: \"1174733c-b49e-4dfe-8f73-c7366fc4b592\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-d2l22" Jul 06 13:50:57.627932 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:57.627900 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1174733c-b49e-4dfe-8f73-c7366fc4b592-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-d2l22\" (UID: \"1174733c-b49e-4dfe-8f73-c7366fc4b592\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-d2l22" Jul 06 13:50:57.629810 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:57.629787 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1174733c-b49e-4dfe-8f73-c7366fc4b592-cacerts\") pod \"istiod-openshift-gateway-7574459656-d2l22\" (UID: \"1174733c-b49e-4dfe-8f73-c7366fc4b592\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-d2l22" Jul 06 13:50:57.629936 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:57.629807 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1174733c-b49e-4dfe-8f73-c7366fc4b592-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-d2l22\" (UID: \"1174733c-b49e-4dfe-8f73-c7366fc4b592\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-d2l22" Jul 06 13:50:57.629936 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:57.629831 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1174733c-b49e-4dfe-8f73-c7366fc4b592-local-certs\") pod \"istiod-openshift-gateway-7574459656-d2l22\" (UID: \"1174733c-b49e-4dfe-8f73-c7366fc4b592\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-d2l22" Jul 06 13:50:57.630056 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:57.630025 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1174733c-b49e-4dfe-8f73-c7366fc4b592-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-d2l22\" (UID: \"1174733c-b49e-4dfe-8f73-c7366fc4b592\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-d2l22" Jul 06 13:50:57.635494 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:57.635472 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1174733c-b49e-4dfe-8f73-c7366fc4b592-istio-token\") pod \"istiod-openshift-gateway-7574459656-d2l22\" (UID: \"1174733c-b49e-4dfe-8f73-c7366fc4b592\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-d2l22" Jul 06 13:50:57.635809 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:57.635783 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjrr4\" (UniqueName: \"kubernetes.io/projected/1174733c-b49e-4dfe-8f73-c7366fc4b592-kube-api-access-kjrr4\") pod \"istiod-openshift-gateway-7574459656-d2l22\" (UID: \"1174733c-b49e-4dfe-8f73-c7366fc4b592\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-d2l22" Jul 06 13:50:57.787330 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:57.787301 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-d2l22" Jul 06 13:50:58.083156 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:58.083123 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-cf46d7698-7mgvt"] Jul 06 13:50:58.084937 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:50:58.084906 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccfcc8fe_0f38_4027_8152_30c716737aaf.slice/crio-7e60c3aabe219993946aec06a38d9a7a0737caf14b8f22e7990129fefd1bc33c WatchSource:0}: Error finding container 7e60c3aabe219993946aec06a38d9a7a0737caf14b8f22e7990129fefd1bc33c: Status 404 returned error can't find the container with id 7e60c3aabe219993946aec06a38d9a7a0737caf14b8f22e7990129fefd1bc33c Jul 06 13:50:58.111069 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:58.111049 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-d2l22"] Jul 06 13:50:58.112291 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:50:58.112268 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1174733c_b49e_4dfe_8f73_c7366fc4b592.slice/crio-e4c0e7327c40dbc681cc62f5eec55a33cba1f66fa6d2211905e60af0092ae096 WatchSource:0}: Error finding container e4c0e7327c40dbc681cc62f5eec55a33cba1f66fa6d2211905e60af0092ae096: Status 404 returned error can't find the container with id e4c0e7327c40dbc681cc62f5eec55a33cba1f66fa6d2211905e60af0092ae096 Jul 06 13:50:58.356814 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:58.356701 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-wx677" event={"ID":"21b366ba-2179-4321-a7ca-fdde9daebb5a","Type":"ContainerStarted","Data":"3009e579236449e6d3640eda5cf81acb6a9a3de6be1288d3b7b8255e6d331068"} Jul 06 13:50:58.356979 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:58.356797 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-wx677" Jul 06 13:50:58.358408 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:58.358375 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-wzv7k" event={"ID":"1c9b87b4-4ae4-439a-8644-d6839d74b15c","Type":"ContainerStarted","Data":"25cc9d971e270b61da77625b02e781768d9f92f261199e7a8fa4356cc00a58ae"} Jul 06 13:50:58.358541 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:58.358449 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-wzv7k" Jul 06 13:50:58.359534 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:58.359513 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-cf46d7698-7mgvt" event={"ID":"ccfcc8fe-0f38-4027-8152-30c716737aaf","Type":"ContainerStarted","Data":"7e60c3aabe219993946aec06a38d9a7a0737caf14b8f22e7990129fefd1bc33c"} Jul 06 13:50:58.360749 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:58.360725 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-d2l22" event={"ID":"1174733c-b49e-4dfe-8f73-c7366fc4b592","Type":"ContainerStarted","Data":"e4c0e7327c40dbc681cc62f5eec55a33cba1f66fa6d2211905e60af0092ae096"} Jul 06 13:50:58.374474 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:58.374435 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-wx677" podStartSLOduration=2.039297184 podStartE2EDuration="5.374422839s" totalImagesPullingTime="3.335125655s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:50:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:50:58.372752502 +0000 UTC m=+352.172498199" watchObservedRunningTime="2026-07-06 13:50:58.374422839 +0000 UTC m=+352.174168531" Jul 06 13:50:58.390606 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:58.390562 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-wzv7k" podStartSLOduration=1.652192119 podStartE2EDuration="4.390545004s" totalImagesPullingTime="2.738352885s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:50:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:50:58.389779839 +0000 UTC m=+352.189525545" watchObservedRunningTime="2026-07-06 13:50:58.390545004 +0000 UTC m=+352.190290697" Jul 06 13:50:58.548738 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:50:58.548698 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:51:01.098733 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:01.098693 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 13:51:01.098992 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:01.098778 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 13:51:01.384370 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:01.384282 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-cf46d7698-7mgvt" event={"ID":"ccfcc8fe-0f38-4027-8152-30c716737aaf","Type":"ContainerStarted","Data":"5fcdc70d24381557bea2e6580129937d07b4b971c1fa02ac0e60c35ec452dbfa"} Jul 06 13:51:01.386150 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:01.386123 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-d2l22" event={"ID":"1174733c-b49e-4dfe-8f73-c7366fc4b592","Type":"ContainerStarted","Data":"b45c902a0f8a69d5b0f64a0527a3f365ae98a2c21d17bcd8cc3b2998f9f94b70"} Jul 06 13:51:01.386282 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:01.386170 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-d2l22" Jul 06 13:51:01.405453 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:01.405409 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-cf46d7698-7mgvt" podStartSLOduration=2.395462631 podStartE2EDuration="5.405395397s" totalImagesPullingTime="3.009932766s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:50:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:51:01.403021356 +0000 UTC m=+355.202767043" watchObservedRunningTime="2026-07-06 13:51:01.405395397 +0000 UTC m=+355.205141089" Jul 06 13:51:01.425595 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:01.425549 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-d2l22" podStartSLOduration=1.4413325399999999 podStartE2EDuration="4.425533393s" totalImagesPullingTime="2.984200853s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:50:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:51:01.423672803 +0000 UTC m=+355.223418498" watchObservedRunningTime="2026-07-06 13:51:01.425533393 +0000 UTC m=+355.225279086" Jul 06 13:51:01.755543 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:01.755504 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:51:01.878381 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:01.878338 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:51:02.393345 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:02.393315 2556 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-d2l22 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 06 13:51:02.393746 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:02.393373 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-d2l22" podUID="1174733c-b49e-4dfe-8f73-c7366fc4b592" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 13:51:02.972087 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:02.972056 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678czrsn"] Jul 06 13:51:02.974790 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:02.974772 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678czrsn" Jul 06 13:51:02.978424 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:02.978399 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-jbvpz\"" Jul 06 13:51:02.997856 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:02.997827 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678czrsn"] Jul 06 13:51:03.034393 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:03.034361 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:51:03.085088 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:03.085053 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc7f48fe-12e2-43df-a252-dfd360ec8b4b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678czrsn\" (UID: \"dc7f48fe-12e2-43df-a252-dfd360ec8b4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678czrsn" Jul 06 13:51:03.085255 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:03.085154 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc7f48fe-12e2-43df-a252-dfd360ec8b4b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678czrsn\" (UID: \"dc7f48fe-12e2-43df-a252-dfd360ec8b4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678czrsn" Jul 06 13:51:03.085255 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:03.085180 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc7f48fe-12e2-43df-a252-dfd360ec8b4b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678czrsn\" (UID: \"dc7f48fe-12e2-43df-a252-dfd360ec8b4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678czrsn" Jul 06 13:51:03.085255 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:03.085203 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95p5g\" (UniqueName: \"kubernetes.io/projected/dc7f48fe-12e2-43df-a252-dfd360ec8b4b-kube-api-access-95p5g\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678czrsn\" (UID: \"dc7f48fe-12e2-43df-a252-dfd360ec8b4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678czrsn" Jul 06 13:51:03.085255 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:03.085228 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc7f48fe-12e2-43df-a252-dfd360ec8b4b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678czrsn\" (UID: \"dc7f48fe-12e2-43df-a252-dfd360ec8b4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678czrsn" Jul 06 13:51:03.085255 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:03.085252 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc7f48fe-12e2-43df-a252-dfd360ec8b4b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678czrsn\" (UID: \"dc7f48fe-12e2-43df-a252-dfd360ec8b4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678czrsn" Jul 06 13:51:03.085503 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:03.085309 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc7f48fe-12e2-43df-a252-dfd360ec8b4b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678czrsn\" (UID: \"dc7f48fe-12e2-43df-a252-dfd360ec8b4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678czrsn" Jul 06 13:51:03.085503 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:03.085350 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc7f48fe-12e2-43df-a252-dfd360ec8b4b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678czrsn\" (UID: \"dc7f48fe-12e2-43df-a252-dfd360ec8b4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678czrsn" Jul 06 13:51:03.085503 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:03.085397 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc7f48fe-12e2-43df-a252-dfd360ec8b4b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678czrsn\" (UID: \"dc7f48fe-12e2-43df-a252-dfd360ec8b4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678czrsn" Jul 06 13:51:03.186778 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:03.186749 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc7f48fe-12e2-43df-a252-dfd360ec8b4b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678czrsn\" (UID: \"dc7f48fe-12e2-43df-a252-dfd360ec8b4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678czrsn" Jul 06 13:51:03.186916 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:03.186793 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc7f48fe-12e2-43df-a252-dfd360ec8b4b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678czrsn\" (UID: \"dc7f48fe-12e2-43df-a252-dfd360ec8b4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678czrsn" Jul 06 13:51:03.186916 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:03.186841 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc7f48fe-12e2-43df-a252-dfd360ec8b4b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678czrsn\" (UID: \"dc7f48fe-12e2-43df-a252-dfd360ec8b4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678czrsn" Jul 06 13:51:03.186916 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:03.186888 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc7f48fe-12e2-43df-a252-dfd360ec8b4b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678czrsn\" (UID: \"dc7f48fe-12e2-43df-a252-dfd360ec8b4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678czrsn" Jul 06 13:51:03.187029 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:03.186951 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc7f48fe-12e2-43df-a252-dfd360ec8b4b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678czrsn\" (UID: \"dc7f48fe-12e2-43df-a252-dfd360ec8b4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678czrsn" Jul 06 13:51:03.187029 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:03.186975 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc7f48fe-12e2-43df-a252-dfd360ec8b4b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678czrsn\" (UID: \"dc7f48fe-12e2-43df-a252-dfd360ec8b4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678czrsn" Jul 06 13:51:03.187029 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:03.186999 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95p5g\" (UniqueName: \"kubernetes.io/projected/dc7f48fe-12e2-43df-a252-dfd360ec8b4b-kube-api-access-95p5g\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678czrsn\" (UID: \"dc7f48fe-12e2-43df-a252-dfd360ec8b4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678czrsn" Jul 06 13:51:03.187180 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:03.187163 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc7f48fe-12e2-43df-a252-dfd360ec8b4b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678czrsn\" (UID: \"dc7f48fe-12e2-43df-a252-dfd360ec8b4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678czrsn" Jul 06 13:51:03.187180 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:03.187163 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc7f48fe-12e2-43df-a252-dfd360ec8b4b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678czrsn\" (UID: \"dc7f48fe-12e2-43df-a252-dfd360ec8b4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678czrsn" Jul 06 13:51:03.187276 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:03.187201 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc7f48fe-12e2-43df-a252-dfd360ec8b4b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678czrsn\" (UID: \"dc7f48fe-12e2-43df-a252-dfd360ec8b4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678czrsn" Jul 06 13:51:03.187276 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:03.187212 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc7f48fe-12e2-43df-a252-dfd360ec8b4b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678czrsn\" (UID: \"dc7f48fe-12e2-43df-a252-dfd360ec8b4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678czrsn" Jul 06 13:51:03.187597 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:03.187569 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc7f48fe-12e2-43df-a252-dfd360ec8b4b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678czrsn\" (UID: \"dc7f48fe-12e2-43df-a252-dfd360ec8b4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678czrsn" Jul 06 13:51:03.187761 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:03.187650 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc7f48fe-12e2-43df-a252-dfd360ec8b4b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678czrsn\" (UID: \"dc7f48fe-12e2-43df-a252-dfd360ec8b4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678czrsn" Jul 06 13:51:03.188029 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:03.188001 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc7f48fe-12e2-43df-a252-dfd360ec8b4b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678czrsn\" (UID: \"dc7f48fe-12e2-43df-a252-dfd360ec8b4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678czrsn" Jul 06 13:51:03.189256 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:03.189231 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc7f48fe-12e2-43df-a252-dfd360ec8b4b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678czrsn\" (UID: \"dc7f48fe-12e2-43df-a252-dfd360ec8b4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678czrsn" Jul 06 13:51:03.189569 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:03.189550 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc7f48fe-12e2-43df-a252-dfd360ec8b4b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678czrsn\" (UID: \"dc7f48fe-12e2-43df-a252-dfd360ec8b4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678czrsn" Jul 06 13:51:03.199231 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:03.199206 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-95p5g\" (UniqueName: \"kubernetes.io/projected/dc7f48fe-12e2-43df-a252-dfd360ec8b4b-kube-api-access-95p5g\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678czrsn\" (UID: \"dc7f48fe-12e2-43df-a252-dfd360ec8b4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678czrsn" Jul 06 13:51:03.199844 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:03.199822 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc7f48fe-12e2-43df-a252-dfd360ec8b4b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678czrsn\" (UID: \"dc7f48fe-12e2-43df-a252-dfd360ec8b4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678czrsn" Jul 06 13:51:03.232272 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:03.232208 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:51:03.286455 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:03.286435 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678czrsn" Jul 06 13:51:03.358523 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:03.358491 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:51:03.451447 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:51:03.451420 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc7f48fe_12e2_43df_a252_dfd360ec8b4b.slice/crio-8f236d15f12c5099ac29eac8dd6c8a40a9e125f314e3a4726e93c440589a1253 WatchSource:0}: Error finding container 8f236d15f12c5099ac29eac8dd6c8a40a9e125f314e3a4726e93c440589a1253: Status 404 returned error can't find the container with id 8f236d15f12c5099ac29eac8dd6c8a40a9e125f314e3a4726e93c440589a1253 Jul 06 13:51:03.451775 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:03.451600 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678czrsn"] Jul 06 13:51:03.620579 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:03.620532 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:51:03.682892 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:03.682863 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-tjk4d"] Jul 06 13:51:03.686459 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:03.686436 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-tjk4d" Jul 06 13:51:03.689279 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:03.689253 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-zwmc6\"" Jul 06 13:51:03.689467 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:03.689447 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 06 13:51:03.695511 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:03.695387 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-4fbkk"] Jul 06 13:51:03.698491 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:03.698470 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4fbkk" Jul 06 13:51:03.700515 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:03.700495 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-tjk4d"] Jul 06 13:51:03.701182 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:03.701165 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 06 13:51:03.701279 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:03.701199 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-hbc8l\"" Jul 06 13:51:03.719315 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:03.719290 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-4fbkk"] Jul 06 13:51:03.723857 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:03.723829 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:51:03.793959 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:03.792824 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f508f15-9231-4c24-85e4-358f1d2f76bf-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-4fbkk\" (UID: \"0f508f15-9231-4c24-85e4-358f1d2f76bf\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4fbkk" Jul 06 13:51:03.793959 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:03.792887 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frvbk\" (UniqueName: \"kubernetes.io/projected/a570c2c3-0315-4e83-b48c-db4b8eda70ae-kube-api-access-frvbk\") pod \"kserve-controller-manager-d6f4b65b8-tjk4d\" (UID: \"a570c2c3-0315-4e83-b48c-db4b8eda70ae\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-tjk4d" Jul 06 13:51:03.793959 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:03.792952 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nljwc\" (UniqueName: \"kubernetes.io/projected/0f508f15-9231-4c24-85e4-358f1d2f76bf-kube-api-access-nljwc\") pod \"llmisvc-controller-manager-777c6bd7d5-4fbkk\" (UID: \"0f508f15-9231-4c24-85e4-358f1d2f76bf\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4fbkk" Jul 06 13:51:03.793959 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:03.793016 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a570c2c3-0315-4e83-b48c-db4b8eda70ae-cert\") pod \"kserve-controller-manager-d6f4b65b8-tjk4d\" (UID: \"a570c2c3-0315-4e83-b48c-db4b8eda70ae\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-tjk4d" Jul 06 13:51:03.894357 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:03.894276 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f508f15-9231-4c24-85e4-358f1d2f76bf-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-4fbkk\" (UID: \"0f508f15-9231-4c24-85e4-358f1d2f76bf\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4fbkk" Jul 06 13:51:03.894357 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:03.894328 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frvbk\" (UniqueName: \"kubernetes.io/projected/a570c2c3-0315-4e83-b48c-db4b8eda70ae-kube-api-access-frvbk\") pod \"kserve-controller-manager-d6f4b65b8-tjk4d\" (UID: \"a570c2c3-0315-4e83-b48c-db4b8eda70ae\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-tjk4d" Jul 06 13:51:03.894357 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:03.894358 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nljwc\" (UniqueName: \"kubernetes.io/projected/0f508f15-9231-4c24-85e4-358f1d2f76bf-kube-api-access-nljwc\") pod \"llmisvc-controller-manager-777c6bd7d5-4fbkk\" (UID: \"0f508f15-9231-4c24-85e4-358f1d2f76bf\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4fbkk" Jul 06 13:51:03.894653 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:03.894488 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a570c2c3-0315-4e83-b48c-db4b8eda70ae-cert\") pod \"kserve-controller-manager-d6f4b65b8-tjk4d\" (UID: \"a570c2c3-0315-4e83-b48c-db4b8eda70ae\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-tjk4d" Jul 06 13:51:03.895206 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:03.895179 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:51:03.896814 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:03.896797 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f508f15-9231-4c24-85e4-358f1d2f76bf-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-4fbkk\" (UID: \"0f508f15-9231-4c24-85e4-358f1d2f76bf\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4fbkk" Jul 06 13:51:03.896988 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:03.896971 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a570c2c3-0315-4e83-b48c-db4b8eda70ae-cert\") pod \"kserve-controller-manager-d6f4b65b8-tjk4d\" (UID: \"a570c2c3-0315-4e83-b48c-db4b8eda70ae\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-tjk4d" Jul 06 13:51:03.906810 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:03.906791 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frvbk\" (UniqueName: \"kubernetes.io/projected/a570c2c3-0315-4e83-b48c-db4b8eda70ae-kube-api-access-frvbk\") pod \"kserve-controller-manager-d6f4b65b8-tjk4d\" (UID: \"a570c2c3-0315-4e83-b48c-db4b8eda70ae\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-tjk4d" Jul 06 13:51:03.906880 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:03.906849 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nljwc\" (UniqueName: \"kubernetes.io/projected/0f508f15-9231-4c24-85e4-358f1d2f76bf-kube-api-access-nljwc\") pod \"llmisvc-controller-manager-777c6bd7d5-4fbkk\" (UID: \"0f508f15-9231-4c24-85e4-358f1d2f76bf\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4fbkk" Jul 06 13:51:03.999388 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:03.999352 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-tjk4d" Jul 06 13:51:04.010976 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:04.010929 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4fbkk" Jul 06 13:51:04.011279 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:04.011248 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:51:04.149604 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:04.149577 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-tjk4d"] Jul 06 13:51:04.151946 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:51:04.151836 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda570c2c3_0315_4e83_b48c_db4b8eda70ae.slice/crio-2c010bc087fa7a8620340abe288e9a1698324db073b660754fedc8242ba7f9a8 WatchSource:0}: Error finding container 2c010bc087fa7a8620340abe288e9a1698324db073b660754fedc8242ba7f9a8: Status 404 returned error can't find the container with id 2c010bc087fa7a8620340abe288e9a1698324db073b660754fedc8242ba7f9a8 Jul 06 13:51:04.175191 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:04.175167 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-4fbkk"] Jul 06 13:51:04.177523 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:51:04.177492 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0f508f15_9231_4c24_85e4_358f1d2f76bf.slice/crio-398af8d51132173d889382502b7729cf36b1f62e34316baf40ec4368216cfb0c WatchSource:0}: Error finding container 398af8d51132173d889382502b7729cf36b1f62e34316baf40ec4368216cfb0c: Status 404 returned error can't find the container with id 398af8d51132173d889382502b7729cf36b1f62e34316baf40ec4368216cfb0c Jul 06 13:51:04.404716 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:04.404636 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4fbkk" event={"ID":"0f508f15-9231-4c24-85e4-358f1d2f76bf","Type":"ContainerStarted","Data":"398af8d51132173d889382502b7729cf36b1f62e34316baf40ec4368216cfb0c"} Jul 06 13:51:04.405952 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:04.405916 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678czrsn" event={"ID":"dc7f48fe-12e2-43df-a252-dfd360ec8b4b","Type":"ContainerStarted","Data":"8f236d15f12c5099ac29eac8dd6c8a40a9e125f314e3a4726e93c440589a1253"} Jul 06 13:51:04.407195 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:04.407162 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-tjk4d" event={"ID":"a570c2c3-0315-4e83-b48c-db4b8eda70ae","Type":"ContainerStarted","Data":"2c010bc087fa7a8620340abe288e9a1698324db073b660754fedc8242ba7f9a8"} Jul 06 13:51:04.955587 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:04.955486 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:51:05.044359 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:05.044312 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:51:05.393504 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:05.393473 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-d2l22" Jul 06 13:51:05.902471 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:05.902438 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-d2l22"] Jul 06 13:51:05.902744 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:05.902717 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-d2l22" podUID="1174733c-b49e-4dfe-8f73-c7366fc4b592" containerName="discovery" containerID="cri-o://b45c902a0f8a69d5b0f64a0527a3f365ae98a2c21d17bcd8cc3b2998f9f94b70" gracePeriod=30 Jul 06 13:51:07.272196 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:07.272172 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-d2l22" Jul 06 13:51:07.326253 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:07.326206 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 13:51:07.326396 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:07.326298 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 13:51:07.326396 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:07.326333 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 13:51:07.426983 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:07.426954 2556 generic.go:356] "Generic (PLEG): container finished" podID="1174733c-b49e-4dfe-8f73-c7366fc4b592" containerID="b45c902a0f8a69d5b0f64a0527a3f365ae98a2c21d17bcd8cc3b2998f9f94b70" exitCode=0 Jul 06 13:51:07.427131 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:07.427004 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-d2l22" Jul 06 13:51:07.427131 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:07.427030 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-d2l22" event={"ID":"1174733c-b49e-4dfe-8f73-c7366fc4b592","Type":"ContainerDied","Data":"b45c902a0f8a69d5b0f64a0527a3f365ae98a2c21d17bcd8cc3b2998f9f94b70"} Jul 06 13:51:07.427131 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:07.427080 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-d2l22" event={"ID":"1174733c-b49e-4dfe-8f73-c7366fc4b592","Type":"ContainerDied","Data":"e4c0e7327c40dbc681cc62f5eec55a33cba1f66fa6d2211905e60af0092ae096"} Jul 06 13:51:07.427131 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:07.427102 2556 scope.go:117] "RemoveContainer" containerID="b45c902a0f8a69d5b0f64a0527a3f365ae98a2c21d17bcd8cc3b2998f9f94b70" Jul 06 13:51:07.430022 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:07.429999 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1174733c-b49e-4dfe-8f73-c7366fc4b592-istio-csr-ca-configmap\") pod \"1174733c-b49e-4dfe-8f73-c7366fc4b592\" (UID: \"1174733c-b49e-4dfe-8f73-c7366fc4b592\") " Jul 06 13:51:07.430137 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:07.430078 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1174733c-b49e-4dfe-8f73-c7366fc4b592-cacerts\") pod \"1174733c-b49e-4dfe-8f73-c7366fc4b592\" (UID: \"1174733c-b49e-4dfe-8f73-c7366fc4b592\") " Jul 06 13:51:07.430137 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:07.430106 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kjrr4\" (UniqueName: \"kubernetes.io/projected/1174733c-b49e-4dfe-8f73-c7366fc4b592-kube-api-access-kjrr4\") pod \"1174733c-b49e-4dfe-8f73-c7366fc4b592\" (UID: \"1174733c-b49e-4dfe-8f73-c7366fc4b592\") " Jul 06 13:51:07.430316 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:07.430175 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1174733c-b49e-4dfe-8f73-c7366fc4b592-local-certs\") pod \"1174733c-b49e-4dfe-8f73-c7366fc4b592\" (UID: \"1174733c-b49e-4dfe-8f73-c7366fc4b592\") " Jul 06 13:51:07.430316 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:07.430231 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1174733c-b49e-4dfe-8f73-c7366fc4b592-istio-kubeconfig\") pod \"1174733c-b49e-4dfe-8f73-c7366fc4b592\" (UID: \"1174733c-b49e-4dfe-8f73-c7366fc4b592\") " Jul 06 13:51:07.430316 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:07.430264 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1174733c-b49e-4dfe-8f73-c7366fc4b592-istio-token\") pod \"1174733c-b49e-4dfe-8f73-c7366fc4b592\" (UID: \"1174733c-b49e-4dfe-8f73-c7366fc4b592\") " Jul 06 13:51:07.430316 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:07.430300 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1174733c-b49e-4dfe-8f73-c7366fc4b592-istio-csr-dns-cert\") pod \"1174733c-b49e-4dfe-8f73-c7366fc4b592\" (UID: \"1174733c-b49e-4dfe-8f73-c7366fc4b592\") " Jul 06 13:51:07.430521 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:07.430448 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1174733c-b49e-4dfe-8f73-c7366fc4b592-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "1174733c-b49e-4dfe-8f73-c7366fc4b592" (UID: "1174733c-b49e-4dfe-8f73-c7366fc4b592"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 13:51:07.430660 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:07.430643 2556 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1174733c-b49e-4dfe-8f73-c7366fc4b592-istio-csr-ca-configmap\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:51:07.433593 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:07.433501 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1174733c-b49e-4dfe-8f73-c7366fc4b592-kube-api-access-kjrr4" (OuterVolumeSpecName: "kube-api-access-kjrr4") pod "1174733c-b49e-4dfe-8f73-c7366fc4b592" (UID: "1174733c-b49e-4dfe-8f73-c7366fc4b592"). InnerVolumeSpecName "kube-api-access-kjrr4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 13:51:07.433990 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:07.433963 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1174733c-b49e-4dfe-8f73-c7366fc4b592-local-certs" (OuterVolumeSpecName: "local-certs") pod "1174733c-b49e-4dfe-8f73-c7366fc4b592" (UID: "1174733c-b49e-4dfe-8f73-c7366fc4b592"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 13:51:07.434120 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:07.434093 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1174733c-b49e-4dfe-8f73-c7366fc4b592-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "1174733c-b49e-4dfe-8f73-c7366fc4b592" (UID: "1174733c-b49e-4dfe-8f73-c7366fc4b592"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 13:51:07.434302 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:07.434274 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1174733c-b49e-4dfe-8f73-c7366fc4b592-cacerts" (OuterVolumeSpecName: "cacerts") pod "1174733c-b49e-4dfe-8f73-c7366fc4b592" (UID: "1174733c-b49e-4dfe-8f73-c7366fc4b592"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 13:51:07.434453 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:07.434434 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1174733c-b49e-4dfe-8f73-c7366fc4b592-istio-token" (OuterVolumeSpecName: "istio-token") pod "1174733c-b49e-4dfe-8f73-c7366fc4b592" (UID: "1174733c-b49e-4dfe-8f73-c7366fc4b592"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 13:51:07.434530 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:07.434478 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1174733c-b49e-4dfe-8f73-c7366fc4b592-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "1174733c-b49e-4dfe-8f73-c7366fc4b592" (UID: "1174733c-b49e-4dfe-8f73-c7366fc4b592"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 13:51:07.531813 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:07.531729 2556 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1174733c-b49e-4dfe-8f73-c7366fc4b592-istio-kubeconfig\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:51:07.531813 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:07.531761 2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1174733c-b49e-4dfe-8f73-c7366fc4b592-istio-token\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:51:07.531813 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:07.531774 2556 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1174733c-b49e-4dfe-8f73-c7366fc4b592-istio-csr-dns-cert\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:51:07.531813 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:07.531783 2556 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1174733c-b49e-4dfe-8f73-c7366fc4b592-cacerts\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:51:07.531813 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:07.531793 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kjrr4\" (UniqueName: \"kubernetes.io/projected/1174733c-b49e-4dfe-8f73-c7366fc4b592-kube-api-access-kjrr4\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:51:07.531813 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:07.531803 2556 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1174733c-b49e-4dfe-8f73-c7366fc4b592-local-certs\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:51:07.751982 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:07.751950 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-d2l22"] Jul 06 13:51:07.758748 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:07.758721 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-d2l22"] Jul 06 13:51:07.993608 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:07.993578 2556 scope.go:117] "RemoveContainer" containerID="b45c902a0f8a69d5b0f64a0527a3f365ae98a2c21d17bcd8cc3b2998f9f94b70" Jul 06 13:51:07.993993 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:51:07.993961 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b45c902a0f8a69d5b0f64a0527a3f365ae98a2c21d17bcd8cc3b2998f9f94b70\": container with ID starting with b45c902a0f8a69d5b0f64a0527a3f365ae98a2c21d17bcd8cc3b2998f9f94b70 not found: ID does not exist" containerID="b45c902a0f8a69d5b0f64a0527a3f365ae98a2c21d17bcd8cc3b2998f9f94b70" Jul 06 13:51:07.994078 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:07.994003 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b45c902a0f8a69d5b0f64a0527a3f365ae98a2c21d17bcd8cc3b2998f9f94b70"} err="failed to get container status \"b45c902a0f8a69d5b0f64a0527a3f365ae98a2c21d17bcd8cc3b2998f9f94b70\": rpc error: code = NotFound desc = could not find container \"b45c902a0f8a69d5b0f64a0527a3f365ae98a2c21d17bcd8cc3b2998f9f94b70\": container with ID starting with b45c902a0f8a69d5b0f64a0527a3f365ae98a2c21d17bcd8cc3b2998f9f94b70 not found: ID does not exist" Jul 06 13:51:08.434129 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:08.434052 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4fbkk" event={"ID":"0f508f15-9231-4c24-85e4-358f1d2f76bf","Type":"ContainerStarted","Data":"bf82a7b4e34b8416707c0e5c8fd6d2d3f6bc5a9c088a06f83c85f011561a76bf"} Jul 06 13:51:08.434563 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:08.434178 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4fbkk" Jul 06 13:51:08.435754 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:08.435727 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678czrsn" event={"ID":"dc7f48fe-12e2-43df-a252-dfd360ec8b4b","Type":"ContainerStarted","Data":"eeb19ac09facae533ac20027424574fbed33bffdeb033490071b746f9df2efbc"} Jul 06 13:51:08.438099 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:08.438065 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-tjk4d" event={"ID":"a570c2c3-0315-4e83-b48c-db4b8eda70ae","Type":"ContainerStarted","Data":"7a7f8ce4806d24b8b589ae0a24fb3ddd759263c943eb916f5e10caea691726ef"} Jul 06 13:51:08.438227 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:08.438212 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-tjk4d" Jul 06 13:51:08.467192 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:08.467147 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4fbkk" podStartSLOduration=1.618289131 podStartE2EDuration="5.467128852s" totalImagesPullingTime="3.848839721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:51:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:51:08.465527089 +0000 UTC m=+362.265272781" watchObservedRunningTime="2026-07-06 13:51:08.467128852 +0000 UTC m=+362.266874548" Jul 06 13:51:08.492592 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:08.492544 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-tjk4d" podStartSLOduration=2.287166094 podStartE2EDuration="5.492527202s" totalImagesPullingTime="3.205361108s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:51:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:51:08.492134924 +0000 UTC m=+362.291880618" watchObservedRunningTime="2026-07-06 13:51:08.492527202 +0000 UTC m=+362.292272897" Jul 06 13:51:08.524669 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:08.524613 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678czrsn" podStartSLOduration=2.652257008 podStartE2EDuration="6.524599012s" totalImagesPullingTime="3.872342004s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:51:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:51:08.523240578 +0000 UTC m=+362.322986272" watchObservedRunningTime="2026-07-06 13:51:08.524599012 +0000 UTC m=+362.324344704" Jul 06 13:51:08.786730 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:08.786697 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1174733c-b49e-4dfe-8f73-c7366fc4b592" path="/var/lib/kubelet/pods/1174733c-b49e-4dfe-8f73-c7366fc4b592/volumes" Jul 06 13:51:09.287004 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:09.286974 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678czrsn" Jul 06 13:51:09.291543 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:09.291521 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678czrsn" Jul 06 13:51:09.373851 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:09.373824 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-wx677" Jul 06 13:51:09.375737 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:09.375714 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-wzv7k" Jul 06 13:51:09.444585 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:09.444551 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678czrsn" Jul 06 13:51:09.445701 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:09.445683 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678czrsn" Jul 06 13:51:39.446931 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:39.446896 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4fbkk" Jul 06 13:51:39.450030 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:39.450010 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-tjk4d" Jul 06 13:51:54.676483 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:54.676445 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:51:54.777853 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:54.777819 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:51:54.832069 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:54.832042 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mj75k"] Jul 06 13:51:54.832400 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:54.832389 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1174733c-b49e-4dfe-8f73-c7366fc4b592" containerName="discovery" Jul 06 13:51:54.832453 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:54.832401 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="1174733c-b49e-4dfe-8f73-c7366fc4b592" containerName="discovery" Jul 06 13:51:54.832491 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:54.832474 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="1174733c-b49e-4dfe-8f73-c7366fc4b592" containerName="discovery" Jul 06 13:51:54.843193 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:54.843165 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mj75k" Jul 06 13:51:54.845250 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:54.845224 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mj75k"] Jul 06 13:51:54.846417 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:54.846395 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 06 13:51:54.846523 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:54.846492 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-2hsm8\"" Jul 06 13:51:54.846671 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:54.846655 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 06 13:51:54.878202 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:54.878172 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:51:54.939026 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:54.938968 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8mj9\" (UniqueName: \"kubernetes.io/projected/5a0f85d7-7220-466d-b5b5-4208894561af-kube-api-access-p8mj9\") pod \"kuadrant-operator-catalog-mj75k\" (UID: \"5a0f85d7-7220-466d-b5b5-4208894561af\") " pod="kuadrant-system/kuadrant-operator-catalog-mj75k" Jul 06 13:51:55.039891 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:55.039840 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8mj9\" (UniqueName: \"kubernetes.io/projected/5a0f85d7-7220-466d-b5b5-4208894561af-kube-api-access-p8mj9\") pod \"kuadrant-operator-catalog-mj75k\" (UID: \"5a0f85d7-7220-466d-b5b5-4208894561af\") " pod="kuadrant-system/kuadrant-operator-catalog-mj75k" Jul 06 13:51:55.048289 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:55.048258 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8mj9\" (UniqueName: \"kubernetes.io/projected/5a0f85d7-7220-466d-b5b5-4208894561af-kube-api-access-p8mj9\") pod \"kuadrant-operator-catalog-mj75k\" (UID: \"5a0f85d7-7220-466d-b5b5-4208894561af\") " pod="kuadrant-system/kuadrant-operator-catalog-mj75k" Jul 06 13:51:55.156594 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:55.156553 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mj75k" Jul 06 13:51:55.197087 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:55.197002 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mj75k"] Jul 06 13:51:55.289878 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:55.289845 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mj75k"] Jul 06 13:51:55.292147 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:51:55.292120 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a0f85d7_7220_466d_b5b5_4208894561af.slice/crio-ce0afddd1617940326e364089321a3846757dab566e95abf96bf4ee2e9e05a48 WatchSource:0}: Error finding container ce0afddd1617940326e364089321a3846757dab566e95abf96bf4ee2e9e05a48: Status 404 returned error can't find the container with id ce0afddd1617940326e364089321a3846757dab566e95abf96bf4ee2e9e05a48 Jul 06 13:51:55.405565 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:55.405540 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-j5ptm"] Jul 06 13:51:55.408496 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:55.408481 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-j5ptm" Jul 06 13:51:55.417163 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:55.417142 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-j5ptm"] Jul 06 13:51:55.544680 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:55.544644 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbkfl\" (UniqueName: \"kubernetes.io/projected/421349c0-bc30-4927-87dc-31a5a8d7863f-kube-api-access-vbkfl\") pod \"kuadrant-operator-catalog-j5ptm\" (UID: \"421349c0-bc30-4927-87dc-31a5a8d7863f\") " pod="kuadrant-system/kuadrant-operator-catalog-j5ptm" Jul 06 13:51:55.645230 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:55.645204 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbkfl\" (UniqueName: \"kubernetes.io/projected/421349c0-bc30-4927-87dc-31a5a8d7863f-kube-api-access-vbkfl\") pod \"kuadrant-operator-catalog-j5ptm\" (UID: \"421349c0-bc30-4927-87dc-31a5a8d7863f\") " pod="kuadrant-system/kuadrant-operator-catalog-j5ptm" Jul 06 13:51:55.653874 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:55.653849 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbkfl\" (UniqueName: \"kubernetes.io/projected/421349c0-bc30-4927-87dc-31a5a8d7863f-kube-api-access-vbkfl\") pod \"kuadrant-operator-catalog-j5ptm\" (UID: \"421349c0-bc30-4927-87dc-31a5a8d7863f\") " pod="kuadrant-system/kuadrant-operator-catalog-j5ptm" Jul 06 13:51:55.679047 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:55.679021 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mj75k" event={"ID":"5a0f85d7-7220-466d-b5b5-4208894561af","Type":"ContainerStarted","Data":"ce0afddd1617940326e364089321a3846757dab566e95abf96bf4ee2e9e05a48"} Jul 06 13:51:55.718730 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:55.718703 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-j5ptm" Jul 06 13:51:55.873267 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:55.873039 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-j5ptm"] Jul 06 13:51:55.888276 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:51:55.888243 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod421349c0_bc30_4927_87dc_31a5a8d7863f.slice/crio-2ec03089dab50ddb688763ed1357114d4059fa2caaaaff93ccd6e58edb4f7788 WatchSource:0}: Error finding container 2ec03089dab50ddb688763ed1357114d4059fa2caaaaff93ccd6e58edb4f7788: Status 404 returned error can't find the container with id 2ec03089dab50ddb688763ed1357114d4059fa2caaaaff93ccd6e58edb4f7788 Jul 06 13:51:56.687059 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:56.686985 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-j5ptm" event={"ID":"421349c0-bc30-4927-87dc-31a5a8d7863f","Type":"ContainerStarted","Data":"2ec03089dab50ddb688763ed1357114d4059fa2caaaaff93ccd6e58edb4f7788"} Jul 06 13:51:56.793988 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:56.793952 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:51:57.693368 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:57.693265 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mj75k" event={"ID":"5a0f85d7-7220-466d-b5b5-4208894561af","Type":"ContainerStarted","Data":"5a2def1c99b4805dbc3ba119816fe4d9fe4d154687f2b6d34f5becb50533e215"} Jul 06 13:51:57.693368 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:57.693304 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-mj75k" podUID="5a0f85d7-7220-466d-b5b5-4208894561af" containerName="registry-server" containerID="cri-o://5a2def1c99b4805dbc3ba119816fe4d9fe4d154687f2b6d34f5becb50533e215" gracePeriod=2 Jul 06 13:51:57.695149 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:57.695104 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-j5ptm" event={"ID":"421349c0-bc30-4927-87dc-31a5a8d7863f","Type":"ContainerStarted","Data":"00e0863415411326f2faa1bf86c6059b931a8d1049198043576f9657d4f02f50"} Jul 06 13:51:57.712231 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:57.712180 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-mj75k" podStartSLOduration=1.6677438439999999 podStartE2EDuration="3.712161037s" totalImagesPullingTime="2.044417193s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:51:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:51:57.709653504 +0000 UTC m=+411.509399196" watchObservedRunningTime="2026-07-06 13:51:57.712161037 +0000 UTC m=+411.511906731" Jul 06 13:51:57.725016 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:57.724975 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-j5ptm" podStartSLOduration=1.274760902 podStartE2EDuration="2.724964804s" totalImagesPullingTime="1.450203902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:51:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:51:57.724502919 +0000 UTC m=+411.524248615" watchObservedRunningTime="2026-07-06 13:51:57.724964804 +0000 UTC m=+411.524710497" Jul 06 13:51:57.933638 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:57.933597 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mj75k" Jul 06 13:51:58.073457 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:58.073430 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p8mj9\" (UniqueName: \"kubernetes.io/projected/5a0f85d7-7220-466d-b5b5-4208894561af-kube-api-access-p8mj9\") pod \"5a0f85d7-7220-466d-b5b5-4208894561af\" (UID: \"5a0f85d7-7220-466d-b5b5-4208894561af\") " Jul 06 13:51:58.075656 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:58.075626 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a0f85d7-7220-466d-b5b5-4208894561af-kube-api-access-p8mj9" (OuterVolumeSpecName: "kube-api-access-p8mj9") pod "5a0f85d7-7220-466d-b5b5-4208894561af" (UID: "5a0f85d7-7220-466d-b5b5-4208894561af"). InnerVolumeSpecName "kube-api-access-p8mj9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 13:51:58.174434 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:58.174411 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p8mj9\" (UniqueName: \"kubernetes.io/projected/5a0f85d7-7220-466d-b5b5-4208894561af-kube-api-access-p8mj9\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:51:58.702463 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:58.702378 2556 generic.go:356] "Generic (PLEG): container finished" podID="5a0f85d7-7220-466d-b5b5-4208894561af" containerID="5a2def1c99b4805dbc3ba119816fe4d9fe4d154687f2b6d34f5becb50533e215" exitCode=0 Jul 06 13:51:58.702463 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:58.702420 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mj75k" Jul 06 13:51:58.702968 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:58.702469 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mj75k" event={"ID":"5a0f85d7-7220-466d-b5b5-4208894561af","Type":"ContainerDied","Data":"5a2def1c99b4805dbc3ba119816fe4d9fe4d154687f2b6d34f5becb50533e215"} Jul 06 13:51:58.702968 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:58.702533 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mj75k" event={"ID":"5a0f85d7-7220-466d-b5b5-4208894561af","Type":"ContainerDied","Data":"ce0afddd1617940326e364089321a3846757dab566e95abf96bf4ee2e9e05a48"} Jul 06 13:51:58.702968 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:58.702563 2556 scope.go:117] "RemoveContainer" containerID="5a2def1c99b4805dbc3ba119816fe4d9fe4d154687f2b6d34f5becb50533e215" Jul 06 13:51:58.712216 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:58.712199 2556 scope.go:117] "RemoveContainer" containerID="5a2def1c99b4805dbc3ba119816fe4d9fe4d154687f2b6d34f5becb50533e215" Jul 06 13:51:58.712477 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:51:58.712460 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a2def1c99b4805dbc3ba119816fe4d9fe4d154687f2b6d34f5becb50533e215\": container with ID starting with 5a2def1c99b4805dbc3ba119816fe4d9fe4d154687f2b6d34f5becb50533e215 not found: ID does not exist" containerID="5a2def1c99b4805dbc3ba119816fe4d9fe4d154687f2b6d34f5becb50533e215" Jul 06 13:51:58.712529 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:58.712485 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a2def1c99b4805dbc3ba119816fe4d9fe4d154687f2b6d34f5becb50533e215"} err="failed to get container status \"5a2def1c99b4805dbc3ba119816fe4d9fe4d154687f2b6d34f5becb50533e215\": rpc error: code = NotFound desc = could not find container \"5a2def1c99b4805dbc3ba119816fe4d9fe4d154687f2b6d34f5becb50533e215\": container with ID starting with 5a2def1c99b4805dbc3ba119816fe4d9fe4d154687f2b6d34f5becb50533e215 not found: ID does not exist" Jul 06 13:51:58.723446 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:58.723423 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mj75k"] Jul 06 13:51:58.737424 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:58.737401 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mj75k"] Jul 06 13:51:58.787432 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:51:58.787412 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a0f85d7-7220-466d-b5b5-4208894561af" path="/var/lib/kubelet/pods/5a0f85d7-7220-466d-b5b5-4208894561af/volumes" Jul 06 13:52:05.719345 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:05.719293 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-j5ptm" Jul 06 13:52:05.719741 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:05.719373 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-j5ptm" Jul 06 13:52:05.742539 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:05.742515 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-j5ptm" Jul 06 13:52:05.764394 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:05.764371 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-j5ptm" Jul 06 13:52:09.816902 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:09.816861 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qsqdp"] Jul 06 13:52:09.817398 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:09.817385 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a0f85d7-7220-466d-b5b5-4208894561af" containerName="registry-server" Jul 06 13:52:09.817486 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:09.817405 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a0f85d7-7220-466d-b5b5-4208894561af" containerName="registry-server" Jul 06 13:52:09.817557 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:09.817540 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a0f85d7-7220-466d-b5b5-4208894561af" containerName="registry-server" Jul 06 13:52:09.822290 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:09.822268 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qsqdp" Jul 06 13:52:09.825075 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:09.825057 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-nhp6c\"" Jul 06 13:52:09.829899 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:09.829877 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qsqdp"] Jul 06 13:52:09.872122 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:09.872096 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cvk6\" (UniqueName: \"kubernetes.io/projected/4973f9d0-ebb9-4f87-a3d7-5916f174cea6-kube-api-access-5cvk6\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qsqdp\" (UID: \"4973f9d0-ebb9-4f87-a3d7-5916f174cea6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qsqdp" Jul 06 13:52:09.872219 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:09.872195 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4973f9d0-ebb9-4f87-a3d7-5916f174cea6-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qsqdp\" (UID: \"4973f9d0-ebb9-4f87-a3d7-5916f174cea6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qsqdp" Jul 06 13:52:09.872219 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:09.872214 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4973f9d0-ebb9-4f87-a3d7-5916f174cea6-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qsqdp\" (UID: \"4973f9d0-ebb9-4f87-a3d7-5916f174cea6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qsqdp" Jul 06 13:52:09.973578 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:09.973547 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4973f9d0-ebb9-4f87-a3d7-5916f174cea6-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qsqdp\" (UID: \"4973f9d0-ebb9-4f87-a3d7-5916f174cea6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qsqdp" Jul 06 13:52:09.973709 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:09.973580 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4973f9d0-ebb9-4f87-a3d7-5916f174cea6-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qsqdp\" (UID: \"4973f9d0-ebb9-4f87-a3d7-5916f174cea6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qsqdp" Jul 06 13:52:09.973709 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:09.973643 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cvk6\" (UniqueName: \"kubernetes.io/projected/4973f9d0-ebb9-4f87-a3d7-5916f174cea6-kube-api-access-5cvk6\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qsqdp\" (UID: \"4973f9d0-ebb9-4f87-a3d7-5916f174cea6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qsqdp" Jul 06 13:52:09.973902 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:09.973882 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4973f9d0-ebb9-4f87-a3d7-5916f174cea6-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qsqdp\" (UID: \"4973f9d0-ebb9-4f87-a3d7-5916f174cea6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qsqdp" Jul 06 13:52:09.973960 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:09.973940 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4973f9d0-ebb9-4f87-a3d7-5916f174cea6-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qsqdp\" (UID: \"4973f9d0-ebb9-4f87-a3d7-5916f174cea6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qsqdp" Jul 06 13:52:09.982514 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:09.982496 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cvk6\" (UniqueName: \"kubernetes.io/projected/4973f9d0-ebb9-4f87-a3d7-5916f174cea6-kube-api-access-5cvk6\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qsqdp\" (UID: \"4973f9d0-ebb9-4f87-a3d7-5916f174cea6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qsqdp" Jul 06 13:52:10.132477 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:10.132422 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qsqdp" Jul 06 13:52:10.217842 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:10.217808 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04xh72"] Jul 06 13:52:10.222473 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:10.222452 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04xh72" Jul 06 13:52:10.229659 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:10.229602 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04xh72"] Jul 06 13:52:10.273050 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:10.273029 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qsqdp"] Jul 06 13:52:10.275373 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:52:10.275348 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4973f9d0_ebb9_4f87_a3d7_5916f174cea6.slice/crio-ff446c12da0f8edce51244c46c1e87827fd78c81e42115fec2734569bfcb9f25 WatchSource:0}: Error finding container ff446c12da0f8edce51244c46c1e87827fd78c81e42115fec2734569bfcb9f25: Status 404 returned error can't find the container with id ff446c12da0f8edce51244c46c1e87827fd78c81e42115fec2734569bfcb9f25 Jul 06 13:52:10.276391 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:10.276369 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4t74z\" (UniqueName: \"kubernetes.io/projected/dbfbd510-6069-4141-8a31-fd55b8a68730-kube-api-access-4t74z\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04xh72\" (UID: \"dbfbd510-6069-4141-8a31-fd55b8a68730\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04xh72" Jul 06 13:52:10.276495 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:10.276430 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dbfbd510-6069-4141-8a31-fd55b8a68730-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04xh72\" (UID: \"dbfbd510-6069-4141-8a31-fd55b8a68730\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04xh72" Jul 06 13:52:10.276495 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:10.276464 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dbfbd510-6069-4141-8a31-fd55b8a68730-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04xh72\" (UID: \"dbfbd510-6069-4141-8a31-fd55b8a68730\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04xh72" Jul 06 13:52:10.377753 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:10.377728 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4t74z\" (UniqueName: \"kubernetes.io/projected/dbfbd510-6069-4141-8a31-fd55b8a68730-kube-api-access-4t74z\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04xh72\" (UID: \"dbfbd510-6069-4141-8a31-fd55b8a68730\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04xh72" Jul 06 13:52:10.377864 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:10.377789 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dbfbd510-6069-4141-8a31-fd55b8a68730-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04xh72\" (UID: \"dbfbd510-6069-4141-8a31-fd55b8a68730\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04xh72" Jul 06 13:52:10.377864 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:10.377812 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dbfbd510-6069-4141-8a31-fd55b8a68730-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04xh72\" (UID: \"dbfbd510-6069-4141-8a31-fd55b8a68730\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04xh72" Jul 06 13:52:10.378171 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:10.378157 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dbfbd510-6069-4141-8a31-fd55b8a68730-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04xh72\" (UID: \"dbfbd510-6069-4141-8a31-fd55b8a68730\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04xh72" Jul 06 13:52:10.378213 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:10.378196 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dbfbd510-6069-4141-8a31-fd55b8a68730-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04xh72\" (UID: \"dbfbd510-6069-4141-8a31-fd55b8a68730\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04xh72" Jul 06 13:52:10.386267 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:10.386211 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4t74z\" (UniqueName: \"kubernetes.io/projected/dbfbd510-6069-4141-8a31-fd55b8a68730-kube-api-access-4t74z\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04xh72\" (UID: \"dbfbd510-6069-4141-8a31-fd55b8a68730\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04xh72" Jul 06 13:52:10.534519 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:10.534495 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04xh72" Jul 06 13:52:10.615729 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:10.615696 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nzcjl"] Jul 06 13:52:10.620767 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:10.620747 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nzcjl" Jul 06 13:52:10.629328 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:10.629020 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nzcjl"] Jul 06 13:52:10.665572 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:10.665553 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04xh72"] Jul 06 13:52:10.667368 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:52:10.667344 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbfbd510_6069_4141_8a31_fd55b8a68730.slice/crio-89d5956e3589c29f85c820d9c8bd42c25682d70c048aaf694d7ac60a0fa18156 WatchSource:0}: Error finding container 89d5956e3589c29f85c820d9c8bd42c25682d70c048aaf694d7ac60a0fa18156: Status 404 returned error can't find the container with id 89d5956e3589c29f85c820d9c8bd42c25682d70c048aaf694d7ac60a0fa18156 Jul 06 13:52:10.680231 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:10.680208 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2m6dp\" (UniqueName: \"kubernetes.io/projected/16125139-f229-460e-98c8-aae5c6465060-kube-api-access-2m6dp\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nzcjl\" (UID: \"16125139-f229-460e-98c8-aae5c6465060\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nzcjl" Jul 06 13:52:10.680333 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:10.680281 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/16125139-f229-460e-98c8-aae5c6465060-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nzcjl\" (UID: \"16125139-f229-460e-98c8-aae5c6465060\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nzcjl" Jul 06 13:52:10.680333 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:10.680322 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/16125139-f229-460e-98c8-aae5c6465060-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nzcjl\" (UID: \"16125139-f229-460e-98c8-aae5c6465060\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nzcjl" Jul 06 13:52:10.764323 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:10.764289 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04xh72" event={"ID":"dbfbd510-6069-4141-8a31-fd55b8a68730","Type":"ContainerStarted","Data":"554f11413158fd6264cf473ee12ce259be28c9feb62480f29e4c6695cfc04da5"} Jul 06 13:52:10.764438 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:10.764381 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04xh72" event={"ID":"dbfbd510-6069-4141-8a31-fd55b8a68730","Type":"ContainerStarted","Data":"89d5956e3589c29f85c820d9c8bd42c25682d70c048aaf694d7ac60a0fa18156"} Jul 06 13:52:10.765642 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:10.765598 2556 generic.go:356] "Generic (PLEG): container finished" podID="4973f9d0-ebb9-4f87-a3d7-5916f174cea6" containerID="92aa36859530b6a6119fde87db5db3f0c11a703a805409fb6424f98b01ae607e" exitCode=0 Jul 06 13:52:10.765746 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:10.765655 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qsqdp" event={"ID":"4973f9d0-ebb9-4f87-a3d7-5916f174cea6","Type":"ContainerDied","Data":"92aa36859530b6a6119fde87db5db3f0c11a703a805409fb6424f98b01ae607e"} Jul 06 13:52:10.765746 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:10.765693 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qsqdp" event={"ID":"4973f9d0-ebb9-4f87-a3d7-5916f174cea6","Type":"ContainerStarted","Data":"ff446c12da0f8edce51244c46c1e87827fd78c81e42115fec2734569bfcb9f25"} Jul 06 13:52:10.781199 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:10.781172 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/16125139-f229-460e-98c8-aae5c6465060-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nzcjl\" (UID: \"16125139-f229-460e-98c8-aae5c6465060\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nzcjl" Jul 06 13:52:10.781311 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:10.781220 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2m6dp\" (UniqueName: \"kubernetes.io/projected/16125139-f229-460e-98c8-aae5c6465060-kube-api-access-2m6dp\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nzcjl\" (UID: \"16125139-f229-460e-98c8-aae5c6465060\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nzcjl" Jul 06 13:52:10.781369 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:10.781327 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/16125139-f229-460e-98c8-aae5c6465060-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nzcjl\" (UID: \"16125139-f229-460e-98c8-aae5c6465060\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nzcjl" Jul 06 13:52:10.781601 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:10.781575 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/16125139-f229-460e-98c8-aae5c6465060-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nzcjl\" (UID: \"16125139-f229-460e-98c8-aae5c6465060\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nzcjl" Jul 06 13:52:10.781710 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:10.781638 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/16125139-f229-460e-98c8-aae5c6465060-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nzcjl\" (UID: \"16125139-f229-460e-98c8-aae5c6465060\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nzcjl" Jul 06 13:52:10.794081 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:10.794059 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2m6dp\" (UniqueName: \"kubernetes.io/projected/16125139-f229-460e-98c8-aae5c6465060-kube-api-access-2m6dp\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nzcjl\" (UID: \"16125139-f229-460e-98c8-aae5c6465060\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nzcjl" Jul 06 13:52:10.932413 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:10.932357 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nzcjl" Jul 06 13:52:11.023840 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:11.023815 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595xs5z"] Jul 06 13:52:11.028637 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:11.028600 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595xs5z" Jul 06 13:52:11.038555 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:11.038534 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595xs5z"] Jul 06 13:52:11.068875 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:11.068854 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nzcjl"] Jul 06 13:52:11.070791 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:52:11.070766 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16125139_f229_460e_98c8_aae5c6465060.slice/crio-b7c6cefdec39d9dba7c4f40920b166f4d8fd9539ddaa9bacbc931a764b95417c WatchSource:0}: Error finding container b7c6cefdec39d9dba7c4f40920b166f4d8fd9539ddaa9bacbc931a764b95417c: Status 404 returned error can't find the container with id b7c6cefdec39d9dba7c4f40920b166f4d8fd9539ddaa9bacbc931a764b95417c Jul 06 13:52:11.084535 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:11.084513 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8660c247-9baf-4e6b-9ff3-c2e4ca1830c3-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595xs5z\" (UID: \"8660c247-9baf-4e6b-9ff3-c2e4ca1830c3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595xs5z" Jul 06 13:52:11.084604 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:11.084564 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8660c247-9baf-4e6b-9ff3-c2e4ca1830c3-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595xs5z\" (UID: \"8660c247-9baf-4e6b-9ff3-c2e4ca1830c3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595xs5z" Jul 06 13:52:11.084666 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:11.084651 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4447k\" (UniqueName: \"kubernetes.io/projected/8660c247-9baf-4e6b-9ff3-c2e4ca1830c3-kube-api-access-4447k\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595xs5z\" (UID: \"8660c247-9baf-4e6b-9ff3-c2e4ca1830c3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595xs5z" Jul 06 13:52:11.185926 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:11.185867 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8660c247-9baf-4e6b-9ff3-c2e4ca1830c3-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595xs5z\" (UID: \"8660c247-9baf-4e6b-9ff3-c2e4ca1830c3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595xs5z" Jul 06 13:52:11.185926 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:11.185918 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4447k\" (UniqueName: \"kubernetes.io/projected/8660c247-9baf-4e6b-9ff3-c2e4ca1830c3-kube-api-access-4447k\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595xs5z\" (UID: \"8660c247-9baf-4e6b-9ff3-c2e4ca1830c3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595xs5z" Jul 06 13:52:11.186061 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:11.185975 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8660c247-9baf-4e6b-9ff3-c2e4ca1830c3-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595xs5z\" (UID: \"8660c247-9baf-4e6b-9ff3-c2e4ca1830c3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595xs5z" Jul 06 13:52:11.186206 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:11.186189 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8660c247-9baf-4e6b-9ff3-c2e4ca1830c3-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595xs5z\" (UID: \"8660c247-9baf-4e6b-9ff3-c2e4ca1830c3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595xs5z" Jul 06 13:52:11.186244 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:11.186214 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8660c247-9baf-4e6b-9ff3-c2e4ca1830c3-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595xs5z\" (UID: \"8660c247-9baf-4e6b-9ff3-c2e4ca1830c3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595xs5z" Jul 06 13:52:11.194714 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:11.194692 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4447k\" (UniqueName: \"kubernetes.io/projected/8660c247-9baf-4e6b-9ff3-c2e4ca1830c3-kube-api-access-4447k\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595xs5z\" (UID: \"8660c247-9baf-4e6b-9ff3-c2e4ca1830c3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595xs5z" Jul 06 13:52:11.341265 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:11.341239 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595xs5z" Jul 06 13:52:11.575571 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:11.575545 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595xs5z"] Jul 06 13:52:11.577171 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:52:11.577143 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8660c247_9baf_4e6b_9ff3_c2e4ca1830c3.slice/crio-026cd58646d5f17d487602d09c92473dba85eca03dc9375a7745071e159dccf4 WatchSource:0}: Error finding container 026cd58646d5f17d487602d09c92473dba85eca03dc9375a7745071e159dccf4: Status 404 returned error can't find the container with id 026cd58646d5f17d487602d09c92473dba85eca03dc9375a7745071e159dccf4 Jul 06 13:52:11.772005 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:11.771975 2556 generic.go:356] "Generic (PLEG): container finished" podID="dbfbd510-6069-4141-8a31-fd55b8a68730" containerID="554f11413158fd6264cf473ee12ce259be28c9feb62480f29e4c6695cfc04da5" exitCode=0 Jul 06 13:52:11.772105 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:11.772036 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04xh72" event={"ID":"dbfbd510-6069-4141-8a31-fd55b8a68730","Type":"ContainerDied","Data":"554f11413158fd6264cf473ee12ce259be28c9feb62480f29e4c6695cfc04da5"} Jul 06 13:52:11.774028 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:11.774009 2556 generic.go:356] "Generic (PLEG): container finished" podID="4973f9d0-ebb9-4f87-a3d7-5916f174cea6" containerID="c836c4d0f19956b9d68746e5be7bccea7d991057b8b47ecc21ab6fd67a6444f9" exitCode=0 Jul 06 13:52:11.774286 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:11.774072 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qsqdp" event={"ID":"4973f9d0-ebb9-4f87-a3d7-5916f174cea6","Type":"ContainerDied","Data":"c836c4d0f19956b9d68746e5be7bccea7d991057b8b47ecc21ab6fd67a6444f9"} Jul 06 13:52:11.775603 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:11.775584 2556 generic.go:356] "Generic (PLEG): container finished" podID="8660c247-9baf-4e6b-9ff3-c2e4ca1830c3" containerID="c708c50317410722db91d41dfa39b0763a6e02cd272042c59087edb3cbebdb23" exitCode=0 Jul 06 13:52:11.775715 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:11.775649 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595xs5z" event={"ID":"8660c247-9baf-4e6b-9ff3-c2e4ca1830c3","Type":"ContainerDied","Data":"c708c50317410722db91d41dfa39b0763a6e02cd272042c59087edb3cbebdb23"} Jul 06 13:52:11.775715 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:11.775687 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595xs5z" event={"ID":"8660c247-9baf-4e6b-9ff3-c2e4ca1830c3","Type":"ContainerStarted","Data":"026cd58646d5f17d487602d09c92473dba85eca03dc9375a7745071e159dccf4"} Jul 06 13:52:11.777483 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:11.777461 2556 generic.go:356] "Generic (PLEG): container finished" podID="16125139-f229-460e-98c8-aae5c6465060" containerID="82adc614545ba3a40924fb96b2e74469c876cf3e461372b0295dc1b4a8758707" exitCode=0 Jul 06 13:52:11.777665 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:11.777578 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nzcjl" event={"ID":"16125139-f229-460e-98c8-aae5c6465060","Type":"ContainerDied","Data":"82adc614545ba3a40924fb96b2e74469c876cf3e461372b0295dc1b4a8758707"} Jul 06 13:52:11.777665 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:11.777637 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nzcjl" event={"ID":"16125139-f229-460e-98c8-aae5c6465060","Type":"ContainerStarted","Data":"b7c6cefdec39d9dba7c4f40920b166f4d8fd9539ddaa9bacbc931a764b95417c"} Jul 06 13:52:12.787542 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:12.787516 2556 generic.go:356] "Generic (PLEG): container finished" podID="dbfbd510-6069-4141-8a31-fd55b8a68730" containerID="e434aa40179e1740306ddb819b997d33a7b22cc2a6b7f6503e70abc3afb797ee" exitCode=0 Jul 06 13:52:12.790031 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:12.790008 2556 generic.go:356] "Generic (PLEG): container finished" podID="4973f9d0-ebb9-4f87-a3d7-5916f174cea6" containerID="fc112959a3a5b2391c2ab5a8b140b281c364ef0dfa6fd853da707787a42e7e6a" exitCode=0 Jul 06 13:52:12.790299 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:12.790280 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04xh72" event={"ID":"dbfbd510-6069-4141-8a31-fd55b8a68730","Type":"ContainerDied","Data":"e434aa40179e1740306ddb819b997d33a7b22cc2a6b7f6503e70abc3afb797ee"} Jul 06 13:52:12.790360 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:12.790323 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qsqdp" event={"ID":"4973f9d0-ebb9-4f87-a3d7-5916f174cea6","Type":"ContainerDied","Data":"fc112959a3a5b2391c2ab5a8b140b281c364ef0dfa6fd853da707787a42e7e6a"} Jul 06 13:52:12.791877 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:12.791855 2556 generic.go:356] "Generic (PLEG): container finished" podID="8660c247-9baf-4e6b-9ff3-c2e4ca1830c3" containerID="0f19ac8bf1878ca4d1e9dbdb89ce09b9bf6743bf8133e2e23de663149d3dbb2b" exitCode=0 Jul 06 13:52:12.791984 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:12.791933 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595xs5z" event={"ID":"8660c247-9baf-4e6b-9ff3-c2e4ca1830c3","Type":"ContainerDied","Data":"0f19ac8bf1878ca4d1e9dbdb89ce09b9bf6743bf8133e2e23de663149d3dbb2b"} Jul 06 13:52:12.793789 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:12.793766 2556 generic.go:356] "Generic (PLEG): container finished" podID="16125139-f229-460e-98c8-aae5c6465060" containerID="9ba319ca0b8148d32058f7b2dbc6db7b86bd9e30ffc8c3cd825db2f13e2bdf31" exitCode=0 Jul 06 13:52:12.793865 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:12.793788 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nzcjl" event={"ID":"16125139-f229-460e-98c8-aae5c6465060","Type":"ContainerDied","Data":"9ba319ca0b8148d32058f7b2dbc6db7b86bd9e30ffc8c3cd825db2f13e2bdf31"} Jul 06 13:52:13.801511 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:13.801477 2556 generic.go:356] "Generic (PLEG): container finished" podID="dbfbd510-6069-4141-8a31-fd55b8a68730" containerID="53cdebee88bf26bfa372d314f8c6985f6db4878201c2419d8740828204ac0520" exitCode=0 Jul 06 13:52:13.801921 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:13.801568 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04xh72" event={"ID":"dbfbd510-6069-4141-8a31-fd55b8a68730","Type":"ContainerDied","Data":"53cdebee88bf26bfa372d314f8c6985f6db4878201c2419d8740828204ac0520"} Jul 06 13:52:13.803661 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:13.803634 2556 generic.go:356] "Generic (PLEG): container finished" podID="8660c247-9baf-4e6b-9ff3-c2e4ca1830c3" containerID="90a2cef29470b109ed9ff1377ec3d2fcf4d75e7dbfc00cf2d9162227276462a3" exitCode=0 Jul 06 13:52:13.803787 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:13.803665 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595xs5z" event={"ID":"8660c247-9baf-4e6b-9ff3-c2e4ca1830c3","Type":"ContainerDied","Data":"90a2cef29470b109ed9ff1377ec3d2fcf4d75e7dbfc00cf2d9162227276462a3"} Jul 06 13:52:13.805524 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:13.805500 2556 generic.go:356] "Generic (PLEG): container finished" podID="16125139-f229-460e-98c8-aae5c6465060" containerID="8759b0c56f124020d18ca6999289a0a7fc298d9651d04afb6ac5538d6b95c4b9" exitCode=0 Jul 06 13:52:13.805706 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:13.805632 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nzcjl" event={"ID":"16125139-f229-460e-98c8-aae5c6465060","Type":"ContainerDied","Data":"8759b0c56f124020d18ca6999289a0a7fc298d9651d04afb6ac5538d6b95c4b9"} Jul 06 13:52:13.937976 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:13.937951 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qsqdp" Jul 06 13:52:14.012318 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:14.012288 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4973f9d0-ebb9-4f87-a3d7-5916f174cea6-bundle\") pod \"4973f9d0-ebb9-4f87-a3d7-5916f174cea6\" (UID: \"4973f9d0-ebb9-4f87-a3d7-5916f174cea6\") " Jul 06 13:52:14.012493 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:14.012383 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5cvk6\" (UniqueName: \"kubernetes.io/projected/4973f9d0-ebb9-4f87-a3d7-5916f174cea6-kube-api-access-5cvk6\") pod \"4973f9d0-ebb9-4f87-a3d7-5916f174cea6\" (UID: \"4973f9d0-ebb9-4f87-a3d7-5916f174cea6\") " Jul 06 13:52:14.012493 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:14.012424 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4973f9d0-ebb9-4f87-a3d7-5916f174cea6-util\") pod \"4973f9d0-ebb9-4f87-a3d7-5916f174cea6\" (UID: \"4973f9d0-ebb9-4f87-a3d7-5916f174cea6\") " Jul 06 13:52:14.012961 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:14.012931 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4973f9d0-ebb9-4f87-a3d7-5916f174cea6-bundle" (OuterVolumeSpecName: "bundle") pod "4973f9d0-ebb9-4f87-a3d7-5916f174cea6" (UID: "4973f9d0-ebb9-4f87-a3d7-5916f174cea6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 13:52:14.014597 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:14.014572 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4973f9d0-ebb9-4f87-a3d7-5916f174cea6-kube-api-access-5cvk6" (OuterVolumeSpecName: "kube-api-access-5cvk6") pod "4973f9d0-ebb9-4f87-a3d7-5916f174cea6" (UID: "4973f9d0-ebb9-4f87-a3d7-5916f174cea6"). InnerVolumeSpecName "kube-api-access-5cvk6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 13:52:14.018131 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:14.018112 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4973f9d0-ebb9-4f87-a3d7-5916f174cea6-util" (OuterVolumeSpecName: "util") pod "4973f9d0-ebb9-4f87-a3d7-5916f174cea6" (UID: "4973f9d0-ebb9-4f87-a3d7-5916f174cea6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 13:52:14.113764 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:14.113688 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5cvk6\" (UniqueName: \"kubernetes.io/projected/4973f9d0-ebb9-4f87-a3d7-5916f174cea6-kube-api-access-5cvk6\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:52:14.113764 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:14.113722 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4973f9d0-ebb9-4f87-a3d7-5916f174cea6-util\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:52:14.113764 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:14.113731 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4973f9d0-ebb9-4f87-a3d7-5916f174cea6-bundle\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:52:14.812232 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:14.812198 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qsqdp" event={"ID":"4973f9d0-ebb9-4f87-a3d7-5916f174cea6","Type":"ContainerDied","Data":"ff446c12da0f8edce51244c46c1e87827fd78c81e42115fec2734569bfcb9f25"} Jul 06 13:52:14.812667 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:14.812256 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ff446c12da0f8edce51244c46c1e87827fd78c81e42115fec2734569bfcb9f25" Jul 06 13:52:14.812667 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:14.812210 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qsqdp" Jul 06 13:52:14.984302 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:14.984277 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nzcjl" Jul 06 13:52:14.987003 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:14.986984 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04xh72" Jul 06 13:52:15.010584 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:15.010561 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595xs5z" Jul 06 13:52:15.022196 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:15.022175 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/16125139-f229-460e-98c8-aae5c6465060-util\") pod \"16125139-f229-460e-98c8-aae5c6465060\" (UID: \"16125139-f229-460e-98c8-aae5c6465060\") " Jul 06 13:52:15.022281 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:15.022226 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dbfbd510-6069-4141-8a31-fd55b8a68730-bundle\") pod \"dbfbd510-6069-4141-8a31-fd55b8a68730\" (UID: \"dbfbd510-6069-4141-8a31-fd55b8a68730\") " Jul 06 13:52:15.022281 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:15.022269 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dbfbd510-6069-4141-8a31-fd55b8a68730-util\") pod \"dbfbd510-6069-4141-8a31-fd55b8a68730\" (UID: \"dbfbd510-6069-4141-8a31-fd55b8a68730\") " Jul 06 13:52:15.022386 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:15.022320 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/16125139-f229-460e-98c8-aae5c6465060-bundle\") pod \"16125139-f229-460e-98c8-aae5c6465060\" (UID: \"16125139-f229-460e-98c8-aae5c6465060\") " Jul 06 13:52:15.022386 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:15.022366 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2m6dp\" (UniqueName: \"kubernetes.io/projected/16125139-f229-460e-98c8-aae5c6465060-kube-api-access-2m6dp\") pod \"16125139-f229-460e-98c8-aae5c6465060\" (UID: \"16125139-f229-460e-98c8-aae5c6465060\") " Jul 06 13:52:15.022484 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:15.022469 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4t74z\" (UniqueName: \"kubernetes.io/projected/dbfbd510-6069-4141-8a31-fd55b8a68730-kube-api-access-4t74z\") pod \"dbfbd510-6069-4141-8a31-fd55b8a68730\" (UID: \"dbfbd510-6069-4141-8a31-fd55b8a68730\") " Jul 06 13:52:15.023179 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:15.022849 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbfbd510-6069-4141-8a31-fd55b8a68730-bundle" (OuterVolumeSpecName: "bundle") pod "dbfbd510-6069-4141-8a31-fd55b8a68730" (UID: "dbfbd510-6069-4141-8a31-fd55b8a68730"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 13:52:15.023336 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:15.023300 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16125139-f229-460e-98c8-aae5c6465060-bundle" (OuterVolumeSpecName: "bundle") pod "16125139-f229-460e-98c8-aae5c6465060" (UID: "16125139-f229-460e-98c8-aae5c6465060"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 13:52:15.024930 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:15.024908 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16125139-f229-460e-98c8-aae5c6465060-kube-api-access-2m6dp" (OuterVolumeSpecName: "kube-api-access-2m6dp") pod "16125139-f229-460e-98c8-aae5c6465060" (UID: "16125139-f229-460e-98c8-aae5c6465060"). InnerVolumeSpecName "kube-api-access-2m6dp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 13:52:15.025224 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:15.025203 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbfbd510-6069-4141-8a31-fd55b8a68730-kube-api-access-4t74z" (OuterVolumeSpecName: "kube-api-access-4t74z") pod "dbfbd510-6069-4141-8a31-fd55b8a68730" (UID: "dbfbd510-6069-4141-8a31-fd55b8a68730"). InnerVolumeSpecName "kube-api-access-4t74z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 13:52:15.031258 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:15.031098 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16125139-f229-460e-98c8-aae5c6465060-util" (OuterVolumeSpecName: "util") pod "16125139-f229-460e-98c8-aae5c6465060" (UID: "16125139-f229-460e-98c8-aae5c6465060"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 13:52:15.031724 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:15.031688 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbfbd510-6069-4141-8a31-fd55b8a68730-util" (OuterVolumeSpecName: "util") pod "dbfbd510-6069-4141-8a31-fd55b8a68730" (UID: "dbfbd510-6069-4141-8a31-fd55b8a68730"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 13:52:15.123794 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:15.123726 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4447k\" (UniqueName: \"kubernetes.io/projected/8660c247-9baf-4e6b-9ff3-c2e4ca1830c3-kube-api-access-4447k\") pod \"8660c247-9baf-4e6b-9ff3-c2e4ca1830c3\" (UID: \"8660c247-9baf-4e6b-9ff3-c2e4ca1830c3\") " Jul 06 13:52:15.123904 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:15.123841 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8660c247-9baf-4e6b-9ff3-c2e4ca1830c3-bundle\") pod \"8660c247-9baf-4e6b-9ff3-c2e4ca1830c3\" (UID: \"8660c247-9baf-4e6b-9ff3-c2e4ca1830c3\") " Jul 06 13:52:15.123904 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:15.123869 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8660c247-9baf-4e6b-9ff3-c2e4ca1830c3-util\") pod \"8660c247-9baf-4e6b-9ff3-c2e4ca1830c3\" (UID: \"8660c247-9baf-4e6b-9ff3-c2e4ca1830c3\") " Jul 06 13:52:15.124162 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:15.124144 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4t74z\" (UniqueName: \"kubernetes.io/projected/dbfbd510-6069-4141-8a31-fd55b8a68730-kube-api-access-4t74z\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:52:15.124162 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:15.124162 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/16125139-f229-460e-98c8-aae5c6465060-util\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:52:15.124269 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:15.124170 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dbfbd510-6069-4141-8a31-fd55b8a68730-bundle\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:52:15.124269 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:15.124189 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dbfbd510-6069-4141-8a31-fd55b8a68730-util\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:52:15.124269 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:15.124198 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/16125139-f229-460e-98c8-aae5c6465060-bundle\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:52:15.124269 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:15.124206 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2m6dp\" (UniqueName: \"kubernetes.io/projected/16125139-f229-460e-98c8-aae5c6465060-kube-api-access-2m6dp\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:52:15.124393 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:15.124261 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8660c247-9baf-4e6b-9ff3-c2e4ca1830c3-bundle" (OuterVolumeSpecName: "bundle") pod "8660c247-9baf-4e6b-9ff3-c2e4ca1830c3" (UID: "8660c247-9baf-4e6b-9ff3-c2e4ca1830c3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 13:52:15.125847 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:15.125825 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8660c247-9baf-4e6b-9ff3-c2e4ca1830c3-kube-api-access-4447k" (OuterVolumeSpecName: "kube-api-access-4447k") pod "8660c247-9baf-4e6b-9ff3-c2e4ca1830c3" (UID: "8660c247-9baf-4e6b-9ff3-c2e4ca1830c3"). InnerVolumeSpecName "kube-api-access-4447k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 13:52:15.129321 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:15.129282 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8660c247-9baf-4e6b-9ff3-c2e4ca1830c3-util" (OuterVolumeSpecName: "util") pod "8660c247-9baf-4e6b-9ff3-c2e4ca1830c3" (UID: "8660c247-9baf-4e6b-9ff3-c2e4ca1830c3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 13:52:15.225221 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:15.225198 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4447k\" (UniqueName: \"kubernetes.io/projected/8660c247-9baf-4e6b-9ff3-c2e4ca1830c3-kube-api-access-4447k\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:52:15.225221 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:15.225218 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8660c247-9baf-4e6b-9ff3-c2e4ca1830c3-bundle\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:52:15.225364 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:15.225227 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8660c247-9baf-4e6b-9ff3-c2e4ca1830c3-util\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:52:15.819380 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:15.819350 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nzcjl" Jul 06 13:52:15.819380 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:15.819372 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nzcjl" event={"ID":"16125139-f229-460e-98c8-aae5c6465060","Type":"ContainerDied","Data":"b7c6cefdec39d9dba7c4f40920b166f4d8fd9539ddaa9bacbc931a764b95417c"} Jul 06 13:52:15.819805 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:15.819419 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b7c6cefdec39d9dba7c4f40920b166f4d8fd9539ddaa9bacbc931a764b95417c" Jul 06 13:52:15.821225 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:15.821203 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04xh72" Jul 06 13:52:15.821338 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:15.821227 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04xh72" event={"ID":"dbfbd510-6069-4141-8a31-fd55b8a68730","Type":"ContainerDied","Data":"89d5956e3589c29f85c820d9c8bd42c25682d70c048aaf694d7ac60a0fa18156"} Jul 06 13:52:15.821338 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:15.821264 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="89d5956e3589c29f85c820d9c8bd42c25682d70c048aaf694d7ac60a0fa18156" Jul 06 13:52:15.823342 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:15.823320 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595xs5z" event={"ID":"8660c247-9baf-4e6b-9ff3-c2e4ca1830c3","Type":"ContainerDied","Data":"026cd58646d5f17d487602d09c92473dba85eca03dc9375a7745071e159dccf4"} Jul 06 13:52:15.823422 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:15.823360 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="026cd58646d5f17d487602d09c92473dba85eca03dc9375a7745071e159dccf4" Jul 06 13:52:15.823422 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:15.823323 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595xs5z" Jul 06 13:52:17.161060 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:17.161023 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:52:20.160298 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:20.160262 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:52:22.063854 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:22.063806 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kwq2b"] Jul 06 13:52:22.064372 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:22.064183 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16125139-f229-460e-98c8-aae5c6465060" containerName="util" Jul 06 13:52:22.064372 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:22.064195 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="16125139-f229-460e-98c8-aae5c6465060" containerName="util" Jul 06 13:52:22.064372 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:22.064206 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbfbd510-6069-4141-8a31-fd55b8a68730" containerName="extract" Jul 06 13:52:22.064372 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:22.064212 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbfbd510-6069-4141-8a31-fd55b8a68730" containerName="extract" Jul 06 13:52:22.064372 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:22.064218 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8660c247-9baf-4e6b-9ff3-c2e4ca1830c3" containerName="extract" Jul 06 13:52:22.064372 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:22.064224 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8660c247-9baf-4e6b-9ff3-c2e4ca1830c3" containerName="extract" Jul 06 13:52:22.064372 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:22.064231 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbfbd510-6069-4141-8a31-fd55b8a68730" containerName="util" Jul 06 13:52:22.064372 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:22.064237 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbfbd510-6069-4141-8a31-fd55b8a68730" containerName="util" Jul 06 13:52:22.064372 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:22.064245 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4973f9d0-ebb9-4f87-a3d7-5916f174cea6" containerName="util" Jul 06 13:52:22.064372 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:22.064250 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="4973f9d0-ebb9-4f87-a3d7-5916f174cea6" containerName="util" Jul 06 13:52:22.064372 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:22.064258 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4973f9d0-ebb9-4f87-a3d7-5916f174cea6" containerName="extract" Jul 06 13:52:22.064372 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:22.064263 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="4973f9d0-ebb9-4f87-a3d7-5916f174cea6" containerName="extract" Jul 06 13:52:22.064372 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:22.064272 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16125139-f229-460e-98c8-aae5c6465060" containerName="pull" Jul 06 13:52:22.064372 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:22.064277 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="16125139-f229-460e-98c8-aae5c6465060" containerName="pull" Jul 06 13:52:22.064372 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:22.064283 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbfbd510-6069-4141-8a31-fd55b8a68730" containerName="pull" Jul 06 13:52:22.064372 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:22.064288 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbfbd510-6069-4141-8a31-fd55b8a68730" containerName="pull" Jul 06 13:52:22.064372 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:22.064294 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8660c247-9baf-4e6b-9ff3-c2e4ca1830c3" containerName="pull" Jul 06 13:52:22.064372 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:22.064301 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8660c247-9baf-4e6b-9ff3-c2e4ca1830c3" containerName="pull" Jul 06 13:52:22.064372 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:22.064309 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8660c247-9baf-4e6b-9ff3-c2e4ca1830c3" containerName="util" Jul 06 13:52:22.064372 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:22.064314 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8660c247-9baf-4e6b-9ff3-c2e4ca1830c3" containerName="util" Jul 06 13:52:22.064372 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:22.064322 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16125139-f229-460e-98c8-aae5c6465060" containerName="extract" Jul 06 13:52:22.064372 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:22.064327 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="16125139-f229-460e-98c8-aae5c6465060" containerName="extract" Jul 06 13:52:22.064372 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:22.064337 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4973f9d0-ebb9-4f87-a3d7-5916f174cea6" containerName="pull" Jul 06 13:52:22.064372 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:22.064342 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="4973f9d0-ebb9-4f87-a3d7-5916f174cea6" containerName="pull" Jul 06 13:52:22.065387 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:22.064416 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="4973f9d0-ebb9-4f87-a3d7-5916f174cea6" containerName="extract" Jul 06 13:52:22.065387 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:22.064424 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbfbd510-6069-4141-8a31-fd55b8a68730" containerName="extract" Jul 06 13:52:22.065387 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:22.064430 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="16125139-f229-460e-98c8-aae5c6465060" containerName="extract" Jul 06 13:52:22.065387 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:22.064440 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="8660c247-9baf-4e6b-9ff3-c2e4ca1830c3" containerName="extract" Jul 06 13:52:22.069259 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:22.069239 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kwq2b" Jul 06 13:52:22.072221 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:22.072199 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-nm4qw\"" Jul 06 13:52:22.081012 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:22.080989 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kwq2b"] Jul 06 13:52:22.183743 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:22.183717 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5942a7c5-f0d8-4032-a33d-96e19fa901e7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kwq2b\" (UID: \"5942a7c5-f0d8-4032-a33d-96e19fa901e7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kwq2b" Jul 06 13:52:22.183884 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:22.183748 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhmvk\" (UniqueName: \"kubernetes.io/projected/5942a7c5-f0d8-4032-a33d-96e19fa901e7-kube-api-access-nhmvk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kwq2b\" (UID: \"5942a7c5-f0d8-4032-a33d-96e19fa901e7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kwq2b" Jul 06 13:52:22.285116 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:22.285092 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5942a7c5-f0d8-4032-a33d-96e19fa901e7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kwq2b\" (UID: \"5942a7c5-f0d8-4032-a33d-96e19fa901e7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kwq2b" Jul 06 13:52:22.285261 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:22.285136 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhmvk\" (UniqueName: \"kubernetes.io/projected/5942a7c5-f0d8-4032-a33d-96e19fa901e7-kube-api-access-nhmvk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kwq2b\" (UID: \"5942a7c5-f0d8-4032-a33d-96e19fa901e7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kwq2b" Jul 06 13:52:22.285446 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:22.285424 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5942a7c5-f0d8-4032-a33d-96e19fa901e7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kwq2b\" (UID: \"5942a7c5-f0d8-4032-a33d-96e19fa901e7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kwq2b" Jul 06 13:52:22.298636 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:22.298602 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhmvk\" (UniqueName: \"kubernetes.io/projected/5942a7c5-f0d8-4032-a33d-96e19fa901e7-kube-api-access-nhmvk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kwq2b\" (UID: \"5942a7c5-f0d8-4032-a33d-96e19fa901e7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kwq2b" Jul 06 13:52:22.380967 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:22.380904 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kwq2b" Jul 06 13:52:22.519115 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:22.519087 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kwq2b"] Jul 06 13:52:22.714986 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:22.714901 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:52:22.862105 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:22.862067 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kwq2b" event={"ID":"5942a7c5-f0d8-4032-a33d-96e19fa901e7","Type":"ContainerStarted","Data":"65be9138e65c4761646b8060583968f51e92970a9b916ac3a0991bd3d011cc34"} Jul 06 13:52:23.983717 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:23.983682 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j84mf"] Jul 06 13:52:23.987503 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:23.987485 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j84mf" Jul 06 13:52:23.990275 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:23.990237 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-sh786\"" Jul 06 13:52:24.004498 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:24.004476 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j84mf"] Jul 06 13:52:24.100529 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:24.100496 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7ktv\" (UniqueName: \"kubernetes.io/projected/de229b56-c059-4ec6-80ba-f510ad31ba18-kube-api-access-h7ktv\") pod \"limitador-operator-controller-manager-859d7b78bd-j84mf\" (UID: \"de229b56-c059-4ec6-80ba-f510ad31ba18\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j84mf" Jul 06 13:52:24.201837 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:24.201808 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7ktv\" (UniqueName: \"kubernetes.io/projected/de229b56-c059-4ec6-80ba-f510ad31ba18-kube-api-access-h7ktv\") pod \"limitador-operator-controller-manager-859d7b78bd-j84mf\" (UID: \"de229b56-c059-4ec6-80ba-f510ad31ba18\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j84mf" Jul 06 13:52:24.210599 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:24.210573 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7ktv\" (UniqueName: \"kubernetes.io/projected/de229b56-c059-4ec6-80ba-f510ad31ba18-kube-api-access-h7ktv\") pod \"limitador-operator-controller-manager-859d7b78bd-j84mf\" (UID: \"de229b56-c059-4ec6-80ba-f510ad31ba18\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j84mf" Jul 06 13:52:24.300575 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:24.300548 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j84mf" Jul 06 13:52:24.310042 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:24.309967 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:52:24.453537 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:24.453500 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j84mf"] Jul 06 13:52:24.455429 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:52:24.455407 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde229b56_c059_4ec6_80ba_f510ad31ba18.slice/crio-bd5c9b902e4b3dbc7368f9a63fdf2c403876556b80c6575927e2895efdaf747a WatchSource:0}: Error finding container bd5c9b902e4b3dbc7368f9a63fdf2c403876556b80c6575927e2895efdaf747a: Status 404 returned error can't find the container with id bd5c9b902e4b3dbc7368f9a63fdf2c403876556b80c6575927e2895efdaf747a Jul 06 13:52:24.720210 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:24.720110 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:52:24.877480 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:24.877412 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j84mf" event={"ID":"de229b56-c059-4ec6-80ba-f510ad31ba18","Type":"ContainerStarted","Data":"bd5c9b902e4b3dbc7368f9a63fdf2c403876556b80c6575927e2895efdaf747a"} Jul 06 13:52:25.365813 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:25.365775 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:52:26.006759 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:26.006722 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:52:26.104670 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:26.104612 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:52:26.892780 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:26.892746 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j84mf" event={"ID":"de229b56-c059-4ec6-80ba-f510ad31ba18","Type":"ContainerStarted","Data":"8bb23c0e82cc7cf204c1340c27ba5736a25628c223f910b7658b7cb46d10aba8"} Jul 06 13:52:26.893264 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:26.892984 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j84mf" Jul 06 13:52:26.914078 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:26.914025 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j84mf" podStartSLOduration=2.003846172 podStartE2EDuration="3.914010474s" totalImagesPullingTime="1.910164302s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:52:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:52:26.910939024 +0000 UTC m=+440.710684717" watchObservedRunningTime="2026-07-06 13:52:26.914010474 +0000 UTC m=+440.713756166" Jul 06 13:52:27.143989 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:27.143895 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-g6mnj"] Jul 06 13:52:27.147884 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:27.147860 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-g6mnj" Jul 06 13:52:27.150852 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:27.150825 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-z5gzw\"" Jul 06 13:52:27.160689 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:27.160662 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-g6mnj"] Jul 06 13:52:27.230357 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:27.230324 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9hc7\" (UniqueName: \"kubernetes.io/projected/49c5b891-8102-4a34-84ee-6d87debad40a-kube-api-access-z9hc7\") pod \"authorino-operator-75cc8d5cb7-g6mnj\" (UID: \"49c5b891-8102-4a34-84ee-6d87debad40a\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-g6mnj" Jul 06 13:52:27.331444 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:27.331404 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9hc7\" (UniqueName: \"kubernetes.io/projected/49c5b891-8102-4a34-84ee-6d87debad40a-kube-api-access-z9hc7\") pod \"authorino-operator-75cc8d5cb7-g6mnj\" (UID: \"49c5b891-8102-4a34-84ee-6d87debad40a\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-g6mnj" Jul 06 13:52:27.340541 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:27.340508 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9hc7\" (UniqueName: \"kubernetes.io/projected/49c5b891-8102-4a34-84ee-6d87debad40a-kube-api-access-z9hc7\") pod \"authorino-operator-75cc8d5cb7-g6mnj\" (UID: \"49c5b891-8102-4a34-84ee-6d87debad40a\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-g6mnj" Jul 06 13:52:27.462342 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:27.462258 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-g6mnj" Jul 06 13:52:27.769089 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:27.769060 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:52:27.862144 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:27.862117 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-g6mnj"] Jul 06 13:52:27.863124 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:27.863095 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:52:27.866670 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:52:27.866643 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49c5b891_8102_4a34_84ee_6d87debad40a.slice/crio-15c501beeef497d6251318b19aaf1970702ebda557d133b53b5459b560650dcb WatchSource:0}: Error finding container 15c501beeef497d6251318b19aaf1970702ebda557d133b53b5459b560650dcb: Status 404 returned error can't find the container with id 15c501beeef497d6251318b19aaf1970702ebda557d133b53b5459b560650dcb Jul 06 13:52:27.899739 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:27.899710 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-g6mnj" event={"ID":"49c5b891-8102-4a34-84ee-6d87debad40a","Type":"ContainerStarted","Data":"15c501beeef497d6251318b19aaf1970702ebda557d133b53b5459b560650dcb"} Jul 06 13:52:27.901352 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:27.901327 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kwq2b" event={"ID":"5942a7c5-f0d8-4032-a33d-96e19fa901e7","Type":"ContainerStarted","Data":"768813959c424e12a924b4093af5dc9ede958c6498fa731927bab6532a26e46f"} Jul 06 13:52:27.901486 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:27.901471 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kwq2b" Jul 06 13:52:27.930655 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:27.930588 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kwq2b" podStartSLOduration=0.674953448 podStartE2EDuration="5.930569271s" totalImagesPullingTime="5.255615823s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:52:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:52:27.928100303 +0000 UTC m=+441.727846009" watchObservedRunningTime="2026-07-06 13:52:27.930569271 +0000 UTC m=+441.730314971" Jul 06 13:52:27.966360 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:27.966337 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:52:29.551722 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:29.551528 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:52:30.852215 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:30.852188 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:52:30.922562 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:30.922533 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-g6mnj" event={"ID":"49c5b891-8102-4a34-84ee-6d87debad40a","Type":"ContainerStarted","Data":"2e334944aea31bdfcc11abc13f5b0ac126bd64a62bfefa7b23af1a7483b0b050"} Jul 06 13:52:30.922741 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:30.922586 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-g6mnj" Jul 06 13:52:30.943587 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:30.943449 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-g6mnj" podStartSLOduration=1.605804615 podStartE2EDuration="3.943435135s" totalImagesPullingTime="2.33763052s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:52:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:52:30.942523703 +0000 UTC m=+444.742269397" watchObservedRunningTime="2026-07-06 13:52:30.943435135 +0000 UTC m=+444.743180827" Jul 06 13:52:31.119376 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:31.119291 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:52:32.396326 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:32.396290 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:52:32.492022 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:32.491991 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:52:37.903991 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:37.903963 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j84mf" Jul 06 13:52:38.911022 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:38.910994 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kwq2b" Jul 06 13:52:40.562705 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:40.562655 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:52:40.664395 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:40.664347 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:52:40.774735 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:40.774700 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kwq2b"] Jul 06 13:52:40.774896 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:40.774864 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kwq2b" podUID="5942a7c5-f0d8-4032-a33d-96e19fa901e7" containerName="manager" containerID="cri-o://768813959c424e12a924b4093af5dc9ede958c6498fa731927bab6532a26e46f" gracePeriod=2 Jul 06 13:52:40.788949 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:40.788925 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kwq2b"] Jul 06 13:52:40.789893 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:52:40.789853 2556 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"5942a7c5-f0d8-4032-a33d-96e19fa901e7\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-kwq2b\": pods \"kuadrant-operator-controller-manager-8684c9ff49-kwq2b\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kwq2b" Jul 06 13:52:40.799352 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:40.799330 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j84mf"] Jul 06 13:52:40.799508 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:40.799485 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j84mf" podUID="de229b56-c059-4ec6-80ba-f510ad31ba18" containerName="manager" containerID="cri-o://8bb23c0e82cc7cf204c1340c27ba5736a25628c223f910b7658b7cb46d10aba8" gracePeriod=2 Jul 06 13:52:40.803545 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:40.803525 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7td77"] Jul 06 13:52:40.803914 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:40.803900 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5942a7c5-f0d8-4032-a33d-96e19fa901e7" containerName="manager" Jul 06 13:52:40.803957 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:40.803917 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="5942a7c5-f0d8-4032-a33d-96e19fa901e7" containerName="manager" Jul 06 13:52:40.803989 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:40.803984 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="5942a7c5-f0d8-4032-a33d-96e19fa901e7" containerName="manager" Jul 06 13:52:40.808272 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:40.808247 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7td77" Jul 06 13:52:40.817008 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:40.816824 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j84mf"] Jul 06 13:52:40.818547 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:52:40.818513 2556 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"de229b56-c059-4ec6-80ba-f510ad31ba18\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-j84mf\": pods \"limitador-operator-controller-manager-859d7b78bd-j84mf\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j84mf" Jul 06 13:52:40.821997 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:52:40.821966 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kwq2b\" is forbidden: User \"system:node:ip-10-0-134-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-85.ec2.internal' and this object" podUID="5942a7c5-f0d8-4032-a33d-96e19fa901e7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kwq2b" Jul 06 13:52:40.822685 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:40.822610 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7td77"] Jul 06 13:52:40.827457 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:40.827437 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sbw4q"] Jul 06 13:52:40.827809 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:40.827794 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de229b56-c059-4ec6-80ba-f510ad31ba18" containerName="manager" Jul 06 13:52:40.827809 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:40.827808 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="de229b56-c059-4ec6-80ba-f510ad31ba18" containerName="manager" Jul 06 13:52:40.827967 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:40.827877 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="de229b56-c059-4ec6-80ba-f510ad31ba18" containerName="manager" Jul 06 13:52:40.829887 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:40.829868 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sbw4q" Jul 06 13:52:40.853130 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:52:40.853075 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-j84mf\" is forbidden: User \"system:node:ip-10-0-134-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-85.ec2.internal' and this object" podUID="de229b56-c059-4ec6-80ba-f510ad31ba18" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j84mf" Jul 06 13:52:40.853470 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:40.853441 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sbw4q"] Jul 06 13:52:40.855206 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:52:40.855178 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kwq2b\" is forbidden: User \"system:node:ip-10-0-134-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-85.ec2.internal' and this object" podUID="5942a7c5-f0d8-4032-a33d-96e19fa901e7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kwq2b" Jul 06 13:52:40.857408 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:52:40.857386 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-j84mf\" is forbidden: User \"system:node:ip-10-0-134-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-85.ec2.internal' and this object" podUID="de229b56-c059-4ec6-80ba-f510ad31ba18" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j84mf" Jul 06 13:52:40.876218 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:52:40.876194 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kwq2b\" is forbidden: User \"system:node:ip-10-0-134-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-85.ec2.internal' and this object" podUID="5942a7c5-f0d8-4032-a33d-96e19fa901e7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kwq2b" Jul 06 13:52:40.951967 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:40.951932 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clld8\" (UniqueName: \"kubernetes.io/projected/9ad0bc2e-6cec-498f-a48f-bfe5dd1e6ca3-kube-api-access-clld8\") pod \"limitador-operator-controller-manager-859d7b78bd-sbw4q\" (UID: \"9ad0bc2e-6cec-498f-a48f-bfe5dd1e6ca3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sbw4q" Jul 06 13:52:40.952136 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:40.951978 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftcz4\" (UniqueName: \"kubernetes.io/projected/1180bab7-a800-45b1-9bdc-05b7c8a4e54c-kube-api-access-ftcz4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7td77\" (UID: \"1180bab7-a800-45b1-9bdc-05b7c8a4e54c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7td77" Jul 06 13:52:40.952136 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:40.952069 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1180bab7-a800-45b1-9bdc-05b7c8a4e54c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7td77\" (UID: \"1180bab7-a800-45b1-9bdc-05b7c8a4e54c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7td77" Jul 06 13:52:41.002730 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:40.996645 2556 generic.go:356] "Generic (PLEG): container finished" podID="5942a7c5-f0d8-4032-a33d-96e19fa901e7" containerID="768813959c424e12a924b4093af5dc9ede958c6498fa731927bab6532a26e46f" exitCode=0 Jul 06 13:52:41.002730 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:40.998705 2556 generic.go:356] "Generic (PLEG): container finished" podID="de229b56-c059-4ec6-80ba-f510ad31ba18" containerID="8bb23c0e82cc7cf204c1340c27ba5736a25628c223f910b7658b7cb46d10aba8" exitCode=0 Jul 06 13:52:41.046288 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:41.046260 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kwq2b" Jul 06 13:52:41.048764 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:52:41.048738 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-j84mf\" is forbidden: User \"system:node:ip-10-0-134-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-85.ec2.internal' and this object" podUID="de229b56-c059-4ec6-80ba-f510ad31ba18" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j84mf" Jul 06 13:52:41.050814 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:52:41.050791 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kwq2b\" is forbidden: User \"system:node:ip-10-0-134-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-85.ec2.internal' and this object" podUID="5942a7c5-f0d8-4032-a33d-96e19fa901e7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kwq2b" Jul 06 13:52:41.053288 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:41.053266 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftcz4\" (UniqueName: \"kubernetes.io/projected/1180bab7-a800-45b1-9bdc-05b7c8a4e54c-kube-api-access-ftcz4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7td77\" (UID: \"1180bab7-a800-45b1-9bdc-05b7c8a4e54c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7td77" Jul 06 13:52:41.053374 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:41.053328 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1180bab7-a800-45b1-9bdc-05b7c8a4e54c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7td77\" (UID: \"1180bab7-a800-45b1-9bdc-05b7c8a4e54c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7td77" Jul 06 13:52:41.053427 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:41.053404 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clld8\" (UniqueName: \"kubernetes.io/projected/9ad0bc2e-6cec-498f-a48f-bfe5dd1e6ca3-kube-api-access-clld8\") pod \"limitador-operator-controller-manager-859d7b78bd-sbw4q\" (UID: \"9ad0bc2e-6cec-498f-a48f-bfe5dd1e6ca3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sbw4q" Jul 06 13:52:41.053774 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:41.053753 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1180bab7-a800-45b1-9bdc-05b7c8a4e54c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7td77\" (UID: \"1180bab7-a800-45b1-9bdc-05b7c8a4e54c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7td77" Jul 06 13:52:41.060256 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:41.060238 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j84mf" Jul 06 13:52:41.062812 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:52:41.062783 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-j84mf\" is forbidden: User \"system:node:ip-10-0-134-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-85.ec2.internal' and this object" podUID="de229b56-c059-4ec6-80ba-f510ad31ba18" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j84mf" Jul 06 13:52:41.064984 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:52:41.064961 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kwq2b\" is forbidden: User \"system:node:ip-10-0-134-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-85.ec2.internal' and this object" podUID="5942a7c5-f0d8-4032-a33d-96e19fa901e7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kwq2b" Jul 06 13:52:41.070557 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:41.070504 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftcz4\" (UniqueName: \"kubernetes.io/projected/1180bab7-a800-45b1-9bdc-05b7c8a4e54c-kube-api-access-ftcz4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7td77\" (UID: \"1180bab7-a800-45b1-9bdc-05b7c8a4e54c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7td77" Jul 06 13:52:41.070557 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:41.070513 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clld8\" (UniqueName: \"kubernetes.io/projected/9ad0bc2e-6cec-498f-a48f-bfe5dd1e6ca3-kube-api-access-clld8\") pod \"limitador-operator-controller-manager-859d7b78bd-sbw4q\" (UID: \"9ad0bc2e-6cec-498f-a48f-bfe5dd1e6ca3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sbw4q" Jul 06 13:52:41.154104 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:41.154084 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nhmvk\" (UniqueName: \"kubernetes.io/projected/5942a7c5-f0d8-4032-a33d-96e19fa901e7-kube-api-access-nhmvk\") pod \"5942a7c5-f0d8-4032-a33d-96e19fa901e7\" (UID: \"5942a7c5-f0d8-4032-a33d-96e19fa901e7\") " Jul 06 13:52:41.154215 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:41.154110 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h7ktv\" (UniqueName: \"kubernetes.io/projected/de229b56-c059-4ec6-80ba-f510ad31ba18-kube-api-access-h7ktv\") pod \"de229b56-c059-4ec6-80ba-f510ad31ba18\" (UID: \"de229b56-c059-4ec6-80ba-f510ad31ba18\") " Jul 06 13:52:41.154215 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:41.154156 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5942a7c5-f0d8-4032-a33d-96e19fa901e7-extensions-socket-volume\") pod \"5942a7c5-f0d8-4032-a33d-96e19fa901e7\" (UID: \"5942a7c5-f0d8-4032-a33d-96e19fa901e7\") " Jul 06 13:52:41.154736 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:41.154713 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5942a7c5-f0d8-4032-a33d-96e19fa901e7-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5942a7c5-f0d8-4032-a33d-96e19fa901e7" (UID: "5942a7c5-f0d8-4032-a33d-96e19fa901e7"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 13:52:41.156026 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:41.156005 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de229b56-c059-4ec6-80ba-f510ad31ba18-kube-api-access-h7ktv" (OuterVolumeSpecName: "kube-api-access-h7ktv") pod "de229b56-c059-4ec6-80ba-f510ad31ba18" (UID: "de229b56-c059-4ec6-80ba-f510ad31ba18"). InnerVolumeSpecName "kube-api-access-h7ktv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 13:52:41.156109 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:41.156052 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5942a7c5-f0d8-4032-a33d-96e19fa901e7-kube-api-access-nhmvk" (OuterVolumeSpecName: "kube-api-access-nhmvk") pod "5942a7c5-f0d8-4032-a33d-96e19fa901e7" (UID: "5942a7c5-f0d8-4032-a33d-96e19fa901e7"). InnerVolumeSpecName "kube-api-access-nhmvk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 13:52:41.218376 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:41.218351 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7td77" Jul 06 13:52:41.225095 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:41.225073 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sbw4q" Jul 06 13:52:41.255559 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:41.255522 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nhmvk\" (UniqueName: \"kubernetes.io/projected/5942a7c5-f0d8-4032-a33d-96e19fa901e7-kube-api-access-nhmvk\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:52:41.255708 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:41.255564 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7ktv\" (UniqueName: \"kubernetes.io/projected/de229b56-c059-4ec6-80ba-f510ad31ba18-kube-api-access-h7ktv\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:52:41.255708 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:41.255582 2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5942a7c5-f0d8-4032-a33d-96e19fa901e7-extensions-socket-volume\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:52:41.368990 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:41.368961 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7td77"] Jul 06 13:52:41.370709 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:52:41.370685 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1180bab7_a800_45b1_9bdc_05b7c8a4e54c.slice/crio-b01a5e2a100453d47a20d5b73cdbf959f48b93dbe24c9cb7a33ceb9320c4e883 WatchSource:0}: Error finding container b01a5e2a100453d47a20d5b73cdbf959f48b93dbe24c9cb7a33ceb9320c4e883: Status 404 returned error can't find the container with id b01a5e2a100453d47a20d5b73cdbf959f48b93dbe24c9cb7a33ceb9320c4e883 Jul 06 13:52:41.381998 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:41.381976 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sbw4q"] Jul 06 13:52:41.385189 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:52:41.385166 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ad0bc2e_6cec_498f_a48f_bfe5dd1e6ca3.slice/crio-47dfc71b36016397d2e3b67172eab61f4d3922de26521bd3a22cf37b02baa263 WatchSource:0}: Error finding container 47dfc71b36016397d2e3b67172eab61f4d3922de26521bd3a22cf37b02baa263: Status 404 returned error can't find the container with id 47dfc71b36016397d2e3b67172eab61f4d3922de26521bd3a22cf37b02baa263 Jul 06 13:52:41.929819 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:41.929792 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-g6mnj" Jul 06 13:52:41.932352 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:52:41.932326 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-j84mf\" is forbidden: User \"system:node:ip-10-0-134-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-85.ec2.internal' and this object" podUID="de229b56-c059-4ec6-80ba-f510ad31ba18" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j84mf" Jul 06 13:52:41.955807 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:52:41.955778 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kwq2b\" is forbidden: User \"system:node:ip-10-0-134-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-85.ec2.internal' and this object" podUID="5942a7c5-f0d8-4032-a33d-96e19fa901e7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kwq2b" Jul 06 13:52:42.006346 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:42.006323 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j84mf" Jul 06 13:52:42.006498 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:42.006384 2556 scope.go:117] "RemoveContainer" containerID="8bb23c0e82cc7cf204c1340c27ba5736a25628c223f910b7658b7cb46d10aba8" Jul 06 13:52:42.008079 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:42.008058 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kwq2b" Jul 06 13:52:42.009310 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:52:42.009234 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-j84mf\" is forbidden: User \"system:node:ip-10-0-134-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-85.ec2.internal' and this object" podUID="de229b56-c059-4ec6-80ba-f510ad31ba18" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j84mf" Jul 06 13:52:42.010124 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:42.010099 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7td77" event={"ID":"1180bab7-a800-45b1-9bdc-05b7c8a4e54c","Type":"ContainerStarted","Data":"7fcb4e2077963576ecf9b3d138cb36fad72a859b0130782482de764bd481a341"} Jul 06 13:52:42.010215 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:42.010150 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7td77" event={"ID":"1180bab7-a800-45b1-9bdc-05b7c8a4e54c","Type":"ContainerStarted","Data":"b01a5e2a100453d47a20d5b73cdbf959f48b93dbe24c9cb7a33ceb9320c4e883"} Jul 06 13:52:42.010285 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:42.010181 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7td77" Jul 06 13:52:42.011996 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:52:42.011770 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kwq2b\" is forbidden: User \"system:node:ip-10-0-134-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-85.ec2.internal' and this object" podUID="5942a7c5-f0d8-4032-a33d-96e19fa901e7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kwq2b" Jul 06 13:52:42.012198 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:42.012176 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sbw4q" event={"ID":"9ad0bc2e-6cec-498f-a48f-bfe5dd1e6ca3","Type":"ContainerStarted","Data":"c8064316b1946673cfb80cfa7c87d0a5cb3962f8168a40a9b25b92d7d21cab11"} Jul 06 13:52:42.012287 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:42.012224 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sbw4q" event={"ID":"9ad0bc2e-6cec-498f-a48f-bfe5dd1e6ca3","Type":"ContainerStarted","Data":"47dfc71b36016397d2e3b67172eab61f4d3922de26521bd3a22cf37b02baa263"} Jul 06 13:52:42.012287 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:42.012256 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sbw4q" Jul 06 13:52:42.017075 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:42.017055 2556 scope.go:117] "RemoveContainer" containerID="768813959c424e12a924b4093af5dc9ede958c6498fa731927bab6532a26e46f" Jul 06 13:52:42.035057 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:42.035010 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7td77" podStartSLOduration=2.034997592 podStartE2EDuration="2.034997592s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:52:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:52:42.033665946 +0000 UTC m=+455.833411640" watchObservedRunningTime="2026-07-06 13:52:42.034997592 +0000 UTC m=+455.834743286" Jul 06 13:52:42.036290 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:52:42.036266 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-j84mf\" is forbidden: User \"system:node:ip-10-0-134-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-85.ec2.internal' and this object" podUID="de229b56-c059-4ec6-80ba-f510ad31ba18" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j84mf" Jul 06 13:52:42.038536 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:52:42.038515 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kwq2b\" is forbidden: User \"system:node:ip-10-0-134-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-85.ec2.internal' and this object" podUID="5942a7c5-f0d8-4032-a33d-96e19fa901e7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kwq2b" Jul 06 13:52:42.040872 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:52:42.040850 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-j84mf\" is forbidden: User \"system:node:ip-10-0-134-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-85.ec2.internal' and this object" podUID="de229b56-c059-4ec6-80ba-f510ad31ba18" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j84mf" Jul 06 13:52:42.060891 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:42.060820 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sbw4q" podStartSLOduration=2.060806528 podStartE2EDuration="2.060806528s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:52:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:52:42.05885733 +0000 UTC m=+455.858603028" watchObservedRunningTime="2026-07-06 13:52:42.060806528 +0000 UTC m=+455.860552221" Jul 06 13:52:42.061217 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:52:42.061195 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kwq2b\" is forbidden: User \"system:node:ip-10-0-134-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-85.ec2.internal' and this object" podUID="5942a7c5-f0d8-4032-a33d-96e19fa901e7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kwq2b" Jul 06 13:52:42.787595 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:42.787561 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5942a7c5-f0d8-4032-a33d-96e19fa901e7" path="/var/lib/kubelet/pods/5942a7c5-f0d8-4032-a33d-96e19fa901e7/volumes" Jul 06 13:52:42.787908 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:42.787894 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de229b56-c059-4ec6-80ba-f510ad31ba18" path="/var/lib/kubelet/pods/de229b56-c059-4ec6-80ba-f510ad31ba18/volumes" Jul 06 13:52:45.341260 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:45.341228 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:52:45.440282 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:45.440258 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:52:47.771439 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:47.771408 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:52:47.873777 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:47.873747 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:52:49.148285 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:49.148247 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:52:49.250518 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:49.250485 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:52:53.022504 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:53.022473 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7td77" Jul 06 13:52:53.022920 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:53.022544 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sbw4q" Jul 06 13:52:53.542857 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:53.542820 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:52:53.648799 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:52:53.648765 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:53:01.331284 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:01.331246 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:53:01.431887 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:01.431843 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:53:05.737294 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:05.737260 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:53:05.839810 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:05.839778 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:53:08.192505 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:08.192465 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:53:08.270375 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:08.270341 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:53:10.969693 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:10.969662 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7td77"] Jul 06 13:53:10.970173 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:10.969897 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7td77" podUID="1180bab7-a800-45b1-9bdc-05b7c8a4e54c" containerName="manager" containerID="cri-o://7fcb4e2077963576ecf9b3d138cb36fad72a859b0130782482de764bd481a341" gracePeriod=10 Jul 06 13:53:11.180313 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:11.180281 2556 generic.go:356] "Generic (PLEG): container finished" podID="1180bab7-a800-45b1-9bdc-05b7c8a4e54c" containerID="7fcb4e2077963576ecf9b3d138cb36fad72a859b0130782482de764bd481a341" exitCode=0 Jul 06 13:53:11.180450 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:11.180349 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7td77" event={"ID":"1180bab7-a800-45b1-9bdc-05b7c8a4e54c","Type":"ContainerDied","Data":"7fcb4e2077963576ecf9b3d138cb36fad72a859b0130782482de764bd481a341"} Jul 06 13:53:11.217152 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:11.217130 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7td77" Jul 06 13:53:11.298635 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:11.298599 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1180bab7-a800-45b1-9bdc-05b7c8a4e54c-extensions-socket-volume\") pod \"1180bab7-a800-45b1-9bdc-05b7c8a4e54c\" (UID: \"1180bab7-a800-45b1-9bdc-05b7c8a4e54c\") " Jul 06 13:53:11.298760 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:11.298695 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ftcz4\" (UniqueName: \"kubernetes.io/projected/1180bab7-a800-45b1-9bdc-05b7c8a4e54c-kube-api-access-ftcz4\") pod \"1180bab7-a800-45b1-9bdc-05b7c8a4e54c\" (UID: \"1180bab7-a800-45b1-9bdc-05b7c8a4e54c\") " Jul 06 13:53:11.298986 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:11.298967 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1180bab7-a800-45b1-9bdc-05b7c8a4e54c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1180bab7-a800-45b1-9bdc-05b7c8a4e54c" (UID: "1180bab7-a800-45b1-9bdc-05b7c8a4e54c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 13:53:11.300581 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:11.300560 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1180bab7-a800-45b1-9bdc-05b7c8a4e54c-kube-api-access-ftcz4" (OuterVolumeSpecName: "kube-api-access-ftcz4") pod "1180bab7-a800-45b1-9bdc-05b7c8a4e54c" (UID: "1180bab7-a800-45b1-9bdc-05b7c8a4e54c"). InnerVolumeSpecName "kube-api-access-ftcz4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 13:53:11.399705 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:11.399678 2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1180bab7-a800-45b1-9bdc-05b7c8a4e54c-extensions-socket-volume\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:53:11.399705 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:11.399703 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ftcz4\" (UniqueName: \"kubernetes.io/projected/1180bab7-a800-45b1-9bdc-05b7c8a4e54c-kube-api-access-ftcz4\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:53:12.187258 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:12.187228 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7td77" Jul 06 13:53:12.187695 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:12.187256 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7td77" event={"ID":"1180bab7-a800-45b1-9bdc-05b7c8a4e54c","Type":"ContainerDied","Data":"b01a5e2a100453d47a20d5b73cdbf959f48b93dbe24c9cb7a33ceb9320c4e883"} Jul 06 13:53:12.187695 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:12.187315 2556 scope.go:117] "RemoveContainer" containerID="7fcb4e2077963576ecf9b3d138cb36fad72a859b0130782482de764bd481a341" Jul 06 13:53:12.210208 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:12.210185 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7td77"] Jul 06 13:53:12.217704 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:12.217684 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7td77"] Jul 06 13:53:12.787171 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:12.787128 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1180bab7-a800-45b1-9bdc-05b7c8a4e54c" path="/var/lib/kubelet/pods/1180bab7-a800-45b1-9bdc-05b7c8a4e54c/volumes" Jul 06 13:53:27.344260 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:27.344224 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-q6bld"] Jul 06 13:53:27.344886 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:27.344868 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1180bab7-a800-45b1-9bdc-05b7c8a4e54c" containerName="manager" Jul 06 13:53:27.344980 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:27.344889 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="1180bab7-a800-45b1-9bdc-05b7c8a4e54c" containerName="manager" Jul 06 13:53:27.344980 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:27.344969 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="1180bab7-a800-45b1-9bdc-05b7c8a4e54c" containerName="manager" Jul 06 13:53:27.348485 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:27.348465 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-q6bld" Jul 06 13:53:27.351275 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:27.351255 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-jlvhp\"" Jul 06 13:53:27.358859 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:27.358839 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-q6bld"] Jul 06 13:53:27.368672 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:27.368650 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:53:27.436685 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:27.436649 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45390162-0f47-46a4-9bf1-513488ce5c95-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-q6bld\" (UID: \"45390162-0f47-46a4-9bf1-513488ce5c95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-q6bld" Jul 06 13:53:27.436860 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:27.436708 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4g2r\" (UniqueName: \"kubernetes.io/projected/45390162-0f47-46a4-9bf1-513488ce5c95-kube-api-access-s4g2r\") pod \"maas-default-gateway-openshift-default-5896d4dd49-q6bld\" (UID: \"45390162-0f47-46a4-9bf1-513488ce5c95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-q6bld" Jul 06 13:53:27.436860 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:27.436749 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/45390162-0f47-46a4-9bf1-513488ce5c95-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-q6bld\" (UID: \"45390162-0f47-46a4-9bf1-513488ce5c95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-q6bld" Jul 06 13:53:27.436860 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:27.436787 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/45390162-0f47-46a4-9bf1-513488ce5c95-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-q6bld\" (UID: \"45390162-0f47-46a4-9bf1-513488ce5c95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-q6bld" Jul 06 13:53:27.436860 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:27.436808 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/45390162-0f47-46a4-9bf1-513488ce5c95-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-q6bld\" (UID: \"45390162-0f47-46a4-9bf1-513488ce5c95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-q6bld" Jul 06 13:53:27.436860 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:27.436829 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/45390162-0f47-46a4-9bf1-513488ce5c95-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-q6bld\" (UID: \"45390162-0f47-46a4-9bf1-513488ce5c95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-q6bld" Jul 06 13:53:27.437057 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:27.436898 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/45390162-0f47-46a4-9bf1-513488ce5c95-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-q6bld\" (UID: \"45390162-0f47-46a4-9bf1-513488ce5c95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-q6bld" Jul 06 13:53:27.437057 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:27.436947 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/45390162-0f47-46a4-9bf1-513488ce5c95-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-q6bld\" (UID: \"45390162-0f47-46a4-9bf1-513488ce5c95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-q6bld" Jul 06 13:53:27.437057 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:27.437032 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/45390162-0f47-46a4-9bf1-513488ce5c95-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-q6bld\" (UID: \"45390162-0f47-46a4-9bf1-513488ce5c95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-q6bld" Jul 06 13:53:27.538375 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:27.538340 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/45390162-0f47-46a4-9bf1-513488ce5c95-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-q6bld\" (UID: \"45390162-0f47-46a4-9bf1-513488ce5c95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-q6bld" Jul 06 13:53:27.538375 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:27.538377 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/45390162-0f47-46a4-9bf1-513488ce5c95-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-q6bld\" (UID: \"45390162-0f47-46a4-9bf1-513488ce5c95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-q6bld" Jul 06 13:53:27.538593 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:27.538408 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/45390162-0f47-46a4-9bf1-513488ce5c95-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-q6bld\" (UID: \"45390162-0f47-46a4-9bf1-513488ce5c95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-q6bld" Jul 06 13:53:27.538593 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:27.538433 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45390162-0f47-46a4-9bf1-513488ce5c95-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-q6bld\" (UID: \"45390162-0f47-46a4-9bf1-513488ce5c95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-q6bld" Jul 06 13:53:27.538593 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:27.538463 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4g2r\" (UniqueName: \"kubernetes.io/projected/45390162-0f47-46a4-9bf1-513488ce5c95-kube-api-access-s4g2r\") pod \"maas-default-gateway-openshift-default-5896d4dd49-q6bld\" (UID: \"45390162-0f47-46a4-9bf1-513488ce5c95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-q6bld" Jul 06 13:53:27.538593 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:27.538486 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/45390162-0f47-46a4-9bf1-513488ce5c95-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-q6bld\" (UID: \"45390162-0f47-46a4-9bf1-513488ce5c95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-q6bld" Jul 06 13:53:27.538847 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:27.538691 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/45390162-0f47-46a4-9bf1-513488ce5c95-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-q6bld\" (UID: \"45390162-0f47-46a4-9bf1-513488ce5c95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-q6bld" Jul 06 13:53:27.538847 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:27.538761 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/45390162-0f47-46a4-9bf1-513488ce5c95-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-q6bld\" (UID: \"45390162-0f47-46a4-9bf1-513488ce5c95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-q6bld" Jul 06 13:53:27.538847 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:27.538784 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/45390162-0f47-46a4-9bf1-513488ce5c95-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-q6bld\" (UID: \"45390162-0f47-46a4-9bf1-513488ce5c95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-q6bld" Jul 06 13:53:27.538847 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:27.538819 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/45390162-0f47-46a4-9bf1-513488ce5c95-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-q6bld\" (UID: \"45390162-0f47-46a4-9bf1-513488ce5c95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-q6bld" Jul 06 13:53:27.539034 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:27.538920 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/45390162-0f47-46a4-9bf1-513488ce5c95-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-q6bld\" (UID: \"45390162-0f47-46a4-9bf1-513488ce5c95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-q6bld" Jul 06 13:53:27.539070 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:27.539036 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/45390162-0f47-46a4-9bf1-513488ce5c95-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-q6bld\" (UID: \"45390162-0f47-46a4-9bf1-513488ce5c95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-q6bld" Jul 06 13:53:27.539114 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:27.539094 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/45390162-0f47-46a4-9bf1-513488ce5c95-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-q6bld\" (UID: \"45390162-0f47-46a4-9bf1-513488ce5c95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-q6bld" Jul 06 13:53:27.539152 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:27.539142 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/45390162-0f47-46a4-9bf1-513488ce5c95-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-q6bld\" (UID: \"45390162-0f47-46a4-9bf1-513488ce5c95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-q6bld" Jul 06 13:53:27.541040 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:27.541013 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/45390162-0f47-46a4-9bf1-513488ce5c95-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-q6bld\" (UID: \"45390162-0f47-46a4-9bf1-513488ce5c95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-q6bld" Jul 06 13:53:27.541435 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:27.541420 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/45390162-0f47-46a4-9bf1-513488ce5c95-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-q6bld\" (UID: \"45390162-0f47-46a4-9bf1-513488ce5c95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-q6bld" Jul 06 13:53:27.547165 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:27.547145 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4g2r\" (UniqueName: \"kubernetes.io/projected/45390162-0f47-46a4-9bf1-513488ce5c95-kube-api-access-s4g2r\") pod \"maas-default-gateway-openshift-default-5896d4dd49-q6bld\" (UID: \"45390162-0f47-46a4-9bf1-513488ce5c95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-q6bld" Jul 06 13:53:27.547705 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:27.547685 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45390162-0f47-46a4-9bf1-513488ce5c95-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-q6bld\" (UID: \"45390162-0f47-46a4-9bf1-513488ce5c95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-q6bld" Jul 06 13:53:27.576472 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:27.576433 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:53:27.661755 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:27.661677 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-q6bld" Jul 06 13:53:27.797288 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:27.797262 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-q6bld"] Jul 06 13:53:27.798638 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:53:27.798592 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45390162_0f47_46a4_9bf1_513488ce5c95.slice/crio-960f2d411d5418a7c1b4d4ea574c1cd541894765cc5f0a59db2a3ba47da8b767 WatchSource:0}: Error finding container 960f2d411d5418a7c1b4d4ea574c1cd541894765cc5f0a59db2a3ba47da8b767: Status 404 returned error can't find the container with id 960f2d411d5418a7c1b4d4ea574c1cd541894765cc5f0a59db2a3ba47da8b767 Jul 06 13:53:27.800672 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:27.800644 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 13:53:27.800751 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:27.800709 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 13:53:27.800751 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:27.800745 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 13:53:28.284182 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:28.284141 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-q6bld" event={"ID":"45390162-0f47-46a4-9bf1-513488ce5c95","Type":"ContainerStarted","Data":"5ae4947708e6e99a7104723682118f3ed2c9fc4a3325c0046ef975cddba41499"} Jul 06 13:53:28.284353 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:28.284209 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-q6bld" event={"ID":"45390162-0f47-46a4-9bf1-513488ce5c95","Type":"ContainerStarted","Data":"960f2d411d5418a7c1b4d4ea574c1cd541894765cc5f0a59db2a3ba47da8b767"} Jul 06 13:53:28.307376 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:28.307328 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-q6bld" podStartSLOduration=1.307312401 podStartE2EDuration="1.307312401s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:53:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:53:28.305573512 +0000 UTC m=+502.105319203" watchObservedRunningTime="2026-07-06 13:53:28.307312401 +0000 UTC m=+502.107058088" Jul 06 13:53:28.662607 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:28.662528 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-q6bld" Jul 06 13:53:28.667456 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:28.667431 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-q6bld" Jul 06 13:53:29.296934 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:29.296904 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-q6bld" Jul 06 13:53:29.297745 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:29.297722 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-q6bld" Jul 06 13:53:29.311383 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:29.311361 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4wh4z"] Jul 06 13:53:29.313902 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:29.313888 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-4wh4z" Jul 06 13:53:29.316713 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:29.316692 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 06 13:53:29.316824 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:29.316803 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-nhp6c\"" Jul 06 13:53:29.318085 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:29.318064 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:53:29.322477 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:29.322456 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4wh4z"] Jul 06 13:53:29.410276 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:29.410246 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4wh4z"] Jul 06 13:53:29.412059 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:29.412024 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:53:29.454938 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:29.454904 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-442s8\" (UniqueName: \"kubernetes.io/projected/514b6c06-9d4c-4708-82b7-b2ec8e2bbbdb-kube-api-access-442s8\") pod \"limitador-limitador-64c94fd64f-4wh4z\" (UID: \"514b6c06-9d4c-4708-82b7-b2ec8e2bbbdb\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4wh4z" Jul 06 13:53:29.455112 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:29.454975 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/514b6c06-9d4c-4708-82b7-b2ec8e2bbbdb-config-file\") pod \"limitador-limitador-64c94fd64f-4wh4z\" (UID: \"514b6c06-9d4c-4708-82b7-b2ec8e2bbbdb\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4wh4z" Jul 06 13:53:29.466225 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:29.466193 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:53:29.556005 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:29.555934 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-442s8\" (UniqueName: \"kubernetes.io/projected/514b6c06-9d4c-4708-82b7-b2ec8e2bbbdb-kube-api-access-442s8\") pod \"limitador-limitador-64c94fd64f-4wh4z\" (UID: \"514b6c06-9d4c-4708-82b7-b2ec8e2bbbdb\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4wh4z" Jul 06 13:53:29.556005 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:29.555979 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/514b6c06-9d4c-4708-82b7-b2ec8e2bbbdb-config-file\") pod \"limitador-limitador-64c94fd64f-4wh4z\" (UID: \"514b6c06-9d4c-4708-82b7-b2ec8e2bbbdb\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4wh4z" Jul 06 13:53:29.556674 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:29.556650 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/514b6c06-9d4c-4708-82b7-b2ec8e2bbbdb-config-file\") pod \"limitador-limitador-64c94fd64f-4wh4z\" (UID: \"514b6c06-9d4c-4708-82b7-b2ec8e2bbbdb\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4wh4z" Jul 06 13:53:29.564407 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:29.564384 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-442s8\" (UniqueName: \"kubernetes.io/projected/514b6c06-9d4c-4708-82b7-b2ec8e2bbbdb-kube-api-access-442s8\") pod \"limitador-limitador-64c94fd64f-4wh4z\" (UID: \"514b6c06-9d4c-4708-82b7-b2ec8e2bbbdb\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4wh4z" Jul 06 13:53:29.626305 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:29.626279 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-4wh4z" Jul 06 13:53:29.759025 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:29.759001 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4wh4z"] Jul 06 13:53:29.760852 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:53:29.760828 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod514b6c06_9d4c_4708_82b7_b2ec8e2bbbdb.slice/crio-9d764fb8178d94c458cc2a3edfb861d480d658ecdf492dc1e2d7415db1aa3cce WatchSource:0}: Error finding container 9d764fb8178d94c458cc2a3edfb861d480d658ecdf492dc1e2d7415db1aa3cce: Status 404 returned error can't find the container with id 9d764fb8178d94c458cc2a3edfb861d480d658ecdf492dc1e2d7415db1aa3cce Jul 06 13:53:30.164480 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:30.164446 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-mmtrf"] Jul 06 13:53:30.167844 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:30.167828 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-mmtrf" Jul 06 13:53:30.170468 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:30.170450 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-4tc5b\"" Jul 06 13:53:30.174703 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:30.174682 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-mmtrf"] Jul 06 13:53:30.192662 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:30.192637 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:53:30.247545 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:30.247520 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:53:30.261023 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:30.261004 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzf4q\" (UniqueName: \"kubernetes.io/projected/f1e781ea-8929-46f9-916e-037af685a83f-kube-api-access-kzf4q\") pod \"authorino-58cd955675-mmtrf\" (UID: \"f1e781ea-8929-46f9-916e-037af685a83f\") " pod="kuadrant-system/authorino-58cd955675-mmtrf" Jul 06 13:53:30.304807 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:30.304783 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-4wh4z" event={"ID":"514b6c06-9d4c-4708-82b7-b2ec8e2bbbdb","Type":"ContainerStarted","Data":"9d764fb8178d94c458cc2a3edfb861d480d658ecdf492dc1e2d7415db1aa3cce"} Jul 06 13:53:30.362168 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:30.362143 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzf4q\" (UniqueName: \"kubernetes.io/projected/f1e781ea-8929-46f9-916e-037af685a83f-kube-api-access-kzf4q\") pod \"authorino-58cd955675-mmtrf\" (UID: \"f1e781ea-8929-46f9-916e-037af685a83f\") " pod="kuadrant-system/authorino-58cd955675-mmtrf" Jul 06 13:53:30.370718 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:30.370694 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzf4q\" (UniqueName: \"kubernetes.io/projected/f1e781ea-8929-46f9-916e-037af685a83f-kube-api-access-kzf4q\") pod \"authorino-58cd955675-mmtrf\" (UID: \"f1e781ea-8929-46f9-916e-037af685a83f\") " pod="kuadrant-system/authorino-58cd955675-mmtrf" Jul 06 13:53:30.478763 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:30.478708 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-mmtrf" Jul 06 13:53:30.635921 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:30.635887 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-mmtrf"] Jul 06 13:53:31.317387 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:31.317352 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-mmtrf" event={"ID":"f1e781ea-8929-46f9-916e-037af685a83f","Type":"ContainerStarted","Data":"a929fae3a171da24adc7f1dc64904384cc83afac21379a9bb8b9794af71fe6c4"} Jul 06 13:53:34.112723 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:34.112689 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-mmtrf"] Jul 06 13:53:35.344599 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:35.344555 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-mmtrf" event={"ID":"f1e781ea-8929-46f9-916e-037af685a83f","Type":"ContainerStarted","Data":"0fad80f2c6b92e3f9e8a3b7a66e19a4fb7d7d3a29513e6633d4ba0172e4e6a70"} Jul 06 13:53:35.345089 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:35.344638 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-mmtrf" podUID="f1e781ea-8929-46f9-916e-037af685a83f" containerName="authorino" containerID="cri-o://0fad80f2c6b92e3f9e8a3b7a66e19a4fb7d7d3a29513e6633d4ba0172e4e6a70" gracePeriod=30 Jul 06 13:53:35.346312 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:35.346286 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-4wh4z" event={"ID":"514b6c06-9d4c-4708-82b7-b2ec8e2bbbdb","Type":"ContainerStarted","Data":"268f1bb72154d37f7ca9fac6683bfcca1d2ba8b431fdc191e9664725380c0d42"} Jul 06 13:53:35.346452 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:35.346419 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-4wh4z" Jul 06 13:53:35.362451 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:35.362408 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-mmtrf" podStartSLOduration=1.477763837 podStartE2EDuration="5.362392852s" totalImagesPullingTime="3.884629015s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:53:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:53:35.360167349 +0000 UTC m=+509.159913044" watchObservedRunningTime="2026-07-06 13:53:35.362392852 +0000 UTC m=+509.162138545" Jul 06 13:53:35.377291 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:35.377254 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-4wh4z" podStartSLOduration=1.613632221 podStartE2EDuration="6.377240204s" totalImagesPullingTime="4.763607983s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:53:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:53:35.37589435 +0000 UTC m=+509.175640043" watchObservedRunningTime="2026-07-06 13:53:35.377240204 +0000 UTC m=+509.176985896" Jul 06 13:53:35.588817 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:35.588795 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-mmtrf" Jul 06 13:53:35.713500 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:35.713431 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kzf4q\" (UniqueName: \"kubernetes.io/projected/f1e781ea-8929-46f9-916e-037af685a83f-kube-api-access-kzf4q\") pod \"f1e781ea-8929-46f9-916e-037af685a83f\" (UID: \"f1e781ea-8929-46f9-916e-037af685a83f\") " Jul 06 13:53:35.715401 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:35.715361 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1e781ea-8929-46f9-916e-037af685a83f-kube-api-access-kzf4q" (OuterVolumeSpecName: "kube-api-access-kzf4q") pod "f1e781ea-8929-46f9-916e-037af685a83f" (UID: "f1e781ea-8929-46f9-916e-037af685a83f"). InnerVolumeSpecName "kube-api-access-kzf4q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 13:53:35.814940 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:35.814915 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kzf4q\" (UniqueName: \"kubernetes.io/projected/f1e781ea-8929-46f9-916e-037af685a83f-kube-api-access-kzf4q\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:53:36.353424 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:36.353387 2556 generic.go:356] "Generic (PLEG): container finished" podID="f1e781ea-8929-46f9-916e-037af685a83f" containerID="0fad80f2c6b92e3f9e8a3b7a66e19a4fb7d7d3a29513e6633d4ba0172e4e6a70" exitCode=0 Jul 06 13:53:36.353424 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:36.353425 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-mmtrf" Jul 06 13:53:36.353913 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:36.353462 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-mmtrf" event={"ID":"f1e781ea-8929-46f9-916e-037af685a83f","Type":"ContainerDied","Data":"0fad80f2c6b92e3f9e8a3b7a66e19a4fb7d7d3a29513e6633d4ba0172e4e6a70"} Jul 06 13:53:36.353913 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:36.353501 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-mmtrf" event={"ID":"f1e781ea-8929-46f9-916e-037af685a83f","Type":"ContainerDied","Data":"a929fae3a171da24adc7f1dc64904384cc83afac21379a9bb8b9794af71fe6c4"} Jul 06 13:53:36.353913 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:36.353519 2556 scope.go:117] "RemoveContainer" containerID="0fad80f2c6b92e3f9e8a3b7a66e19a4fb7d7d3a29513e6633d4ba0172e4e6a70" Jul 06 13:53:36.363362 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:36.363347 2556 scope.go:117] "RemoveContainer" containerID="0fad80f2c6b92e3f9e8a3b7a66e19a4fb7d7d3a29513e6633d4ba0172e4e6a70" Jul 06 13:53:36.363636 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:53:36.363597 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0fad80f2c6b92e3f9e8a3b7a66e19a4fb7d7d3a29513e6633d4ba0172e4e6a70\": container with ID starting with 0fad80f2c6b92e3f9e8a3b7a66e19a4fb7d7d3a29513e6633d4ba0172e4e6a70 not found: ID does not exist" containerID="0fad80f2c6b92e3f9e8a3b7a66e19a4fb7d7d3a29513e6633d4ba0172e4e6a70" Jul 06 13:53:36.363693 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:36.363643 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fad80f2c6b92e3f9e8a3b7a66e19a4fb7d7d3a29513e6633d4ba0172e4e6a70"} err="failed to get container status \"0fad80f2c6b92e3f9e8a3b7a66e19a4fb7d7d3a29513e6633d4ba0172e4e6a70\": rpc error: code = NotFound desc = could not find container \"0fad80f2c6b92e3f9e8a3b7a66e19a4fb7d7d3a29513e6633d4ba0172e4e6a70\": container with ID starting with 0fad80f2c6b92e3f9e8a3b7a66e19a4fb7d7d3a29513e6633d4ba0172e4e6a70 not found: ID does not exist" Jul 06 13:53:36.375042 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:36.375020 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-mmtrf"] Jul 06 13:53:36.377334 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:36.377316 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-mmtrf"] Jul 06 13:53:36.788156 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:36.788119 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1e781ea-8929-46f9-916e-037af685a83f" path="/var/lib/kubelet/pods/f1e781ea-8929-46f9-916e-037af685a83f/volumes" Jul 06 13:53:44.406350 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:44.406309 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4wh4z"] Jul 06 13:53:44.406856 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:44.406522 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-4wh4z" podUID="514b6c06-9d4c-4708-82b7-b2ec8e2bbbdb" containerName="limitador" containerID="cri-o://268f1bb72154d37f7ca9fac6683bfcca1d2ba8b431fdc191e9664725380c0d42" gracePeriod=30 Jul 06 13:53:44.407177 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:44.407159 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-4wh4z" Jul 06 13:53:44.951525 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:44.951494 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-4wh4z" Jul 06 13:53:45.095461 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:45.095431 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-442s8\" (UniqueName: \"kubernetes.io/projected/514b6c06-9d4c-4708-82b7-b2ec8e2bbbdb-kube-api-access-442s8\") pod \"514b6c06-9d4c-4708-82b7-b2ec8e2bbbdb\" (UID: \"514b6c06-9d4c-4708-82b7-b2ec8e2bbbdb\") " Jul 06 13:53:45.095654 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:45.095466 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/514b6c06-9d4c-4708-82b7-b2ec8e2bbbdb-config-file\") pod \"514b6c06-9d4c-4708-82b7-b2ec8e2bbbdb\" (UID: \"514b6c06-9d4c-4708-82b7-b2ec8e2bbbdb\") " Jul 06 13:53:45.095859 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:45.095839 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/514b6c06-9d4c-4708-82b7-b2ec8e2bbbdb-config-file" (OuterVolumeSpecName: "config-file") pod "514b6c06-9d4c-4708-82b7-b2ec8e2bbbdb" (UID: "514b6c06-9d4c-4708-82b7-b2ec8e2bbbdb"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 13:53:45.097512 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:45.097486 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/514b6c06-9d4c-4708-82b7-b2ec8e2bbbdb-kube-api-access-442s8" (OuterVolumeSpecName: "kube-api-access-442s8") pod "514b6c06-9d4c-4708-82b7-b2ec8e2bbbdb" (UID: "514b6c06-9d4c-4708-82b7-b2ec8e2bbbdb"). InnerVolumeSpecName "kube-api-access-442s8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 13:53:45.196438 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:45.196408 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-442s8\" (UniqueName: \"kubernetes.io/projected/514b6c06-9d4c-4708-82b7-b2ec8e2bbbdb-kube-api-access-442s8\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:53:45.196438 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:45.196434 2556 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/514b6c06-9d4c-4708-82b7-b2ec8e2bbbdb-config-file\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:53:45.407949 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:45.407860 2556 generic.go:356] "Generic (PLEG): container finished" podID="514b6c06-9d4c-4708-82b7-b2ec8e2bbbdb" containerID="268f1bb72154d37f7ca9fac6683bfcca1d2ba8b431fdc191e9664725380c0d42" exitCode=0 Jul 06 13:53:45.407949 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:45.407911 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-4wh4z" Jul 06 13:53:45.407949 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:45.407918 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-4wh4z" event={"ID":"514b6c06-9d4c-4708-82b7-b2ec8e2bbbdb","Type":"ContainerDied","Data":"268f1bb72154d37f7ca9fac6683bfcca1d2ba8b431fdc191e9664725380c0d42"} Jul 06 13:53:45.408483 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:45.407962 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-4wh4z" event={"ID":"514b6c06-9d4c-4708-82b7-b2ec8e2bbbdb","Type":"ContainerDied","Data":"9d764fb8178d94c458cc2a3edfb861d480d658ecdf492dc1e2d7415db1aa3cce"} Jul 06 13:53:45.408483 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:45.407983 2556 scope.go:117] "RemoveContainer" containerID="268f1bb72154d37f7ca9fac6683bfcca1d2ba8b431fdc191e9664725380c0d42" Jul 06 13:53:45.421397 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:45.421378 2556 scope.go:117] "RemoveContainer" containerID="268f1bb72154d37f7ca9fac6683bfcca1d2ba8b431fdc191e9664725380c0d42" Jul 06 13:53:45.421659 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:53:45.421642 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"268f1bb72154d37f7ca9fac6683bfcca1d2ba8b431fdc191e9664725380c0d42\": container with ID starting with 268f1bb72154d37f7ca9fac6683bfcca1d2ba8b431fdc191e9664725380c0d42 not found: ID does not exist" containerID="268f1bb72154d37f7ca9fac6683bfcca1d2ba8b431fdc191e9664725380c0d42" Jul 06 13:53:45.421698 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:45.421667 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"268f1bb72154d37f7ca9fac6683bfcca1d2ba8b431fdc191e9664725380c0d42"} err="failed to get container status \"268f1bb72154d37f7ca9fac6683bfcca1d2ba8b431fdc191e9664725380c0d42\": rpc error: code = NotFound desc = could not find container \"268f1bb72154d37f7ca9fac6683bfcca1d2ba8b431fdc191e9664725380c0d42\": container with ID starting with 268f1bb72154d37f7ca9fac6683bfcca1d2ba8b431fdc191e9664725380c0d42 not found: ID does not exist" Jul 06 13:53:45.433187 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:45.433164 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4wh4z"] Jul 06 13:53:45.438514 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:45.438489 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4wh4z"] Jul 06 13:53:45.763117 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:45.763088 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-js52g"] Jul 06 13:53:45.763570 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:45.763549 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="514b6c06-9d4c-4708-82b7-b2ec8e2bbbdb" containerName="limitador" Jul 06 13:53:45.763570 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:45.763567 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="514b6c06-9d4c-4708-82b7-b2ec8e2bbbdb" containerName="limitador" Jul 06 13:53:45.763570 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:45.763576 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1e781ea-8929-46f9-916e-037af685a83f" containerName="authorino" Jul 06 13:53:45.763817 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:45.763581 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1e781ea-8929-46f9-916e-037af685a83f" containerName="authorino" Jul 06 13:53:45.763817 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:45.763675 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1e781ea-8929-46f9-916e-037af685a83f" containerName="authorino" Jul 06 13:53:45.763817 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:45.763684 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="514b6c06-9d4c-4708-82b7-b2ec8e2bbbdb" containerName="limitador" Jul 06 13:53:45.766893 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:45.766872 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-js52g" Jul 06 13:53:45.769561 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:45.769540 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-tmtnw\"" Jul 06 13:53:45.769561 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:45.769555 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jul 06 13:53:45.774387 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:45.774367 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-js52g"] Jul 06 13:53:45.789360 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:45.789340 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:53:45.902577 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:45.902542 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qz6fp\" (UniqueName: \"kubernetes.io/projected/215f3d1a-f8c8-4813-9f80-96003dead010-kube-api-access-qz6fp\") pod \"postgres-69fb4594cf-js52g\" (UID: \"215f3d1a-f8c8-4813-9f80-96003dead010\") " pod="opendatahub/postgres-69fb4594cf-js52g" Jul 06 13:53:45.902734 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:45.902654 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/215f3d1a-f8c8-4813-9f80-96003dead010-data\") pod \"postgres-69fb4594cf-js52g\" (UID: \"215f3d1a-f8c8-4813-9f80-96003dead010\") " pod="opendatahub/postgres-69fb4594cf-js52g" Jul 06 13:53:46.003342 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:46.003316 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qz6fp\" (UniqueName: \"kubernetes.io/projected/215f3d1a-f8c8-4813-9f80-96003dead010-kube-api-access-qz6fp\") pod \"postgres-69fb4594cf-js52g\" (UID: \"215f3d1a-f8c8-4813-9f80-96003dead010\") " pod="opendatahub/postgres-69fb4594cf-js52g" Jul 06 13:53:46.003472 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:46.003360 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/215f3d1a-f8c8-4813-9f80-96003dead010-data\") pod \"postgres-69fb4594cf-js52g\" (UID: \"215f3d1a-f8c8-4813-9f80-96003dead010\") " pod="opendatahub/postgres-69fb4594cf-js52g" Jul 06 13:53:46.003764 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:46.003748 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/215f3d1a-f8c8-4813-9f80-96003dead010-data\") pod \"postgres-69fb4594cf-js52g\" (UID: \"215f3d1a-f8c8-4813-9f80-96003dead010\") " pod="opendatahub/postgres-69fb4594cf-js52g" Jul 06 13:53:46.012987 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:46.012971 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qz6fp\" (UniqueName: \"kubernetes.io/projected/215f3d1a-f8c8-4813-9f80-96003dead010-kube-api-access-qz6fp\") pod \"postgres-69fb4594cf-js52g\" (UID: \"215f3d1a-f8c8-4813-9f80-96003dead010\") " pod="opendatahub/postgres-69fb4594cf-js52g" Jul 06 13:53:46.079809 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:46.079752 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-js52g" Jul 06 13:53:46.208507 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:46.208483 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-js52g"] Jul 06 13:53:46.210305 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:53:46.210282 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod215f3d1a_f8c8_4813_9f80_96003dead010.slice/crio-1860ce76749b61818a2aca06ddbac57c8559f6d9f279af77fab7e48b9b2c5c3b WatchSource:0}: Error finding container 1860ce76749b61818a2aca06ddbac57c8559f6d9f279af77fab7e48b9b2c5c3b: Status 404 returned error can't find the container with id 1860ce76749b61818a2aca06ddbac57c8559f6d9f279af77fab7e48b9b2c5c3b Jul 06 13:53:46.415205 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:46.415127 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-js52g" event={"ID":"215f3d1a-f8c8-4813-9f80-96003dead010","Type":"ContainerStarted","Data":"1860ce76749b61818a2aca06ddbac57c8559f6d9f279af77fab7e48b9b2c5c3b"} Jul 06 13:53:46.787564 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:46.787535 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="514b6c06-9d4c-4708-82b7-b2ec8e2bbbdb" path="/var/lib/kubelet/pods/514b6c06-9d4c-4708-82b7-b2ec8e2bbbdb/volumes" Jul 06 13:53:51.451334 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:51.451297 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-js52g" event={"ID":"215f3d1a-f8c8-4813-9f80-96003dead010","Type":"ContainerStarted","Data":"c71c72fe2290759b7554c0b8e2cfd353fb0f3cb00230dd2c1a1148dcab339308"} Jul 06 13:53:51.451726 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:51.451441 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-js52g" Jul 06 13:53:51.473985 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:51.473937 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-js52g" podStartSLOduration=1.807596132 podStartE2EDuration="6.473923533s" totalImagesPullingTime="4.666327401s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:53:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:53:51.468886511 +0000 UTC m=+525.268632216" watchObservedRunningTime="2026-07-06 13:53:51.473923533 +0000 UTC m=+525.273669226" Jul 06 13:53:53.187154 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:53.187108 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:53:57.487195 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:57.487160 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-js52g" Jul 06 13:53:57.796776 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:57.796689 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:53:57.926026 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:57.925985 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:53:58.018042 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:58.018013 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7n5fj"] Jul 06 13:53:58.025231 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:58.025211 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-7n5fj" Jul 06 13:53:58.027820 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:58.027801 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-4tc5b\"" Jul 06 13:53:58.028973 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:58.028951 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7n5fj"] Jul 06 13:53:58.120717 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:58.120651 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dx8md\" (UniqueName: \"kubernetes.io/projected/47a6c792-3135-4059-8edd-a63606d31bc5-kube-api-access-dx8md\") pod \"authorino-5d4b67c446-7n5fj\" (UID: \"47a6c792-3135-4059-8edd-a63606d31bc5\") " pod="kuadrant-system/authorino-5d4b67c446-7n5fj" Jul 06 13:53:58.197135 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:58.197096 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7n5fj"] Jul 06 13:53:58.197397 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:53:58.197378 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-dx8md], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-7n5fj" podUID="47a6c792-3135-4059-8edd-a63606d31bc5" Jul 06 13:53:58.221352 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:58.221319 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dx8md\" (UniqueName: \"kubernetes.io/projected/47a6c792-3135-4059-8edd-a63606d31bc5-kube-api-access-dx8md\") pod \"authorino-5d4b67c446-7n5fj\" (UID: \"47a6c792-3135-4059-8edd-a63606d31bc5\") " pod="kuadrant-system/authorino-5d4b67c446-7n5fj" Jul 06 13:53:58.223532 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:58.223510 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-pfx2t"] Jul 06 13:53:58.227309 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:58.227294 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-pfx2t" Jul 06 13:53:58.229881 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:58.229866 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 06 13:53:58.237248 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:58.237225 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-pfx2t"] Jul 06 13:53:58.237831 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:58.237811 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dx8md\" (UniqueName: \"kubernetes.io/projected/47a6c792-3135-4059-8edd-a63606d31bc5-kube-api-access-dx8md\") pod \"authorino-5d4b67c446-7n5fj\" (UID: \"47a6c792-3135-4059-8edd-a63606d31bc5\") " pod="kuadrant-system/authorino-5d4b67c446-7n5fj" Jul 06 13:53:58.277138 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:58.277068 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-pfx2t"] Jul 06 13:53:58.277352 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:53:58.277332 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-rdctm tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-rdctm tls-cert]: context canceled" pod="kuadrant-system/authorino-76877994-pfx2t" podUID="6a3690bc-932f-473f-a318-92351727fb02" Jul 06 13:53:58.305405 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:58.305382 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b9868b9c9-vqzvg"] Jul 06 13:53:58.309275 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:58.309257 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b9868b9c9-vqzvg" Jul 06 13:53:58.316829 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:58.316814 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b9868b9c9-vqzvg"] Jul 06 13:53:58.322490 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:58.322470 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6a3690bc-932f-473f-a318-92351727fb02-tls-cert\") pod \"authorino-76877994-pfx2t\" (UID: \"6a3690bc-932f-473f-a318-92351727fb02\") " pod="kuadrant-system/authorino-76877994-pfx2t" Jul 06 13:53:58.322577 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:58.322509 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdctm\" (UniqueName: \"kubernetes.io/projected/6a3690bc-932f-473f-a318-92351727fb02-kube-api-access-rdctm\") pod \"authorino-76877994-pfx2t\" (UID: \"6a3690bc-932f-473f-a318-92351727fb02\") " pod="kuadrant-system/authorino-76877994-pfx2t" Jul 06 13:53:58.423389 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:58.423313 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6a3690bc-932f-473f-a318-92351727fb02-tls-cert\") pod \"authorino-76877994-pfx2t\" (UID: \"6a3690bc-932f-473f-a318-92351727fb02\") " pod="kuadrant-system/authorino-76877994-pfx2t" Jul 06 13:53:58.423389 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:58.423356 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmh75\" (UniqueName: \"kubernetes.io/projected/f8c3c9d8-3ae0-42c2-bfd4-129b23070342-kube-api-access-bmh75\") pod \"authorino-b9868b9c9-vqzvg\" (UID: \"f8c3c9d8-3ae0-42c2-bfd4-129b23070342\") " pod="kuadrant-system/authorino-b9868b9c9-vqzvg" Jul 06 13:53:58.423389 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:58.423384 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdctm\" (UniqueName: \"kubernetes.io/projected/6a3690bc-932f-473f-a318-92351727fb02-kube-api-access-rdctm\") pod \"authorino-76877994-pfx2t\" (UID: \"6a3690bc-932f-473f-a318-92351727fb02\") " pod="kuadrant-system/authorino-76877994-pfx2t" Jul 06 13:53:58.423723 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:58.423460 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f8c3c9d8-3ae0-42c2-bfd4-129b23070342-tls-cert\") pod \"authorino-b9868b9c9-vqzvg\" (UID: \"f8c3c9d8-3ae0-42c2-bfd4-129b23070342\") " pod="kuadrant-system/authorino-b9868b9c9-vqzvg" Jul 06 13:53:58.425767 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:58.425748 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6a3690bc-932f-473f-a318-92351727fb02-tls-cert\") pod \"authorino-76877994-pfx2t\" (UID: \"6a3690bc-932f-473f-a318-92351727fb02\") " pod="kuadrant-system/authorino-76877994-pfx2t" Jul 06 13:53:58.431114 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:58.431092 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdctm\" (UniqueName: \"kubernetes.io/projected/6a3690bc-932f-473f-a318-92351727fb02-kube-api-access-rdctm\") pod \"authorino-76877994-pfx2t\" (UID: \"6a3690bc-932f-473f-a318-92351727fb02\") " pod="kuadrant-system/authorino-76877994-pfx2t" Jul 06 13:53:58.488790 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:58.488762 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-pfx2t" Jul 06 13:53:58.489201 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:58.488762 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-7n5fj" Jul 06 13:53:58.496115 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:58.496093 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-pfx2t" Jul 06 13:53:58.498994 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:58.498978 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-7n5fj" Jul 06 13:53:58.524506 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:58.524482 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f8c3c9d8-3ae0-42c2-bfd4-129b23070342-tls-cert\") pod \"authorino-b9868b9c9-vqzvg\" (UID: \"f8c3c9d8-3ae0-42c2-bfd4-129b23070342\") " pod="kuadrant-system/authorino-b9868b9c9-vqzvg" Jul 06 13:53:58.524666 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:58.524606 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmh75\" (UniqueName: \"kubernetes.io/projected/f8c3c9d8-3ae0-42c2-bfd4-129b23070342-kube-api-access-bmh75\") pod \"authorino-b9868b9c9-vqzvg\" (UID: \"f8c3c9d8-3ae0-42c2-bfd4-129b23070342\") " pod="kuadrant-system/authorino-b9868b9c9-vqzvg" Jul 06 13:53:58.526802 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:58.526779 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f8c3c9d8-3ae0-42c2-bfd4-129b23070342-tls-cert\") pod \"authorino-b9868b9c9-vqzvg\" (UID: \"f8c3c9d8-3ae0-42c2-bfd4-129b23070342\") " pod="kuadrant-system/authorino-b9868b9c9-vqzvg" Jul 06 13:53:58.532314 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:58.532292 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmh75\" (UniqueName: \"kubernetes.io/projected/f8c3c9d8-3ae0-42c2-bfd4-129b23070342-kube-api-access-bmh75\") pod \"authorino-b9868b9c9-vqzvg\" (UID: \"f8c3c9d8-3ae0-42c2-bfd4-129b23070342\") " pod="kuadrant-system/authorino-b9868b9c9-vqzvg" Jul 06 13:53:58.619416 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:58.619389 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b9868b9c9-vqzvg" Jul 06 13:53:58.625469 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:58.625449 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6a3690bc-932f-473f-a318-92351727fb02-tls-cert\") pod \"6a3690bc-932f-473f-a318-92351727fb02\" (UID: \"6a3690bc-932f-473f-a318-92351727fb02\") " Jul 06 13:53:58.625589 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:58.625568 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dx8md\" (UniqueName: \"kubernetes.io/projected/47a6c792-3135-4059-8edd-a63606d31bc5-kube-api-access-dx8md\") pod \"47a6c792-3135-4059-8edd-a63606d31bc5\" (UID: \"47a6c792-3135-4059-8edd-a63606d31bc5\") " Jul 06 13:53:58.625684 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:58.625648 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rdctm\" (UniqueName: \"kubernetes.io/projected/6a3690bc-932f-473f-a318-92351727fb02-kube-api-access-rdctm\") pod \"6a3690bc-932f-473f-a318-92351727fb02\" (UID: \"6a3690bc-932f-473f-a318-92351727fb02\") " Jul 06 13:53:58.627530 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:58.627497 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47a6c792-3135-4059-8edd-a63606d31bc5-kube-api-access-dx8md" (OuterVolumeSpecName: "kube-api-access-dx8md") pod "47a6c792-3135-4059-8edd-a63606d31bc5" (UID: "47a6c792-3135-4059-8edd-a63606d31bc5"). InnerVolumeSpecName "kube-api-access-dx8md". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 13:53:58.627652 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:58.627532 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a3690bc-932f-473f-a318-92351727fb02-kube-api-access-rdctm" (OuterVolumeSpecName: "kube-api-access-rdctm") pod "6a3690bc-932f-473f-a318-92351727fb02" (UID: "6a3690bc-932f-473f-a318-92351727fb02"). InnerVolumeSpecName "kube-api-access-rdctm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 13:53:58.627652 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:58.627509 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a3690bc-932f-473f-a318-92351727fb02-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "6a3690bc-932f-473f-a318-92351727fb02" (UID: "6a3690bc-932f-473f-a318-92351727fb02"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 13:53:58.726639 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:58.726591 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rdctm\" (UniqueName: \"kubernetes.io/projected/6a3690bc-932f-473f-a318-92351727fb02-kube-api-access-rdctm\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:53:58.726750 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:58.726649 2556 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6a3690bc-932f-473f-a318-92351727fb02-tls-cert\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:53:58.726750 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:58.726662 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dx8md\" (UniqueName: \"kubernetes.io/projected/47a6c792-3135-4059-8edd-a63606d31bc5-kube-api-access-dx8md\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:53:58.750798 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:58.750775 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b9868b9c9-vqzvg"] Jul 06 13:53:58.751997 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:53:58.751972 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf8c3c9d8_3ae0_42c2_bfd4_129b23070342.slice/crio-b045ec670d946ccaba09be84287200a98b3190f8023890bb9faecb068be87eaf WatchSource:0}: Error finding container b045ec670d946ccaba09be84287200a98b3190f8023890bb9faecb068be87eaf: Status 404 returned error can't find the container with id b045ec670d946ccaba09be84287200a98b3190f8023890bb9faecb068be87eaf Jul 06 13:53:59.498172 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:59.498106 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b9868b9c9-vqzvg" event={"ID":"f8c3c9d8-3ae0-42c2-bfd4-129b23070342","Type":"ContainerStarted","Data":"b09b674e13245ae612cc80f974f95b16b422eb9c0bca595b119733d3120f688b"} Jul 06 13:53:59.498172 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:59.498147 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-7n5fj" Jul 06 13:53:59.498172 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:59.498156 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b9868b9c9-vqzvg" event={"ID":"f8c3c9d8-3ae0-42c2-bfd4-129b23070342","Type":"ContainerStarted","Data":"b045ec670d946ccaba09be84287200a98b3190f8023890bb9faecb068be87eaf"} Jul 06 13:53:59.498172 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:59.498163 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-pfx2t" Jul 06 13:53:59.516997 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:59.516956 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b9868b9c9-vqzvg" podStartSLOduration=0.872212276 podStartE2EDuration="1.516941662s" totalImagesPullingTime="644.729386ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:53:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:53:59.51529348 +0000 UTC m=+533.315039174" watchObservedRunningTime="2026-07-06 13:53:59.516941662 +0000 UTC m=+533.316687355" Jul 06 13:53:59.554554 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:59.554518 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7n5fj"] Jul 06 13:53:59.563424 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:59.563393 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7n5fj"] Jul 06 13:53:59.584216 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:59.584186 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-pfx2t"] Jul 06 13:53:59.587711 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:53:59.587643 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-pfx2t"] Jul 06 13:54:00.788376 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:00.788341 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47a6c792-3135-4059-8edd-a63606d31bc5" path="/var/lib/kubelet/pods/47a6c792-3135-4059-8edd-a63606d31bc5/volumes" Jul 06 13:54:00.788761 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:00.788604 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a3690bc-932f-473f-a318-92351727fb02" path="/var/lib/kubelet/pods/6a3690bc-932f-473f-a318-92351727fb02/volumes" Jul 06 13:54:03.828412 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:03.828371 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5c86ff9874-xr4bk"] Jul 06 13:54:03.838641 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:03.838596 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:54:03.913359 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:03.913324 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c86ff9874-xr4bk"] Jul 06 13:54:03.913514 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:03.913416 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c86ff9874-xr4bk" Jul 06 13:54:03.916433 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:03.916412 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 06 13:54:03.916581 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:03.916454 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 06 13:54:03.916581 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:03.916459 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-jdg4q\"" Jul 06 13:54:03.927895 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:03.927872 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:54:03.975974 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:03.975950 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szjz5\" (UniqueName: \"kubernetes.io/projected/05e285f7-9191-440c-980b-c7084bcf7972-kube-api-access-szjz5\") pod \"maas-controller-5c86ff9874-xr4bk\" (UID: \"05e285f7-9191-440c-980b-c7084bcf7972\") " pod="opendatahub/maas-controller-5c86ff9874-xr4bk" Jul 06 13:54:03.976079 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:03.975991 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/05e285f7-9191-440c-980b-c7084bcf7972-webhook-cert\") pod \"maas-controller-5c86ff9874-xr4bk\" (UID: \"05e285f7-9191-440c-980b-c7084bcf7972\") " pod="opendatahub/maas-controller-5c86ff9874-xr4bk" Jul 06 13:54:04.009245 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:04.009221 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-ff4954456-d8xdx"] Jul 06 13:54:04.034272 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:04.034247 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-ff4954456-d8xdx"] Jul 06 13:54:04.034424 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:04.034333 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-ff4954456-d8xdx" Jul 06 13:54:04.070413 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:04.070391 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:54:04.076518 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:04.076495 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szjz5\" (UniqueName: \"kubernetes.io/projected/05e285f7-9191-440c-980b-c7084bcf7972-kube-api-access-szjz5\") pod \"maas-controller-5c86ff9874-xr4bk\" (UID: \"05e285f7-9191-440c-980b-c7084bcf7972\") " pod="opendatahub/maas-controller-5c86ff9874-xr4bk" Jul 06 13:54:04.076668 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:04.076536 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/05e285f7-9191-440c-980b-c7084bcf7972-webhook-cert\") pod \"maas-controller-5c86ff9874-xr4bk\" (UID: \"05e285f7-9191-440c-980b-c7084bcf7972\") " pod="opendatahub/maas-controller-5c86ff9874-xr4bk" Jul 06 13:54:04.078973 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:04.078916 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/05e285f7-9191-440c-980b-c7084bcf7972-webhook-cert\") pod \"maas-controller-5c86ff9874-xr4bk\" (UID: \"05e285f7-9191-440c-980b-c7084bcf7972\") " pod="opendatahub/maas-controller-5c86ff9874-xr4bk" Jul 06 13:54:04.085039 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:04.085016 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-szjz5\" (UniqueName: \"kubernetes.io/projected/05e285f7-9191-440c-980b-c7084bcf7972-kube-api-access-szjz5\") pod \"maas-controller-5c86ff9874-xr4bk\" (UID: \"05e285f7-9191-440c-980b-c7084bcf7972\") " pod="opendatahub/maas-controller-5c86ff9874-xr4bk" Jul 06 13:54:04.177813 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:04.177781 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj2vz\" (UniqueName: \"kubernetes.io/projected/cfeef4b0-e983-4149-bd4b-17201be445d5-kube-api-access-kj2vz\") pod \"maas-controller-ff4954456-d8xdx\" (UID: \"cfeef4b0-e983-4149-bd4b-17201be445d5\") " pod="opendatahub/maas-controller-ff4954456-d8xdx" Jul 06 13:54:04.177813 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:04.177815 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cfeef4b0-e983-4149-bd4b-17201be445d5-webhook-cert\") pod \"maas-controller-ff4954456-d8xdx\" (UID: \"cfeef4b0-e983-4149-bd4b-17201be445d5\") " pod="opendatahub/maas-controller-ff4954456-d8xdx" Jul 06 13:54:04.225684 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:04.225661 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c86ff9874-xr4bk" Jul 06 13:54:04.278504 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:04.278477 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj2vz\" (UniqueName: \"kubernetes.io/projected/cfeef4b0-e983-4149-bd4b-17201be445d5-kube-api-access-kj2vz\") pod \"maas-controller-ff4954456-d8xdx\" (UID: \"cfeef4b0-e983-4149-bd4b-17201be445d5\") " pod="opendatahub/maas-controller-ff4954456-d8xdx" Jul 06 13:54:04.278652 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:04.278513 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cfeef4b0-e983-4149-bd4b-17201be445d5-webhook-cert\") pod \"maas-controller-ff4954456-d8xdx\" (UID: \"cfeef4b0-e983-4149-bd4b-17201be445d5\") " pod="opendatahub/maas-controller-ff4954456-d8xdx" Jul 06 13:54:04.280942 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:04.280907 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cfeef4b0-e983-4149-bd4b-17201be445d5-webhook-cert\") pod \"maas-controller-ff4954456-d8xdx\" (UID: \"cfeef4b0-e983-4149-bd4b-17201be445d5\") " pod="opendatahub/maas-controller-ff4954456-d8xdx" Jul 06 13:54:04.288786 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:04.288759 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj2vz\" (UniqueName: \"kubernetes.io/projected/cfeef4b0-e983-4149-bd4b-17201be445d5-kube-api-access-kj2vz\") pod \"maas-controller-ff4954456-d8xdx\" (UID: \"cfeef4b0-e983-4149-bd4b-17201be445d5\") " pod="opendatahub/maas-controller-ff4954456-d8xdx" Jul 06 13:54:04.345731 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:04.345659 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-ff4954456-d8xdx" Jul 06 13:54:04.417518 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:04.417487 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c86ff9874-xr4bk"] Jul 06 13:54:04.419117 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:54:04.419089 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05e285f7_9191_440c_980b_c7084bcf7972.slice/crio-accc27d370f794c600a8f4137723acf3410bbd5f14b6dc3864700744167f3700 WatchSource:0}: Error finding container accc27d370f794c600a8f4137723acf3410bbd5f14b6dc3864700744167f3700: Status 404 returned error can't find the container with id accc27d370f794c600a8f4137723acf3410bbd5f14b6dc3864700744167f3700 Jul 06 13:54:04.510950 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:04.510929 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-ff4954456-d8xdx"] Jul 06 13:54:04.512701 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:54:04.512664 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfeef4b0_e983_4149_bd4b_17201be445d5.slice/crio-451195224ddd92bde7a4334b68fd854ae7f89165d7b927316ef507a7b12f1dfc WatchSource:0}: Error finding container 451195224ddd92bde7a4334b68fd854ae7f89165d7b927316ef507a7b12f1dfc: Status 404 returned error can't find the container with id 451195224ddd92bde7a4334b68fd854ae7f89165d7b927316ef507a7b12f1dfc Jul 06 13:54:04.526045 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:04.526015 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c86ff9874-xr4bk" event={"ID":"05e285f7-9191-440c-980b-c7084bcf7972","Type":"ContainerStarted","Data":"accc27d370f794c600a8f4137723acf3410bbd5f14b6dc3864700744167f3700"} Jul 06 13:54:04.527199 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:04.527171 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-ff4954456-d8xdx" event={"ID":"cfeef4b0-e983-4149-bd4b-17201be445d5","Type":"ContainerStarted","Data":"451195224ddd92bde7a4334b68fd854ae7f89165d7b927316ef507a7b12f1dfc"} Jul 06 13:54:06.406540 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:06.406506 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:54:06.507823 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:06.507786 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:54:07.420876 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:07.420850 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 06 13:54:07.555253 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:07.555210 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-ff4954456-d8xdx" event={"ID":"cfeef4b0-e983-4149-bd4b-17201be445d5","Type":"ContainerStarted","Data":"aa1628193d2e91811bc7af7b0734e2d0c5dd71e5465b1a9551884d2967c99f62"} Jul 06 13:54:07.718177 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:07.718090 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:54:07.868008 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:07.867979 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:54:08.562344 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:08.562300 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c86ff9874-xr4bk" event={"ID":"05e285f7-9191-440c-980b-c7084bcf7972","Type":"ContainerStarted","Data":"77b6ea0c429b3cd0e6527244909f918307ccd3bf7cc39bfdadcb05bd765d6559"} Jul 06 13:54:08.562770 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:08.562571 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5c86ff9874-xr4bk" Jul 06 13:54:08.600723 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:08.600671 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5c86ff9874-xr4bk" podStartSLOduration=2.602898995 podStartE2EDuration="5.600656468s" totalImagesPullingTime="2.997757473s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:54:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:54:08.598762449 +0000 UTC m=+542.398508143" watchObservedRunningTime="2026-07-06 13:54:08.600656468 +0000 UTC m=+542.400402186" Jul 06 13:54:08.618450 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:08.618405 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-ff4954456-d8xdx" podStartSLOduration=2.707224244 podStartE2EDuration="5.618390701s" totalImagesPullingTime="2.911166457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:54:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:54:08.617471898 +0000 UTC m=+542.417217592" watchObservedRunningTime="2026-07-06 13:54:08.618390701 +0000 UTC m=+542.418136396" Jul 06 13:54:18.563019 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:18.562978 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-ff4954456-d8xdx" Jul 06 13:54:18.568083 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:18.568063 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-ff4954456-d8xdx" Jul 06 13:54:18.616210 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:18.616177 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5c86ff9874-xr4bk"] Jul 06 13:54:18.616458 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:18.616411 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-5c86ff9874-xr4bk" podUID="05e285f7-9191-440c-980b-c7084bcf7972" containerName="manager" containerID="cri-o://77b6ea0c429b3cd0e6527244909f918307ccd3bf7cc39bfdadcb05bd765d6559" gracePeriod=30 Jul 06 13:54:18.623187 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:18.623164 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5c86ff9874-xr4bk" Jul 06 13:54:18.859988 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:18.859964 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c86ff9874-xr4bk" Jul 06 13:54:19.009247 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:19.009220 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/05e285f7-9191-440c-980b-c7084bcf7972-webhook-cert\") pod \"05e285f7-9191-440c-980b-c7084bcf7972\" (UID: \"05e285f7-9191-440c-980b-c7084bcf7972\") " Jul 06 13:54:19.009389 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:19.009307 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-szjz5\" (UniqueName: \"kubernetes.io/projected/05e285f7-9191-440c-980b-c7084bcf7972-kube-api-access-szjz5\") pod \"05e285f7-9191-440c-980b-c7084bcf7972\" (UID: \"05e285f7-9191-440c-980b-c7084bcf7972\") " Jul 06 13:54:19.011377 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:19.011352 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05e285f7-9191-440c-980b-c7084bcf7972-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "05e285f7-9191-440c-980b-c7084bcf7972" (UID: "05e285f7-9191-440c-980b-c7084bcf7972"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 13:54:19.011481 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:19.011411 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05e285f7-9191-440c-980b-c7084bcf7972-kube-api-access-szjz5" (OuterVolumeSpecName: "kube-api-access-szjz5") pod "05e285f7-9191-440c-980b-c7084bcf7972" (UID: "05e285f7-9191-440c-980b-c7084bcf7972"). InnerVolumeSpecName "kube-api-access-szjz5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 13:54:19.110822 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:19.110745 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-szjz5\" (UniqueName: \"kubernetes.io/projected/05e285f7-9191-440c-980b-c7084bcf7972-kube-api-access-szjz5\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:54:19.110822 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:19.110767 2556 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/05e285f7-9191-440c-980b-c7084bcf7972-webhook-cert\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:54:19.625137 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:19.625092 2556 generic.go:356] "Generic (PLEG): container finished" podID="05e285f7-9191-440c-980b-c7084bcf7972" containerID="77b6ea0c429b3cd0e6527244909f918307ccd3bf7cc39bfdadcb05bd765d6559" exitCode=0 Jul 06 13:54:19.625556 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:19.625144 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c86ff9874-xr4bk" Jul 06 13:54:19.625556 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:19.625180 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c86ff9874-xr4bk" event={"ID":"05e285f7-9191-440c-980b-c7084bcf7972","Type":"ContainerDied","Data":"77b6ea0c429b3cd0e6527244909f918307ccd3bf7cc39bfdadcb05bd765d6559"} Jul 06 13:54:19.625556 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:19.625233 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c86ff9874-xr4bk" event={"ID":"05e285f7-9191-440c-980b-c7084bcf7972","Type":"ContainerDied","Data":"accc27d370f794c600a8f4137723acf3410bbd5f14b6dc3864700744167f3700"} Jul 06 13:54:19.625556 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:19.625260 2556 scope.go:117] "RemoveContainer" containerID="77b6ea0c429b3cd0e6527244909f918307ccd3bf7cc39bfdadcb05bd765d6559" Jul 06 13:54:19.634914 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:19.634892 2556 scope.go:117] "RemoveContainer" containerID="77b6ea0c429b3cd0e6527244909f918307ccd3bf7cc39bfdadcb05bd765d6559" Jul 06 13:54:19.635145 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:54:19.635126 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77b6ea0c429b3cd0e6527244909f918307ccd3bf7cc39bfdadcb05bd765d6559\": container with ID starting with 77b6ea0c429b3cd0e6527244909f918307ccd3bf7cc39bfdadcb05bd765d6559 not found: ID does not exist" containerID="77b6ea0c429b3cd0e6527244909f918307ccd3bf7cc39bfdadcb05bd765d6559" Jul 06 13:54:19.635193 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:19.635154 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77b6ea0c429b3cd0e6527244909f918307ccd3bf7cc39bfdadcb05bd765d6559"} err="failed to get container status \"77b6ea0c429b3cd0e6527244909f918307ccd3bf7cc39bfdadcb05bd765d6559\": rpc error: code = NotFound desc = could not find container \"77b6ea0c429b3cd0e6527244909f918307ccd3bf7cc39bfdadcb05bd765d6559\": container with ID starting with 77b6ea0c429b3cd0e6527244909f918307ccd3bf7cc39bfdadcb05bd765d6559 not found: ID does not exist" Jul 06 13:54:19.647679 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:19.647660 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5c86ff9874-xr4bk"] Jul 06 13:54:19.652858 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:19.652840 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5c86ff9874-xr4bk"] Jul 06 13:54:20.787336 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:20.787300 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05e285f7-9191-440c-980b-c7084bcf7972" path="/var/lib/kubelet/pods/05e285f7-9191-440c-980b-c7084bcf7972/volumes" Jul 06 13:54:38.902575 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:38.902544 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:54:39.327475 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:39.327445 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:54:39.392281 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:39.392248 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-7676dfbcb7-p2ffk"] Jul 06 13:54:39.392696 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:39.392678 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05e285f7-9191-440c-980b-c7084bcf7972" containerName="manager" Jul 06 13:54:39.392776 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:39.392699 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="05e285f7-9191-440c-980b-c7084bcf7972" containerName="manager" Jul 06 13:54:39.392776 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:39.392769 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="05e285f7-9191-440c-980b-c7084bcf7972" containerName="manager" Jul 06 13:54:39.396009 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:39.395992 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7676dfbcb7-p2ffk" Jul 06 13:54:39.398788 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:39.398768 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jul 06 13:54:39.398958 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:39.398942 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-ffx9s\"" Jul 06 13:54:39.408752 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:39.408734 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7676dfbcb7-p2ffk"] Jul 06 13:54:39.445991 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:39.445956 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:54:39.481203 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:39.481175 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b6e54a17-606d-4712-842c-a110ac5350c0-maas-api-tls\") pod \"maas-api-7676dfbcb7-p2ffk\" (UID: \"b6e54a17-606d-4712-842c-a110ac5350c0\") " pod="opendatahub/maas-api-7676dfbcb7-p2ffk" Jul 06 13:54:39.481364 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:39.481216 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6e54a17-606d-4712-842c-a110ac5350c0-openshift-service-ca\") pod \"maas-api-7676dfbcb7-p2ffk\" (UID: \"b6e54a17-606d-4712-842c-a110ac5350c0\") " pod="opendatahub/maas-api-7676dfbcb7-p2ffk" Jul 06 13:54:39.481364 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:39.481344 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7x58\" (UniqueName: \"kubernetes.io/projected/b6e54a17-606d-4712-842c-a110ac5350c0-kube-api-access-z7x58\") pod \"maas-api-7676dfbcb7-p2ffk\" (UID: \"b6e54a17-606d-4712-842c-a110ac5350c0\") " pod="opendatahub/maas-api-7676dfbcb7-p2ffk" Jul 06 13:54:39.582725 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:39.582604 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7x58\" (UniqueName: \"kubernetes.io/projected/b6e54a17-606d-4712-842c-a110ac5350c0-kube-api-access-z7x58\") pod \"maas-api-7676dfbcb7-p2ffk\" (UID: \"b6e54a17-606d-4712-842c-a110ac5350c0\") " pod="opendatahub/maas-api-7676dfbcb7-p2ffk" Jul 06 13:54:39.582907 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:39.582725 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b6e54a17-606d-4712-842c-a110ac5350c0-maas-api-tls\") pod \"maas-api-7676dfbcb7-p2ffk\" (UID: \"b6e54a17-606d-4712-842c-a110ac5350c0\") " pod="opendatahub/maas-api-7676dfbcb7-p2ffk" Jul 06 13:54:39.582907 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:39.582766 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6e54a17-606d-4712-842c-a110ac5350c0-openshift-service-ca\") pod \"maas-api-7676dfbcb7-p2ffk\" (UID: \"b6e54a17-606d-4712-842c-a110ac5350c0\") " pod="opendatahub/maas-api-7676dfbcb7-p2ffk" Jul 06 13:54:39.583485 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:39.583462 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6e54a17-606d-4712-842c-a110ac5350c0-openshift-service-ca\") pod \"maas-api-7676dfbcb7-p2ffk\" (UID: \"b6e54a17-606d-4712-842c-a110ac5350c0\") " pod="opendatahub/maas-api-7676dfbcb7-p2ffk" Jul 06 13:54:39.585174 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:39.585152 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b6e54a17-606d-4712-842c-a110ac5350c0-maas-api-tls\") pod \"maas-api-7676dfbcb7-p2ffk\" (UID: \"b6e54a17-606d-4712-842c-a110ac5350c0\") " pod="opendatahub/maas-api-7676dfbcb7-p2ffk" Jul 06 13:54:39.601772 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:39.601751 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7x58\" (UniqueName: \"kubernetes.io/projected/b6e54a17-606d-4712-842c-a110ac5350c0-kube-api-access-z7x58\") pod \"maas-api-7676dfbcb7-p2ffk\" (UID: \"b6e54a17-606d-4712-842c-a110ac5350c0\") " pod="opendatahub/maas-api-7676dfbcb7-p2ffk" Jul 06 13:54:39.706955 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:39.706922 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7676dfbcb7-p2ffk" Jul 06 13:54:39.817546 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:39.817515 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:54:39.846034 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:39.846010 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7676dfbcb7-p2ffk"] Jul 06 13:54:39.847250 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:54:39.847226 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6e54a17_606d_4712_842c_a110ac5350c0.slice/crio-4670df2cafed1497ad989aa64b77a781c267a1a936ffdf969e1cb6dff3cf2daf WatchSource:0}: Error finding container 4670df2cafed1497ad989aa64b77a781c267a1a936ffdf969e1cb6dff3cf2daf: Status 404 returned error can't find the container with id 4670df2cafed1497ad989aa64b77a781c267a1a936ffdf969e1cb6dff3cf2daf Jul 06 13:54:39.910112 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:39.910077 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:54:39.917392 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:39.917369 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-8rm9x"] Jul 06 13:54:39.920649 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:39.920631 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-8rm9x" Jul 06 13:54:39.924926 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:39.924909 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 06 13:54:39.925021 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:39.924963 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-qddlk\"" Jul 06 13:54:39.934456 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:39.934435 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-8rm9x"] Jul 06 13:54:39.953407 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:39.953381 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-cl9ff"] Jul 06 13:54:39.956091 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:39.956073 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-cl9ff" Jul 06 13:54:39.964418 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:39.964398 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-cl9ff"] Jul 06 13:54:39.986849 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:39.986821 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qvbg\" (UniqueName: \"kubernetes.io/projected/52649a68-8920-4e60-be96-d73697ff2aac-kube-api-access-4qvbg\") pod \"payload-pre-processing-7964457696-8rm9x\" (UID: \"52649a68-8920-4e60-be96-d73697ff2aac\") " pod="openshift-ingress/payload-pre-processing-7964457696-8rm9x" Jul 06 13:54:39.986951 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:39.986856 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/52649a68-8920-4e60-be96-d73697ff2aac-plugins-config-volume\") pod \"payload-pre-processing-7964457696-8rm9x\" (UID: \"52649a68-8920-4e60-be96-d73697ff2aac\") " pod="openshift-ingress/payload-pre-processing-7964457696-8rm9x" Jul 06 13:54:39.986951 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:39.986900 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxpd4\" (UniqueName: \"kubernetes.io/projected/682be737-a35e-44da-b377-58987ce9b2dd-kube-api-access-sxpd4\") pod \"payload-processing-58f86c7798-cl9ff\" (UID: \"682be737-a35e-44da-b377-58987ce9b2dd\") " pod="openshift-ingress/payload-processing-58f86c7798-cl9ff" Jul 06 13:54:39.986951 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:39.986944 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/682be737-a35e-44da-b377-58987ce9b2dd-plugins-config-volume\") pod \"payload-processing-58f86c7798-cl9ff\" (UID: \"682be737-a35e-44da-b377-58987ce9b2dd\") " pod="openshift-ingress/payload-processing-58f86c7798-cl9ff" Jul 06 13:54:40.088266 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:40.088228 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxpd4\" (UniqueName: \"kubernetes.io/projected/682be737-a35e-44da-b377-58987ce9b2dd-kube-api-access-sxpd4\") pod \"payload-processing-58f86c7798-cl9ff\" (UID: \"682be737-a35e-44da-b377-58987ce9b2dd\") " pod="openshift-ingress/payload-processing-58f86c7798-cl9ff" Jul 06 13:54:40.088457 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:40.088312 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/682be737-a35e-44da-b377-58987ce9b2dd-plugins-config-volume\") pod \"payload-processing-58f86c7798-cl9ff\" (UID: \"682be737-a35e-44da-b377-58987ce9b2dd\") " pod="openshift-ingress/payload-processing-58f86c7798-cl9ff" Jul 06 13:54:40.088457 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:40.088400 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qvbg\" (UniqueName: \"kubernetes.io/projected/52649a68-8920-4e60-be96-d73697ff2aac-kube-api-access-4qvbg\") pod \"payload-pre-processing-7964457696-8rm9x\" (UID: \"52649a68-8920-4e60-be96-d73697ff2aac\") " pod="openshift-ingress/payload-pre-processing-7964457696-8rm9x" Jul 06 13:54:40.088457 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:40.088436 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/52649a68-8920-4e60-be96-d73697ff2aac-plugins-config-volume\") pod \"payload-pre-processing-7964457696-8rm9x\" (UID: \"52649a68-8920-4e60-be96-d73697ff2aac\") " pod="openshift-ingress/payload-pre-processing-7964457696-8rm9x" Jul 06 13:54:40.089271 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:40.089251 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/52649a68-8920-4e60-be96-d73697ff2aac-plugins-config-volume\") pod \"payload-pre-processing-7964457696-8rm9x\" (UID: \"52649a68-8920-4e60-be96-d73697ff2aac\") " pod="openshift-ingress/payload-pre-processing-7964457696-8rm9x" Jul 06 13:54:40.089346 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:40.089293 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/682be737-a35e-44da-b377-58987ce9b2dd-plugins-config-volume\") pod \"payload-processing-58f86c7798-cl9ff\" (UID: \"682be737-a35e-44da-b377-58987ce9b2dd\") " pod="openshift-ingress/payload-processing-58f86c7798-cl9ff" Jul 06 13:54:40.096186 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:40.096129 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxpd4\" (UniqueName: \"kubernetes.io/projected/682be737-a35e-44da-b377-58987ce9b2dd-kube-api-access-sxpd4\") pod \"payload-processing-58f86c7798-cl9ff\" (UID: \"682be737-a35e-44da-b377-58987ce9b2dd\") " pod="openshift-ingress/payload-processing-58f86c7798-cl9ff" Jul 06 13:54:40.096278 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:40.096251 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qvbg\" (UniqueName: \"kubernetes.io/projected/52649a68-8920-4e60-be96-d73697ff2aac-kube-api-access-4qvbg\") pod \"payload-pre-processing-7964457696-8rm9x\" (UID: \"52649a68-8920-4e60-be96-d73697ff2aac\") " pod="openshift-ingress/payload-pre-processing-7964457696-8rm9x" Jul 06 13:54:40.231757 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:40.231725 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-8rm9x" Jul 06 13:54:40.267801 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:40.267764 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-cl9ff" Jul 06 13:54:40.369596 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:40.369568 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-8rm9x"] Jul 06 13:54:40.372929 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:54:40.372884 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52649a68_8920_4e60_be96_d73697ff2aac.slice/crio-f7055733b809f8ba47f5959aacf4999846d8c51974f167ff93a0e19cba5c49dd WatchSource:0}: Error finding container f7055733b809f8ba47f5959aacf4999846d8c51974f167ff93a0e19cba5c49dd: Status 404 returned error can't find the container with id f7055733b809f8ba47f5959aacf4999846d8c51974f167ff93a0e19cba5c49dd Jul 06 13:54:40.416106 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:40.416076 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-cl9ff"] Jul 06 13:54:40.418140 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:54:40.418116 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod682be737_a35e_44da_b377_58987ce9b2dd.slice/crio-2d5d591d9ce7cd360440d3214a9999d8e22f5f6ca7e0403033155c6790305f44 WatchSource:0}: Error finding container 2d5d591d9ce7cd360440d3214a9999d8e22f5f6ca7e0403033155c6790305f44: Status 404 returned error can't find the container with id 2d5d591d9ce7cd360440d3214a9999d8e22f5f6ca7e0403033155c6790305f44 Jul 06 13:54:40.752015 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:40.751971 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7676dfbcb7-p2ffk" event={"ID":"b6e54a17-606d-4712-842c-a110ac5350c0","Type":"ContainerStarted","Data":"4670df2cafed1497ad989aa64b77a781c267a1a936ffdf969e1cb6dff3cf2daf"} Jul 06 13:54:40.753500 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:40.753472 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-8rm9x" event={"ID":"52649a68-8920-4e60-be96-d73697ff2aac","Type":"ContainerStarted","Data":"f7055733b809f8ba47f5959aacf4999846d8c51974f167ff93a0e19cba5c49dd"} Jul 06 13:54:40.754925 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:40.754892 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-cl9ff" event={"ID":"682be737-a35e-44da-b377-58987ce9b2dd","Type":"ContainerStarted","Data":"2d5d591d9ce7cd360440d3214a9999d8e22f5f6ca7e0403033155c6790305f44"} Jul 06 13:54:40.944395 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:40.944359 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:54:41.045900 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:41.045808 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:54:42.768456 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:42.768419 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7676dfbcb7-p2ffk" event={"ID":"b6e54a17-606d-4712-842c-a110ac5350c0","Type":"ContainerStarted","Data":"2ded1e924e0aa4c1eaea70aa654d044419e0497f26af748afd83d5569cb247d2"} Jul 06 13:54:42.768928 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:42.768643 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-7676dfbcb7-p2ffk" Jul 06 13:54:42.769932 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:42.769898 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-8rm9x" event={"ID":"52649a68-8920-4e60-be96-d73697ff2aac","Type":"ContainerStarted","Data":"9e21c23b32b87e3d494fc6a602ee2f4543b50d60d06795abeee9bda0b66e575a"} Jul 06 13:54:42.770062 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:42.770012 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-8rm9x" Jul 06 13:54:42.771416 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:42.771392 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-cl9ff" event={"ID":"682be737-a35e-44da-b377-58987ce9b2dd","Type":"ContainerStarted","Data":"e2fbee44e11554c9907f485d43c6d746100a6092bb04bbc017e633431930e80b"} Jul 06 13:54:42.771498 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:42.771440 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-cl9ff" Jul 06 13:54:42.792009 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:42.791968 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-7676dfbcb7-p2ffk" podStartSLOduration=1.461623811 podStartE2EDuration="3.791955744s" totalImagesPullingTime="2.330331933s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:54:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:54:42.790071279 +0000 UTC m=+576.589816983" watchObservedRunningTime="2026-07-06 13:54:42.791955744 +0000 UTC m=+576.591701436" Jul 06 13:54:42.810236 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:42.810197 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-8rm9x" podStartSLOduration=2.003892713 podStartE2EDuration="3.810184921s" totalImagesPullingTime="1.806292208s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:54:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:54:42.807957128 +0000 UTC m=+576.607702844" watchObservedRunningTime="2026-07-06 13:54:42.810184921 +0000 UTC m=+576.609930613" Jul 06 13:54:42.833110 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:42.833047 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-cl9ff" podStartSLOduration=2.073914333 podStartE2EDuration="3.833031171s" totalImagesPullingTime="1.759116838s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:54:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:54:42.832248954 +0000 UTC m=+576.631994653" watchObservedRunningTime="2026-07-06 13:54:42.833031171 +0000 UTC m=+576.632776868" Jul 06 13:54:47.801579 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:47.801546 2556 generic.go:356] "Generic (PLEG): container finished" podID="45390162-0f47-46a4-9bf1-513488ce5c95" containerID="5ae4947708e6e99a7104723682118f3ed2c9fc4a3325c0046ef975cddba41499" exitCode=0 Jul 06 13:54:47.802003 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:47.801595 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-q6bld" event={"ID":"45390162-0f47-46a4-9bf1-513488ce5c95","Type":"ContainerDied","Data":"5ae4947708e6e99a7104723682118f3ed2c9fc4a3325c0046ef975cddba41499"} Jul 06 13:54:47.802003 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:47.801984 2556 scope.go:117] "RemoveContainer" containerID="5ae4947708e6e99a7104723682118f3ed2c9fc4a3325c0046ef975cddba41499" Jul 06 13:54:47.802944 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:47.802916 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 13:54:47.803000 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:47.802985 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 13:54:47.803036 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:47.803017 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 13:54:48.788289 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:48.788264 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-7676dfbcb7-p2ffk" Jul 06 13:54:48.809457 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:48.809425 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-q6bld" event={"ID":"45390162-0f47-46a4-9bf1-513488ce5c95","Type":"ContainerStarted","Data":"1e807df4e071467452dd8f45f41fc96b973057f56188a149fd3fccdd01025dee"} Jul 06 13:54:49.662343 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:49.662305 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-q6bld" Jul 06 13:54:49.662516 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:49.662490 2556 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-q6bld container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body= Jul 06 13:54:49.662561 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:49.662531 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-q6bld" podUID="45390162-0f47-46a4-9bf1-513488ce5c95" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" Jul 06 13:54:50.282121 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:50.282080 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:54:50.375173 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:50.375137 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:54:50.663002 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:50.662916 2556 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-q6bld container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body= Jul 06 13:54:50.663002 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:50.662978 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-q6bld" podUID="45390162-0f47-46a4-9bf1-513488ce5c95" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" Jul 06 13:54:51.662076 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:51.662034 2556 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-q6bld container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body= Jul 06 13:54:51.662456 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:51.662091 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-q6bld" podUID="45390162-0f47-46a4-9bf1-513488ce5c95" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" Jul 06 13:54:52.662548 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:52.662512 2556 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-q6bld container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body= Jul 06 13:54:52.662950 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:52.662568 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-q6bld" podUID="45390162-0f47-46a4-9bf1-513488ce5c95" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" Jul 06 13:54:53.665823 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:53.665796 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-q6bld" Jul 06 13:54:53.666207 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:53.666119 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-q6bld" Jul 06 13:54:53.666808 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:53.666788 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-q6bld" Jul 06 13:54:53.779003 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:53.778974 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-cl9ff" Jul 06 13:54:53.779168 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:53.779132 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-8rm9x" Jul 06 13:54:59.963526 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:59.963492 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xg4bl"] Jul 06 13:54:59.966174 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:59.966155 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xg4bl" Jul 06 13:54:59.969230 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:59.969205 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 06 13:54:59.970536 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:59.970516 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-96n6p\"" Jul 06 13:54:59.970673 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:59.970516 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 06 13:54:59.970673 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:59.970515 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 06 13:54:59.983899 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:54:59.983877 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xg4bl"] Jul 06 13:55:00.003268 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:55:00.003243 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:55:00.099523 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:55:00.099493 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffzph\" (UniqueName: \"kubernetes.io/projected/fbf10280-af08-4206-a8d7-4fc1cc5f5fa6-kube-api-access-ffzph\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xg4bl\" (UID: \"fbf10280-af08-4206-a8d7-4fc1cc5f5fa6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xg4bl" Jul 06 13:55:00.099714 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:55:00.099541 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fbf10280-af08-4206-a8d7-4fc1cc5f5fa6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xg4bl\" (UID: \"fbf10280-af08-4206-a8d7-4fc1cc5f5fa6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xg4bl" Jul 06 13:55:00.099714 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:55:00.099578 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fbf10280-af08-4206-a8d7-4fc1cc5f5fa6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xg4bl\" (UID: \"fbf10280-af08-4206-a8d7-4fc1cc5f5fa6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xg4bl" Jul 06 13:55:00.099714 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:55:00.099609 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fbf10280-af08-4206-a8d7-4fc1cc5f5fa6-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xg4bl\" (UID: \"fbf10280-af08-4206-a8d7-4fc1cc5f5fa6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xg4bl" Jul 06 13:55:00.099835 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:55:00.099705 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbf10280-af08-4206-a8d7-4fc1cc5f5fa6-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xg4bl\" (UID: \"fbf10280-af08-4206-a8d7-4fc1cc5f5fa6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xg4bl" Jul 06 13:55:00.099835 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:55:00.099763 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fbf10280-af08-4206-a8d7-4fc1cc5f5fa6-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xg4bl\" (UID: \"fbf10280-af08-4206-a8d7-4fc1cc5f5fa6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xg4bl" Jul 06 13:55:00.200837 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:55:00.200810 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fbf10280-af08-4206-a8d7-4fc1cc5f5fa6-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xg4bl\" (UID: \"fbf10280-af08-4206-a8d7-4fc1cc5f5fa6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xg4bl" Jul 06 13:55:00.200974 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:55:00.200857 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffzph\" (UniqueName: \"kubernetes.io/projected/fbf10280-af08-4206-a8d7-4fc1cc5f5fa6-kube-api-access-ffzph\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xg4bl\" (UID: \"fbf10280-af08-4206-a8d7-4fc1cc5f5fa6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xg4bl" Jul 06 13:55:00.200974 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:55:00.200895 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fbf10280-af08-4206-a8d7-4fc1cc5f5fa6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xg4bl\" (UID: \"fbf10280-af08-4206-a8d7-4fc1cc5f5fa6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xg4bl" Jul 06 13:55:00.200974 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:55:00.200931 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fbf10280-af08-4206-a8d7-4fc1cc5f5fa6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xg4bl\" (UID: \"fbf10280-af08-4206-a8d7-4fc1cc5f5fa6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xg4bl" Jul 06 13:55:00.200974 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:55:00.200949 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fbf10280-af08-4206-a8d7-4fc1cc5f5fa6-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xg4bl\" (UID: \"fbf10280-af08-4206-a8d7-4fc1cc5f5fa6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xg4bl" Jul 06 13:55:00.201164 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:55:00.200980 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbf10280-af08-4206-a8d7-4fc1cc5f5fa6-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xg4bl\" (UID: \"fbf10280-af08-4206-a8d7-4fc1cc5f5fa6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xg4bl" Jul 06 13:55:00.201219 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:55:00.201191 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fbf10280-af08-4206-a8d7-4fc1cc5f5fa6-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xg4bl\" (UID: \"fbf10280-af08-4206-a8d7-4fc1cc5f5fa6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xg4bl" Jul 06 13:55:00.201301 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:55:00.201280 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fbf10280-af08-4206-a8d7-4fc1cc5f5fa6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xg4bl\" (UID: \"fbf10280-af08-4206-a8d7-4fc1cc5f5fa6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xg4bl" Jul 06 13:55:00.201362 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:55:00.201310 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbf10280-af08-4206-a8d7-4fc1cc5f5fa6-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xg4bl\" (UID: \"fbf10280-af08-4206-a8d7-4fc1cc5f5fa6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xg4bl" Jul 06 13:55:00.203198 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:55:00.203169 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fbf10280-af08-4206-a8d7-4fc1cc5f5fa6-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xg4bl\" (UID: \"fbf10280-af08-4206-a8d7-4fc1cc5f5fa6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xg4bl" Jul 06 13:55:00.203459 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:55:00.203441 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fbf10280-af08-4206-a8d7-4fc1cc5f5fa6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xg4bl\" (UID: \"fbf10280-af08-4206-a8d7-4fc1cc5f5fa6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xg4bl" Jul 06 13:55:00.208654 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:55:00.208635 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffzph\" (UniqueName: \"kubernetes.io/projected/fbf10280-af08-4206-a8d7-4fc1cc5f5fa6-kube-api-access-ffzph\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xg4bl\" (UID: \"fbf10280-af08-4206-a8d7-4fc1cc5f5fa6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xg4bl" Jul 06 13:55:00.278193 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:55:00.278176 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xg4bl" Jul 06 13:55:00.426641 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:55:00.426588 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xg4bl"] Jul 06 13:55:00.427638 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:55:00.427588 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbf10280_af08_4206_a8d7_4fc1cc5f5fa6.slice/crio-544f94d21188bd1f4b8c5d8d8cbc239c213c3bc4cd51db86ee1c98b36e23c699 WatchSource:0}: Error finding container 544f94d21188bd1f4b8c5d8d8cbc239c213c3bc4cd51db86ee1c98b36e23c699: Status 404 returned error can't find the container with id 544f94d21188bd1f4b8c5d8d8cbc239c213c3bc4cd51db86ee1c98b36e23c699 Jul 06 13:55:00.889292 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:55:00.889255 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xg4bl" event={"ID":"fbf10280-af08-4206-a8d7-4fc1cc5f5fa6","Type":"ContainerStarted","Data":"544f94d21188bd1f4b8c5d8d8cbc239c213c3bc4cd51db86ee1c98b36e23c699"} Jul 06 13:55:01.897174 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:55:01.897019 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xg4bl" event={"ID":"fbf10280-af08-4206-a8d7-4fc1cc5f5fa6","Type":"ContainerStarted","Data":"68f81fee7af189a847ee9d28efc087ce66d773720d2415959ab88cfac2b056e0"} Jul 06 13:55:01.916631 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:55:01.916569 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xg4bl" podStartSLOduration=1.7458749789999999 podStartE2EDuration="2.916553636s" totalImagesPullingTime="1.170678657s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:54:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:55:01.914251989 +0000 UTC m=+595.713997693" watchObservedRunningTime="2026-07-06 13:55:01.916553636 +0000 UTC m=+595.716299331" Jul 06 13:55:06.086997 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:55:06.086960 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:55:06.641346 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:55:06.641321 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vjl62_b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7/console-operator/2.log" Jul 06 13:55:06.641872 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:55:06.641854 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vjl62_b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7/console-operator/2.log" Jul 06 13:55:07.415913 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:55:07.415878 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:55:10.278969 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:55:10.278934 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xg4bl" Jul 06 13:55:10.279490 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:55:10.278993 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xg4bl" Jul 06 13:55:10.291776 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:55:10.291754 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xg4bl" Jul 06 13:55:10.958166 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:55:10.958137 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xg4bl" Jul 06 13:55:14.732609 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:55:14.732575 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:55:15.711855 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:55:15.711820 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:55:19.699904 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:55:19.699870 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:55:32.702485 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:55:32.702371 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:55:36.889833 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:55:36.889800 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:55:46.718727 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:55:46.718691 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:56:05.572064 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:56:05.572024 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:56:05.674388 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:56:05.674343 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:56:20.381152 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:56:20.381084 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:56:20.439024 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:56:20.438998 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:56:22.080608 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:56:22.080578 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-68f484898b-w4rc4"] Jul 06 13:56:22.084273 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:56:22.084257 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68f484898b-w4rc4" Jul 06 13:56:22.092469 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:56:22.092273 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-68f484898b-w4rc4"] Jul 06 13:56:22.240153 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:56:22.240124 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjdvd\" (UniqueName: \"kubernetes.io/projected/620b2a03-1191-476d-a026-17faef9b7c9b-kube-api-access-qjdvd\") pod \"authorino-68f484898b-w4rc4\" (UID: \"620b2a03-1191-476d-a026-17faef9b7c9b\") " pod="kuadrant-system/authorino-68f484898b-w4rc4" Jul 06 13:56:22.240290 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:56:22.240182 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/620b2a03-1191-476d-a026-17faef9b7c9b-tls-cert\") pod \"authorino-68f484898b-w4rc4\" (UID: \"620b2a03-1191-476d-a026-17faef9b7c9b\") " pod="kuadrant-system/authorino-68f484898b-w4rc4" Jul 06 13:56:22.341496 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:56:22.341434 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/620b2a03-1191-476d-a026-17faef9b7c9b-tls-cert\") pod \"authorino-68f484898b-w4rc4\" (UID: \"620b2a03-1191-476d-a026-17faef9b7c9b\") " pod="kuadrant-system/authorino-68f484898b-w4rc4" Jul 06 13:56:22.341654 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:56:22.341500 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjdvd\" (UniqueName: \"kubernetes.io/projected/620b2a03-1191-476d-a026-17faef9b7c9b-kube-api-access-qjdvd\") pod \"authorino-68f484898b-w4rc4\" (UID: \"620b2a03-1191-476d-a026-17faef9b7c9b\") " pod="kuadrant-system/authorino-68f484898b-w4rc4" Jul 06 13:56:22.343815 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:56:22.343793 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/620b2a03-1191-476d-a026-17faef9b7c9b-tls-cert\") pod \"authorino-68f484898b-w4rc4\" (UID: \"620b2a03-1191-476d-a026-17faef9b7c9b\") " pod="kuadrant-system/authorino-68f484898b-w4rc4" Jul 06 13:56:22.350647 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:56:22.350606 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjdvd\" (UniqueName: \"kubernetes.io/projected/620b2a03-1191-476d-a026-17faef9b7c9b-kube-api-access-qjdvd\") pod \"authorino-68f484898b-w4rc4\" (UID: \"620b2a03-1191-476d-a026-17faef9b7c9b\") " pod="kuadrant-system/authorino-68f484898b-w4rc4" Jul 06 13:56:22.395317 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:56:22.395291 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68f484898b-w4rc4" Jul 06 13:56:22.440804 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:56:22.440773 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:56:22.539940 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:56:22.539910 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-68f484898b-w4rc4"] Jul 06 13:56:22.541312 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:56:22.541283 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:56:22.541430 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:56:22.541292 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod620b2a03_1191_476d_a026_17faef9b7c9b.slice/crio-7cb35f987b89e6dcf75e187bf478370b69d346e851dc3fd2ea85851fee10b1d4 WatchSource:0}: Error finding container 7cb35f987b89e6dcf75e187bf478370b69d346e851dc3fd2ea85851fee10b1d4: Status 404 returned error can't find the container with id 7cb35f987b89e6dcf75e187bf478370b69d346e851dc3fd2ea85851fee10b1d4 Jul 06 13:56:22.542772 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:56:22.542753 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 13:56:23.367657 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:56:23.367529 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68f484898b-w4rc4" event={"ID":"620b2a03-1191-476d-a026-17faef9b7c9b","Type":"ContainerStarted","Data":"995498b3dc4ece46a0559ea739972b46a6fb5293d6065ebbf5040d263e8e8ab5"} Jul 06 13:56:23.367657 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:56:23.367574 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68f484898b-w4rc4" event={"ID":"620b2a03-1191-476d-a026-17faef9b7c9b","Type":"ContainerStarted","Data":"7cb35f987b89e6dcf75e187bf478370b69d346e851dc3fd2ea85851fee10b1d4"} Jul 06 13:56:23.392218 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:56:23.392156 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-68f484898b-w4rc4" podStartSLOduration=0.878702784 podStartE2EDuration="1.392134468s" totalImagesPullingTime="513.431684ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:56:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:56:23.387909719 +0000 UTC m=+677.187655417" watchObservedRunningTime="2026-07-06 13:56:23.392134468 +0000 UTC m=+677.191880161" Jul 06 13:56:23.417844 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:56:23.417806 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b9868b9c9-vqzvg"] Jul 06 13:56:23.418193 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:56:23.418029 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-b9868b9c9-vqzvg" podUID="f8c3c9d8-3ae0-42c2-bfd4-129b23070342" containerName="authorino" containerID="cri-o://b09b674e13245ae612cc80f974f95b16b422eb9c0bca595b119733d3120f688b" gracePeriod=30 Jul 06 13:56:23.607353 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:56:23.607227 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:56:23.690941 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:56:23.690919 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b9868b9c9-vqzvg" Jul 06 13:56:23.703666 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:56:23.703639 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:56:23.856894 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:56:23.856854 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bmh75\" (UniqueName: \"kubernetes.io/projected/f8c3c9d8-3ae0-42c2-bfd4-129b23070342-kube-api-access-bmh75\") pod \"f8c3c9d8-3ae0-42c2-bfd4-129b23070342\" (UID: \"f8c3c9d8-3ae0-42c2-bfd4-129b23070342\") " Jul 06 13:56:23.857555 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:56:23.857532 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f8c3c9d8-3ae0-42c2-bfd4-129b23070342-tls-cert\") pod \"f8c3c9d8-3ae0-42c2-bfd4-129b23070342\" (UID: \"f8c3c9d8-3ae0-42c2-bfd4-129b23070342\") " Jul 06 13:56:23.861746 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:56:23.861700 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8c3c9d8-3ae0-42c2-bfd4-129b23070342-kube-api-access-bmh75" (OuterVolumeSpecName: "kube-api-access-bmh75") pod "f8c3c9d8-3ae0-42c2-bfd4-129b23070342" (UID: "f8c3c9d8-3ae0-42c2-bfd4-129b23070342"). InnerVolumeSpecName "kube-api-access-bmh75". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 13:56:23.871754 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:56:23.871730 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8c3c9d8-3ae0-42c2-bfd4-129b23070342-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "f8c3c9d8-3ae0-42c2-bfd4-129b23070342" (UID: "f8c3c9d8-3ae0-42c2-bfd4-129b23070342"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 13:56:23.958791 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:56:23.958714 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bmh75\" (UniqueName: \"kubernetes.io/projected/f8c3c9d8-3ae0-42c2-bfd4-129b23070342-kube-api-access-bmh75\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:56:23.958791 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:56:23.958741 2556 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f8c3c9d8-3ae0-42c2-bfd4-129b23070342-tls-cert\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:56:24.375192 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:56:24.375150 2556 generic.go:356] "Generic (PLEG): container finished" podID="f8c3c9d8-3ae0-42c2-bfd4-129b23070342" containerID="b09b674e13245ae612cc80f974f95b16b422eb9c0bca595b119733d3120f688b" exitCode=0 Jul 06 13:56:24.375569 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:56:24.375212 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b9868b9c9-vqzvg" Jul 06 13:56:24.375569 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:56:24.375248 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b9868b9c9-vqzvg" event={"ID":"f8c3c9d8-3ae0-42c2-bfd4-129b23070342","Type":"ContainerDied","Data":"b09b674e13245ae612cc80f974f95b16b422eb9c0bca595b119733d3120f688b"} Jul 06 13:56:24.375569 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:56:24.375303 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b9868b9c9-vqzvg" event={"ID":"f8c3c9d8-3ae0-42c2-bfd4-129b23070342","Type":"ContainerDied","Data":"b045ec670d946ccaba09be84287200a98b3190f8023890bb9faecb068be87eaf"} Jul 06 13:56:24.375569 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:56:24.375327 2556 scope.go:117] "RemoveContainer" containerID="b09b674e13245ae612cc80f974f95b16b422eb9c0bca595b119733d3120f688b" Jul 06 13:56:24.385319 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:56:24.385301 2556 scope.go:117] "RemoveContainer" containerID="b09b674e13245ae612cc80f974f95b16b422eb9c0bca595b119733d3120f688b" Jul 06 13:56:24.385579 ip-10-0-134-85 kubenswrapper[2556]: E0706 13:56:24.385560 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b09b674e13245ae612cc80f974f95b16b422eb9c0bca595b119733d3120f688b\": container with ID starting with b09b674e13245ae612cc80f974f95b16b422eb9c0bca595b119733d3120f688b not found: ID does not exist" containerID="b09b674e13245ae612cc80f974f95b16b422eb9c0bca595b119733d3120f688b" Jul 06 13:56:24.385693 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:56:24.385589 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b09b674e13245ae612cc80f974f95b16b422eb9c0bca595b119733d3120f688b"} err="failed to get container status \"b09b674e13245ae612cc80f974f95b16b422eb9c0bca595b119733d3120f688b\": rpc error: code = NotFound desc = could not find container \"b09b674e13245ae612cc80f974f95b16b422eb9c0bca595b119733d3120f688b\": container with ID starting with b09b674e13245ae612cc80f974f95b16b422eb9c0bca595b119733d3120f688b not found: ID does not exist" Jul 06 13:56:24.397704 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:56:24.397681 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b9868b9c9-vqzvg"] Jul 06 13:56:24.404689 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:56:24.404670 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-b9868b9c9-vqzvg"] Jul 06 13:56:24.787970 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:56:24.787934 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8c3c9d8-3ae0-42c2-bfd4-129b23070342" path="/var/lib/kubelet/pods/f8c3c9d8-3ae0-42c2-bfd4-129b23070342/volumes" Jul 06 13:56:44.255609 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:56:44.255550 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:57:34.490011 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:57:34.489978 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:57:34.556941 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:57:34.556911 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-ff4954456-d8xdx"] Jul 06 13:57:34.557130 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:57:34.557101 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-ff4954456-d8xdx" podUID="cfeef4b0-e983-4149-bd4b-17201be445d5" containerName="manager" containerID="cri-o://aa1628193d2e91811bc7af7b0734e2d0c5dd71e5465b1a9551884d2967c99f62" gracePeriod=30 Jul 06 13:57:34.800113 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:57:34.800084 2556 generic.go:356] "Generic (PLEG): container finished" podID="cfeef4b0-e983-4149-bd4b-17201be445d5" containerID="aa1628193d2e91811bc7af7b0734e2d0c5dd71e5465b1a9551884d2967c99f62" exitCode=0 Jul 06 13:57:34.800230 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:57:34.800162 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-ff4954456-d8xdx" event={"ID":"cfeef4b0-e983-4149-bd4b-17201be445d5","Type":"ContainerDied","Data":"aa1628193d2e91811bc7af7b0734e2d0c5dd71e5465b1a9551884d2967c99f62"} Jul 06 13:57:34.800230 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:57:34.800206 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-ff4954456-d8xdx" event={"ID":"cfeef4b0-e983-4149-bd4b-17201be445d5","Type":"ContainerDied","Data":"451195224ddd92bde7a4334b68fd854ae7f89165d7b927316ef507a7b12f1dfc"} Jul 06 13:57:34.800230 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:57:34.800222 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="451195224ddd92bde7a4334b68fd854ae7f89165d7b927316ef507a7b12f1dfc" Jul 06 13:57:34.809910 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:57:34.809891 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-ff4954456-d8xdx" Jul 06 13:57:34.909802 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:57:34.909771 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cfeef4b0-e983-4149-bd4b-17201be445d5-webhook-cert\") pod \"cfeef4b0-e983-4149-bd4b-17201be445d5\" (UID: \"cfeef4b0-e983-4149-bd4b-17201be445d5\") " Jul 06 13:57:34.909978 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:57:34.909861 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kj2vz\" (UniqueName: \"kubernetes.io/projected/cfeef4b0-e983-4149-bd4b-17201be445d5-kube-api-access-kj2vz\") pod \"cfeef4b0-e983-4149-bd4b-17201be445d5\" (UID: \"cfeef4b0-e983-4149-bd4b-17201be445d5\") " Jul 06 13:57:34.911839 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:57:34.911802 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfeef4b0-e983-4149-bd4b-17201be445d5-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "cfeef4b0-e983-4149-bd4b-17201be445d5" (UID: "cfeef4b0-e983-4149-bd4b-17201be445d5"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 13:57:34.911839 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:57:34.911824 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfeef4b0-e983-4149-bd4b-17201be445d5-kube-api-access-kj2vz" (OuterVolumeSpecName: "kube-api-access-kj2vz") pod "cfeef4b0-e983-4149-bd4b-17201be445d5" (UID: "cfeef4b0-e983-4149-bd4b-17201be445d5"). InnerVolumeSpecName "kube-api-access-kj2vz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 13:57:35.011311 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:57:35.011283 2556 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cfeef4b0-e983-4149-bd4b-17201be445d5-webhook-cert\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:57:35.011311 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:57:35.011307 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kj2vz\" (UniqueName: \"kubernetes.io/projected/cfeef4b0-e983-4149-bd4b-17201be445d5-kube-api-access-kj2vz\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 13:57:35.806302 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:57:35.806270 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-ff4954456-d8xdx" Jul 06 13:57:35.830839 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:57:35.830813 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-ff4954456-d8xdx"] Jul 06 13:57:35.834878 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:57:35.834854 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-ff4954456-d8xdx"] Jul 06 13:57:36.515489 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:57:36.515460 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:57:36.632234 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:57:36.632207 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-ff4954456-dhw6w"] Jul 06 13:57:36.632638 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:57:36.632604 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfeef4b0-e983-4149-bd4b-17201be445d5" containerName="manager" Jul 06 13:57:36.632638 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:57:36.632633 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfeef4b0-e983-4149-bd4b-17201be445d5" containerName="manager" Jul 06 13:57:36.632720 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:57:36.632642 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8c3c9d8-3ae0-42c2-bfd4-129b23070342" containerName="authorino" Jul 06 13:57:36.632720 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:57:36.632648 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8c3c9d8-3ae0-42c2-bfd4-129b23070342" containerName="authorino" Jul 06 13:57:36.632786 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:57:36.632727 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8c3c9d8-3ae0-42c2-bfd4-129b23070342" containerName="authorino" Jul 06 13:57:36.632786 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:57:36.632735 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfeef4b0-e983-4149-bd4b-17201be445d5" containerName="manager" Jul 06 13:57:36.635936 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:57:36.635914 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-ff4954456-dhw6w" Jul 06 13:57:36.638555 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:57:36.638536 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 06 13:57:36.639958 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:57:36.639933 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-jdg4q\"" Jul 06 13:57:36.640073 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:57:36.639959 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 06 13:57:36.645642 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:57:36.645603 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-ff4954456-dhw6w"] Jul 06 13:57:36.725755 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:57:36.725730 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gb8sf\" (UniqueName: \"kubernetes.io/projected/1790d630-1c05-471a-a75c-16fe9ef7437c-kube-api-access-gb8sf\") pod \"maas-controller-ff4954456-dhw6w\" (UID: \"1790d630-1c05-471a-a75c-16fe9ef7437c\") " pod="opendatahub/maas-controller-ff4954456-dhw6w" Jul 06 13:57:36.725869 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:57:36.725792 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1790d630-1c05-471a-a75c-16fe9ef7437c-webhook-cert\") pod \"maas-controller-ff4954456-dhw6w\" (UID: \"1790d630-1c05-471a-a75c-16fe9ef7437c\") " pod="opendatahub/maas-controller-ff4954456-dhw6w" Jul 06 13:57:36.788201 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:57:36.788136 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cfeef4b0-e983-4149-bd4b-17201be445d5" path="/var/lib/kubelet/pods/cfeef4b0-e983-4149-bd4b-17201be445d5/volumes" Jul 06 13:57:36.826746 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:57:36.826718 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1790d630-1c05-471a-a75c-16fe9ef7437c-webhook-cert\") pod \"maas-controller-ff4954456-dhw6w\" (UID: \"1790d630-1c05-471a-a75c-16fe9ef7437c\") " pod="opendatahub/maas-controller-ff4954456-dhw6w" Jul 06 13:57:36.827045 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:57:36.826801 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gb8sf\" (UniqueName: \"kubernetes.io/projected/1790d630-1c05-471a-a75c-16fe9ef7437c-kube-api-access-gb8sf\") pod \"maas-controller-ff4954456-dhw6w\" (UID: \"1790d630-1c05-471a-a75c-16fe9ef7437c\") " pod="opendatahub/maas-controller-ff4954456-dhw6w" Jul 06 13:57:36.829097 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:57:36.829081 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1790d630-1c05-471a-a75c-16fe9ef7437c-webhook-cert\") pod \"maas-controller-ff4954456-dhw6w\" (UID: \"1790d630-1c05-471a-a75c-16fe9ef7437c\") " pod="opendatahub/maas-controller-ff4954456-dhw6w" Jul 06 13:57:36.835106 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:57:36.835089 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gb8sf\" (UniqueName: \"kubernetes.io/projected/1790d630-1c05-471a-a75c-16fe9ef7437c-kube-api-access-gb8sf\") pod \"maas-controller-ff4954456-dhw6w\" (UID: \"1790d630-1c05-471a-a75c-16fe9ef7437c\") " pod="opendatahub/maas-controller-ff4954456-dhw6w" Jul 06 13:57:36.947425 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:57:36.947395 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-ff4954456-dhw6w" Jul 06 13:57:37.086077 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:57:37.086054 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-ff4954456-dhw6w"] Jul 06 13:57:37.087497 ip-10-0-134-85 kubenswrapper[2556]: W0706 13:57:37.087468 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1790d630_1c05_471a_a75c_16fe9ef7437c.slice/crio-0e270e532094ce9042641733b512e2f571cac93c73b7111d14213f7c7da79f37 WatchSource:0}: Error finding container 0e270e532094ce9042641733b512e2f571cac93c73b7111d14213f7c7da79f37: Status 404 returned error can't find the container with id 0e270e532094ce9042641733b512e2f571cac93c73b7111d14213f7c7da79f37 Jul 06 13:57:37.818061 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:57:37.818030 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-ff4954456-dhw6w" event={"ID":"1790d630-1c05-471a-a75c-16fe9ef7437c","Type":"ContainerStarted","Data":"f8eba519c114165eca1e4877389bfd76e2d656b2acf6ad29b115598b7420e07e"} Jul 06 13:57:37.818191 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:57:37.818083 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-ff4954456-dhw6w" event={"ID":"1790d630-1c05-471a-a75c-16fe9ef7437c","Type":"ContainerStarted","Data":"0e270e532094ce9042641733b512e2f571cac93c73b7111d14213f7c7da79f37"} Jul 06 13:57:37.818267 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:57:37.818198 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-ff4954456-dhw6w" Jul 06 13:57:37.838970 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:57:37.838929 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-ff4954456-dhw6w" podStartSLOduration=1.2195766319999999 podStartE2EDuration="1.838913924s" totalImagesPullingTime="619.337292ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:57:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:57:37.837745099 +0000 UTC m=+751.637490814" watchObservedRunningTime="2026-07-06 13:57:37.838913924 +0000 UTC m=+751.638659617" Jul 06 13:57:39.950846 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:57:39.950810 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:57:48.829579 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:57:48.829551 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-ff4954456-dhw6w" Jul 06 13:58:19.237805 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:58:19.237771 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:58:19.339286 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:58:19.339251 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:58:19.500702 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:58:19.500581 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:58:25.089403 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:58:25.089369 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:58:25.194812 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:58:25.194775 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:58:25.290163 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:58:25.290128 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:58:25.441253 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:58:25.441169 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:58:31.079913 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:58:31.079825 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:58:31.146220 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:58:31.146187 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:58:59.012217 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:58:59.012179 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:59:35.361792 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:59:35.361754 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:59:35.416515 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:59:35.416477 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 13:59:43.833675 ip-10-0-134-85 kubenswrapper[2556]: I0706 13:59:43.833642 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:00:00.143499 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:00:00.143405 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29722440-86579"] Jul 06 14:00:00.146997 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:00:00.146982 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722440-86579" Jul 06 14:00:00.163894 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:00:00.163870 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722440-86579"] Jul 06 14:00:00.212861 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:00:00.212833 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqsbp\" (UniqueName: \"kubernetes.io/projected/310d776c-ffee-443e-9b6c-6abdcce5f6ff-kube-api-access-fqsbp\") pod \"maas-api-key-cleanup-29722440-86579\" (UID: \"310d776c-ffee-443e-9b6c-6abdcce5f6ff\") " pod="opendatahub/maas-api-key-cleanup-29722440-86579" Jul 06 14:00:00.313992 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:00:00.313960 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqsbp\" (UniqueName: \"kubernetes.io/projected/310d776c-ffee-443e-9b6c-6abdcce5f6ff-kube-api-access-fqsbp\") pod \"maas-api-key-cleanup-29722440-86579\" (UID: \"310d776c-ffee-443e-9b6c-6abdcce5f6ff\") " pod="opendatahub/maas-api-key-cleanup-29722440-86579" Jul 06 14:00:00.322737 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:00:00.322707 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqsbp\" (UniqueName: \"kubernetes.io/projected/310d776c-ffee-443e-9b6c-6abdcce5f6ff-kube-api-access-fqsbp\") pod \"maas-api-key-cleanup-29722440-86579\" (UID: \"310d776c-ffee-443e-9b6c-6abdcce5f6ff\") " pod="opendatahub/maas-api-key-cleanup-29722440-86579" Jul 06 14:00:00.483805 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:00:00.483729 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722440-86579" Jul 06 14:00:00.824166 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:00:00.824140 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722440-86579"] Jul 06 14:00:00.825322 ip-10-0-134-85 kubenswrapper[2556]: W0706 14:00:00.825298 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod310d776c_ffee_443e_9b6c_6abdcce5f6ff.slice/crio-dd8ee77cfc9d0c4559aa0218888480de2b2585e5f6380abeefc6dbfef17fb0dd WatchSource:0}: Error finding container dd8ee77cfc9d0c4559aa0218888480de2b2585e5f6380abeefc6dbfef17fb0dd: Status 404 returned error can't find the container with id dd8ee77cfc9d0c4559aa0218888480de2b2585e5f6380abeefc6dbfef17fb0dd Jul 06 14:00:01.675424 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:00:01.675391 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722440-86579" event={"ID":"310d776c-ffee-443e-9b6c-6abdcce5f6ff","Type":"ContainerStarted","Data":"dd8ee77cfc9d0c4559aa0218888480de2b2585e5f6380abeefc6dbfef17fb0dd"} Jul 06 14:00:06.683775 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:00:06.683745 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vjl62_b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7/console-operator/2.log" Jul 06 14:00:06.685429 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:00:06.685406 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vjl62_b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7/console-operator/2.log" Jul 06 14:00:15.760589 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:00:15.760552 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722440-86579" event={"ID":"310d776c-ffee-443e-9b6c-6abdcce5f6ff","Type":"ContainerStarted","Data":"b7e8271cb8e124eecaf6c835cdb90f2eb88611a3e2ff46475afbdc22bf92c387"} Jul 06 14:00:15.780278 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:00:15.780233 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29722440-86579" podStartSLOduration=1.179477617 podStartE2EDuration="15.78021664s" totalImagesPullingTime="14.600739023s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:00:15.777371261 +0000 UTC m=+909.577116954" watchObservedRunningTime="2026-07-06 14:00:15.78021664 +0000 UTC m=+909.579962332" Jul 06 14:00:16.767350 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:00:16.767317 2556 generic.go:356] "Generic (PLEG): container finished" podID="310d776c-ffee-443e-9b6c-6abdcce5f6ff" containerID="b7e8271cb8e124eecaf6c835cdb90f2eb88611a3e2ff46475afbdc22bf92c387" exitCode=0 Jul 06 14:00:16.767797 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:00:16.767363 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722440-86579" event={"ID":"310d776c-ffee-443e-9b6c-6abdcce5f6ff","Type":"ContainerDied","Data":"b7e8271cb8e124eecaf6c835cdb90f2eb88611a3e2ff46475afbdc22bf92c387"} Jul 06 14:00:17.915127 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:00:17.915105 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722440-86579" Jul 06 14:00:18.076991 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:00:18.076925 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fqsbp\" (UniqueName: \"kubernetes.io/projected/310d776c-ffee-443e-9b6c-6abdcce5f6ff-kube-api-access-fqsbp\") pod \"310d776c-ffee-443e-9b6c-6abdcce5f6ff\" (UID: \"310d776c-ffee-443e-9b6c-6abdcce5f6ff\") " Jul 06 14:00:18.078866 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:00:18.078838 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/310d776c-ffee-443e-9b6c-6abdcce5f6ff-kube-api-access-fqsbp" (OuterVolumeSpecName: "kube-api-access-fqsbp") pod "310d776c-ffee-443e-9b6c-6abdcce5f6ff" (UID: "310d776c-ffee-443e-9b6c-6abdcce5f6ff"). InnerVolumeSpecName "kube-api-access-fqsbp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 14:00:18.178001 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:00:18.177974 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fqsbp\" (UniqueName: \"kubernetes.io/projected/310d776c-ffee-443e-9b6c-6abdcce5f6ff-kube-api-access-fqsbp\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 14:00:18.787252 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:00:18.787225 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722440-86579" Jul 06 14:00:18.789035 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:00:18.789006 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722440-86579" event={"ID":"310d776c-ffee-443e-9b6c-6abdcce5f6ff","Type":"ContainerDied","Data":"dd8ee77cfc9d0c4559aa0218888480de2b2585e5f6380abeefc6dbfef17fb0dd"} Jul 06 14:00:18.789188 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:00:18.789049 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dd8ee77cfc9d0c4559aa0218888480de2b2585e5f6380abeefc6dbfef17fb0dd" Jul 06 14:00:41.013602 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:00:41.013562 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:00:42.971055 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:00:42.971019 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:01:07.033542 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:01:07.033510 2556 scope.go:117] "RemoveContainer" containerID="aa1628193d2e91811bc7af7b0734e2d0c5dd71e5465b1a9551884d2967c99f62" Jul 06 14:03:28.295273 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:03:28.295238 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fg9r4"] Jul 06 14:03:28.295920 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:03:28.295742 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="310d776c-ffee-443e-9b6c-6abdcce5f6ff" containerName="cleanup" Jul 06 14:03:28.295920 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:03:28.295756 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="310d776c-ffee-443e-9b6c-6abdcce5f6ff" containerName="cleanup" Jul 06 14:03:28.295920 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:03:28.295854 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="310d776c-ffee-443e-9b6c-6abdcce5f6ff" containerName="cleanup" Jul 06 14:03:28.298185 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:03:28.298170 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fg9r4" Jul 06 14:03:28.301543 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:03:28.301525 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-nm4qw\"" Jul 06 14:03:28.315029 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:03:28.315008 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fg9r4"] Jul 06 14:03:28.383527 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:03:28.383493 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64hn5\" (UniqueName: \"kubernetes.io/projected/903ccc46-66c9-468f-8a87-e3546ba7b1c4-kube-api-access-64hn5\") pod \"kuadrant-operator-controller-manager-86878c769f-fg9r4\" (UID: \"903ccc46-66c9-468f-8a87-e3546ba7b1c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fg9r4" Jul 06 14:03:28.383707 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:03:28.383561 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/903ccc46-66c9-468f-8a87-e3546ba7b1c4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fg9r4\" (UID: \"903ccc46-66c9-468f-8a87-e3546ba7b1c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fg9r4" Jul 06 14:03:28.484942 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:03:28.484914 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/903ccc46-66c9-468f-8a87-e3546ba7b1c4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fg9r4\" (UID: \"903ccc46-66c9-468f-8a87-e3546ba7b1c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fg9r4" Jul 06 14:03:28.485059 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:03:28.485016 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64hn5\" (UniqueName: \"kubernetes.io/projected/903ccc46-66c9-468f-8a87-e3546ba7b1c4-kube-api-access-64hn5\") pod \"kuadrant-operator-controller-manager-86878c769f-fg9r4\" (UID: \"903ccc46-66c9-468f-8a87-e3546ba7b1c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fg9r4" Jul 06 14:03:28.485290 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:03:28.485270 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/903ccc46-66c9-468f-8a87-e3546ba7b1c4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fg9r4\" (UID: \"903ccc46-66c9-468f-8a87-e3546ba7b1c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fg9r4" Jul 06 14:03:28.495767 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:03:28.495743 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-64hn5\" (UniqueName: \"kubernetes.io/projected/903ccc46-66c9-468f-8a87-e3546ba7b1c4-kube-api-access-64hn5\") pod \"kuadrant-operator-controller-manager-86878c769f-fg9r4\" (UID: \"903ccc46-66c9-468f-8a87-e3546ba7b1c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fg9r4" Jul 06 14:03:28.609193 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:03:28.609130 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fg9r4" Jul 06 14:03:28.754017 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:03:28.753991 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fg9r4"] Jul 06 14:03:28.757015 ip-10-0-134-85 kubenswrapper[2556]: W0706 14:03:28.756986 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod903ccc46_66c9_468f_8a87_e3546ba7b1c4.slice/crio-43102bee44c6ce79ffbd0f9e71cf4de295f3cca6d1e29f35bfb0bff4abc138ec WatchSource:0}: Error finding container 43102bee44c6ce79ffbd0f9e71cf4de295f3cca6d1e29f35bfb0bff4abc138ec: Status 404 returned error can't find the container with id 43102bee44c6ce79ffbd0f9e71cf4de295f3cca6d1e29f35bfb0bff4abc138ec Jul 06 14:03:28.927114 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:03:28.927014 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fg9r4" event={"ID":"903ccc46-66c9-468f-8a87-e3546ba7b1c4","Type":"ContainerStarted","Data":"80d0580bb90d9be8bbfef49e244c55fe6539b180e1ff412d4eb612793a8b8273"} Jul 06 14:03:28.927114 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:03:28.927075 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fg9r4" event={"ID":"903ccc46-66c9-468f-8a87-e3546ba7b1c4","Type":"ContainerStarted","Data":"43102bee44c6ce79ffbd0f9e71cf4de295f3cca6d1e29f35bfb0bff4abc138ec"} Jul 06 14:03:28.927330 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:03:28.927118 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fg9r4" Jul 06 14:03:28.946920 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:03:28.946870 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fg9r4" podStartSLOduration=0.946855829 podStartE2EDuration="946.855829ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:03:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:03:28.944301527 +0000 UTC m=+1102.744047220" watchObservedRunningTime="2026-07-06 14:03:28.946855829 +0000 UTC m=+1102.746601523" Jul 06 14:03:39.934978 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:03:39.934898 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fg9r4" Jul 06 14:04:53.005685 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:04:53.005644 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:05:06.725775 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:05:06.725745 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vjl62_b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7/console-operator/2.log" Jul 06 14:05:06.728120 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:05:06.726997 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vjl62_b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7/console-operator/2.log" Jul 06 14:06:17.899955 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:06:17.899923 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:06:26.026633 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:06:26.026582 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:07:10.299817 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:07:10.299784 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:07:26.021681 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:07:26.021645 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f88d8cbdf-r847m"] Jul 06 14:07:26.025922 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:07:26.025897 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f88d8cbdf-r847m" Jul 06 14:07:26.045587 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:07:26.045564 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f88d8cbdf-r847m"] Jul 06 14:07:26.074311 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:07:26.074288 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:07:26.110604 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:07:26.110577 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2d81cc14-fd39-46b7-9075-758a663ccee1-console-serving-cert\") pod \"console-7f88d8cbdf-r847m\" (UID: \"2d81cc14-fd39-46b7-9075-758a663ccee1\") " pod="openshift-console/console-7f88d8cbdf-r847m" Jul 06 14:07:26.110729 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:07:26.110670 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2d81cc14-fd39-46b7-9075-758a663ccee1-oauth-serving-cert\") pod \"console-7f88d8cbdf-r847m\" (UID: \"2d81cc14-fd39-46b7-9075-758a663ccee1\") " pod="openshift-console/console-7f88d8cbdf-r847m" Jul 06 14:07:26.110729 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:07:26.110693 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2d81cc14-fd39-46b7-9075-758a663ccee1-console-oauth-config\") pod \"console-7f88d8cbdf-r847m\" (UID: \"2d81cc14-fd39-46b7-9075-758a663ccee1\") " pod="openshift-console/console-7f88d8cbdf-r847m" Jul 06 14:07:26.110729 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:07:26.110712 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcbpc\" (UniqueName: \"kubernetes.io/projected/2d81cc14-fd39-46b7-9075-758a663ccee1-kube-api-access-kcbpc\") pod \"console-7f88d8cbdf-r847m\" (UID: \"2d81cc14-fd39-46b7-9075-758a663ccee1\") " pod="openshift-console/console-7f88d8cbdf-r847m" Jul 06 14:07:26.110837 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:07:26.110773 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2d81cc14-fd39-46b7-9075-758a663ccee1-service-ca\") pod \"console-7f88d8cbdf-r847m\" (UID: \"2d81cc14-fd39-46b7-9075-758a663ccee1\") " pod="openshift-console/console-7f88d8cbdf-r847m" Jul 06 14:07:26.110837 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:07:26.110820 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2d81cc14-fd39-46b7-9075-758a663ccee1-console-config\") pod \"console-7f88d8cbdf-r847m\" (UID: \"2d81cc14-fd39-46b7-9075-758a663ccee1\") " pod="openshift-console/console-7f88d8cbdf-r847m" Jul 06 14:07:26.110901 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:07:26.110884 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d81cc14-fd39-46b7-9075-758a663ccee1-trusted-ca-bundle\") pod \"console-7f88d8cbdf-r847m\" (UID: \"2d81cc14-fd39-46b7-9075-758a663ccee1\") " pod="openshift-console/console-7f88d8cbdf-r847m" Jul 06 14:07:26.128349 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:07:26.128306 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:07:26.211322 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:07:26.211295 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2d81cc14-fd39-46b7-9075-758a663ccee1-oauth-serving-cert\") pod \"console-7f88d8cbdf-r847m\" (UID: \"2d81cc14-fd39-46b7-9075-758a663ccee1\") " pod="openshift-console/console-7f88d8cbdf-r847m" Jul 06 14:07:26.211436 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:07:26.211326 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2d81cc14-fd39-46b7-9075-758a663ccee1-console-oauth-config\") pod \"console-7f88d8cbdf-r847m\" (UID: \"2d81cc14-fd39-46b7-9075-758a663ccee1\") " pod="openshift-console/console-7f88d8cbdf-r847m" Jul 06 14:07:26.211436 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:07:26.211346 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcbpc\" (UniqueName: \"kubernetes.io/projected/2d81cc14-fd39-46b7-9075-758a663ccee1-kube-api-access-kcbpc\") pod \"console-7f88d8cbdf-r847m\" (UID: \"2d81cc14-fd39-46b7-9075-758a663ccee1\") " pod="openshift-console/console-7f88d8cbdf-r847m" Jul 06 14:07:26.211436 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:07:26.211370 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2d81cc14-fd39-46b7-9075-758a663ccee1-service-ca\") pod \"console-7f88d8cbdf-r847m\" (UID: \"2d81cc14-fd39-46b7-9075-758a663ccee1\") " pod="openshift-console/console-7f88d8cbdf-r847m" Jul 06 14:07:26.211436 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:07:26.211400 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2d81cc14-fd39-46b7-9075-758a663ccee1-console-config\") pod \"console-7f88d8cbdf-r847m\" (UID: \"2d81cc14-fd39-46b7-9075-758a663ccee1\") " pod="openshift-console/console-7f88d8cbdf-r847m" Jul 06 14:07:26.211653 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:07:26.211466 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d81cc14-fd39-46b7-9075-758a663ccee1-trusted-ca-bundle\") pod \"console-7f88d8cbdf-r847m\" (UID: \"2d81cc14-fd39-46b7-9075-758a663ccee1\") " pod="openshift-console/console-7f88d8cbdf-r847m" Jul 06 14:07:26.211653 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:07:26.211508 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2d81cc14-fd39-46b7-9075-758a663ccee1-console-serving-cert\") pod \"console-7f88d8cbdf-r847m\" (UID: \"2d81cc14-fd39-46b7-9075-758a663ccee1\") " pod="openshift-console/console-7f88d8cbdf-r847m" Jul 06 14:07:26.212135 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:07:26.212083 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2d81cc14-fd39-46b7-9075-758a663ccee1-oauth-serving-cert\") pod \"console-7f88d8cbdf-r847m\" (UID: \"2d81cc14-fd39-46b7-9075-758a663ccee1\") " pod="openshift-console/console-7f88d8cbdf-r847m" Jul 06 14:07:26.212258 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:07:26.212162 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2d81cc14-fd39-46b7-9075-758a663ccee1-service-ca\") pod \"console-7f88d8cbdf-r847m\" (UID: \"2d81cc14-fd39-46b7-9075-758a663ccee1\") " pod="openshift-console/console-7f88d8cbdf-r847m" Jul 06 14:07:26.212326 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:07:26.212274 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2d81cc14-fd39-46b7-9075-758a663ccee1-console-config\") pod \"console-7f88d8cbdf-r847m\" (UID: \"2d81cc14-fd39-46b7-9075-758a663ccee1\") " pod="openshift-console/console-7f88d8cbdf-r847m" Jul 06 14:07:26.212553 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:07:26.212530 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d81cc14-fd39-46b7-9075-758a663ccee1-trusted-ca-bundle\") pod \"console-7f88d8cbdf-r847m\" (UID: \"2d81cc14-fd39-46b7-9075-758a663ccee1\") " pod="openshift-console/console-7f88d8cbdf-r847m" Jul 06 14:07:26.213948 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:07:26.213929 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2d81cc14-fd39-46b7-9075-758a663ccee1-console-oauth-config\") pod \"console-7f88d8cbdf-r847m\" (UID: \"2d81cc14-fd39-46b7-9075-758a663ccee1\") " pod="openshift-console/console-7f88d8cbdf-r847m" Jul 06 14:07:26.214054 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:07:26.214036 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2d81cc14-fd39-46b7-9075-758a663ccee1-console-serving-cert\") pod \"console-7f88d8cbdf-r847m\" (UID: \"2d81cc14-fd39-46b7-9075-758a663ccee1\") " pod="openshift-console/console-7f88d8cbdf-r847m" Jul 06 14:07:26.219236 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:07:26.219215 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcbpc\" (UniqueName: \"kubernetes.io/projected/2d81cc14-fd39-46b7-9075-758a663ccee1-kube-api-access-kcbpc\") pod \"console-7f88d8cbdf-r847m\" (UID: \"2d81cc14-fd39-46b7-9075-758a663ccee1\") " pod="openshift-console/console-7f88d8cbdf-r847m" Jul 06 14:07:26.337007 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:07:26.336940 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f88d8cbdf-r847m" Jul 06 14:07:26.683415 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:07:26.683390 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f88d8cbdf-r847m"] Jul 06 14:07:26.684773 ip-10-0-134-85 kubenswrapper[2556]: W0706 14:07:26.684747 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d81cc14_fd39_46b7_9075_758a663ccee1.slice/crio-e8b976631cd661196db218b41263f068926e7f17f3e187c805b413a1418285ff WatchSource:0}: Error finding container e8b976631cd661196db218b41263f068926e7f17f3e187c805b413a1418285ff: Status 404 returned error can't find the container with id e8b976631cd661196db218b41263f068926e7f17f3e187c805b413a1418285ff Jul 06 14:07:27.400890 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:07:27.400850 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f88d8cbdf-r847m" event={"ID":"2d81cc14-fd39-46b7-9075-758a663ccee1","Type":"ContainerStarted","Data":"d1f6f853d122146cafc4e08235ce49f296f8bcad55b82fbe1e854e8fa3759889"} Jul 06 14:07:27.401266 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:07:27.400931 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f88d8cbdf-r847m" event={"ID":"2d81cc14-fd39-46b7-9075-758a663ccee1","Type":"ContainerStarted","Data":"e8b976631cd661196db218b41263f068926e7f17f3e187c805b413a1418285ff"} Jul 06 14:07:27.419299 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:07:27.419252 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f88d8cbdf-r847m" podStartSLOduration=1.419234092 podStartE2EDuration="1.419234092s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:07:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:07:27.418232114 +0000 UTC m=+1341.217977807" watchObservedRunningTime="2026-07-06 14:07:27.419234092 +0000 UTC m=+1341.218979785" Jul 06 14:07:36.337475 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:07:36.337390 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f88d8cbdf-r847m" Jul 06 14:07:36.337475 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:07:36.337449 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f88d8cbdf-r847m" Jul 06 14:07:36.342290 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:07:36.342269 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f88d8cbdf-r847m" Jul 06 14:07:36.457725 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:07:36.457700 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f88d8cbdf-r847m" Jul 06 14:07:36.506702 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:07:36.506675 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b94bb86cb-wc47x"] Jul 06 14:07:36.619787 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:07:36.619703 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:07:37.699356 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:07:37.699325 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:07:37.799778 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:07:37.799749 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:07:56.184092 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:07:56.184050 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:07:56.239855 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:07:56.239827 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:08:01.530643 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:08:01.530586 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7b94bb86cb-wc47x" podUID="0d53be34-f43c-499c-a628-2c78365f752d" containerName="console" containerID="cri-o://178f3e407c8804b835fad4139d67a6f823af172cae41539b5f104a589bad569f" gracePeriod=15 Jul 06 14:08:01.629811 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:08:01.629783 2556 patch_prober.go:28] interesting pod/console-7b94bb86cb-wc47x container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.134.0.23:8443/health\": dial tcp 10.134.0.23:8443: connect: connection refused" start-of-body= Jul 06 14:08:01.629952 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:08:01.629839 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-7b94bb86cb-wc47x" podUID="0d53be34-f43c-499c-a628-2c78365f752d" containerName="console" probeResult="failure" output="Get \"https://10.134.0.23:8443/health\": dial tcp 10.134.0.23:8443: connect: connection refused" Jul 06 14:08:01.790295 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:08:01.790233 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b94bb86cb-wc47x" Jul 06 14:08:01.947368 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:08:01.947328 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0d53be34-f43c-499c-a628-2c78365f752d-oauth-serving-cert\") pod \"0d53be34-f43c-499c-a628-2c78365f752d\" (UID: \"0d53be34-f43c-499c-a628-2c78365f752d\") " Jul 06 14:08:01.947565 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:08:01.947381 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0d53be34-f43c-499c-a628-2c78365f752d-console-config\") pod \"0d53be34-f43c-499c-a628-2c78365f752d\" (UID: \"0d53be34-f43c-499c-a628-2c78365f752d\") " Jul 06 14:08:01.947565 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:08:01.947416 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d53be34-f43c-499c-a628-2c78365f752d-trusted-ca-bundle\") pod \"0d53be34-f43c-499c-a628-2c78365f752d\" (UID: \"0d53be34-f43c-499c-a628-2c78365f752d\") " Jul 06 14:08:01.947565 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:08:01.947474 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0d53be34-f43c-499c-a628-2c78365f752d-console-oauth-config\") pod \"0d53be34-f43c-499c-a628-2c78365f752d\" (UID: \"0d53be34-f43c-499c-a628-2c78365f752d\") " Jul 06 14:08:01.947565 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:08:01.947515 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0d53be34-f43c-499c-a628-2c78365f752d-service-ca\") pod \"0d53be34-f43c-499c-a628-2c78365f752d\" (UID: \"0d53be34-f43c-499c-a628-2c78365f752d\") " Jul 06 14:08:01.947840 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:08:01.947612 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0d53be34-f43c-499c-a628-2c78365f752d-console-serving-cert\") pod \"0d53be34-f43c-499c-a628-2c78365f752d\" (UID: \"0d53be34-f43c-499c-a628-2c78365f752d\") " Jul 06 14:08:01.947840 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:08:01.947653 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2t67\" (UniqueName: \"kubernetes.io/projected/0d53be34-f43c-499c-a628-2c78365f752d-kube-api-access-h2t67\") pod \"0d53be34-f43c-499c-a628-2c78365f752d\" (UID: \"0d53be34-f43c-499c-a628-2c78365f752d\") " Jul 06 14:08:01.947950 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:08:01.947932 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d53be34-f43c-499c-a628-2c78365f752d-console-config" (OuterVolumeSpecName: "console-config") pod "0d53be34-f43c-499c-a628-2c78365f752d" (UID: "0d53be34-f43c-499c-a628-2c78365f752d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 14:08:01.948004 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:08:01.947941 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d53be34-f43c-499c-a628-2c78365f752d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0d53be34-f43c-499c-a628-2c78365f752d" (UID: "0d53be34-f43c-499c-a628-2c78365f752d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 14:08:01.948103 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:08:01.948086 2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0d53be34-f43c-499c-a628-2c78365f752d-console-config\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 14:08:01.948164 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:08:01.948142 2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d53be34-f43c-499c-a628-2c78365f752d-trusted-ca-bundle\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 14:08:01.948277 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:08:01.948253 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d53be34-f43c-499c-a628-2c78365f752d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0d53be34-f43c-499c-a628-2c78365f752d" (UID: "0d53be34-f43c-499c-a628-2c78365f752d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 14:08:01.948411 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:08:01.948388 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d53be34-f43c-499c-a628-2c78365f752d-service-ca" (OuterVolumeSpecName: "service-ca") pod "0d53be34-f43c-499c-a628-2c78365f752d" (UID: "0d53be34-f43c-499c-a628-2c78365f752d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 14:08:01.949865 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:08:01.949842 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d53be34-f43c-499c-a628-2c78365f752d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0d53be34-f43c-499c-a628-2c78365f752d" (UID: "0d53be34-f43c-499c-a628-2c78365f752d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 14:08:01.949960 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:08:01.949927 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d53be34-f43c-499c-a628-2c78365f752d-kube-api-access-h2t67" (OuterVolumeSpecName: "kube-api-access-h2t67") pod "0d53be34-f43c-499c-a628-2c78365f752d" (UID: "0d53be34-f43c-499c-a628-2c78365f752d"). InnerVolumeSpecName "kube-api-access-h2t67". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 14:08:01.950007 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:08:01.949955 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d53be34-f43c-499c-a628-2c78365f752d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0d53be34-f43c-499c-a628-2c78365f752d" (UID: "0d53be34-f43c-499c-a628-2c78365f752d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 14:08:02.049273 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:08:02.049184 2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0d53be34-f43c-499c-a628-2c78365f752d-console-oauth-config\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 14:08:02.049273 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:08:02.049215 2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0d53be34-f43c-499c-a628-2c78365f752d-service-ca\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 14:08:02.049273 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:08:02.049225 2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0d53be34-f43c-499c-a628-2c78365f752d-console-serving-cert\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 14:08:02.049273 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:08:02.049234 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2t67\" (UniqueName: \"kubernetes.io/projected/0d53be34-f43c-499c-a628-2c78365f752d-kube-api-access-h2t67\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 14:08:02.049273 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:08:02.049243 2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0d53be34-f43c-499c-a628-2c78365f752d-oauth-serving-cert\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 14:08:02.613248 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:08:02.613215 2556 generic.go:356] "Generic (PLEG): container finished" podID="0d53be34-f43c-499c-a628-2c78365f752d" containerID="178f3e407c8804b835fad4139d67a6f823af172cae41539b5f104a589bad569f" exitCode=0 Jul 06 14:08:02.613734 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:08:02.613260 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b94bb86cb-wc47x" Jul 06 14:08:02.613734 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:08:02.613306 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b94bb86cb-wc47x" event={"ID":"0d53be34-f43c-499c-a628-2c78365f752d","Type":"ContainerDied","Data":"178f3e407c8804b835fad4139d67a6f823af172cae41539b5f104a589bad569f"} Jul 06 14:08:02.613734 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:08:02.613407 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b94bb86cb-wc47x" event={"ID":"0d53be34-f43c-499c-a628-2c78365f752d","Type":"ContainerDied","Data":"22fe69bcd997ce8e0e97b7f056b3ffcf7a362a114409dff4e7bd7d784ef60028"} Jul 06 14:08:02.613734 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:08:02.613437 2556 scope.go:117] "RemoveContainer" containerID="178f3e407c8804b835fad4139d67a6f823af172cae41539b5f104a589bad569f" Jul 06 14:08:02.628464 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:08:02.628440 2556 scope.go:117] "RemoveContainer" containerID="178f3e407c8804b835fad4139d67a6f823af172cae41539b5f104a589bad569f" Jul 06 14:08:02.628798 ip-10-0-134-85 kubenswrapper[2556]: E0706 14:08:02.628779 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"178f3e407c8804b835fad4139d67a6f823af172cae41539b5f104a589bad569f\": container with ID starting with 178f3e407c8804b835fad4139d67a6f823af172cae41539b5f104a589bad569f not found: ID does not exist" containerID="178f3e407c8804b835fad4139d67a6f823af172cae41539b5f104a589bad569f" Jul 06 14:08:02.628877 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:08:02.628804 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"178f3e407c8804b835fad4139d67a6f823af172cae41539b5f104a589bad569f"} err="failed to get container status \"178f3e407c8804b835fad4139d67a6f823af172cae41539b5f104a589bad569f\": rpc error: code = NotFound desc = could not find container \"178f3e407c8804b835fad4139d67a6f823af172cae41539b5f104a589bad569f\": container with ID starting with 178f3e407c8804b835fad4139d67a6f823af172cae41539b5f104a589bad569f not found: ID does not exist" Jul 06 14:08:02.641463 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:08:02.641437 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b94bb86cb-wc47x"] Jul 06 14:08:02.645430 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:08:02.645401 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7b94bb86cb-wc47x"] Jul 06 14:08:02.787443 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:08:02.787411 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d53be34-f43c-499c-a628-2c78365f752d" path="/var/lib/kubelet/pods/0d53be34-f43c-499c-a628-2c78365f752d/volumes" Jul 06 14:09:18.529595 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:09:18.529554 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:09:18.629868 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:09:18.629832 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:09:18.959092 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:09:18.959013 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:09:24.651243 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:09:24.651209 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:09:24.751586 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:09:24.751548 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:09:24.899989 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:09:24.899955 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:09:25.027109 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:09:25.027084 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:09:26.097208 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:09:26.097176 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:09:26.195328 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:09:26.195299 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:09:26.319957 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:09:26.319921 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:09:26.685030 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:09:26.684992 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:09:26.785772 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:09:26.785736 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:09:26.886076 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:09:26.886025 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:09:28.499086 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:09:28.499049 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:09:31.206798 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:09:31.206756 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:09:31.390936 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:09:31.390905 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:09:31.491764 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:09:31.491723 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:09:31.567901 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:09:31.567869 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:09:32.882239 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:09:32.882209 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:09:37.259538 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:09:37.259505 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:09:37.331213 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:09:37.331183 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:09:37.468680 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:09:37.468651 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:09:37.569209 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:09:37.569122 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:09:38.681237 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:09:38.681201 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:09:38.772082 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:09:38.772036 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:09:38.890146 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:09:38.890103 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:09:39.134898 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:09:39.134862 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:09:39.323923 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:09:39.323885 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:09:39.424913 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:09:39.424825 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:09:40.411238 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:09:40.411213 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:09:43.794745 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:09:43.794702 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:09:44.064128 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:09:44.064046 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:09:50.187716 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:09:50.187676 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:09:50.295789 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:09:50.295754 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:09:56.212110 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:09:56.212070 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:09:56.280373 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:09:56.280335 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:09:56.743090 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:09:56.743049 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:09:56.842676 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:09:56.842631 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:09:56.919231 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:09:56.919199 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:09:57.608705 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:09:57.608646 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:09:57.711233 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:09:57.711150 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:09:57.837997 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:09:57.837963 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:09:58.324640 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:09:58.324586 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:09:58.425415 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:09:58.425382 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:09:58.528251 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:09:58.528215 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:10:00.640077 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:10:00.640046 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:10:02.231759 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:10:02.231696 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:10:02.804197 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:10:02.804164 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:10:02.868673 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:10:02.868645 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:10:04.069062 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:10:04.069033 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:10:06.782526 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:10:06.782496 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vjl62_b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7/console-operator/2.log" Jul 06 14:10:06.787679 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:10:06.787659 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vjl62_b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7/console-operator/2.log" Jul 06 14:10:08.722218 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:10:08.722181 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:10:08.815357 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:10:08.815326 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:10:09.171478 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:10:09.171428 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:10:09.266190 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:10:09.266159 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:10:09.448780 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:10:09.448696 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:10:10.788122 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:10:10.788081 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:10:16.720331 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:10:16.720296 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:10:16.830266 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:10:16.830225 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:10:16.920778 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:10:16.920742 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:10:16.976094 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:10:16.976006 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:10:17.467071 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:10:17.467039 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:10:44.142388 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:10:44.142303 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:10:49.320518 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:10:49.320484 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:10:49.384898 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:10:49.384867 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:10:49.467055 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:10:49.467022 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:10:49.567816 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:10:49.567769 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:11:05.366454 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:11:05.366404 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:11:11.081928 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:11:11.081889 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:11:11.188920 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:11:11.188888 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:11:11.346954 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:11:11.346856 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:11:21.827141 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:11:21.827110 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:11:23.117085 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:11:23.117044 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:11:28.413539 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:11:28.413489 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:11:28.524065 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:11:28.524031 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:11:28.614108 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:11:28.614077 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:11:28.714265 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:11:28.714174 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:11:29.470541 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:11:29.470502 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:11:29.570678 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:11:29.570639 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:11:29.670825 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:11:29.670795 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:11:31.265879 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:11:31.265843 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:11:37.151006 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:11:37.150949 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:11:37.253581 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:11:37.253544 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:11:37.868565 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:11:37.868514 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:11:44.006796 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:11:44.006762 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:11:44.107408 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:11:44.107380 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:11:44.250903 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:11:44.250866 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:11:44.616322 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:11:44.616293 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:11:44.895977 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:11:44.895887 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:11:47.341448 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:11:47.341398 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:11:47.459000 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:11:47.458965 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:11:47.604170 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:11:47.604077 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:11:47.687351 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:11:47.687320 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:11:48.001435 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:11:48.001408 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:11:48.102304 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:11:48.102267 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:11:51.819564 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:11:51.819510 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:11:52.458818 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:11:52.458785 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:11:52.556344 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:11:52.556299 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:11:52.880555 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:11:52.880521 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:11:58.699841 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:11:58.699757 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:11:58.799709 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:11:58.799668 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:11:59.108792 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:11:59.108757 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:11:59.368818 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:11:59.368739 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:11:59.506239 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:11:59.506204 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:12:05.367081 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:12:05.367045 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:12:05.464973 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:12:05.464939 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:12:05.694771 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:12:05.694692 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:12:05.880910 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:12:05.880877 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:12:06.006938 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:12:06.006906 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:12:06.100778 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:12:06.100746 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:12:06.223290 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:12:06.223262 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:12:12.204985 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:12:12.204948 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:12:12.266959 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:12:12.266926 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:12:12.337070 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:12:12.337039 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:12:12.438027 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:12:12.437995 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:12:12.594021 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:12:12.593995 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:12:18.641774 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:12:18.641734 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:12:18.758090 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:12:18.758056 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:12:25.465220 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:12:25.465182 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:12:25.777323 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:12:25.777292 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:12:25.884092 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:12:25.884059 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:12:28.464178 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:12:28.464141 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:12:28.553505 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:12:28.553466 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:12:28.624461 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:12:28.624420 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:12:28.830176 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:12:28.830140 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:12:29.102294 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:12:29.102206 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:12:29.208765 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:12:29.208732 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:12:32.958904 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:12:32.958873 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:12:40.788362 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:12:40.788325 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:12:49.876141 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:12:49.876106 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:13:00.470872 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:13:00.470841 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:13:00.572186 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:13:00.572153 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:13:05.326087 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:13:05.326047 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:13:05.735126 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:13:05.735092 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:13:05.836221 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:13:05.836192 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:13:05.972251 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:13:05.972223 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:13:11.408712 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:13:11.408677 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:13:16.432134 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:13:16.432100 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:13:52.779967 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:13:52.779885 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:13:53.903979 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:13:53.903939 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:13:59.373423 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:13:59.373389 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:14:04.927402 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:14:04.927368 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:14:05.001335 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:14:05.001304 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:14:05.205298 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:14:05.205210 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:14:05.430957 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:14:05.430922 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:14:06.482213 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:14:06.482180 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:14:06.583513 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:14:06.583484 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:14:06.683575 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:14:06.683540 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:14:07.429947 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:14:07.429894 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:14:07.538682 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:14:07.538648 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:14:07.699155 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:14:07.699074 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:14:09.014484 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:14:09.014404 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:14:15.042047 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:14:15.042012 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:14:15.102368 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:14:15.102335 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:14:15.711685 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:14:15.711640 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:14:21.468981 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:14:21.468943 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:14:21.536512 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:14:21.536481 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:14:21.616972 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:14:21.616946 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:14:21.717022 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:14:21.716994 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:14:32.235448 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:14:32.235415 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:14:32.620058 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:14:32.619968 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:14:53.670265 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:14:53.670234 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:14:59.380650 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:14:59.380539 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:14:59.514196 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:14:59.514165 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:14:59.730410 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:14:59.730328 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:15:00.061234 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:15:00.061199 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:15:00.167120 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:15:00.167086 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:15:03.193291 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:15:03.193246 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:15:03.292269 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:15:03.292230 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:15:03.407727 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:15:03.407693 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:15:03.653995 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:15:03.653960 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:15:03.952154 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:15:03.952072 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:15:04.053081 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:15:04.053048 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:15:06.826457 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:15:06.826351 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vjl62_b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7/console-operator/2.log" Jul 06 14:15:06.836034 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:15:06.832860 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vjl62_b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7/console-operator/2.log" Jul 06 14:15:07.727038 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:15:07.727012 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:15:08.053349 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:15:08.053316 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:15:08.368105 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:15:08.367991 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:15:08.898317 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:15:08.898280 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:15:11.271193 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:15:11.271160 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:15:11.352355 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:15:11.352312 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:15:11.419137 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:15:11.419101 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:15:11.728075 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:15:11.727982 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:15:11.934610 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:15:11.934572 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:15:12.037422 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:15:12.037387 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:15:15.750642 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:15:15.750562 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:15:24.845318 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:15:24.845286 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:15:24.947847 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:15:24.947816 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:15:32.811927 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:15:32.811887 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:15:32.912263 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:15:32.912241 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:15:35.983263 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:15:35.983224 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-2beb98/test-model-2beb98-kserve-7479bb6c69-rbtnx"] Jul 06 14:15:35.983867 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:15:35.983849 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d53be34-f43c-499c-a628-2c78365f752d" containerName="console" Jul 06 14:15:35.983959 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:15:35.983871 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d53be34-f43c-499c-a628-2c78365f752d" containerName="console" Jul 06 14:15:35.984015 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:15:35.984004 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d53be34-f43c-499c-a628-2c78365f752d" containerName="console" Jul 06 14:15:35.987290 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:15:35.987269 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2beb98/test-model-2beb98-kserve-7479bb6c69-rbtnx" Jul 06 14:15:35.991678 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:15:35.991653 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-2beb98\"/\"default-dockercfg-4m9v8\"" Jul 06 14:15:35.991678 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:15:35.991672 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-2beb98\"/\"test-model-2beb98-kserve-self-signed-certs\"" Jul 06 14:15:35.991970 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:15:35.991846 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-2beb98\"/\"openshift-service-ca.crt\"" Jul 06 14:15:35.991970 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:15:35.991909 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-2beb98\"/\"kube-root-ca.crt\"" Jul 06 14:15:35.999800 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:15:35.999772 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-2beb98/test-model-2beb98-kserve-7479bb6c69-rbtnx"] Jul 06 14:15:36.007445 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:15:36.007422 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:15:36.077585 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:15:36.077552 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bac48270-e0a1-4a76-9116-e9af99acf796-home\") pod \"test-model-2beb98-kserve-7479bb6c69-rbtnx\" (UID: \"bac48270-e0a1-4a76-9116-e9af99acf796\") " pod="ai-tenant-e2e-inf-a-2beb98/test-model-2beb98-kserve-7479bb6c69-rbtnx" Jul 06 14:15:36.077759 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:15:36.077646 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bac48270-e0a1-4a76-9116-e9af99acf796-tls-certs\") pod \"test-model-2beb98-kserve-7479bb6c69-rbtnx\" (UID: \"bac48270-e0a1-4a76-9116-e9af99acf796\") " pod="ai-tenant-e2e-inf-a-2beb98/test-model-2beb98-kserve-7479bb6c69-rbtnx" Jul 06 14:15:36.077759 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:15:36.077672 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bac48270-e0a1-4a76-9116-e9af99acf796-tmp-dir\") pod \"test-model-2beb98-kserve-7479bb6c69-rbtnx\" (UID: \"bac48270-e0a1-4a76-9116-e9af99acf796\") " pod="ai-tenant-e2e-inf-a-2beb98/test-model-2beb98-kserve-7479bb6c69-rbtnx" Jul 06 14:15:36.077759 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:15:36.077691 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bac48270-e0a1-4a76-9116-e9af99acf796-dshm\") pod \"test-model-2beb98-kserve-7479bb6c69-rbtnx\" (UID: \"bac48270-e0a1-4a76-9116-e9af99acf796\") " pod="ai-tenant-e2e-inf-a-2beb98/test-model-2beb98-kserve-7479bb6c69-rbtnx" Jul 06 14:15:36.077884 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:15:36.077764 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bac48270-e0a1-4a76-9116-e9af99acf796-model-cache\") pod \"test-model-2beb98-kserve-7479bb6c69-rbtnx\" (UID: \"bac48270-e0a1-4a76-9116-e9af99acf796\") " pod="ai-tenant-e2e-inf-a-2beb98/test-model-2beb98-kserve-7479bb6c69-rbtnx" Jul 06 14:15:36.077884 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:15:36.077853 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qwbt\" (UniqueName: \"kubernetes.io/projected/bac48270-e0a1-4a76-9116-e9af99acf796-kube-api-access-5qwbt\") pod \"test-model-2beb98-kserve-7479bb6c69-rbtnx\" (UID: \"bac48270-e0a1-4a76-9116-e9af99acf796\") " pod="ai-tenant-e2e-inf-a-2beb98/test-model-2beb98-kserve-7479bb6c69-rbtnx" Jul 06 14:15:36.178972 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:15:36.178929 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bac48270-e0a1-4a76-9116-e9af99acf796-model-cache\") pod \"test-model-2beb98-kserve-7479bb6c69-rbtnx\" (UID: \"bac48270-e0a1-4a76-9116-e9af99acf796\") " pod="ai-tenant-e2e-inf-a-2beb98/test-model-2beb98-kserve-7479bb6c69-rbtnx" Jul 06 14:15:36.179141 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:15:36.179023 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qwbt\" (UniqueName: \"kubernetes.io/projected/bac48270-e0a1-4a76-9116-e9af99acf796-kube-api-access-5qwbt\") pod \"test-model-2beb98-kserve-7479bb6c69-rbtnx\" (UID: \"bac48270-e0a1-4a76-9116-e9af99acf796\") " pod="ai-tenant-e2e-inf-a-2beb98/test-model-2beb98-kserve-7479bb6c69-rbtnx" Jul 06 14:15:36.179141 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:15:36.179063 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bac48270-e0a1-4a76-9116-e9af99acf796-home\") pod \"test-model-2beb98-kserve-7479bb6c69-rbtnx\" (UID: \"bac48270-e0a1-4a76-9116-e9af99acf796\") " pod="ai-tenant-e2e-inf-a-2beb98/test-model-2beb98-kserve-7479bb6c69-rbtnx" Jul 06 14:15:36.179270 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:15:36.179148 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bac48270-e0a1-4a76-9116-e9af99acf796-tls-certs\") pod \"test-model-2beb98-kserve-7479bb6c69-rbtnx\" (UID: \"bac48270-e0a1-4a76-9116-e9af99acf796\") " pod="ai-tenant-e2e-inf-a-2beb98/test-model-2beb98-kserve-7479bb6c69-rbtnx" Jul 06 14:15:36.179270 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:15:36.179182 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bac48270-e0a1-4a76-9116-e9af99acf796-tmp-dir\") pod \"test-model-2beb98-kserve-7479bb6c69-rbtnx\" (UID: \"bac48270-e0a1-4a76-9116-e9af99acf796\") " pod="ai-tenant-e2e-inf-a-2beb98/test-model-2beb98-kserve-7479bb6c69-rbtnx" Jul 06 14:15:36.179270 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:15:36.179214 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bac48270-e0a1-4a76-9116-e9af99acf796-dshm\") pod \"test-model-2beb98-kserve-7479bb6c69-rbtnx\" (UID: \"bac48270-e0a1-4a76-9116-e9af99acf796\") " pod="ai-tenant-e2e-inf-a-2beb98/test-model-2beb98-kserve-7479bb6c69-rbtnx" Jul 06 14:15:36.179439 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:15:36.179413 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bac48270-e0a1-4a76-9116-e9af99acf796-model-cache\") pod \"test-model-2beb98-kserve-7479bb6c69-rbtnx\" (UID: \"bac48270-e0a1-4a76-9116-e9af99acf796\") " pod="ai-tenant-e2e-inf-a-2beb98/test-model-2beb98-kserve-7479bb6c69-rbtnx" Jul 06 14:15:36.179519 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:15:36.179500 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bac48270-e0a1-4a76-9116-e9af99acf796-home\") pod \"test-model-2beb98-kserve-7479bb6c69-rbtnx\" (UID: \"bac48270-e0a1-4a76-9116-e9af99acf796\") " pod="ai-tenant-e2e-inf-a-2beb98/test-model-2beb98-kserve-7479bb6c69-rbtnx" Jul 06 14:15:36.179724 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:15:36.179705 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bac48270-e0a1-4a76-9116-e9af99acf796-tmp-dir\") pod \"test-model-2beb98-kserve-7479bb6c69-rbtnx\" (UID: \"bac48270-e0a1-4a76-9116-e9af99acf796\") " pod="ai-tenant-e2e-inf-a-2beb98/test-model-2beb98-kserve-7479bb6c69-rbtnx" Jul 06 14:15:36.181872 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:15:36.181816 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bac48270-e0a1-4a76-9116-e9af99acf796-dshm\") pod \"test-model-2beb98-kserve-7479bb6c69-rbtnx\" (UID: \"bac48270-e0a1-4a76-9116-e9af99acf796\") " pod="ai-tenant-e2e-inf-a-2beb98/test-model-2beb98-kserve-7479bb6c69-rbtnx" Jul 06 14:15:36.182270 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:15:36.182249 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bac48270-e0a1-4a76-9116-e9af99acf796-tls-certs\") pod \"test-model-2beb98-kserve-7479bb6c69-rbtnx\" (UID: \"bac48270-e0a1-4a76-9116-e9af99acf796\") " pod="ai-tenant-e2e-inf-a-2beb98/test-model-2beb98-kserve-7479bb6c69-rbtnx" Jul 06 14:15:36.188225 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:15:36.188202 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qwbt\" (UniqueName: \"kubernetes.io/projected/bac48270-e0a1-4a76-9116-e9af99acf796-kube-api-access-5qwbt\") pod \"test-model-2beb98-kserve-7479bb6c69-rbtnx\" (UID: \"bac48270-e0a1-4a76-9116-e9af99acf796\") " pod="ai-tenant-e2e-inf-a-2beb98/test-model-2beb98-kserve-7479bb6c69-rbtnx" Jul 06 14:15:36.300857 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:15:36.300833 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2beb98/test-model-2beb98-kserve-7479bb6c69-rbtnx" Jul 06 14:15:36.442675 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:15:36.442649 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-2beb98/test-model-2beb98-kserve-7479bb6c69-rbtnx"] Jul 06 14:15:36.443835 ip-10-0-134-85 kubenswrapper[2556]: W0706 14:15:36.443798 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbac48270_e0a1_4a76_9116_e9af99acf796.slice/crio-a99b23e883310f844ecb6ae4ed6e294926033127c97d4b6c8d7c26a62a47a46e WatchSource:0}: Error finding container a99b23e883310f844ecb6ae4ed6e294926033127c97d4b6c8d7c26a62a47a46e: Status 404 returned error can't find the container with id a99b23e883310f844ecb6ae4ed6e294926033127c97d4b6c8d7c26a62a47a46e Jul 06 14:15:37.341302 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:15:37.341263 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2beb98/test-model-2beb98-kserve-7479bb6c69-rbtnx" event={"ID":"bac48270-e0a1-4a76-9116-e9af99acf796","Type":"ContainerStarted","Data":"882cd6443821f586bbc8632a277da0160989f68a8f9a66211471163f5f18847c"} Jul 06 14:15:37.341731 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:15:37.341313 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2beb98/test-model-2beb98-kserve-7479bb6c69-rbtnx" event={"ID":"bac48270-e0a1-4a76-9116-e9af99acf796","Type":"ContainerStarted","Data":"a99b23e883310f844ecb6ae4ed6e294926033127c97d4b6c8d7c26a62a47a46e"} Jul 06 14:15:37.363143 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:15:37.363093 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-2beb98/test-model-2beb98-kserve-7479bb6c69-rbtnx" podStartSLOduration=2.363077973 podStartE2EDuration="2.363077973s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:15:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:15:37.3612356 +0000 UTC m=+1831.160981288" watchObservedRunningTime="2026-07-06 14:15:37.363077973 +0000 UTC m=+1831.162823668" Jul 06 14:15:43.479754 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:15:43.479721 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:15:46.300994 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:15:46.300957 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-2beb98/test-model-2beb98-kserve-7479bb6c69-rbtnx" Jul 06 14:15:46.301412 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:15:46.301013 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-2beb98/test-model-2beb98-kserve-7479bb6c69-rbtnx" Jul 06 14:15:46.313843 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:15:46.313820 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-2beb98/test-model-2beb98-kserve-7479bb6c69-rbtnx" Jul 06 14:15:46.407226 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:15:46.407200 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-2beb98/test-model-2beb98-kserve-7479bb6c69-rbtnx" Jul 06 14:15:52.791826 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:15:52.791789 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:15:52.892893 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:15:52.892863 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:16:06.176341 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:06.176307 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-53d7c5/test-model-53d7c5-kserve-b97d74f47-dcv6d"] Jul 06 14:16:06.180938 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:06.180907 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-53d7c5/test-model-53d7c5-kserve-b97d74f47-dcv6d" Jul 06 14:16:06.186070 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:06.186042 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-53d7c5\"/\"kube-root-ca.crt\"" Jul 06 14:16:06.186200 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:06.186055 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-53d7c5\"/\"test-model-53d7c5-kserve-self-signed-certs\"" Jul 06 14:16:06.186283 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:06.186258 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-53d7c5\"/\"openshift-service-ca.crt\"" Jul 06 14:16:06.186437 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:06.186406 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-53d7c5\"/\"default-dockercfg-chbfm\"" Jul 06 14:16:06.189920 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:06.189841 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-53d7c5/test-model-53d7c5-kserve-b97d74f47-dcv6d"] Jul 06 14:16:06.257462 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:06.257430 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9cac69d1-0edf-48a0-bdf5-9640385ec15a-dshm\") pod \"test-model-53d7c5-kserve-b97d74f47-dcv6d\" (UID: \"9cac69d1-0edf-48a0-bdf5-9640385ec15a\") " pod="ai-tenant-e2e-inf-b-53d7c5/test-model-53d7c5-kserve-b97d74f47-dcv6d" Jul 06 14:16:06.257608 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:06.257465 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9cac69d1-0edf-48a0-bdf5-9640385ec15a-model-cache\") pod \"test-model-53d7c5-kserve-b97d74f47-dcv6d\" (UID: \"9cac69d1-0edf-48a0-bdf5-9640385ec15a\") " pod="ai-tenant-e2e-inf-b-53d7c5/test-model-53d7c5-kserve-b97d74f47-dcv6d" Jul 06 14:16:06.257608 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:06.257513 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9cac69d1-0edf-48a0-bdf5-9640385ec15a-tmp-dir\") pod \"test-model-53d7c5-kserve-b97d74f47-dcv6d\" (UID: \"9cac69d1-0edf-48a0-bdf5-9640385ec15a\") " pod="ai-tenant-e2e-inf-b-53d7c5/test-model-53d7c5-kserve-b97d74f47-dcv6d" Jul 06 14:16:06.257608 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:06.257564 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9cac69d1-0edf-48a0-bdf5-9640385ec15a-home\") pod \"test-model-53d7c5-kserve-b97d74f47-dcv6d\" (UID: \"9cac69d1-0edf-48a0-bdf5-9640385ec15a\") " pod="ai-tenant-e2e-inf-b-53d7c5/test-model-53d7c5-kserve-b97d74f47-dcv6d" Jul 06 14:16:06.257779 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:06.257609 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klnc5\" (UniqueName: \"kubernetes.io/projected/9cac69d1-0edf-48a0-bdf5-9640385ec15a-kube-api-access-klnc5\") pod \"test-model-53d7c5-kserve-b97d74f47-dcv6d\" (UID: \"9cac69d1-0edf-48a0-bdf5-9640385ec15a\") " pod="ai-tenant-e2e-inf-b-53d7c5/test-model-53d7c5-kserve-b97d74f47-dcv6d" Jul 06 14:16:06.257779 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:06.257669 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9cac69d1-0edf-48a0-bdf5-9640385ec15a-tls-certs\") pod \"test-model-53d7c5-kserve-b97d74f47-dcv6d\" (UID: \"9cac69d1-0edf-48a0-bdf5-9640385ec15a\") " pod="ai-tenant-e2e-inf-b-53d7c5/test-model-53d7c5-kserve-b97d74f47-dcv6d" Jul 06 14:16:06.358545 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:06.358505 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9cac69d1-0edf-48a0-bdf5-9640385ec15a-home\") pod \"test-model-53d7c5-kserve-b97d74f47-dcv6d\" (UID: \"9cac69d1-0edf-48a0-bdf5-9640385ec15a\") " pod="ai-tenant-e2e-inf-b-53d7c5/test-model-53d7c5-kserve-b97d74f47-dcv6d" Jul 06 14:16:06.358751 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:06.358564 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klnc5\" (UniqueName: \"kubernetes.io/projected/9cac69d1-0edf-48a0-bdf5-9640385ec15a-kube-api-access-klnc5\") pod \"test-model-53d7c5-kserve-b97d74f47-dcv6d\" (UID: \"9cac69d1-0edf-48a0-bdf5-9640385ec15a\") " pod="ai-tenant-e2e-inf-b-53d7c5/test-model-53d7c5-kserve-b97d74f47-dcv6d" Jul 06 14:16:06.358751 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:06.358595 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9cac69d1-0edf-48a0-bdf5-9640385ec15a-tls-certs\") pod \"test-model-53d7c5-kserve-b97d74f47-dcv6d\" (UID: \"9cac69d1-0edf-48a0-bdf5-9640385ec15a\") " pod="ai-tenant-e2e-inf-b-53d7c5/test-model-53d7c5-kserve-b97d74f47-dcv6d" Jul 06 14:16:06.358751 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:06.358679 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9cac69d1-0edf-48a0-bdf5-9640385ec15a-dshm\") pod \"test-model-53d7c5-kserve-b97d74f47-dcv6d\" (UID: \"9cac69d1-0edf-48a0-bdf5-9640385ec15a\") " pod="ai-tenant-e2e-inf-b-53d7c5/test-model-53d7c5-kserve-b97d74f47-dcv6d" Jul 06 14:16:06.358751 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:06.358705 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9cac69d1-0edf-48a0-bdf5-9640385ec15a-model-cache\") pod \"test-model-53d7c5-kserve-b97d74f47-dcv6d\" (UID: \"9cac69d1-0edf-48a0-bdf5-9640385ec15a\") " pod="ai-tenant-e2e-inf-b-53d7c5/test-model-53d7c5-kserve-b97d74f47-dcv6d" Jul 06 14:16:06.358978 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:06.358771 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9cac69d1-0edf-48a0-bdf5-9640385ec15a-tmp-dir\") pod \"test-model-53d7c5-kserve-b97d74f47-dcv6d\" (UID: \"9cac69d1-0edf-48a0-bdf5-9640385ec15a\") " pod="ai-tenant-e2e-inf-b-53d7c5/test-model-53d7c5-kserve-b97d74f47-dcv6d" Jul 06 14:16:06.359040 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:06.358973 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9cac69d1-0edf-48a0-bdf5-9640385ec15a-home\") pod \"test-model-53d7c5-kserve-b97d74f47-dcv6d\" (UID: \"9cac69d1-0edf-48a0-bdf5-9640385ec15a\") " pod="ai-tenant-e2e-inf-b-53d7c5/test-model-53d7c5-kserve-b97d74f47-dcv6d" Jul 06 14:16:06.359136 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:06.359117 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9cac69d1-0edf-48a0-bdf5-9640385ec15a-tmp-dir\") pod \"test-model-53d7c5-kserve-b97d74f47-dcv6d\" (UID: \"9cac69d1-0edf-48a0-bdf5-9640385ec15a\") " pod="ai-tenant-e2e-inf-b-53d7c5/test-model-53d7c5-kserve-b97d74f47-dcv6d" Jul 06 14:16:06.359194 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:06.359120 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9cac69d1-0edf-48a0-bdf5-9640385ec15a-model-cache\") pod \"test-model-53d7c5-kserve-b97d74f47-dcv6d\" (UID: \"9cac69d1-0edf-48a0-bdf5-9640385ec15a\") " pod="ai-tenant-e2e-inf-b-53d7c5/test-model-53d7c5-kserve-b97d74f47-dcv6d" Jul 06 14:16:06.360953 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:06.360927 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9cac69d1-0edf-48a0-bdf5-9640385ec15a-dshm\") pod \"test-model-53d7c5-kserve-b97d74f47-dcv6d\" (UID: \"9cac69d1-0edf-48a0-bdf5-9640385ec15a\") " pod="ai-tenant-e2e-inf-b-53d7c5/test-model-53d7c5-kserve-b97d74f47-dcv6d" Jul 06 14:16:06.361084 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:06.361064 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9cac69d1-0edf-48a0-bdf5-9640385ec15a-tls-certs\") pod \"test-model-53d7c5-kserve-b97d74f47-dcv6d\" (UID: \"9cac69d1-0edf-48a0-bdf5-9640385ec15a\") " pod="ai-tenant-e2e-inf-b-53d7c5/test-model-53d7c5-kserve-b97d74f47-dcv6d" Jul 06 14:16:06.367187 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:06.367168 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-klnc5\" (UniqueName: \"kubernetes.io/projected/9cac69d1-0edf-48a0-bdf5-9640385ec15a-kube-api-access-klnc5\") pod \"test-model-53d7c5-kserve-b97d74f47-dcv6d\" (UID: \"9cac69d1-0edf-48a0-bdf5-9640385ec15a\") " pod="ai-tenant-e2e-inf-b-53d7c5/test-model-53d7c5-kserve-b97d74f47-dcv6d" Jul 06 14:16:06.483395 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:06.483334 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:16:06.493326 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:06.493305 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-53d7c5/test-model-53d7c5-kserve-b97d74f47-dcv6d" Jul 06 14:16:06.634832 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:06.634798 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-53d7c5/test-model-53d7c5-kserve-b97d74f47-dcv6d"] Jul 06 14:16:06.635626 ip-10-0-134-85 kubenswrapper[2556]: W0706 14:16:06.635582 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9cac69d1_0edf_48a0_bdf5_9640385ec15a.slice/crio-f1ed322444f06d878792d1b0a8e73755a01d49c046757963eb08842b6a742147 WatchSource:0}: Error finding container f1ed322444f06d878792d1b0a8e73755a01d49c046757963eb08842b6a742147: Status 404 returned error can't find the container with id f1ed322444f06d878792d1b0a8e73755a01d49c046757963eb08842b6a742147 Jul 06 14:16:07.524216 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:07.524170 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-53d7c5/test-model-53d7c5-kserve-b97d74f47-dcv6d" event={"ID":"9cac69d1-0edf-48a0-bdf5-9640385ec15a","Type":"ContainerStarted","Data":"828c00fdeee616e20180cb72a6bd190580c4c865a49456eb5a6f2dbfdcddd227"} Jul 06 14:16:07.524698 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:07.524227 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-53d7c5/test-model-53d7c5-kserve-b97d74f47-dcv6d" event={"ID":"9cac69d1-0edf-48a0-bdf5-9640385ec15a","Type":"ContainerStarted","Data":"f1ed322444f06d878792d1b0a8e73755a01d49c046757963eb08842b6a742147"} Jul 06 14:16:07.548103 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:07.548053 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-53d7c5/test-model-53d7c5-kserve-b97d74f47-dcv6d" podStartSLOduration=1.548039368 podStartE2EDuration="1.548039368s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:16:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:16:07.546019767 +0000 UTC m=+1861.345765460" watchObservedRunningTime="2026-07-06 14:16:07.548039368 +0000 UTC m=+1861.347785058" Jul 06 14:16:16.493516 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:16.493479 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-53d7c5/test-model-53d7c5-kserve-b97d74f47-dcv6d" Jul 06 14:16:16.493940 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:16.493537 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-53d7c5/test-model-53d7c5-kserve-b97d74f47-dcv6d" Jul 06 14:16:16.505847 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:16.505821 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-53d7c5/test-model-53d7c5-kserve-b97d74f47-dcv6d" Jul 06 14:16:16.589572 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:16.589546 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-53d7c5/test-model-53d7c5-kserve-b97d74f47-dcv6d" Jul 06 14:16:24.624094 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:24.624056 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-2beb98/test-model-2beb98-kserve-7479bb6c69-rbtnx"] Jul 06 14:16:24.640961 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:24.640904 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:16:25.568106 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:25.568073 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-53d7c5/test-model-53d7c5-kserve-b97d74f47-dcv6d"] Jul 06 14:16:26.541438 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:26.541402 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:16:26.621246 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:26.621200 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:16:31.450198 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:31.450088 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:16:39.647236 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:39.647177 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-2beb98/test-model-2beb98-kserve-7479bb6c69-rbtnx" podUID="bac48270-e0a1-4a76-9116-e9af99acf796" containerName="main" containerID="cri-o://882cd6443821f586bbc8632a277da0160989f68a8f9a66211471163f5f18847c" gracePeriod=45 Jul 06 14:16:39.901528 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:39.901471 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2beb98/test-model-2beb98-kserve-7479bb6c69-rbtnx" Jul 06 14:16:39.970607 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:39.970580 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bac48270-e0a1-4a76-9116-e9af99acf796-dshm\") pod \"bac48270-e0a1-4a76-9116-e9af99acf796\" (UID: \"bac48270-e0a1-4a76-9116-e9af99acf796\") " Jul 06 14:16:39.970780 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:39.970637 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bac48270-e0a1-4a76-9116-e9af99acf796-home\") pod \"bac48270-e0a1-4a76-9116-e9af99acf796\" (UID: \"bac48270-e0a1-4a76-9116-e9af99acf796\") " Jul 06 14:16:39.970780 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:39.970656 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bac48270-e0a1-4a76-9116-e9af99acf796-tmp-dir\") pod \"bac48270-e0a1-4a76-9116-e9af99acf796\" (UID: \"bac48270-e0a1-4a76-9116-e9af99acf796\") " Jul 06 14:16:39.970780 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:39.970685 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bac48270-e0a1-4a76-9116-e9af99acf796-model-cache\") pod \"bac48270-e0a1-4a76-9116-e9af99acf796\" (UID: \"bac48270-e0a1-4a76-9116-e9af99acf796\") " Jul 06 14:16:39.970780 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:39.970732 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bac48270-e0a1-4a76-9116-e9af99acf796-tls-certs\") pod \"bac48270-e0a1-4a76-9116-e9af99acf796\" (UID: \"bac48270-e0a1-4a76-9116-e9af99acf796\") " Jul 06 14:16:39.970985 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:39.970787 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5qwbt\" (UniqueName: \"kubernetes.io/projected/bac48270-e0a1-4a76-9116-e9af99acf796-kube-api-access-5qwbt\") pod \"bac48270-e0a1-4a76-9116-e9af99acf796\" (UID: \"bac48270-e0a1-4a76-9116-e9af99acf796\") " Jul 06 14:16:39.970985 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:39.970894 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bac48270-e0a1-4a76-9116-e9af99acf796-home" (OuterVolumeSpecName: "home") pod "bac48270-e0a1-4a76-9116-e9af99acf796" (UID: "bac48270-e0a1-4a76-9116-e9af99acf796"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:16:39.970985 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:39.970944 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bac48270-e0a1-4a76-9116-e9af99acf796-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bac48270-e0a1-4a76-9116-e9af99acf796" (UID: "bac48270-e0a1-4a76-9116-e9af99acf796"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:16:39.970985 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:39.970962 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bac48270-e0a1-4a76-9116-e9af99acf796-model-cache" (OuterVolumeSpecName: "model-cache") pod "bac48270-e0a1-4a76-9116-e9af99acf796" (UID: "bac48270-e0a1-4a76-9116-e9af99acf796"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:16:39.971157 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:39.971142 2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bac48270-e0a1-4a76-9116-e9af99acf796-home\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 14:16:39.971203 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:39.971161 2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bac48270-e0a1-4a76-9116-e9af99acf796-tmp-dir\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 14:16:39.971203 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:39.971170 2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bac48270-e0a1-4a76-9116-e9af99acf796-model-cache\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 14:16:39.972817 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:39.972786 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bac48270-e0a1-4a76-9116-e9af99acf796-dshm" (OuterVolumeSpecName: "dshm") pod "bac48270-e0a1-4a76-9116-e9af99acf796" (UID: "bac48270-e0a1-4a76-9116-e9af99acf796"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:16:39.972926 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:39.972839 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bac48270-e0a1-4a76-9116-e9af99acf796-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bac48270-e0a1-4a76-9116-e9af99acf796" (UID: "bac48270-e0a1-4a76-9116-e9af99acf796"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 14:16:39.972926 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:39.972871 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bac48270-e0a1-4a76-9116-e9af99acf796-kube-api-access-5qwbt" (OuterVolumeSpecName: "kube-api-access-5qwbt") pod "bac48270-e0a1-4a76-9116-e9af99acf796" (UID: "bac48270-e0a1-4a76-9116-e9af99acf796"). InnerVolumeSpecName "kube-api-access-5qwbt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 14:16:40.072422 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:40.072395 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5qwbt\" (UniqueName: \"kubernetes.io/projected/bac48270-e0a1-4a76-9116-e9af99acf796-kube-api-access-5qwbt\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 14:16:40.072422 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:40.072424 2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bac48270-e0a1-4a76-9116-e9af99acf796-dshm\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 14:16:40.072562 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:40.072433 2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bac48270-e0a1-4a76-9116-e9af99acf796-tls-certs\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 14:16:40.589064 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:40.589004 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-53d7c5/test-model-53d7c5-kserve-b97d74f47-dcv6d" podUID="9cac69d1-0edf-48a0-bdf5-9640385ec15a" containerName="main" containerID="cri-o://828c00fdeee616e20180cb72a6bd190580c4c865a49456eb5a6f2dbfdcddd227" gracePeriod=45 Jul 06 14:16:40.728101 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:40.728051 2556 generic.go:356] "Generic (PLEG): container finished" podID="9cac69d1-0edf-48a0-bdf5-9640385ec15a" containerID="828c00fdeee616e20180cb72a6bd190580c4c865a49456eb5a6f2dbfdcddd227" exitCode=0 Jul 06 14:16:40.728432 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:40.728114 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-53d7c5/test-model-53d7c5-kserve-b97d74f47-dcv6d" event={"ID":"9cac69d1-0edf-48a0-bdf5-9640385ec15a","Type":"ContainerDied","Data":"828c00fdeee616e20180cb72a6bd190580c4c865a49456eb5a6f2dbfdcddd227"} Jul 06 14:16:40.729716 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:40.729689 2556 generic.go:356] "Generic (PLEG): container finished" podID="bac48270-e0a1-4a76-9116-e9af99acf796" containerID="882cd6443821f586bbc8632a277da0160989f68a8f9a66211471163f5f18847c" exitCode=0 Jul 06 14:16:40.729821 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:40.729739 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2beb98/test-model-2beb98-kserve-7479bb6c69-rbtnx" event={"ID":"bac48270-e0a1-4a76-9116-e9af99acf796","Type":"ContainerDied","Data":"882cd6443821f586bbc8632a277da0160989f68a8f9a66211471163f5f18847c"} Jul 06 14:16:40.729821 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:40.729775 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2beb98/test-model-2beb98-kserve-7479bb6c69-rbtnx" event={"ID":"bac48270-e0a1-4a76-9116-e9af99acf796","Type":"ContainerDied","Data":"a99b23e883310f844ecb6ae4ed6e294926033127c97d4b6c8d7c26a62a47a46e"} Jul 06 14:16:40.729821 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:40.729798 2556 scope.go:117] "RemoveContainer" containerID="882cd6443821f586bbc8632a277da0160989f68a8f9a66211471163f5f18847c" Jul 06 14:16:40.729821 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:40.729742 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2beb98/test-model-2beb98-kserve-7479bb6c69-rbtnx" Jul 06 14:16:40.740172 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:40.740156 2556 scope.go:117] "RemoveContainer" containerID="882cd6443821f586bbc8632a277da0160989f68a8f9a66211471163f5f18847c" Jul 06 14:16:40.740434 ip-10-0-134-85 kubenswrapper[2556]: E0706 14:16:40.740417 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"882cd6443821f586bbc8632a277da0160989f68a8f9a66211471163f5f18847c\": container with ID starting with 882cd6443821f586bbc8632a277da0160989f68a8f9a66211471163f5f18847c not found: ID does not exist" containerID="882cd6443821f586bbc8632a277da0160989f68a8f9a66211471163f5f18847c" Jul 06 14:16:40.740493 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:40.740443 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"882cd6443821f586bbc8632a277da0160989f68a8f9a66211471163f5f18847c"} err="failed to get container status \"882cd6443821f586bbc8632a277da0160989f68a8f9a66211471163f5f18847c\": rpc error: code = NotFound desc = could not find container \"882cd6443821f586bbc8632a277da0160989f68a8f9a66211471163f5f18847c\": container with ID starting with 882cd6443821f586bbc8632a277da0160989f68a8f9a66211471163f5f18847c not found: ID does not exist" Jul 06 14:16:40.754630 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:40.754601 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-2beb98/test-model-2beb98-kserve-7479bb6c69-rbtnx"] Jul 06 14:16:40.764257 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:40.764239 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-2beb98/test-model-2beb98-kserve-7479bb6c69-rbtnx"] Jul 06 14:16:40.792162 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:40.792135 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bac48270-e0a1-4a76-9116-e9af99acf796" path="/var/lib/kubelet/pods/bac48270-e0a1-4a76-9116-e9af99acf796/volumes" Jul 06 14:16:40.849852 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:40.849800 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-53d7c5/test-model-53d7c5-kserve-b97d74f47-dcv6d" Jul 06 14:16:40.879068 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:40.879048 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9cac69d1-0edf-48a0-bdf5-9640385ec15a-home\") pod \"9cac69d1-0edf-48a0-bdf5-9640385ec15a\" (UID: \"9cac69d1-0edf-48a0-bdf5-9640385ec15a\") " Jul 06 14:16:40.879171 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:40.879103 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9cac69d1-0edf-48a0-bdf5-9640385ec15a-tmp-dir\") pod \"9cac69d1-0edf-48a0-bdf5-9640385ec15a\" (UID: \"9cac69d1-0edf-48a0-bdf5-9640385ec15a\") " Jul 06 14:16:40.879171 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:40.879132 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9cac69d1-0edf-48a0-bdf5-9640385ec15a-model-cache\") pod \"9cac69d1-0edf-48a0-bdf5-9640385ec15a\" (UID: \"9cac69d1-0edf-48a0-bdf5-9640385ec15a\") " Jul 06 14:16:40.879295 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:40.879235 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9cac69d1-0edf-48a0-bdf5-9640385ec15a-dshm\") pod \"9cac69d1-0edf-48a0-bdf5-9640385ec15a\" (UID: \"9cac69d1-0edf-48a0-bdf5-9640385ec15a\") " Jul 06 14:16:40.879295 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:40.879276 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9cac69d1-0edf-48a0-bdf5-9640385ec15a-tls-certs\") pod \"9cac69d1-0edf-48a0-bdf5-9640385ec15a\" (UID: \"9cac69d1-0edf-48a0-bdf5-9640385ec15a\") " Jul 06 14:16:40.879399 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:40.879302 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-klnc5\" (UniqueName: \"kubernetes.io/projected/9cac69d1-0edf-48a0-bdf5-9640385ec15a-kube-api-access-klnc5\") pod \"9cac69d1-0edf-48a0-bdf5-9640385ec15a\" (UID: \"9cac69d1-0edf-48a0-bdf5-9640385ec15a\") " Jul 06 14:16:40.879399 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:40.879342 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cac69d1-0edf-48a0-bdf5-9640385ec15a-home" (OuterVolumeSpecName: "home") pod "9cac69d1-0edf-48a0-bdf5-9640385ec15a" (UID: "9cac69d1-0edf-48a0-bdf5-9640385ec15a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:16:40.879495 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:40.879434 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cac69d1-0edf-48a0-bdf5-9640385ec15a-model-cache" (OuterVolumeSpecName: "model-cache") pod "9cac69d1-0edf-48a0-bdf5-9640385ec15a" (UID: "9cac69d1-0edf-48a0-bdf5-9640385ec15a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:16:40.879698 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:40.879677 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cac69d1-0edf-48a0-bdf5-9640385ec15a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9cac69d1-0edf-48a0-bdf5-9640385ec15a" (UID: "9cac69d1-0edf-48a0-bdf5-9640385ec15a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:16:40.879771 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:40.879710 2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9cac69d1-0edf-48a0-bdf5-9640385ec15a-home\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 14:16:40.879771 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:40.879751 2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9cac69d1-0edf-48a0-bdf5-9640385ec15a-model-cache\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 14:16:40.881473 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:40.881449 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9cac69d1-0edf-48a0-bdf5-9640385ec15a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9cac69d1-0edf-48a0-bdf5-9640385ec15a" (UID: "9cac69d1-0edf-48a0-bdf5-9640385ec15a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 14:16:40.881570 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:40.881486 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cac69d1-0edf-48a0-bdf5-9640385ec15a-dshm" (OuterVolumeSpecName: "dshm") pod "9cac69d1-0edf-48a0-bdf5-9640385ec15a" (UID: "9cac69d1-0edf-48a0-bdf5-9640385ec15a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:16:40.881798 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:40.881777 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cac69d1-0edf-48a0-bdf5-9640385ec15a-kube-api-access-klnc5" (OuterVolumeSpecName: "kube-api-access-klnc5") pod "9cac69d1-0edf-48a0-bdf5-9640385ec15a" (UID: "9cac69d1-0edf-48a0-bdf5-9640385ec15a"). InnerVolumeSpecName "kube-api-access-klnc5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 14:16:40.980682 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:40.980652 2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9cac69d1-0edf-48a0-bdf5-9640385ec15a-tmp-dir\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 14:16:40.980682 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:40.980674 2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9cac69d1-0edf-48a0-bdf5-9640385ec15a-dshm\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 14:16:40.980823 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:40.980686 2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9cac69d1-0edf-48a0-bdf5-9640385ec15a-tls-certs\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 14:16:40.980823 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:40.980701 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-klnc5\" (UniqueName: \"kubernetes.io/projected/9cac69d1-0edf-48a0-bdf5-9640385ec15a-kube-api-access-klnc5\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 14:16:41.737265 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:41.737234 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-53d7c5/test-model-53d7c5-kserve-b97d74f47-dcv6d" Jul 06 14:16:41.737738 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:41.737280 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-53d7c5/test-model-53d7c5-kserve-b97d74f47-dcv6d" event={"ID":"9cac69d1-0edf-48a0-bdf5-9640385ec15a","Type":"ContainerDied","Data":"f1ed322444f06d878792d1b0a8e73755a01d49c046757963eb08842b6a742147"} Jul 06 14:16:41.737738 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:41.737336 2556 scope.go:117] "RemoveContainer" containerID="828c00fdeee616e20180cb72a6bd190580c4c865a49456eb5a6f2dbfdcddd227" Jul 06 14:16:41.761092 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:41.761068 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-53d7c5/test-model-53d7c5-kserve-b97d74f47-dcv6d"] Jul 06 14:16:41.766807 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:41.766786 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-53d7c5/test-model-53d7c5-kserve-b97d74f47-dcv6d"] Jul 06 14:16:42.788135 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:42.788105 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9cac69d1-0edf-48a0-bdf5-9640385ec15a" path="/var/lib/kubelet/pods/9cac69d1-0edf-48a0-bdf5-9640385ec15a/volumes" Jul 06 14:16:49.829284 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:49.829244 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:16:50.188329 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:50.188250 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:16:50.391986 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:50.391935 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:16:50.610302 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:50.610259 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:16:50.998733 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:50.998695 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:16:51.121076 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:51.121044 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:16:51.239344 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:51.239302 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:16:51.603085 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:51.603051 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:16:57.904068 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:57.904020 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:16:58.004795 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:58.004765 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:16:58.248008 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:58.247980 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:16:58.475166 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:58.475130 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:16:59.342342 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:59.342312 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:16:59.438884 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:16:59.438854 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:17:02.056040 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:17:02.056006 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:17:02.178889 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:17:02.178852 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:17:02.294993 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:17:02.294959 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:17:02.543456 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:17:02.543429 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:17:02.886446 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:17:02.886359 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:17:03.003331 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:17:03.003300 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:17:06.955996 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:17:06.955960 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:17:07.154429 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:17:07.154389 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:17:07.484106 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:17:07.484008 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:17:07.859509 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:17:07.859426 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:17:11.023188 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:17:11.023153 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:17:11.111681 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:17:11.111633 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:17:11.282914 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:17:11.282826 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:17:11.505922 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:17:11.505891 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:17:11.834074 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:17:11.834040 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:17:11.934182 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:17:11.934148 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:17:15.544074 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:17:15.544039 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:17:23.839253 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:17:23.839218 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:17:24.290517 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:17:24.290480 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:17:24.393238 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:17:24.393208 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:17:24.546633 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:17:24.546533 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:17:30.820686 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:17:30.820645 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:17:30.960924 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:17:30.960890 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:17:31.157037 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:17:31.156956 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:17:31.380204 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:17:31.380168 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:17:31.630867 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:17:31.630834 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:17:31.978377 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:17:31.978294 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:17:32.084015 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:17:32.083980 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:17:32.179101 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:17:32.179070 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:17:32.370610 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:17:32.370575 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:17:38.585566 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:17:38.585527 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:17:38.699329 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:17:38.699294 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:17:38.796031 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:17:38.796002 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:17:39.148940 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:17:39.148914 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:17:39.499206 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:17:39.499177 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:17:39.589739 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:17:39.589704 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:17:42.077022 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:17:42.076986 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:17:42.160430 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:17:42.160397 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:17:42.230594 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:17:42.230561 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:17:42.336240 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:17:42.336158 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:17:42.729852 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:17:42.729771 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:17:42.983553 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:17:42.983457 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:17:46.599105 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:17:46.599072 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:17:46.956063 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:17:46.955975 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:17:47.322074 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:17:47.322033 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:17:47.503932 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:17:47.503898 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:17:50.188234 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:17:50.188198 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:17:50.287159 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:17:50.287122 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:17:50.457295 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:17:50.457202 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:17:50.854505 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:17:50.854473 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:17:50.997879 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:17:50.997846 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:17:51.098908 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:17:51.098873 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:17:54.679842 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:17:54.679808 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:18:01.147831 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:18:01.147734 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:18:01.186918 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:18:01.186886 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-0ba2b8/auth-test-model-0ba2b8-kserve-5c5cd4cf7f-6njsr"] Jul 06 14:18:01.187412 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:18:01.187394 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bac48270-e0a1-4a76-9116-e9af99acf796" containerName="main" Jul 06 14:18:01.187506 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:18:01.187415 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="bac48270-e0a1-4a76-9116-e9af99acf796" containerName="main" Jul 06 14:18:01.187506 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:18:01.187435 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cac69d1-0edf-48a0-bdf5-9640385ec15a" containerName="main" Jul 06 14:18:01.187506 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:18:01.187443 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cac69d1-0edf-48a0-bdf5-9640385ec15a" containerName="main" Jul 06 14:18:01.187686 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:18:01.187580 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cac69d1-0edf-48a0-bdf5-9640385ec15a" containerName="main" Jul 06 14:18:01.187686 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:18:01.187593 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="bac48270-e0a1-4a76-9116-e9af99acf796" containerName="main" Jul 06 14:18:01.191048 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:18:01.191028 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0ba2b8/auth-test-model-0ba2b8-kserve-5c5cd4cf7f-6njsr" Jul 06 14:18:01.195058 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:18:01.195030 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-0ba2b8\"/\"kube-root-ca.crt\"" Jul 06 14:18:01.195058 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:18:01.195049 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-0ba2b8\"/\"default-dockercfg-82tgw\"" Jul 06 14:18:01.195237 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:18:01.195049 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-0ba2b8\"/\"auth-test-model-0ba2b8-kserve-self-signed-certs\"" Jul 06 14:18:01.195237 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:18:01.195116 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-0ba2b8\"/\"openshift-service-ca.crt\"" Jul 06 14:18:01.203413 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:18:01.203392 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0ba2b8/auth-test-model-0ba2b8-kserve-5c5cd4cf7f-6njsr"] Jul 06 14:18:01.225908 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:18:01.225882 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:18:01.345263 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:18:01.345234 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6710f3a9-f694-4322-a7c3-3509c4c0b1a0-dshm\") pod \"auth-test-model-0ba2b8-kserve-5c5cd4cf7f-6njsr\" (UID: \"6710f3a9-f694-4322-a7c3-3509c4c0b1a0\") " pod="ai-tenant-e2e-shared-a-0ba2b8/auth-test-model-0ba2b8-kserve-5c5cd4cf7f-6njsr" Jul 06 14:18:01.345409 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:18:01.345274 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6710f3a9-f694-4322-a7c3-3509c4c0b1a0-model-cache\") pod \"auth-test-model-0ba2b8-kserve-5c5cd4cf7f-6njsr\" (UID: \"6710f3a9-f694-4322-a7c3-3509c4c0b1a0\") " pod="ai-tenant-e2e-shared-a-0ba2b8/auth-test-model-0ba2b8-kserve-5c5cd4cf7f-6njsr" Jul 06 14:18:01.345409 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:18:01.345372 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kftg\" (UniqueName: \"kubernetes.io/projected/6710f3a9-f694-4322-a7c3-3509c4c0b1a0-kube-api-access-6kftg\") pod \"auth-test-model-0ba2b8-kserve-5c5cd4cf7f-6njsr\" (UID: \"6710f3a9-f694-4322-a7c3-3509c4c0b1a0\") " pod="ai-tenant-e2e-shared-a-0ba2b8/auth-test-model-0ba2b8-kserve-5c5cd4cf7f-6njsr" Jul 06 14:18:01.345507 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:18:01.345428 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6710f3a9-f694-4322-a7c3-3509c4c0b1a0-tmp-dir\") pod \"auth-test-model-0ba2b8-kserve-5c5cd4cf7f-6njsr\" (UID: \"6710f3a9-f694-4322-a7c3-3509c4c0b1a0\") " pod="ai-tenant-e2e-shared-a-0ba2b8/auth-test-model-0ba2b8-kserve-5c5cd4cf7f-6njsr" Jul 06 14:18:01.345507 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:18:01.345446 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6710f3a9-f694-4322-a7c3-3509c4c0b1a0-home\") pod \"auth-test-model-0ba2b8-kserve-5c5cd4cf7f-6njsr\" (UID: \"6710f3a9-f694-4322-a7c3-3509c4c0b1a0\") " pod="ai-tenant-e2e-shared-a-0ba2b8/auth-test-model-0ba2b8-kserve-5c5cd4cf7f-6njsr" Jul 06 14:18:01.345582 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:18:01.345526 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6710f3a9-f694-4322-a7c3-3509c4c0b1a0-tls-certs\") pod \"auth-test-model-0ba2b8-kserve-5c5cd4cf7f-6njsr\" (UID: \"6710f3a9-f694-4322-a7c3-3509c4c0b1a0\") " pod="ai-tenant-e2e-shared-a-0ba2b8/auth-test-model-0ba2b8-kserve-5c5cd4cf7f-6njsr" Jul 06 14:18:01.446482 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:18:01.446395 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6710f3a9-f694-4322-a7c3-3509c4c0b1a0-tls-certs\") pod \"auth-test-model-0ba2b8-kserve-5c5cd4cf7f-6njsr\" (UID: \"6710f3a9-f694-4322-a7c3-3509c4c0b1a0\") " pod="ai-tenant-e2e-shared-a-0ba2b8/auth-test-model-0ba2b8-kserve-5c5cd4cf7f-6njsr" Jul 06 14:18:01.446482 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:18:01.446449 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6710f3a9-f694-4322-a7c3-3509c4c0b1a0-dshm\") pod \"auth-test-model-0ba2b8-kserve-5c5cd4cf7f-6njsr\" (UID: \"6710f3a9-f694-4322-a7c3-3509c4c0b1a0\") " pod="ai-tenant-e2e-shared-a-0ba2b8/auth-test-model-0ba2b8-kserve-5c5cd4cf7f-6njsr" Jul 06 14:18:01.446482 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:18:01.446470 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6710f3a9-f694-4322-a7c3-3509c4c0b1a0-model-cache\") pod \"auth-test-model-0ba2b8-kserve-5c5cd4cf7f-6njsr\" (UID: \"6710f3a9-f694-4322-a7c3-3509c4c0b1a0\") " pod="ai-tenant-e2e-shared-a-0ba2b8/auth-test-model-0ba2b8-kserve-5c5cd4cf7f-6njsr" Jul 06 14:18:01.446828 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:18:01.446514 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kftg\" (UniqueName: \"kubernetes.io/projected/6710f3a9-f694-4322-a7c3-3509c4c0b1a0-kube-api-access-6kftg\") pod \"auth-test-model-0ba2b8-kserve-5c5cd4cf7f-6njsr\" (UID: \"6710f3a9-f694-4322-a7c3-3509c4c0b1a0\") " pod="ai-tenant-e2e-shared-a-0ba2b8/auth-test-model-0ba2b8-kserve-5c5cd4cf7f-6njsr" Jul 06 14:18:01.446828 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:18:01.446559 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6710f3a9-f694-4322-a7c3-3509c4c0b1a0-tmp-dir\") pod \"auth-test-model-0ba2b8-kserve-5c5cd4cf7f-6njsr\" (UID: \"6710f3a9-f694-4322-a7c3-3509c4c0b1a0\") " pod="ai-tenant-e2e-shared-a-0ba2b8/auth-test-model-0ba2b8-kserve-5c5cd4cf7f-6njsr" Jul 06 14:18:01.446828 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:18:01.446582 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6710f3a9-f694-4322-a7c3-3509c4c0b1a0-home\") pod \"auth-test-model-0ba2b8-kserve-5c5cd4cf7f-6njsr\" (UID: \"6710f3a9-f694-4322-a7c3-3509c4c0b1a0\") " pod="ai-tenant-e2e-shared-a-0ba2b8/auth-test-model-0ba2b8-kserve-5c5cd4cf7f-6njsr" Jul 06 14:18:01.446995 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:18:01.446945 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6710f3a9-f694-4322-a7c3-3509c4c0b1a0-model-cache\") pod \"auth-test-model-0ba2b8-kserve-5c5cd4cf7f-6njsr\" (UID: \"6710f3a9-f694-4322-a7c3-3509c4c0b1a0\") " pod="ai-tenant-e2e-shared-a-0ba2b8/auth-test-model-0ba2b8-kserve-5c5cd4cf7f-6njsr" Jul 06 14:18:01.446995 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:18:01.446984 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6710f3a9-f694-4322-a7c3-3509c4c0b1a0-tmp-dir\") pod \"auth-test-model-0ba2b8-kserve-5c5cd4cf7f-6njsr\" (UID: \"6710f3a9-f694-4322-a7c3-3509c4c0b1a0\") " pod="ai-tenant-e2e-shared-a-0ba2b8/auth-test-model-0ba2b8-kserve-5c5cd4cf7f-6njsr" Jul 06 14:18:01.447068 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:18:01.447047 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6710f3a9-f694-4322-a7c3-3509c4c0b1a0-home\") pod \"auth-test-model-0ba2b8-kserve-5c5cd4cf7f-6njsr\" (UID: \"6710f3a9-f694-4322-a7c3-3509c4c0b1a0\") " pod="ai-tenant-e2e-shared-a-0ba2b8/auth-test-model-0ba2b8-kserve-5c5cd4cf7f-6njsr" Jul 06 14:18:01.448726 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:18:01.448705 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6710f3a9-f694-4322-a7c3-3509c4c0b1a0-dshm\") pod \"auth-test-model-0ba2b8-kserve-5c5cd4cf7f-6njsr\" (UID: \"6710f3a9-f694-4322-a7c3-3509c4c0b1a0\") " pod="ai-tenant-e2e-shared-a-0ba2b8/auth-test-model-0ba2b8-kserve-5c5cd4cf7f-6njsr" Jul 06 14:18:01.449059 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:18:01.449044 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6710f3a9-f694-4322-a7c3-3509c4c0b1a0-tls-certs\") pod \"auth-test-model-0ba2b8-kserve-5c5cd4cf7f-6njsr\" (UID: \"6710f3a9-f694-4322-a7c3-3509c4c0b1a0\") " pod="ai-tenant-e2e-shared-a-0ba2b8/auth-test-model-0ba2b8-kserve-5c5cd4cf7f-6njsr" Jul 06 14:18:01.456120 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:18:01.456095 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kftg\" (UniqueName: \"kubernetes.io/projected/6710f3a9-f694-4322-a7c3-3509c4c0b1a0-kube-api-access-6kftg\") pod \"auth-test-model-0ba2b8-kserve-5c5cd4cf7f-6njsr\" (UID: \"6710f3a9-f694-4322-a7c3-3509c4c0b1a0\") " pod="ai-tenant-e2e-shared-a-0ba2b8/auth-test-model-0ba2b8-kserve-5c5cd4cf7f-6njsr" Jul 06 14:18:01.500808 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:18:01.500774 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0ba2b8/auth-test-model-0ba2b8-kserve-5c5cd4cf7f-6njsr" Jul 06 14:18:01.642535 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:18:01.642505 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0ba2b8/auth-test-model-0ba2b8-kserve-5c5cd4cf7f-6njsr"] Jul 06 14:18:01.643960 ip-10-0-134-85 kubenswrapper[2556]: W0706 14:18:01.643936 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6710f3a9_f694_4322_a7c3_3509c4c0b1a0.slice/crio-6aeda7afcc9c9b82d4517319b2f867e83d7545f50b6ae0dc92825d0aa20d9fb0 WatchSource:0}: Error finding container 6aeda7afcc9c9b82d4517319b2f867e83d7545f50b6ae0dc92825d0aa20d9fb0: Status 404 returned error can't find the container with id 6aeda7afcc9c9b82d4517319b2f867e83d7545f50b6ae0dc92825d0aa20d9fb0 Jul 06 14:18:02.228562 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:18:02.228530 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0ba2b8/auth-test-model-0ba2b8-kserve-5c5cd4cf7f-6njsr" event={"ID":"6710f3a9-f694-4322-a7c3-3509c4c0b1a0","Type":"ContainerStarted","Data":"9d369aadefe9532d445512a3e43ff604a42625a08e88d2a0fa3ae6626aae7706"} Jul 06 14:18:02.228951 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:18:02.228569 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0ba2b8/auth-test-model-0ba2b8-kserve-5c5cd4cf7f-6njsr" event={"ID":"6710f3a9-f694-4322-a7c3-3509c4c0b1a0","Type":"ContainerStarted","Data":"6aeda7afcc9c9b82d4517319b2f867e83d7545f50b6ae0dc92825d0aa20d9fb0"} Jul 06 14:18:02.249480 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:18:02.249429 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-0ba2b8/auth-test-model-0ba2b8-kserve-5c5cd4cf7f-6njsr" podStartSLOduration=1.24941368 podStartE2EDuration="1.24941368s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:18:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:18:02.247206284 +0000 UTC m=+1976.046951978" watchObservedRunningTime="2026-07-06 14:18:02.24941368 +0000 UTC m=+1976.049159372" Jul 06 14:18:04.317554 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:18:04.317523 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:18:04.414292 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:18:04.414258 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:18:11.501079 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:18:11.501049 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-0ba2b8/auth-test-model-0ba2b8-kserve-5c5cd4cf7f-6njsr" Jul 06 14:18:11.501583 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:18:11.501307 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-0ba2b8/auth-test-model-0ba2b8-kserve-5c5cd4cf7f-6njsr" Jul 06 14:18:11.513895 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:18:11.513872 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-0ba2b8/auth-test-model-0ba2b8-kserve-5c5cd4cf7f-6njsr" Jul 06 14:18:12.299111 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:18:12.299082 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-0ba2b8/auth-test-model-0ba2b8-kserve-5c5cd4cf7f-6njsr" Jul 06 14:18:12.495939 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:18:12.495909 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:18:12.595758 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:18:12.595676 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:18:22.498611 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:18:22.498569 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:19:47.241856 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:19:47.241769 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:19:47.338348 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:19:47.338322 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:06.877776 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:20:06.877656 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vjl62_b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7/console-operator/2.log" Jul 06 14:20:06.885027 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:20:06.885004 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vjl62_b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7/console-operator/2.log" Jul 06 14:20:27.544327 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:20:27.544295 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0ba2b8/auth-test-model-0ba2b8-kserve-5c5cd4cf7f-6njsr"] Jul 06 14:20:27.562823 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:20:27.562797 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:28.504046 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:20:28.504011 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:37.202680 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:20:37.202649 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-0ba2b8/sub-test-model-0ba2b8-kserve-76bf96bc7-hqdw4"] Jul 06 14:20:37.207664 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:20:37.207610 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0ba2b8/sub-test-model-0ba2b8-kserve-76bf96bc7-hqdw4" Jul 06 14:20:37.210488 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:20:37.210467 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-0ba2b8\"/\"sub-test-model-0ba2b8-kserve-self-signed-certs\"" Jul 06 14:20:37.219389 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:20:37.219366 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0ba2b8/sub-test-model-0ba2b8-kserve-76bf96bc7-hqdw4"] Jul 06 14:20:37.235117 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:20:37.235094 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:37.259314 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:20:37.259293 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45bbebcf-4238-4376-91df-fb8f24a4e54a-tls-certs\") pod \"sub-test-model-0ba2b8-kserve-76bf96bc7-hqdw4\" (UID: \"45bbebcf-4238-4376-91df-fb8f24a4e54a\") " pod="ai-tenant-e2e-shared-a-0ba2b8/sub-test-model-0ba2b8-kserve-76bf96bc7-hqdw4" Jul 06 14:20:37.259417 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:20:37.259342 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45bbebcf-4238-4376-91df-fb8f24a4e54a-model-cache\") pod \"sub-test-model-0ba2b8-kserve-76bf96bc7-hqdw4\" (UID: \"45bbebcf-4238-4376-91df-fb8f24a4e54a\") " pod="ai-tenant-e2e-shared-a-0ba2b8/sub-test-model-0ba2b8-kserve-76bf96bc7-hqdw4" Jul 06 14:20:37.259417 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:20:37.259369 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45bbebcf-4238-4376-91df-fb8f24a4e54a-tmp-dir\") pod \"sub-test-model-0ba2b8-kserve-76bf96bc7-hqdw4\" (UID: \"45bbebcf-4238-4376-91df-fb8f24a4e54a\") " pod="ai-tenant-e2e-shared-a-0ba2b8/sub-test-model-0ba2b8-kserve-76bf96bc7-hqdw4" Jul 06 14:20:37.259491 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:20:37.259429 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chmnz\" (UniqueName: \"kubernetes.io/projected/45bbebcf-4238-4376-91df-fb8f24a4e54a-kube-api-access-chmnz\") pod \"sub-test-model-0ba2b8-kserve-76bf96bc7-hqdw4\" (UID: \"45bbebcf-4238-4376-91df-fb8f24a4e54a\") " pod="ai-tenant-e2e-shared-a-0ba2b8/sub-test-model-0ba2b8-kserve-76bf96bc7-hqdw4" Jul 06 14:20:37.259526 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:20:37.259484 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/45bbebcf-4238-4376-91df-fb8f24a4e54a-dshm\") pod \"sub-test-model-0ba2b8-kserve-76bf96bc7-hqdw4\" (UID: \"45bbebcf-4238-4376-91df-fb8f24a4e54a\") " pod="ai-tenant-e2e-shared-a-0ba2b8/sub-test-model-0ba2b8-kserve-76bf96bc7-hqdw4" Jul 06 14:20:37.259562 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:20:37.259541 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/45bbebcf-4238-4376-91df-fb8f24a4e54a-home\") pod \"sub-test-model-0ba2b8-kserve-76bf96bc7-hqdw4\" (UID: \"45bbebcf-4238-4376-91df-fb8f24a4e54a\") " pod="ai-tenant-e2e-shared-a-0ba2b8/sub-test-model-0ba2b8-kserve-76bf96bc7-hqdw4" Jul 06 14:20:37.360605 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:20:37.360577 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/45bbebcf-4238-4376-91df-fb8f24a4e54a-home\") pod \"sub-test-model-0ba2b8-kserve-76bf96bc7-hqdw4\" (UID: \"45bbebcf-4238-4376-91df-fb8f24a4e54a\") " pod="ai-tenant-e2e-shared-a-0ba2b8/sub-test-model-0ba2b8-kserve-76bf96bc7-hqdw4" Jul 06 14:20:37.360753 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:20:37.360613 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45bbebcf-4238-4376-91df-fb8f24a4e54a-tls-certs\") pod \"sub-test-model-0ba2b8-kserve-76bf96bc7-hqdw4\" (UID: \"45bbebcf-4238-4376-91df-fb8f24a4e54a\") " pod="ai-tenant-e2e-shared-a-0ba2b8/sub-test-model-0ba2b8-kserve-76bf96bc7-hqdw4" Jul 06 14:20:37.360753 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:20:37.360684 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45bbebcf-4238-4376-91df-fb8f24a4e54a-model-cache\") pod \"sub-test-model-0ba2b8-kserve-76bf96bc7-hqdw4\" (UID: \"45bbebcf-4238-4376-91df-fb8f24a4e54a\") " pod="ai-tenant-e2e-shared-a-0ba2b8/sub-test-model-0ba2b8-kserve-76bf96bc7-hqdw4" Jul 06 14:20:37.360753 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:20:37.360710 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45bbebcf-4238-4376-91df-fb8f24a4e54a-tmp-dir\") pod \"sub-test-model-0ba2b8-kserve-76bf96bc7-hqdw4\" (UID: \"45bbebcf-4238-4376-91df-fb8f24a4e54a\") " pod="ai-tenant-e2e-shared-a-0ba2b8/sub-test-model-0ba2b8-kserve-76bf96bc7-hqdw4" Jul 06 14:20:37.360880 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:20:37.360751 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chmnz\" (UniqueName: \"kubernetes.io/projected/45bbebcf-4238-4376-91df-fb8f24a4e54a-kube-api-access-chmnz\") pod \"sub-test-model-0ba2b8-kserve-76bf96bc7-hqdw4\" (UID: \"45bbebcf-4238-4376-91df-fb8f24a4e54a\") " pod="ai-tenant-e2e-shared-a-0ba2b8/sub-test-model-0ba2b8-kserve-76bf96bc7-hqdw4" Jul 06 14:20:37.360880 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:20:37.360790 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/45bbebcf-4238-4376-91df-fb8f24a4e54a-dshm\") pod \"sub-test-model-0ba2b8-kserve-76bf96bc7-hqdw4\" (UID: \"45bbebcf-4238-4376-91df-fb8f24a4e54a\") " pod="ai-tenant-e2e-shared-a-0ba2b8/sub-test-model-0ba2b8-kserve-76bf96bc7-hqdw4" Jul 06 14:20:37.360998 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:20:37.360975 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/45bbebcf-4238-4376-91df-fb8f24a4e54a-home\") pod \"sub-test-model-0ba2b8-kserve-76bf96bc7-hqdw4\" (UID: \"45bbebcf-4238-4376-91df-fb8f24a4e54a\") " pod="ai-tenant-e2e-shared-a-0ba2b8/sub-test-model-0ba2b8-kserve-76bf96bc7-hqdw4" Jul 06 14:20:37.361070 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:20:37.361040 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45bbebcf-4238-4376-91df-fb8f24a4e54a-model-cache\") pod \"sub-test-model-0ba2b8-kserve-76bf96bc7-hqdw4\" (UID: \"45bbebcf-4238-4376-91df-fb8f24a4e54a\") " pod="ai-tenant-e2e-shared-a-0ba2b8/sub-test-model-0ba2b8-kserve-76bf96bc7-hqdw4" Jul 06 14:20:37.361131 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:20:37.361118 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45bbebcf-4238-4376-91df-fb8f24a4e54a-tmp-dir\") pod \"sub-test-model-0ba2b8-kserve-76bf96bc7-hqdw4\" (UID: \"45bbebcf-4238-4376-91df-fb8f24a4e54a\") " pod="ai-tenant-e2e-shared-a-0ba2b8/sub-test-model-0ba2b8-kserve-76bf96bc7-hqdw4" Jul 06 14:20:37.363002 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:20:37.362981 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/45bbebcf-4238-4376-91df-fb8f24a4e54a-dshm\") pod \"sub-test-model-0ba2b8-kserve-76bf96bc7-hqdw4\" (UID: \"45bbebcf-4238-4376-91df-fb8f24a4e54a\") " pod="ai-tenant-e2e-shared-a-0ba2b8/sub-test-model-0ba2b8-kserve-76bf96bc7-hqdw4" Jul 06 14:20:37.363149 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:20:37.363133 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45bbebcf-4238-4376-91df-fb8f24a4e54a-tls-certs\") pod \"sub-test-model-0ba2b8-kserve-76bf96bc7-hqdw4\" (UID: \"45bbebcf-4238-4376-91df-fb8f24a4e54a\") " pod="ai-tenant-e2e-shared-a-0ba2b8/sub-test-model-0ba2b8-kserve-76bf96bc7-hqdw4" Jul 06 14:20:37.369387 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:20:37.369367 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chmnz\" (UniqueName: \"kubernetes.io/projected/45bbebcf-4238-4376-91df-fb8f24a4e54a-kube-api-access-chmnz\") pod \"sub-test-model-0ba2b8-kserve-76bf96bc7-hqdw4\" (UID: \"45bbebcf-4238-4376-91df-fb8f24a4e54a\") " pod="ai-tenant-e2e-shared-a-0ba2b8/sub-test-model-0ba2b8-kserve-76bf96bc7-hqdw4" Jul 06 14:20:37.518328 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:20:37.518293 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0ba2b8/sub-test-model-0ba2b8-kserve-76bf96bc7-hqdw4" Jul 06 14:20:37.863355 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:20:37.863328 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0ba2b8/sub-test-model-0ba2b8-kserve-76bf96bc7-hqdw4"] Jul 06 14:20:37.865152 ip-10-0-134-85 kubenswrapper[2556]: W0706 14:20:37.865116 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod45bbebcf_4238_4376_91df_fb8f24a4e54a.slice/crio-1abb976ab7c89ee213fb1fda88105e37773a7264d19600da87f6dea599293e44 WatchSource:0}: Error finding container 1abb976ab7c89ee213fb1fda88105e37773a7264d19600da87f6dea599293e44: Status 404 returned error can't find the container with id 1abb976ab7c89ee213fb1fda88105e37773a7264d19600da87f6dea599293e44 Jul 06 14:20:38.148910 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:20:38.148824 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0ba2b8/sub-test-model-0ba2b8-kserve-76bf96bc7-hqdw4" event={"ID":"45bbebcf-4238-4376-91df-fb8f24a4e54a","Type":"ContainerStarted","Data":"3c3fde09f1094cb88f36fc1dd5d174f58187aa1acfc27607854107194b91cc18"} Jul 06 14:20:38.148910 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:20:38.148875 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0ba2b8/sub-test-model-0ba2b8-kserve-76bf96bc7-hqdw4" event={"ID":"45bbebcf-4238-4376-91df-fb8f24a4e54a","Type":"ContainerStarted","Data":"1abb976ab7c89ee213fb1fda88105e37773a7264d19600da87f6dea599293e44"} Jul 06 14:20:38.169125 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:20:38.169080 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-0ba2b8/sub-test-model-0ba2b8-kserve-76bf96bc7-hqdw4" podStartSLOduration=1.169066789 podStartE2EDuration="1.169066789s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:20:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:20:38.168742077 +0000 UTC m=+2131.968487770" watchObservedRunningTime="2026-07-06 14:20:38.169066789 +0000 UTC m=+2131.968812483" Jul 06 14:20:42.564541 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:20:42.564502 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-0ba2b8/auth-test-model-0ba2b8-kserve-5c5cd4cf7f-6njsr" podUID="6710f3a9-f694-4322-a7c3-3509c4c0b1a0" containerName="main" containerID="cri-o://9d369aadefe9532d445512a3e43ff604a42625a08e88d2a0fa3ae6626aae7706" gracePeriod=45 Jul 06 14:20:42.832900 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:20:42.832847 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0ba2b8/auth-test-model-0ba2b8-kserve-5c5cd4cf7f-6njsr" Jul 06 14:20:42.918148 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:20:42.918118 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6710f3a9-f694-4322-a7c3-3509c4c0b1a0-model-cache\") pod \"6710f3a9-f694-4322-a7c3-3509c4c0b1a0\" (UID: \"6710f3a9-f694-4322-a7c3-3509c4c0b1a0\") " Jul 06 14:20:42.918401 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:20:42.918371 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6710f3a9-f694-4322-a7c3-3509c4c0b1a0-model-cache" (OuterVolumeSpecName: "model-cache") pod "6710f3a9-f694-4322-a7c3-3509c4c0b1a0" (UID: "6710f3a9-f694-4322-a7c3-3509c4c0b1a0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:20:42.918527 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:20:42.918473 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6710f3a9-f694-4322-a7c3-3509c4c0b1a0-home\") pod \"6710f3a9-f694-4322-a7c3-3509c4c0b1a0\" (UID: \"6710f3a9-f694-4322-a7c3-3509c4c0b1a0\") " Jul 06 14:20:42.918527 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:20:42.918513 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6kftg\" (UniqueName: \"kubernetes.io/projected/6710f3a9-f694-4322-a7c3-3509c4c0b1a0-kube-api-access-6kftg\") pod \"6710f3a9-f694-4322-a7c3-3509c4c0b1a0\" (UID: \"6710f3a9-f694-4322-a7c3-3509c4c0b1a0\") " Jul 06 14:20:42.918668 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:20:42.918539 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6710f3a9-f694-4322-a7c3-3509c4c0b1a0-tls-certs\") pod \"6710f3a9-f694-4322-a7c3-3509c4c0b1a0\" (UID: \"6710f3a9-f694-4322-a7c3-3509c4c0b1a0\") " Jul 06 14:20:42.918668 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:20:42.918572 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6710f3a9-f694-4322-a7c3-3509c4c0b1a0-tmp-dir\") pod \"6710f3a9-f694-4322-a7c3-3509c4c0b1a0\" (UID: \"6710f3a9-f694-4322-a7c3-3509c4c0b1a0\") " Jul 06 14:20:42.918668 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:20:42.918597 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6710f3a9-f694-4322-a7c3-3509c4c0b1a0-dshm\") pod \"6710f3a9-f694-4322-a7c3-3509c4c0b1a0\" (UID: \"6710f3a9-f694-4322-a7c3-3509c4c0b1a0\") " Jul 06 14:20:42.918837 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:20:42.918772 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6710f3a9-f694-4322-a7c3-3509c4c0b1a0-home" (OuterVolumeSpecName: "home") pod "6710f3a9-f694-4322-a7c3-3509c4c0b1a0" (UID: "6710f3a9-f694-4322-a7c3-3509c4c0b1a0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:20:42.919066 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:20:42.919041 2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6710f3a9-f694-4322-a7c3-3509c4c0b1a0-home\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 14:20:42.919066 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:20:42.919063 2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6710f3a9-f694-4322-a7c3-3509c4c0b1a0-model-cache\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 14:20:42.919710 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:20:42.919685 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6710f3a9-f694-4322-a7c3-3509c4c0b1a0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6710f3a9-f694-4322-a7c3-3509c4c0b1a0" (UID: "6710f3a9-f694-4322-a7c3-3509c4c0b1a0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:20:42.921550 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:20:42.921525 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6710f3a9-f694-4322-a7c3-3509c4c0b1a0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6710f3a9-f694-4322-a7c3-3509c4c0b1a0" (UID: "6710f3a9-f694-4322-a7c3-3509c4c0b1a0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 14:20:42.921817 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:20:42.921787 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6710f3a9-f694-4322-a7c3-3509c4c0b1a0-kube-api-access-6kftg" (OuterVolumeSpecName: "kube-api-access-6kftg") pod "6710f3a9-f694-4322-a7c3-3509c4c0b1a0" (UID: "6710f3a9-f694-4322-a7c3-3509c4c0b1a0"). InnerVolumeSpecName "kube-api-access-6kftg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 14:20:42.922201 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:20:42.922181 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6710f3a9-f694-4322-a7c3-3509c4c0b1a0-dshm" (OuterVolumeSpecName: "dshm") pod "6710f3a9-f694-4322-a7c3-3509c4c0b1a0" (UID: "6710f3a9-f694-4322-a7c3-3509c4c0b1a0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:20:43.019867 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:20:43.019843 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6kftg\" (UniqueName: \"kubernetes.io/projected/6710f3a9-f694-4322-a7c3-3509c4c0b1a0-kube-api-access-6kftg\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 14:20:43.019980 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:20:43.019871 2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6710f3a9-f694-4322-a7c3-3509c4c0b1a0-tls-certs\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 14:20:43.019980 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:20:43.019890 2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6710f3a9-f694-4322-a7c3-3509c4c0b1a0-tmp-dir\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 14:20:43.019980 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:20:43.019903 2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6710f3a9-f694-4322-a7c3-3509c4c0b1a0-dshm\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 14:20:43.186599 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:20:43.186506 2556 generic.go:356] "Generic (PLEG): container finished" podID="6710f3a9-f694-4322-a7c3-3509c4c0b1a0" containerID="9d369aadefe9532d445512a3e43ff604a42625a08e88d2a0fa3ae6626aae7706" exitCode=0 Jul 06 14:20:43.186599 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:20:43.186560 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0ba2b8/auth-test-model-0ba2b8-kserve-5c5cd4cf7f-6njsr" event={"ID":"6710f3a9-f694-4322-a7c3-3509c4c0b1a0","Type":"ContainerDied","Data":"9d369aadefe9532d445512a3e43ff604a42625a08e88d2a0fa3ae6626aae7706"} Jul 06 14:20:43.186599 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:20:43.186564 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0ba2b8/auth-test-model-0ba2b8-kserve-5c5cd4cf7f-6njsr" Jul 06 14:20:43.186599 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:20:43.186587 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0ba2b8/auth-test-model-0ba2b8-kserve-5c5cd4cf7f-6njsr" event={"ID":"6710f3a9-f694-4322-a7c3-3509c4c0b1a0","Type":"ContainerDied","Data":"6aeda7afcc9c9b82d4517319b2f867e83d7545f50b6ae0dc92825d0aa20d9fb0"} Jul 06 14:20:43.186599 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:20:43.186604 2556 scope.go:117] "RemoveContainer" containerID="9d369aadefe9532d445512a3e43ff604a42625a08e88d2a0fa3ae6626aae7706" Jul 06 14:20:43.196866 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:20:43.196848 2556 scope.go:117] "RemoveContainer" containerID="9d369aadefe9532d445512a3e43ff604a42625a08e88d2a0fa3ae6626aae7706" Jul 06 14:20:43.197118 ip-10-0-134-85 kubenswrapper[2556]: E0706 14:20:43.197098 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d369aadefe9532d445512a3e43ff604a42625a08e88d2a0fa3ae6626aae7706\": container with ID starting with 9d369aadefe9532d445512a3e43ff604a42625a08e88d2a0fa3ae6626aae7706 not found: ID does not exist" containerID="9d369aadefe9532d445512a3e43ff604a42625a08e88d2a0fa3ae6626aae7706" Jul 06 14:20:43.197158 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:20:43.197127 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d369aadefe9532d445512a3e43ff604a42625a08e88d2a0fa3ae6626aae7706"} err="failed to get container status \"9d369aadefe9532d445512a3e43ff604a42625a08e88d2a0fa3ae6626aae7706\": rpc error: code = NotFound desc = could not find container \"9d369aadefe9532d445512a3e43ff604a42625a08e88d2a0fa3ae6626aae7706\": container with ID starting with 9d369aadefe9532d445512a3e43ff604a42625a08e88d2a0fa3ae6626aae7706 not found: ID does not exist" Jul 06 14:20:43.209797 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:20:43.209776 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0ba2b8/auth-test-model-0ba2b8-kserve-5c5cd4cf7f-6njsr"] Jul 06 14:20:43.213444 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:20:43.213425 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-0ba2b8/auth-test-model-0ba2b8-kserve-5c5cd4cf7f-6njsr"] Jul 06 14:20:44.787346 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:20:44.787309 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6710f3a9-f694-4322-a7c3-3509c4c0b1a0" path="/var/lib/kubelet/pods/6710f3a9-f694-4322-a7c3-3509c4c0b1a0/volumes" Jul 06 14:20:47.519083 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:20:47.519049 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-0ba2b8/sub-test-model-0ba2b8-kserve-76bf96bc7-hqdw4" Jul 06 14:20:47.519540 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:20:47.519102 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-0ba2b8/sub-test-model-0ba2b8-kserve-76bf96bc7-hqdw4" Jul 06 14:20:47.531559 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:20:47.531535 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-0ba2b8/sub-test-model-0ba2b8-kserve-76bf96bc7-hqdw4" Jul 06 14:20:48.228204 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:20:48.228171 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-0ba2b8/sub-test-model-0ba2b8-kserve-76bf96bc7-hqdw4" Jul 06 14:21:04.558579 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:21:04.558488 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:53.830129 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:21:53.830092 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0ba2b8/sub-test-model-0ba2b8-kserve-76bf96bc7-hqdw4"] Jul 06 14:21:53.867257 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:21:53.867227 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:55.943107 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:21:55.943073 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:59.021220 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:21:59.021187 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:22:08.850012 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:08.849976 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-0ba2b8/sub-test-model-0ba2b8-kserve-76bf96bc7-hqdw4" podUID="45bbebcf-4238-4376-91df-fb8f24a4e54a" containerName="main" containerID="cri-o://3c3fde09f1094cb88f36fc1dd5d174f58187aa1acfc27607854107194b91cc18" gracePeriod=45 Jul 06 14:22:09.109122 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:09.109051 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0ba2b8/sub-test-model-0ba2b8-kserve-76bf96bc7-hqdw4" Jul 06 14:22:09.214864 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:09.214830 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45bbebcf-4238-4376-91df-fb8f24a4e54a-model-cache\") pod \"45bbebcf-4238-4376-91df-fb8f24a4e54a\" (UID: \"45bbebcf-4238-4376-91df-fb8f24a4e54a\") " Jul 06 14:22:09.215042 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:09.214885 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45bbebcf-4238-4376-91df-fb8f24a4e54a-tmp-dir\") pod \"45bbebcf-4238-4376-91df-fb8f24a4e54a\" (UID: \"45bbebcf-4238-4376-91df-fb8f24a4e54a\") " Jul 06 14:22:09.215042 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:09.214924 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/45bbebcf-4238-4376-91df-fb8f24a4e54a-home\") pod \"45bbebcf-4238-4376-91df-fb8f24a4e54a\" (UID: \"45bbebcf-4238-4376-91df-fb8f24a4e54a\") " Jul 06 14:22:09.215042 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:09.214966 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45bbebcf-4238-4376-91df-fb8f24a4e54a-tls-certs\") pod \"45bbebcf-4238-4376-91df-fb8f24a4e54a\" (UID: \"45bbebcf-4238-4376-91df-fb8f24a4e54a\") " Jul 06 14:22:09.215042 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:09.214991 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/45bbebcf-4238-4376-91df-fb8f24a4e54a-dshm\") pod \"45bbebcf-4238-4376-91df-fb8f24a4e54a\" (UID: \"45bbebcf-4238-4376-91df-fb8f24a4e54a\") " Jul 06 14:22:09.215042 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:09.215016 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-chmnz\" (UniqueName: \"kubernetes.io/projected/45bbebcf-4238-4376-91df-fb8f24a4e54a-kube-api-access-chmnz\") pod \"45bbebcf-4238-4376-91df-fb8f24a4e54a\" (UID: \"45bbebcf-4238-4376-91df-fb8f24a4e54a\") " Jul 06 14:22:09.215312 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:09.215101 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45bbebcf-4238-4376-91df-fb8f24a4e54a-model-cache" (OuterVolumeSpecName: "model-cache") pod "45bbebcf-4238-4376-91df-fb8f24a4e54a" (UID: "45bbebcf-4238-4376-91df-fb8f24a4e54a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:22:09.215312 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:09.215169 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45bbebcf-4238-4376-91df-fb8f24a4e54a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "45bbebcf-4238-4376-91df-fb8f24a4e54a" (UID: "45bbebcf-4238-4376-91df-fb8f24a4e54a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:22:09.215312 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:09.215206 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45bbebcf-4238-4376-91df-fb8f24a4e54a-home" (OuterVolumeSpecName: "home") pod "45bbebcf-4238-4376-91df-fb8f24a4e54a" (UID: "45bbebcf-4238-4376-91df-fb8f24a4e54a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:22:09.215449 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:09.215356 2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/45bbebcf-4238-4376-91df-fb8f24a4e54a-home\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 14:22:09.215449 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:09.215374 2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45bbebcf-4238-4376-91df-fb8f24a4e54a-model-cache\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 14:22:09.215449 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:09.215390 2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45bbebcf-4238-4376-91df-fb8f24a4e54a-tmp-dir\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 14:22:09.217343 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:09.217315 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45bbebcf-4238-4376-91df-fb8f24a4e54a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "45bbebcf-4238-4376-91df-fb8f24a4e54a" (UID: "45bbebcf-4238-4376-91df-fb8f24a4e54a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 14:22:09.217594 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:09.217566 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45bbebcf-4238-4376-91df-fb8f24a4e54a-dshm" (OuterVolumeSpecName: "dshm") pod "45bbebcf-4238-4376-91df-fb8f24a4e54a" (UID: "45bbebcf-4238-4376-91df-fb8f24a4e54a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:22:09.217753 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:09.217591 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45bbebcf-4238-4376-91df-fb8f24a4e54a-kube-api-access-chmnz" (OuterVolumeSpecName: "kube-api-access-chmnz") pod "45bbebcf-4238-4376-91df-fb8f24a4e54a" (UID: "45bbebcf-4238-4376-91df-fb8f24a4e54a"). InnerVolumeSpecName "kube-api-access-chmnz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 14:22:09.316049 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:09.316017 2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45bbebcf-4238-4376-91df-fb8f24a4e54a-tls-certs\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 14:22:09.316049 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:09.316043 2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/45bbebcf-4238-4376-91df-fb8f24a4e54a-dshm\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 14:22:09.316049 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:09.316053 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-chmnz\" (UniqueName: \"kubernetes.io/projected/45bbebcf-4238-4376-91df-fb8f24a4e54a-kube-api-access-chmnz\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 14:22:09.710867 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:09.710831 2556 generic.go:356] "Generic (PLEG): container finished" podID="45bbebcf-4238-4376-91df-fb8f24a4e54a" containerID="3c3fde09f1094cb88f36fc1dd5d174f58187aa1acfc27607854107194b91cc18" exitCode=0 Jul 06 14:22:09.711059 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:09.710885 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0ba2b8/sub-test-model-0ba2b8-kserve-76bf96bc7-hqdw4" Jul 06 14:22:09.711059 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:09.710914 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0ba2b8/sub-test-model-0ba2b8-kserve-76bf96bc7-hqdw4" event={"ID":"45bbebcf-4238-4376-91df-fb8f24a4e54a","Type":"ContainerDied","Data":"3c3fde09f1094cb88f36fc1dd5d174f58187aa1acfc27607854107194b91cc18"} Jul 06 14:22:09.711059 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:09.710961 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0ba2b8/sub-test-model-0ba2b8-kserve-76bf96bc7-hqdw4" event={"ID":"45bbebcf-4238-4376-91df-fb8f24a4e54a","Type":"ContainerDied","Data":"1abb976ab7c89ee213fb1fda88105e37773a7264d19600da87f6dea599293e44"} Jul 06 14:22:09.711059 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:09.710986 2556 scope.go:117] "RemoveContainer" containerID="3c3fde09f1094cb88f36fc1dd5d174f58187aa1acfc27607854107194b91cc18" Jul 06 14:22:09.720955 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:09.720941 2556 scope.go:117] "RemoveContainer" containerID="3c3fde09f1094cb88f36fc1dd5d174f58187aa1acfc27607854107194b91cc18" Jul 06 14:22:09.721222 ip-10-0-134-85 kubenswrapper[2556]: E0706 14:22:09.721206 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c3fde09f1094cb88f36fc1dd5d174f58187aa1acfc27607854107194b91cc18\": container with ID starting with 3c3fde09f1094cb88f36fc1dd5d174f58187aa1acfc27607854107194b91cc18 not found: ID does not exist" containerID="3c3fde09f1094cb88f36fc1dd5d174f58187aa1acfc27607854107194b91cc18" Jul 06 14:22:09.721272 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:09.721231 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c3fde09f1094cb88f36fc1dd5d174f58187aa1acfc27607854107194b91cc18"} err="failed to get container status \"3c3fde09f1094cb88f36fc1dd5d174f58187aa1acfc27607854107194b91cc18\": rpc error: code = NotFound desc = could not find container \"3c3fde09f1094cb88f36fc1dd5d174f58187aa1acfc27607854107194b91cc18\": container with ID starting with 3c3fde09f1094cb88f36fc1dd5d174f58187aa1acfc27607854107194b91cc18 not found: ID does not exist" Jul 06 14:22:09.737629 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:09.737590 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0ba2b8/sub-test-model-0ba2b8-kserve-76bf96bc7-hqdw4"] Jul 06 14:22:09.742173 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:09.742152 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-0ba2b8/sub-test-model-0ba2b8-kserve-76bf96bc7-hqdw4"] Jul 06 14:22:10.787872 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:10.787837 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45bbebcf-4238-4376-91df-fb8f24a4e54a" path="/var/lib/kubelet/pods/45bbebcf-4238-4376-91df-fb8f24a4e54a/volumes" Jul 06 14:22:30.061027 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:30.060940 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:22:30.159870 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:30.159833 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:22:35.489179 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:35.489146 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-74bb89/rate-test-model-74bb89-kserve-948997d99-2rnjd"] Jul 06 14:22:35.489643 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:35.489606 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6710f3a9-f694-4322-a7c3-3509c4c0b1a0" containerName="main" Jul 06 14:22:35.489643 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:35.489634 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6710f3a9-f694-4322-a7c3-3509c4c0b1a0" containerName="main" Jul 06 14:22:35.489725 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:35.489655 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45bbebcf-4238-4376-91df-fb8f24a4e54a" containerName="main" Jul 06 14:22:35.489725 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:35.489661 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="45bbebcf-4238-4376-91df-fb8f24a4e54a" containerName="main" Jul 06 14:22:35.489794 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:35.489739 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="45bbebcf-4238-4376-91df-fb8f24a4e54a" containerName="main" Jul 06 14:22:35.489794 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:35.489750 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="6710f3a9-f694-4322-a7c3-3509c4c0b1a0" containerName="main" Jul 06 14:22:35.493103 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:35.493082 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-74bb89/rate-test-model-74bb89-kserve-948997d99-2rnjd" Jul 06 14:22:35.497728 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:35.497474 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-74bb89\"/\"rate-test-model-74bb89-kserve-self-signed-certs\"" Jul 06 14:22:35.497728 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:35.497556 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-74bb89\"/\"kube-root-ca.crt\"" Jul 06 14:22:35.497728 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:35.497483 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-74bb89\"/\"openshift-service-ca.crt\"" Jul 06 14:22:35.497728 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:35.497648 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-74bb89\"/\"default-dockercfg-6ql69\"" Jul 06 14:22:35.502080 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:35.502051 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-74bb89/rate-test-model-74bb89-kserve-948997d99-2rnjd"] Jul 06 14:22:35.526004 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:35.525975 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:22:35.655751 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:35.655717 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b0d1f87d-6f3f-4014-b893-d5f395dd6217-home\") pod \"rate-test-model-74bb89-kserve-948997d99-2rnjd\" (UID: \"b0d1f87d-6f3f-4014-b893-d5f395dd6217\") " pod="ai-tenant-e2e-shared-b-74bb89/rate-test-model-74bb89-kserve-948997d99-2rnjd" Jul 06 14:22:35.655903 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:35.655796 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b0d1f87d-6f3f-4014-b893-d5f395dd6217-model-cache\") pod \"rate-test-model-74bb89-kserve-948997d99-2rnjd\" (UID: \"b0d1f87d-6f3f-4014-b893-d5f395dd6217\") " pod="ai-tenant-e2e-shared-b-74bb89/rate-test-model-74bb89-kserve-948997d99-2rnjd" Jul 06 14:22:35.655903 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:35.655830 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r29kd\" (UniqueName: \"kubernetes.io/projected/b0d1f87d-6f3f-4014-b893-d5f395dd6217-kube-api-access-r29kd\") pod \"rate-test-model-74bb89-kserve-948997d99-2rnjd\" (UID: \"b0d1f87d-6f3f-4014-b893-d5f395dd6217\") " pod="ai-tenant-e2e-shared-b-74bb89/rate-test-model-74bb89-kserve-948997d99-2rnjd" Jul 06 14:22:35.655903 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:35.655874 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0d1f87d-6f3f-4014-b893-d5f395dd6217-tmp-dir\") pod \"rate-test-model-74bb89-kserve-948997d99-2rnjd\" (UID: \"b0d1f87d-6f3f-4014-b893-d5f395dd6217\") " pod="ai-tenant-e2e-shared-b-74bb89/rate-test-model-74bb89-kserve-948997d99-2rnjd" Jul 06 14:22:35.656080 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:35.655987 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b0d1f87d-6f3f-4014-b893-d5f395dd6217-dshm\") pod \"rate-test-model-74bb89-kserve-948997d99-2rnjd\" (UID: \"b0d1f87d-6f3f-4014-b893-d5f395dd6217\") " pod="ai-tenant-e2e-shared-b-74bb89/rate-test-model-74bb89-kserve-948997d99-2rnjd" Jul 06 14:22:35.656080 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:35.656030 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0d1f87d-6f3f-4014-b893-d5f395dd6217-tls-certs\") pod \"rate-test-model-74bb89-kserve-948997d99-2rnjd\" (UID: \"b0d1f87d-6f3f-4014-b893-d5f395dd6217\") " pod="ai-tenant-e2e-shared-b-74bb89/rate-test-model-74bb89-kserve-948997d99-2rnjd" Jul 06 14:22:35.756572 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:35.756496 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b0d1f87d-6f3f-4014-b893-d5f395dd6217-home\") pod \"rate-test-model-74bb89-kserve-948997d99-2rnjd\" (UID: \"b0d1f87d-6f3f-4014-b893-d5f395dd6217\") " pod="ai-tenant-e2e-shared-b-74bb89/rate-test-model-74bb89-kserve-948997d99-2rnjd" Jul 06 14:22:35.756572 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:35.756537 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b0d1f87d-6f3f-4014-b893-d5f395dd6217-model-cache\") pod \"rate-test-model-74bb89-kserve-948997d99-2rnjd\" (UID: \"b0d1f87d-6f3f-4014-b893-d5f395dd6217\") " pod="ai-tenant-e2e-shared-b-74bb89/rate-test-model-74bb89-kserve-948997d99-2rnjd" Jul 06 14:22:35.756572 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:35.756555 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r29kd\" (UniqueName: \"kubernetes.io/projected/b0d1f87d-6f3f-4014-b893-d5f395dd6217-kube-api-access-r29kd\") pod \"rate-test-model-74bb89-kserve-948997d99-2rnjd\" (UID: \"b0d1f87d-6f3f-4014-b893-d5f395dd6217\") " pod="ai-tenant-e2e-shared-b-74bb89/rate-test-model-74bb89-kserve-948997d99-2rnjd" Jul 06 14:22:35.756871 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:35.756590 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0d1f87d-6f3f-4014-b893-d5f395dd6217-tmp-dir\") pod \"rate-test-model-74bb89-kserve-948997d99-2rnjd\" (UID: \"b0d1f87d-6f3f-4014-b893-d5f395dd6217\") " pod="ai-tenant-e2e-shared-b-74bb89/rate-test-model-74bb89-kserve-948997d99-2rnjd" Jul 06 14:22:35.756871 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:35.756659 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b0d1f87d-6f3f-4014-b893-d5f395dd6217-dshm\") pod \"rate-test-model-74bb89-kserve-948997d99-2rnjd\" (UID: \"b0d1f87d-6f3f-4014-b893-d5f395dd6217\") " pod="ai-tenant-e2e-shared-b-74bb89/rate-test-model-74bb89-kserve-948997d99-2rnjd" Jul 06 14:22:35.756871 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:35.756689 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0d1f87d-6f3f-4014-b893-d5f395dd6217-tls-certs\") pod \"rate-test-model-74bb89-kserve-948997d99-2rnjd\" (UID: \"b0d1f87d-6f3f-4014-b893-d5f395dd6217\") " pod="ai-tenant-e2e-shared-b-74bb89/rate-test-model-74bb89-kserve-948997d99-2rnjd" Jul 06 14:22:35.757052 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:35.757015 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b0d1f87d-6f3f-4014-b893-d5f395dd6217-model-cache\") pod \"rate-test-model-74bb89-kserve-948997d99-2rnjd\" (UID: \"b0d1f87d-6f3f-4014-b893-d5f395dd6217\") " pod="ai-tenant-e2e-shared-b-74bb89/rate-test-model-74bb89-kserve-948997d99-2rnjd" Jul 06 14:22:35.757135 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:35.757046 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0d1f87d-6f3f-4014-b893-d5f395dd6217-tmp-dir\") pod \"rate-test-model-74bb89-kserve-948997d99-2rnjd\" (UID: \"b0d1f87d-6f3f-4014-b893-d5f395dd6217\") " pod="ai-tenant-e2e-shared-b-74bb89/rate-test-model-74bb89-kserve-948997d99-2rnjd" Jul 06 14:22:35.757135 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:35.757059 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b0d1f87d-6f3f-4014-b893-d5f395dd6217-home\") pod \"rate-test-model-74bb89-kserve-948997d99-2rnjd\" (UID: \"b0d1f87d-6f3f-4014-b893-d5f395dd6217\") " pod="ai-tenant-e2e-shared-b-74bb89/rate-test-model-74bb89-kserve-948997d99-2rnjd" Jul 06 14:22:35.758927 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:35.758906 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b0d1f87d-6f3f-4014-b893-d5f395dd6217-dshm\") pod \"rate-test-model-74bb89-kserve-948997d99-2rnjd\" (UID: \"b0d1f87d-6f3f-4014-b893-d5f395dd6217\") " pod="ai-tenant-e2e-shared-b-74bb89/rate-test-model-74bb89-kserve-948997d99-2rnjd" Jul 06 14:22:35.759043 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:35.759001 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0d1f87d-6f3f-4014-b893-d5f395dd6217-tls-certs\") pod \"rate-test-model-74bb89-kserve-948997d99-2rnjd\" (UID: \"b0d1f87d-6f3f-4014-b893-d5f395dd6217\") " pod="ai-tenant-e2e-shared-b-74bb89/rate-test-model-74bb89-kserve-948997d99-2rnjd" Jul 06 14:22:35.768552 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:35.768513 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r29kd\" (UniqueName: \"kubernetes.io/projected/b0d1f87d-6f3f-4014-b893-d5f395dd6217-kube-api-access-r29kd\") pod \"rate-test-model-74bb89-kserve-948997d99-2rnjd\" (UID: \"b0d1f87d-6f3f-4014-b893-d5f395dd6217\") " pod="ai-tenant-e2e-shared-b-74bb89/rate-test-model-74bb89-kserve-948997d99-2rnjd" Jul 06 14:22:35.804771 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:35.804746 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-74bb89/rate-test-model-74bb89-kserve-948997d99-2rnjd" Jul 06 14:22:35.952640 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:35.952597 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-74bb89/rate-test-model-74bb89-kserve-948997d99-2rnjd"] Jul 06 14:22:35.954206 ip-10-0-134-85 kubenswrapper[2556]: W0706 14:22:35.954170 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb0d1f87d_6f3f_4014_b893_d5f395dd6217.slice/crio-0a377c3231ed5f464be9962b6fbbbb433bd503aef30a563a3f24c02fec9a6805 WatchSource:0}: Error finding container 0a377c3231ed5f464be9962b6fbbbb433bd503aef30a563a3f24c02fec9a6805: Status 404 returned error can't find the container with id 0a377c3231ed5f464be9962b6fbbbb433bd503aef30a563a3f24c02fec9a6805 Jul 06 14:22:36.872902 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:36.872870 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-74bb89/rate-test-model-74bb89-kserve-948997d99-2rnjd" event={"ID":"b0d1f87d-6f3f-4014-b893-d5f395dd6217","Type":"ContainerStarted","Data":"0d1f68cb84f8236de05b57d88afcb6684396e65e593ea9e3becd331c67f22b74"} Jul 06 14:22:36.872902 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:36.872907 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-74bb89/rate-test-model-74bb89-kserve-948997d99-2rnjd" event={"ID":"b0d1f87d-6f3f-4014-b893-d5f395dd6217","Type":"ContainerStarted","Data":"0a377c3231ed5f464be9962b6fbbbb433bd503aef30a563a3f24c02fec9a6805"} Jul 06 14:22:36.892249 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:36.892203 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-74bb89/rate-test-model-74bb89-kserve-948997d99-2rnjd" podStartSLOduration=1.892188733 podStartE2EDuration="1.892188733s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:22:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:22:36.891248134 +0000 UTC m=+2250.690993829" watchObservedRunningTime="2026-07-06 14:22:36.892188733 +0000 UTC m=+2250.691934427" Jul 06 14:22:45.805180 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:45.805146 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-74bb89/rate-test-model-74bb89-kserve-948997d99-2rnjd" Jul 06 14:22:45.805663 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:45.805201 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-74bb89/rate-test-model-74bb89-kserve-948997d99-2rnjd" Jul 06 14:22:45.817370 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:45.817348 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-74bb89/rate-test-model-74bb89-kserve-948997d99-2rnjd" Jul 06 14:22:45.941690 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:22:45.941663 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-74bb89/rate-test-model-74bb89-kserve-948997d99-2rnjd" Jul 06 14:23:01.913304 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:23:01.913265 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:23:02.017770 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:23:02.017726 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:23:04.977757 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:23:04.977727 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:23:05.078632 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:23:05.078586 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:23:13.268375 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:23:13.268335 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:23:13.368072 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:23:13.368038 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:23:26.985259 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:23:26.985227 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:23:27.758156 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:23:27.758114 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-74bb89/rate-test-model-74bb89-kserve-948997d99-2rnjd"] Jul 06 14:23:27.794599 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:23:27.794559 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:23:28.903930 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:23:28.903897 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:23:29.282173 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:23:29.282141 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:23:29.382449 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:23:29.382414 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:23:29.527375 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:23:29.527329 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:23:34.358790 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:23:34.358753 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:23:39.073957 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:23:39.073925 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:23:42.780487 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:23:42.780440 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-74bb89/rate-test-model-74bb89-kserve-948997d99-2rnjd" podUID="b0d1f87d-6f3f-4014-b893-d5f395dd6217" containerName="main" containerID="cri-o://0d1f68cb84f8236de05b57d88afcb6684396e65e593ea9e3becd331c67f22b74" gracePeriod=45 Jul 06 14:23:43.040090 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:23:43.040027 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-74bb89/rate-test-model-74bb89-kserve-948997d99-2rnjd" Jul 06 14:23:43.179868 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:23:43.179840 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r29kd\" (UniqueName: \"kubernetes.io/projected/b0d1f87d-6f3f-4014-b893-d5f395dd6217-kube-api-access-r29kd\") pod \"b0d1f87d-6f3f-4014-b893-d5f395dd6217\" (UID: \"b0d1f87d-6f3f-4014-b893-d5f395dd6217\") " Jul 06 14:23:43.180020 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:23:43.179948 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b0d1f87d-6f3f-4014-b893-d5f395dd6217-home\") pod \"b0d1f87d-6f3f-4014-b893-d5f395dd6217\" (UID: \"b0d1f87d-6f3f-4014-b893-d5f395dd6217\") " Jul 06 14:23:43.180020 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:23:43.179968 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b0d1f87d-6f3f-4014-b893-d5f395dd6217-model-cache\") pod \"b0d1f87d-6f3f-4014-b893-d5f395dd6217\" (UID: \"b0d1f87d-6f3f-4014-b893-d5f395dd6217\") " Jul 06 14:23:43.180020 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:23:43.179988 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0d1f87d-6f3f-4014-b893-d5f395dd6217-tls-certs\") pod \"b0d1f87d-6f3f-4014-b893-d5f395dd6217\" (UID: \"b0d1f87d-6f3f-4014-b893-d5f395dd6217\") " Jul 06 14:23:43.180020 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:23:43.180003 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b0d1f87d-6f3f-4014-b893-d5f395dd6217-dshm\") pod \"b0d1f87d-6f3f-4014-b893-d5f395dd6217\" (UID: \"b0d1f87d-6f3f-4014-b893-d5f395dd6217\") " Jul 06 14:23:43.180236 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:23:43.180025 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0d1f87d-6f3f-4014-b893-d5f395dd6217-tmp-dir\") pod \"b0d1f87d-6f3f-4014-b893-d5f395dd6217\" (UID: \"b0d1f87d-6f3f-4014-b893-d5f395dd6217\") " Jul 06 14:23:43.180291 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:23:43.180258 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0d1f87d-6f3f-4014-b893-d5f395dd6217-model-cache" (OuterVolumeSpecName: "model-cache") pod "b0d1f87d-6f3f-4014-b893-d5f395dd6217" (UID: "b0d1f87d-6f3f-4014-b893-d5f395dd6217"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:23:43.180291 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:23:43.180275 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0d1f87d-6f3f-4014-b893-d5f395dd6217-home" (OuterVolumeSpecName: "home") pod "b0d1f87d-6f3f-4014-b893-d5f395dd6217" (UID: "b0d1f87d-6f3f-4014-b893-d5f395dd6217"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:23:43.180468 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:23:43.180450 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0d1f87d-6f3f-4014-b893-d5f395dd6217-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b0d1f87d-6f3f-4014-b893-d5f395dd6217" (UID: "b0d1f87d-6f3f-4014-b893-d5f395dd6217"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:23:43.182187 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:23:43.182170 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0d1f87d-6f3f-4014-b893-d5f395dd6217-dshm" (OuterVolumeSpecName: "dshm") pod "b0d1f87d-6f3f-4014-b893-d5f395dd6217" (UID: "b0d1f87d-6f3f-4014-b893-d5f395dd6217"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:23:43.182408 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:23:43.182380 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0d1f87d-6f3f-4014-b893-d5f395dd6217-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b0d1f87d-6f3f-4014-b893-d5f395dd6217" (UID: "b0d1f87d-6f3f-4014-b893-d5f395dd6217"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 14:23:43.182505 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:23:43.182418 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0d1f87d-6f3f-4014-b893-d5f395dd6217-kube-api-access-r29kd" (OuterVolumeSpecName: "kube-api-access-r29kd") pod "b0d1f87d-6f3f-4014-b893-d5f395dd6217" (UID: "b0d1f87d-6f3f-4014-b893-d5f395dd6217"). InnerVolumeSpecName "kube-api-access-r29kd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 14:23:43.273014 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:23:43.272976 2556 generic.go:356] "Generic (PLEG): container finished" podID="b0d1f87d-6f3f-4014-b893-d5f395dd6217" containerID="0d1f68cb84f8236de05b57d88afcb6684396e65e593ea9e3becd331c67f22b74" exitCode=0 Jul 06 14:23:43.273178 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:23:43.273025 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-74bb89/rate-test-model-74bb89-kserve-948997d99-2rnjd" Jul 06 14:23:43.273178 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:23:43.273021 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-74bb89/rate-test-model-74bb89-kserve-948997d99-2rnjd" event={"ID":"b0d1f87d-6f3f-4014-b893-d5f395dd6217","Type":"ContainerDied","Data":"0d1f68cb84f8236de05b57d88afcb6684396e65e593ea9e3becd331c67f22b74"} Jul 06 14:23:43.273178 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:23:43.273158 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-74bb89/rate-test-model-74bb89-kserve-948997d99-2rnjd" event={"ID":"b0d1f87d-6f3f-4014-b893-d5f395dd6217","Type":"ContainerDied","Data":"0a377c3231ed5f464be9962b6fbbbb433bd503aef30a563a3f24c02fec9a6805"} Jul 06 14:23:43.273347 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:23:43.273191 2556 scope.go:117] "RemoveContainer" containerID="0d1f68cb84f8236de05b57d88afcb6684396e65e593ea9e3becd331c67f22b74" Jul 06 14:23:43.280850 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:23:43.280793 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r29kd\" (UniqueName: \"kubernetes.io/projected/b0d1f87d-6f3f-4014-b893-d5f395dd6217-kube-api-access-r29kd\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 14:23:43.280850 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:23:43.280821 2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b0d1f87d-6f3f-4014-b893-d5f395dd6217-home\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 14:23:43.280850 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:23:43.280838 2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b0d1f87d-6f3f-4014-b893-d5f395dd6217-model-cache\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 14:23:43.280850 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:23:43.280850 2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0d1f87d-6f3f-4014-b893-d5f395dd6217-tls-certs\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 14:23:43.281142 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:23:43.280862 2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b0d1f87d-6f3f-4014-b893-d5f395dd6217-dshm\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 14:23:43.281142 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:23:43.280872 2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0d1f87d-6f3f-4014-b893-d5f395dd6217-tmp-dir\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Jul 06 14:23:43.283295 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:23:43.283268 2556 scope.go:117] "RemoveContainer" containerID="0d1f68cb84f8236de05b57d88afcb6684396e65e593ea9e3becd331c67f22b74" Jul 06 14:23:43.283546 ip-10-0-134-85 kubenswrapper[2556]: E0706 14:23:43.283521 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d1f68cb84f8236de05b57d88afcb6684396e65e593ea9e3becd331c67f22b74\": container with ID starting with 0d1f68cb84f8236de05b57d88afcb6684396e65e593ea9e3becd331c67f22b74 not found: ID does not exist" containerID="0d1f68cb84f8236de05b57d88afcb6684396e65e593ea9e3becd331c67f22b74" Jul 06 14:23:43.283588 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:23:43.283555 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d1f68cb84f8236de05b57d88afcb6684396e65e593ea9e3becd331c67f22b74"} err="failed to get container status \"0d1f68cb84f8236de05b57d88afcb6684396e65e593ea9e3becd331c67f22b74\": rpc error: code = NotFound desc = could not find container \"0d1f68cb84f8236de05b57d88afcb6684396e65e593ea9e3becd331c67f22b74\": container with ID starting with 0d1f68cb84f8236de05b57d88afcb6684396e65e593ea9e3becd331c67f22b74 not found: ID does not exist" Jul 06 14:23:43.295757 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:23:43.295684 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-74bb89/rate-test-model-74bb89-kserve-948997d99-2rnjd"] Jul 06 14:23:43.299850 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:23:43.299830 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-74bb89/rate-test-model-74bb89-kserve-948997d99-2rnjd"] Jul 06 14:23:44.788775 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:23:44.788740 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0d1f87d-6f3f-4014-b893-d5f395dd6217" path="/var/lib/kubelet/pods/b0d1f87d-6f3f-4014-b893-d5f395dd6217/volumes" Jul 06 14:24:11.486373 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:11.486337 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:24:11.755968 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:11.755883 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:24:11.988466 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:11.988428 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:24:12.222984 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:12.222905 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:24:12.682516 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:12.682485 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:24:12.787073 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:12.787034 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:24:12.902063 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:12.902026 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:24:13.068197 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:13.068166 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:24:14.225262 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:14.225231 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:24:18.539952 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:18.539908 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:24:18.612753 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:18.612723 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:24:18.834797 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:18.834717 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:24:19.063197 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:19.063165 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:24:19.502556 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:19.502521 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-68f484898b-w4rc4_620b2a03-1191-476d-a026-17faef9b7c9b/authorino/0.log" Jul 06 14:24:24.302454 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:24.302426 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-tjk4d_a570c2c3-0315-4e83-b48c-db4b8eda70ae/manager/0.log" Jul 06 14:24:24.424008 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:24.423974 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-4fbkk_0f508f15-9231-4c24-85e4-358f1d2f76bf/manager/0.log" Jul 06 14:24:24.548478 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:24.548447 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-7676dfbcb7-p2ffk_b6e54a17-606d-4712-842c-a110ac5350c0/maas-api/0.log" Jul 06 14:24:24.655804 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:24.655719 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722440-86579_310d776c-ffee-443e-9b6c-6abdcce5f6ff/cleanup/0.log" Jul 06 14:24:24.929442 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:24.929360 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-ff4954456-dhw6w_1790d630-1c05-471a-a75c-16fe9ef7437c/manager/0.log" Jul 06 14:24:25.051101 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:25.051076 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-wzv7k_1c9b87b4-4ae4-439a-8644-d6839d74b15c/server/0.log" Jul 06 14:24:25.182163 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:25.182098 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-wx677_21b366ba-2179-4321-a7ca-fdde9daebb5a/manager/0.log" Jul 06 14:24:25.582188 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:25.582161 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69bb6cc6d7-whnwf_90bf4f2a-d6cf-46fa-b36f-512130b1dc91/copy-manifests/0.log" Jul 06 14:24:25.599032 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:25.599010 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69bb6cc6d7-whnwf_90bf4f2a-d6cf-46fa-b36f-512130b1dc91/manager/0.log" Jul 06 14:24:25.720024 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:25.719993 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-js52g_215f3d1a-f8c8-4813-9f80-96003dead010/postgres/0.log" Jul 06 14:24:26.581513 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:26.581483 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595xs5z_8660c247-9baf-4e6b-9ff3-c2e4ca1830c3/extract/0.log" Jul 06 14:24:26.588486 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:26.588464 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595xs5z_8660c247-9baf-4e6b-9ff3-c2e4ca1830c3/util/0.log" Jul 06 14:24:26.596029 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:26.596009 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595xs5z_8660c247-9baf-4e6b-9ff3-c2e4ca1830c3/pull/0.log" Jul 06 14:24:26.713832 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:26.713804 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04xh72_dbfbd510-6069-4141-8a31-fd55b8a68730/extract/0.log" Jul 06 14:24:26.720472 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:26.720454 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04xh72_dbfbd510-6069-4141-8a31-fd55b8a68730/util/0.log" Jul 06 14:24:26.727395 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:26.727369 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04xh72_dbfbd510-6069-4141-8a31-fd55b8a68730/pull/0.log" Jul 06 14:24:26.853041 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:26.852981 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nzcjl_16125139-f229-460e-98c8-aae5c6465060/util/0.log" Jul 06 14:24:26.860410 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:26.860384 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nzcjl_16125139-f229-460e-98c8-aae5c6465060/pull/0.log" Jul 06 14:24:26.868231 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:26.868210 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nzcjl_16125139-f229-460e-98c8-aae5c6465060/extract/0.log" Jul 06 14:24:26.996267 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:26.996243 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qsqdp_4973f9d0-ebb9-4f87-a3d7-5916f174cea6/util/0.log" Jul 06 14:24:27.002219 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:27.002198 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qsqdp_4973f9d0-ebb9-4f87-a3d7-5916f174cea6/pull/0.log" Jul 06 14:24:27.008135 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:27.008118 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qsqdp_4973f9d0-ebb9-4f87-a3d7-5916f174cea6/extract/0.log" Jul 06 14:24:27.149388 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:27.149284 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-68f484898b-w4rc4_620b2a03-1191-476d-a026-17faef9b7c9b/authorino/0.log" Jul 06 14:24:27.284540 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:27.284506 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-g6mnj_49c5b891-8102-4a34-84ee-6d87debad40a/manager/0.log" Jul 06 14:24:27.645696 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:27.645664 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-j5ptm_421349c0-bc30-4927-87dc-31a5a8d7863f/registry-server/0.log" Jul 06 14:24:27.779984 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:27.779957 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-fg9r4_903ccc46-66c9-468f-8a87-e3546ba7b1c4/manager/0.log" Jul 06 14:24:28.034613 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:28.034587 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-sbw4q_9ad0bc2e-6cec-498f-a48f-bfe5dd1e6ca3/manager/0.log" Jul 06 14:24:28.405257 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:28.405163 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678czrsn_dc7f48fe-12e2-43df-a252-dfd360ec8b4b/istio-proxy/0.log" Jul 06 14:24:28.647131 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:28.647093 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cf46d7698-7mgvt_ccfcc8fe-0f38-4027-8152-30c716737aaf/kube-auth-proxy/0.log" Jul 06 14:24:28.899049 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:28.899006 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-q6bld_45390162-0f47-46a4-9bf1-513488ce5c95/istio-proxy/1.log" Jul 06 14:24:29.032761 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:29.032729 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-8rm9x_52649a68-8920-4e60-be96-d73697ff2aac/payload-pre-processing/0.log" Jul 06 14:24:29.162644 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:29.162508 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-cl9ff_682be737-a35e-44da-b377-58987ce9b2dd/payload-processing/0.log" Jul 06 14:24:29.664357 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:29.664325 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-xg4bl_fbf10280-af08-4206-a8d7-4fc1cc5f5fa6/main/0.log" Jul 06 14:24:34.171347 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:34.171308 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:24:34.295031 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:34.294995 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" limit=1024 Jul 06 14:24:37.293091 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:37.293060 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-w5psk_b400c7ed-fd28-44f0-802f-17b18fa21328/global-pull-secret-syncer/0.log" Jul 06 14:24:37.367132 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:37.367106 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-266zj_2f4f1d96-1e31-4efd-8569-e719707555e7/konnectivity-agent/0.log" Jul 06 14:24:37.480275 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:37.480247 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-85.ec2.internal_918473a18bd382b5ab12df4cdc26e303/haproxy/0.log" Jul 06 14:24:41.811232 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:41.811207 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595xs5z_8660c247-9baf-4e6b-9ff3-c2e4ca1830c3/extract/0.log" Jul 06 14:24:41.834847 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:41.834826 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595xs5z_8660c247-9baf-4e6b-9ff3-c2e4ca1830c3/util/0.log" Jul 06 14:24:41.862718 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:41.862693 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595xs5z_8660c247-9baf-4e6b-9ff3-c2e4ca1830c3/pull/0.log" Jul 06 14:24:41.895460 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:41.895435 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04xh72_dbfbd510-6069-4141-8a31-fd55b8a68730/extract/0.log" Jul 06 14:24:41.924240 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:41.924223 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04xh72_dbfbd510-6069-4141-8a31-fd55b8a68730/util/0.log" Jul 06 14:24:41.951908 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:41.951885 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04xh72_dbfbd510-6069-4141-8a31-fd55b8a68730/pull/0.log" Jul 06 14:24:41.995176 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:41.995149 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nzcjl_16125139-f229-460e-98c8-aae5c6465060/extract/0.log" Jul 06 14:24:42.030246 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:42.030227 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nzcjl_16125139-f229-460e-98c8-aae5c6465060/util/0.log" Jul 06 14:24:42.053570 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:42.053553 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nzcjl_16125139-f229-460e-98c8-aae5c6465060/pull/0.log" Jul 06 14:24:42.083488 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:42.083414 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qsqdp_4973f9d0-ebb9-4f87-a3d7-5916f174cea6/extract/0.log" Jul 06 14:24:42.110641 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:42.110611 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qsqdp_4973f9d0-ebb9-4f87-a3d7-5916f174cea6/util/0.log" Jul 06 14:24:42.164501 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:42.164482 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qsqdp_4973f9d0-ebb9-4f87-a3d7-5916f174cea6/pull/0.log" Jul 06 14:24:42.632884 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:42.632851 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-68f484898b-w4rc4_620b2a03-1191-476d-a026-17faef9b7c9b/authorino/0.log" Jul 06 14:24:42.664179 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:42.664145 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-g6mnj_49c5b891-8102-4a34-84ee-6d87debad40a/manager/0.log" Jul 06 14:24:42.778934 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:42.778913 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-j5ptm_421349c0-bc30-4927-87dc-31a5a8d7863f/registry-server/0.log" Jul 06 14:24:42.970815 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:42.970738 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-fg9r4_903ccc46-66c9-468f-8a87-e3546ba7b1c4/manager/0.log" Jul 06 14:24:43.112057 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:43.112020 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-sbw4q_9ad0bc2e-6cec-498f-a48f-bfe5dd1e6ca3/manager/0.log" Jul 06 14:24:44.681843 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:44.681806 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0340b7c7-bd42-4aec-81e7-8bceaa11cf0b/alertmanager/0.log" Jul 06 14:24:44.789782 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:44.789753 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0340b7c7-bd42-4aec-81e7-8bceaa11cf0b/config-reloader/0.log" Jul 06 14:24:44.847576 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:44.847548 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0340b7c7-bd42-4aec-81e7-8bceaa11cf0b/kube-rbac-proxy-web/0.log" Jul 06 14:24:44.949099 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:44.949029 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0340b7c7-bd42-4aec-81e7-8bceaa11cf0b/kube-rbac-proxy/0.log" Jul 06 14:24:44.977864 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:44.977839 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0340b7c7-bd42-4aec-81e7-8bceaa11cf0b/kube-rbac-proxy-metric/0.log" Jul 06 14:24:45.002888 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:45.002866 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0340b7c7-bd42-4aec-81e7-8bceaa11cf0b/prom-label-proxy/0.log" Jul 06 14:24:45.027951 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:45.027927 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0340b7c7-bd42-4aec-81e7-8bceaa11cf0b/init-config-reloader/0.log" Jul 06 14:24:45.078178 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:45.078160 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-gnsd2_377826fd-f531-4a58-98a8-bc2b2e536fb7/cluster-monitoring-operator/0.log" Jul 06 14:24:45.115526 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:45.115502 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-2ftx5_c132506e-d653-4be7-ba5c-0f3a74ca7b82/kube-state-metrics/0.log" Jul 06 14:24:45.136123 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:45.136106 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-2ftx5_c132506e-d653-4be7-ba5c-0f3a74ca7b82/kube-rbac-proxy-main/0.log" Jul 06 14:24:45.161608 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:45.161587 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-2ftx5_c132506e-d653-4be7-ba5c-0f3a74ca7b82/kube-rbac-proxy-self/0.log" Jul 06 14:24:45.193869 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:45.193850 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5875c5dd9d-97pfx_59d49927-745f-4803-a410-9456251924fc/metrics-server/0.log" Jul 06 14:24:45.434215 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:45.434184 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-njffn_30395750-6592-40d0-ac24-8573d4e55d6b/node-exporter/0.log" Jul 06 14:24:45.458546 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:45.458522 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-njffn_30395750-6592-40d0-ac24-8573d4e55d6b/kube-rbac-proxy/0.log" Jul 06 14:24:45.485628 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:45.485594 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-njffn_30395750-6592-40d0-ac24-8573d4e55d6b/init-textfile/0.log" Jul 06 14:24:45.888077 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:45.888054 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7bbff69f4f-scjnw_b409a175-cf7a-4f84-81f4-b6d8c48769c7/telemeter-client/0.log" Jul 06 14:24:45.913364 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:45.913338 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7bbff69f4f-scjnw_b409a175-cf7a-4f84-81f4-b6d8c48769c7/reload/0.log" Jul 06 14:24:45.936168 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:45.936151 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7bbff69f4f-scjnw_b409a175-cf7a-4f84-81f4-b6d8c48769c7/kube-rbac-proxy/0.log" Jul 06 14:24:47.185066 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:47.185031 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7nz7d/perf-node-gather-daemonset-xgxzj"] Jul 06 14:24:47.185543 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:47.185525 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0d1f87d-6f3f-4014-b893-d5f395dd6217" containerName="main" Jul 06 14:24:47.185588 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:47.185545 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0d1f87d-6f3f-4014-b893-d5f395dd6217" containerName="main" Jul 06 14:24:47.185661 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:47.185651 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0d1f87d-6f3f-4014-b893-d5f395dd6217" containerName="main" Jul 06 14:24:47.188863 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:47.188847 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7nz7d/perf-node-gather-daemonset-xgxzj" Jul 06 14:24:47.191737 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:47.191704 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7nz7d\"/\"default-dockercfg-hxwfj\"" Jul 06 14:24:47.191866 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:47.191805 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7nz7d\"/\"openshift-service-ca.crt\"" Jul 06 14:24:47.192924 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:47.192908 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7nz7d\"/\"kube-root-ca.crt\"" Jul 06 14:24:47.198509 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:47.198487 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7nz7d/perf-node-gather-daemonset-xgxzj"] Jul 06 14:24:47.252151 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:47.252123 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c9fba23c-93e7-4827-9c6c-946007f638c5-lib-modules\") pod \"perf-node-gather-daemonset-xgxzj\" (UID: \"c9fba23c-93e7-4827-9c6c-946007f638c5\") " pod="openshift-must-gather-7nz7d/perf-node-gather-daemonset-xgxzj" Jul 06 14:24:47.252291 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:47.252173 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42zsr\" (UniqueName: \"kubernetes.io/projected/c9fba23c-93e7-4827-9c6c-946007f638c5-kube-api-access-42zsr\") pod \"perf-node-gather-daemonset-xgxzj\" (UID: \"c9fba23c-93e7-4827-9c6c-946007f638c5\") " pod="openshift-must-gather-7nz7d/perf-node-gather-daemonset-xgxzj" Jul 06 14:24:47.252291 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:47.252207 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c9fba23c-93e7-4827-9c6c-946007f638c5-podres\") pod \"perf-node-gather-daemonset-xgxzj\" (UID: \"c9fba23c-93e7-4827-9c6c-946007f638c5\") " pod="openshift-must-gather-7nz7d/perf-node-gather-daemonset-xgxzj" Jul 06 14:24:47.252291 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:47.252264 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c9fba23c-93e7-4827-9c6c-946007f638c5-sys\") pod \"perf-node-gather-daemonset-xgxzj\" (UID: \"c9fba23c-93e7-4827-9c6c-946007f638c5\") " pod="openshift-must-gather-7nz7d/perf-node-gather-daemonset-xgxzj" Jul 06 14:24:47.252418 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:47.252307 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c9fba23c-93e7-4827-9c6c-946007f638c5-proc\") pod \"perf-node-gather-daemonset-xgxzj\" (UID: \"c9fba23c-93e7-4827-9c6c-946007f638c5\") " pod="openshift-must-gather-7nz7d/perf-node-gather-daemonset-xgxzj" Jul 06 14:24:47.353126 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:47.353097 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c9fba23c-93e7-4827-9c6c-946007f638c5-sys\") pod \"perf-node-gather-daemonset-xgxzj\" (UID: \"c9fba23c-93e7-4827-9c6c-946007f638c5\") " pod="openshift-must-gather-7nz7d/perf-node-gather-daemonset-xgxzj" Jul 06 14:24:47.353236 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:47.353133 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c9fba23c-93e7-4827-9c6c-946007f638c5-proc\") pod \"perf-node-gather-daemonset-xgxzj\" (UID: \"c9fba23c-93e7-4827-9c6c-946007f638c5\") " pod="openshift-must-gather-7nz7d/perf-node-gather-daemonset-xgxzj" Jul 06 14:24:47.353236 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:47.353220 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c9fba23c-93e7-4827-9c6c-946007f638c5-sys\") pod \"perf-node-gather-daemonset-xgxzj\" (UID: \"c9fba23c-93e7-4827-9c6c-946007f638c5\") " pod="openshift-must-gather-7nz7d/perf-node-gather-daemonset-xgxzj" Jul 06 14:24:47.353312 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:47.353232 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c9fba23c-93e7-4827-9c6c-946007f638c5-lib-modules\") pod \"perf-node-gather-daemonset-xgxzj\" (UID: \"c9fba23c-93e7-4827-9c6c-946007f638c5\") " pod="openshift-must-gather-7nz7d/perf-node-gather-daemonset-xgxzj" Jul 06 14:24:47.353312 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:47.353278 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42zsr\" (UniqueName: \"kubernetes.io/projected/c9fba23c-93e7-4827-9c6c-946007f638c5-kube-api-access-42zsr\") pod \"perf-node-gather-daemonset-xgxzj\" (UID: \"c9fba23c-93e7-4827-9c6c-946007f638c5\") " pod="openshift-must-gather-7nz7d/perf-node-gather-daemonset-xgxzj" Jul 06 14:24:47.353312 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:47.353287 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c9fba23c-93e7-4827-9c6c-946007f638c5-proc\") pod \"perf-node-gather-daemonset-xgxzj\" (UID: \"c9fba23c-93e7-4827-9c6c-946007f638c5\") " pod="openshift-must-gather-7nz7d/perf-node-gather-daemonset-xgxzj" Jul 06 14:24:47.353312 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:47.353303 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c9fba23c-93e7-4827-9c6c-946007f638c5-podres\") pod \"perf-node-gather-daemonset-xgxzj\" (UID: \"c9fba23c-93e7-4827-9c6c-946007f638c5\") " pod="openshift-must-gather-7nz7d/perf-node-gather-daemonset-xgxzj" Jul 06 14:24:47.353442 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:47.353354 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c9fba23c-93e7-4827-9c6c-946007f638c5-lib-modules\") pod \"perf-node-gather-daemonset-xgxzj\" (UID: \"c9fba23c-93e7-4827-9c6c-946007f638c5\") " pod="openshift-must-gather-7nz7d/perf-node-gather-daemonset-xgxzj" Jul 06 14:24:47.353442 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:47.353417 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c9fba23c-93e7-4827-9c6c-946007f638c5-podres\") pod \"perf-node-gather-daemonset-xgxzj\" (UID: \"c9fba23c-93e7-4827-9c6c-946007f638c5\") " pod="openshift-must-gather-7nz7d/perf-node-gather-daemonset-xgxzj" Jul 06 14:24:47.362001 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:47.361982 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42zsr\" (UniqueName: \"kubernetes.io/projected/c9fba23c-93e7-4827-9c6c-946007f638c5-kube-api-access-42zsr\") pod \"perf-node-gather-daemonset-xgxzj\" (UID: \"c9fba23c-93e7-4827-9c6c-946007f638c5\") " pod="openshift-must-gather-7nz7d/perf-node-gather-daemonset-xgxzj" Jul 06 14:24:47.499930 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:47.499911 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7nz7d/perf-node-gather-daemonset-xgxzj" Jul 06 14:24:47.633111 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:47.633079 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7nz7d/perf-node-gather-daemonset-xgxzj"] Jul 06 14:24:47.634093 ip-10-0-134-85 kubenswrapper[2556]: W0706 14:24:47.634068 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc9fba23c_93e7_4827_9c6c_946007f638c5.slice/crio-8a0f7bb84957aab68cc19f6c10a1a20839a05928ad8386d39fd31751f9cbb08d WatchSource:0}: Error finding container 8a0f7bb84957aab68cc19f6c10a1a20839a05928ad8386d39fd31751f9cbb08d: Status 404 returned error can't find the container with id 8a0f7bb84957aab68cc19f6c10a1a20839a05928ad8386d39fd31751f9cbb08d Jul 06 14:24:47.655497 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:47.655470 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7nz7d/perf-node-gather-daemonset-xgxzj" event={"ID":"c9fba23c-93e7-4827-9c6c-946007f638c5","Type":"ContainerStarted","Data":"8a0f7bb84957aab68cc19f6c10a1a20839a05928ad8386d39fd31751f9cbb08d"} Jul 06 14:24:47.995445 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:47.995424 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vjl62_b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7/console-operator/2.log" Jul 06 14:24:48.002379 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:48.002354 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vjl62_b2d4f8d0-dee7-4ceb-bd7e-691ebe8021e7/console-operator/3.log" Jul 06 14:24:48.474472 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:48.474388 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7f88d8cbdf-r847m_2d81cc14-fd39-46b7-9075-758a663ccee1/console/0.log" Jul 06 14:24:48.663573 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:48.663541 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7nz7d/perf-node-gather-daemonset-xgxzj" event={"ID":"c9fba23c-93e7-4827-9c6c-946007f638c5","Type":"ContainerStarted","Data":"ba06ea96d5530e7bfac5e52c5428214d7a018f0b361eba13d9dac5a1a47715a6"} Jul 06 14:24:48.663770 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:48.663648 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-7nz7d/perf-node-gather-daemonset-xgxzj" Jul 06 14:24:48.681067 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:48.681024 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7nz7d/perf-node-gather-daemonset-xgxzj" podStartSLOduration=1.681005402 podStartE2EDuration="1.681005402s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:24:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:24:48.679799683 +0000 UTC m=+2382.479545376" watchObservedRunningTime="2026-07-06 14:24:48.681005402 +0000 UTC m=+2382.480751094" Jul 06 14:24:49.088770 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:49.088740 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-xg4z5_0cba18f9-762c-4a58-8b34-66a661b7094b/volume-data-source-validator/0.log" Jul 06 14:24:50.244098 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:50.244070 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zz5qt_39f1f56d-ff91-4983-b7b1-602a2bf245d8/dns/0.log" Jul 06 14:24:50.269587 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:50.269563 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zz5qt_39f1f56d-ff91-4983-b7b1-602a2bf245d8/kube-rbac-proxy/0.log" Jul 06 14:24:50.360746 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:50.360723 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jpdcl_d9c6489d-fe7d-4af6-a03d-04488b5a20ac/dns-node-resolver/0.log" Jul 06 14:24:50.935928 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:50.935898 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-59959bf766-kn9ns_e15f7474-ae11-4486-9feb-d6ca49655405/registry/0.log" Jul 06 14:24:51.019004 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:51.018978 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wmfs6_73be228a-e09a-4ef2-9df5-b3ef9a8324fc/node-ca/0.log" Jul 06 14:24:51.989256 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:51.989226 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678czrsn_dc7f48fe-12e2-43df-a252-dfd360ec8b4b/istio-proxy/0.log" Jul 06 14:24:52.116706 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:52.116672 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cf46d7698-7mgvt_ccfcc8fe-0f38-4027-8152-30c716737aaf/kube-auth-proxy/0.log" Jul 06 14:24:52.182079 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:52.182052 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-q6bld_45390162-0f47-46a4-9bf1-513488ce5c95/istio-proxy/0.log" Jul 06 14:24:52.235638 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:52.235594 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-q6bld_45390162-0f47-46a4-9bf1-513488ce5c95/istio-proxy/1.log" Jul 06 14:24:52.276771 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:52.276701 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-8rm9x_52649a68-8920-4e60-be96-d73697ff2aac/payload-pre-processing/0.log" Jul 06 14:24:52.348826 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:52.348799 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-cl9ff_682be737-a35e-44da-b377-58987ce9b2dd/payload-processing/0.log" Jul 06 14:24:53.073091 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:53.073059 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-crrkc_f145985c-f05e-41c0-9f44-b6c230aa961c/serve-healthcheck-canary/0.log" Jul 06 14:24:53.602172 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:53.602141 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2x68v_d72c5579-a74a-4fe9-8c89-75cff6c559ea/kube-rbac-proxy/0.log" Jul 06 14:24:53.629505 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:53.629472 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2x68v_d72c5579-a74a-4fe9-8c89-75cff6c559ea/exporter/0.log" Jul 06 14:24:53.659283 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:53.659258 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2x68v_d72c5579-a74a-4fe9-8c89-75cff6c559ea/extractor/0.log" Jul 06 14:24:54.679870 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:54.679847 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-7nz7d/perf-node-gather-daemonset-xgxzj" Jul 06 14:24:56.107249 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:56.107178 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-tjk4d_a570c2c3-0315-4e83-b48c-db4b8eda70ae/manager/0.log" Jul 06 14:24:56.330738 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:56.330706 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-4fbkk_0f508f15-9231-4c24-85e4-358f1d2f76bf/manager/0.log" Jul 06 14:24:56.381239 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:56.381169 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-7676dfbcb7-p2ffk_b6e54a17-606d-4712-842c-a110ac5350c0/maas-api/0.log" Jul 06 14:24:56.402423 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:56.402399 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722440-86579_310d776c-ffee-443e-9b6c-6abdcce5f6ff/cleanup/0.log" Jul 06 14:24:56.604537 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:56.604513 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-ff4954456-dhw6w_1790d630-1c05-471a-a75c-16fe9ef7437c/manager/0.log" Jul 06 14:24:56.630060 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:56.630037 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-wzv7k_1c9b87b4-4ae4-439a-8644-d6839d74b15c/server/0.log" Jul 06 14:24:56.743928 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:56.743901 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-wx677_21b366ba-2179-4321-a7ca-fdde9daebb5a/manager/0.log" Jul 06 14:24:56.933859 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:56.933830 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69bb6cc6d7-whnwf_90bf4f2a-d6cf-46fa-b36f-512130b1dc91/manager/0.log" Jul 06 14:24:56.959153 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:56.959127 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69bb6cc6d7-whnwf_90bf4f2a-d6cf-46fa-b36f-512130b1dc91/copy-manifests/0.log" Jul 06 14:24:56.988458 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:56.988171 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-js52g_215f3d1a-f8c8-4813-9f80-96003dead010/postgres/0.log" Jul 06 14:24:57.588758 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:57.588674 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678czrsn_dc7f48fe-12e2-43df-a252-dfd360ec8b4b/istio-proxy/0.log" Jul 06 14:24:57.698922 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:57.698894 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cf46d7698-7mgvt_ccfcc8fe-0f38-4027-8152-30c716737aaf/kube-auth-proxy/0.log" Jul 06 14:24:57.740445 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:57.740415 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-q6bld_45390162-0f47-46a4-9bf1-513488ce5c95/istio-proxy/0.log" Jul 06 14:24:57.793470 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:57.793446 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-q6bld_45390162-0f47-46a4-9bf1-513488ce5c95/istio-proxy/1.log" Jul 06 14:24:57.821978 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:57.821949 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-8rm9x_52649a68-8920-4e60-be96-d73697ff2aac/payload-pre-processing/0.log" Jul 06 14:24:57.882886 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:57.882813 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-cl9ff_682be737-a35e-44da-b377-58987ce9b2dd/payload-processing/0.log" Jul 06 14:24:59.055920 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:59.055898 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678czrsn_dc7f48fe-12e2-43df-a252-dfd360ec8b4b/istio-proxy/0.log" Jul 06 14:24:59.167537 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:59.167468 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cf46d7698-7mgvt_ccfcc8fe-0f38-4027-8152-30c716737aaf/kube-auth-proxy/0.log" Jul 06 14:24:59.215458 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:59.215435 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-q6bld_45390162-0f47-46a4-9bf1-513488ce5c95/istio-proxy/0.log" Jul 06 14:24:59.270392 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:59.270372 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-q6bld_45390162-0f47-46a4-9bf1-513488ce5c95/istio-proxy/1.log" Jul 06 14:24:59.300881 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:59.300857 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-8rm9x_52649a68-8920-4e60-be96-d73697ff2aac/payload-pre-processing/0.log" Jul 06 14:24:59.366114 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:24:59.366092 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-cl9ff_682be737-a35e-44da-b377-58987ce9b2dd/payload-processing/0.log" Jul 06 14:25:03.650476 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:25:03.650387 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-j6clh_d4ae4ed5-1e0d-4012-98bd-3c91d9d55dd1/kube-storage-version-migrator-operator/1.log" Jul 06 14:25:03.652219 ip-10-0-134-85 kubenswrapper[2556]: I0706 14:25:03.652195 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-j6clh_d4ae4ed5-1e0d-4012-98bd-3c91d9d55dd1/kube-storage-version-migrator-operator/0.log"