Jul 02 13:59:08.771423 ip-10-0-133-57 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 02 13:59:08.771434 ip-10-0-133-57 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 02 13:59:08.771441 ip-10-0-133-57 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 02 13:59:08.771650 ip-10-0-133-57 systemd[1]: Failed to start Kubernetes Kubelet. Jul 02 13:59:18.902125 ip-10-0-133-57 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 02 13:59:18.902150 ip-10-0-133-57 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 687d55f756eb40e1a6374f312297456a -- Jul 02 14:01:07.489395 ip-10-0-133-57 systemd[1]: Starting Kubernetes Kubelet... Jul 02 14:01:09.047981 ip-10-0-133-57 kubenswrapper[2553]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 14:01:09.047981 ip-10-0-133-57 kubenswrapper[2553]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 02 14:01:09.047981 ip-10-0-133-57 kubenswrapper[2553]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 14:01:09.047981 ip-10-0-133-57 kubenswrapper[2553]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 02 14:01:09.047981 ip-10-0-133-57 kubenswrapper[2553]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 14:01:09.048856 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.048764 2553 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 02 14:01:09.053581 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053560 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 14:01:09.053581 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053576 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 14:01:09.053581 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053584 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 14:01:09.053581 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053588 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 14:01:09.053834 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053593 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 14:01:09.053834 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053597 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 14:01:09.053834 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053602 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 14:01:09.053834 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053605 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 14:01:09.053834 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053610 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 14:01:09.053834 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053614 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 14:01:09.053834 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053618 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 14:01:09.053834 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053622 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 14:01:09.053834 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053626 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 14:01:09.053834 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053632 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 14:01:09.053834 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053638 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 14:01:09.053834 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053642 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 14:01:09.053834 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053646 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 14:01:09.053834 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053649 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 14:01:09.053834 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053653 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 14:01:09.053834 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053656 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 14:01:09.053834 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053660 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 14:01:09.053834 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053676 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 14:01:09.053834 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053680 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 14:01:09.053834 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053684 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 14:01:09.054647 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053688 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 14:01:09.054647 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053691 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 14:01:09.054647 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053695 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 14:01:09.054647 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053700 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 14:01:09.054647 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053704 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 14:01:09.054647 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053708 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 14:01:09.054647 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053711 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 14:01:09.054647 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053715 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 14:01:09.054647 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053719 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 14:01:09.054647 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053723 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 14:01:09.054647 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053727 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 14:01:09.054647 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053732 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 14:01:09.054647 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053737 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 14:01:09.054647 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053741 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 14:01:09.054647 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053749 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 14:01:09.054647 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053753 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 14:01:09.054647 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053757 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 14:01:09.054647 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053761 2553 feature_gate.go:328] unrecognized feature gate: Example Jul 02 14:01:09.054647 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053767 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 14:01:09.055450 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053771 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 14:01:09.055450 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053779 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 14:01:09.055450 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053785 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 14:01:09.055450 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053790 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 14:01:09.055450 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053794 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 14:01:09.055450 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053801 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 14:01:09.055450 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053807 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 14:01:09.055450 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053811 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 14:01:09.055450 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053816 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 14:01:09.055450 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053821 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 14:01:09.055450 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053826 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 14:01:09.055450 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053830 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 14:01:09.055450 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053834 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 14:01:09.055450 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053838 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 14:01:09.055450 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053842 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 14:01:09.055450 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053847 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 14:01:09.055450 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053852 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 14:01:09.055450 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053855 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 14:01:09.055450 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053860 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 14:01:09.056234 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053864 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 14:01:09.056234 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053868 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 14:01:09.056234 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053872 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 14:01:09.056234 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053877 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 14:01:09.056234 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053881 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 14:01:09.056234 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053885 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 14:01:09.056234 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053889 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 14:01:09.056234 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053894 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 14:01:09.056234 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053899 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 14:01:09.056234 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053903 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 14:01:09.056234 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053907 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 14:01:09.056234 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053911 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 14:01:09.056234 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053915 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 14:01:09.056234 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053919 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 14:01:09.056234 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053927 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 14:01:09.056234 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053932 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 14:01:09.056234 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053936 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 14:01:09.056234 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053940 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 14:01:09.056234 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053945 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 14:01:09.056234 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053949 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 14:01:09.057140 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053953 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 14:01:09.057140 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053957 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 14:01:09.057140 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053961 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 14:01:09.057140 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053965 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 14:01:09.057140 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053969 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 14:01:09.057140 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053973 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 14:01:09.057140 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053977 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 14:01:09.057140 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053981 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 14:01:09.057140 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.053999 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 14:01:09.057140 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.054003 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 14:01:09.057140 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.054008 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 14:01:09.057140 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.054012 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 14:01:09.057140 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.054017 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 14:01:09.057140 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.054021 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 14:01:09.057140 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.054025 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 14:01:09.057140 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.054029 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 14:01:09.057140 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.054033 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 14:01:09.057140 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055181 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 14:01:09.057140 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055191 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 14:01:09.057140 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055198 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 14:01:09.057959 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055202 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 14:01:09.057959 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055207 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 14:01:09.057959 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055211 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 14:01:09.057959 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055215 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 14:01:09.057959 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055220 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 14:01:09.057959 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055224 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 14:01:09.057959 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055228 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 14:01:09.057959 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055233 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 14:01:09.057959 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055238 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 14:01:09.057959 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055245 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 14:01:09.057959 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055251 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 14:01:09.057959 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055255 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 14:01:09.057959 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055259 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 14:01:09.057959 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055264 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 14:01:09.057959 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055268 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 14:01:09.057959 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055272 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 14:01:09.057959 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055276 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 14:01:09.057959 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055280 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 14:01:09.057959 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055284 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 14:01:09.058652 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055289 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 14:01:09.058652 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055293 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 14:01:09.058652 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055297 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 14:01:09.058652 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055301 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 14:01:09.058652 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055305 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 14:01:09.058652 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055309 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 14:01:09.058652 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055313 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 14:01:09.058652 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055317 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 14:01:09.058652 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055321 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 14:01:09.058652 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055326 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 14:01:09.058652 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055330 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 14:01:09.058652 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055334 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 14:01:09.058652 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055341 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 14:01:09.058652 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055345 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 14:01:09.058652 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055349 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 14:01:09.058652 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055354 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 14:01:09.058652 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055359 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 14:01:09.058652 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055363 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 14:01:09.058652 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055371 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 14:01:09.059159 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055377 2553 feature_gate.go:328] unrecognized feature gate: Example Jul 02 14:01:09.059159 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055382 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 14:01:09.059159 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055386 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 14:01:09.059159 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055392 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 14:01:09.059159 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055397 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 14:01:09.059159 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055401 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 14:01:09.059159 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055404 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 14:01:09.059159 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055409 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 14:01:09.059159 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055413 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 14:01:09.059159 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055417 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 14:01:09.059159 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055421 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 14:01:09.059159 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055425 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 14:01:09.059159 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055429 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 14:01:09.059159 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055434 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 14:01:09.059159 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055438 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 14:01:09.059159 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055442 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 14:01:09.059159 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055446 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 14:01:09.059159 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055450 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 14:01:09.059159 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055453 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 14:01:09.059159 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055461 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 14:01:09.059748 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055466 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 14:01:09.059748 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055471 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 14:01:09.059748 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055476 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 14:01:09.059748 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055481 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 14:01:09.059748 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055486 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 14:01:09.059748 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055491 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 14:01:09.059748 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055496 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 14:01:09.059748 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055500 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 14:01:09.059748 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055504 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 14:01:09.059748 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055508 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 14:01:09.059748 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055513 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 14:01:09.059748 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055516 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 14:01:09.059748 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055520 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 14:01:09.059748 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055524 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 14:01:09.059748 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055529 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 14:01:09.059748 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055533 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 14:01:09.059748 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055546 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 14:01:09.059748 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055550 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 14:01:09.059748 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055554 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 14:01:09.059748 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055558 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 14:01:09.060452 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055563 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 14:01:09.060452 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055567 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 14:01:09.060452 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055571 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 14:01:09.060452 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055575 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 14:01:09.060452 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055579 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 14:01:09.060452 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055583 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 14:01:09.060452 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055587 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 14:01:09.060452 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055591 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 14:01:09.060452 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055603 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 14:01:09.060452 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055607 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 14:01:09.060452 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055612 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 14:01:09.060452 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055617 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 14:01:09.060452 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055620 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 14:01:09.060452 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055628 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 14:01:09.060452 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055633 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 14:01:09.060452 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055637 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 14:01:09.060452 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055641 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 14:01:09.060452 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.055645 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 14:01:09.060452 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056318 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 14:01:09.060452 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056328 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 14:01:09.060957 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056334 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 14:01:09.060957 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056339 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 14:01:09.060957 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056344 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 14:01:09.060957 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056349 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 14:01:09.060957 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056354 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 14:01:09.060957 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056358 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 14:01:09.060957 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056363 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 14:01:09.060957 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056368 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 14:01:09.060957 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056381 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 14:01:09.060957 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056386 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 14:01:09.060957 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056391 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 14:01:09.060957 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056396 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 14:01:09.060957 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056400 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 14:01:09.060957 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056405 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 14:01:09.060957 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056409 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 14:01:09.060957 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056413 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 14:01:09.060957 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056417 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 14:01:09.060957 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056421 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 14:01:09.060957 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056425 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 14:01:09.061447 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056429 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 14:01:09.061447 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056433 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 14:01:09.061447 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056437 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 14:01:09.061447 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056441 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 14:01:09.061447 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056445 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 14:01:09.061447 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056450 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 14:01:09.061447 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056457 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 14:01:09.061447 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056462 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 14:01:09.061447 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056467 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 14:01:09.061447 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056471 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 14:01:09.061447 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056475 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 14:01:09.061447 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056481 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 14:01:09.061447 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056489 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 14:01:09.061447 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056496 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 14:01:09.061447 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056502 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 14:01:09.061447 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056507 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 14:01:09.061447 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056512 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 14:01:09.061447 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056516 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 14:01:09.061447 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056520 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 14:01:09.062007 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056525 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 14:01:09.062007 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056529 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 14:01:09.062007 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056533 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 14:01:09.062007 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056545 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 14:01:09.062007 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056549 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 14:01:09.062007 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056553 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 14:01:09.062007 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056557 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 14:01:09.062007 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056562 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 14:01:09.062007 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056566 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 14:01:09.062007 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056571 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 14:01:09.062007 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056575 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 14:01:09.062007 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056579 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 14:01:09.062007 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056583 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 14:01:09.062007 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056587 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 14:01:09.062007 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056591 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 14:01:09.062007 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056596 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 14:01:09.062007 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056600 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 14:01:09.062007 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056604 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 14:01:09.062007 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056608 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 14:01:09.062007 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056614 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 14:01:09.062535 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056619 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 14:01:09.062535 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056623 2553 feature_gate.go:328] unrecognized feature gate: Example Jul 02 14:01:09.062535 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056627 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 14:01:09.062535 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056631 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 14:01:09.062535 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056635 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 14:01:09.062535 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056639 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 14:01:09.062535 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056644 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 14:01:09.062535 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056648 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 14:01:09.062535 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056652 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 14:01:09.062535 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056656 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 14:01:09.062535 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056661 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 14:01:09.062535 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056665 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 14:01:09.062535 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056669 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 14:01:09.062535 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056673 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 14:01:09.062535 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056679 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 14:01:09.062535 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056685 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 14:01:09.062535 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056695 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 14:01:09.062535 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056700 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 14:01:09.062535 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056705 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 14:01:09.062981 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056709 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 14:01:09.062981 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056714 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 14:01:09.062981 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056718 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 14:01:09.062981 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056722 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 14:01:09.062981 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056726 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 14:01:09.062981 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056730 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 14:01:09.062981 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056735 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 14:01:09.062981 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056739 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 14:01:09.062981 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056743 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 14:01:09.062981 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056747 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 14:01:09.062981 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056751 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 14:01:09.062981 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056755 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 14:01:09.062981 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056761 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 14:01:09.062981 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056766 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 14:01:09.062981 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056770 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 14:01:09.062981 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056774 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 14:01:09.062981 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056778 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 14:01:09.062981 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056783 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 14:01:09.062981 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056787 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 14:01:09.062981 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.056791 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 14:01:09.063467 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.056888 2553 flags.go:64] FLAG: --address="0.0.0.0" Jul 02 14:01:09.063467 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.056899 2553 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 02 14:01:09.063467 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.056909 2553 flags.go:64] FLAG: --anonymous-auth="true" Jul 02 14:01:09.063467 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.056916 2553 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 02 14:01:09.063467 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.056922 2553 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 02 14:01:09.063467 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.056928 2553 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 02 14:01:09.063467 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.056934 2553 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 02 14:01:09.063467 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.056953 2553 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 02 14:01:09.063467 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.056959 2553 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 02 14:01:09.063467 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.056964 2553 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 02 14:01:09.063467 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.056971 2553 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 02 14:01:09.063467 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.056976 2553 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 02 14:01:09.063467 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.056981 2553 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 02 14:01:09.063467 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057001 2553 flags.go:64] FLAG: --cgroup-root="" Jul 02 14:01:09.063467 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057006 2553 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 02 14:01:09.063467 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057011 2553 flags.go:64] FLAG: --client-ca-file="" Jul 02 14:01:09.063467 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057015 2553 flags.go:64] FLAG: --cloud-provider="external" Jul 02 14:01:09.063467 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057020 2553 flags.go:64] FLAG: --cluster-dns="[]" Jul 02 14:01:09.063467 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057027 2553 flags.go:64] FLAG: --cluster-domain="" Jul 02 14:01:09.063467 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057031 2553 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 02 14:01:09.063467 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057037 2553 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 02 14:01:09.063467 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057042 2553 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 02 14:01:09.063467 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057047 2553 flags.go:64] FLAG: --container-log-max-files="5" Jul 02 14:01:09.063467 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057053 2553 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 02 14:01:09.064169 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057060 2553 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 02 14:01:09.064169 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057066 2553 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 02 14:01:09.064169 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057072 2553 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 02 14:01:09.064169 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057077 2553 flags.go:64] FLAG: --contention-profiling="false" Jul 02 14:01:09.064169 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057082 2553 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 02 14:01:09.064169 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057086 2553 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 02 14:01:09.064169 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057092 2553 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 02 14:01:09.064169 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057096 2553 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 02 14:01:09.064169 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057103 2553 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 02 14:01:09.064169 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057108 2553 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 02 14:01:09.064169 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057113 2553 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 02 14:01:09.064169 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057118 2553 flags.go:64] FLAG: --enable-load-reader="false" Jul 02 14:01:09.064169 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057123 2553 flags.go:64] FLAG: --enable-server="true" Jul 02 14:01:09.064169 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057127 2553 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 02 14:01:09.064169 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057135 2553 flags.go:64] FLAG: --event-burst="100" Jul 02 14:01:09.064169 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057140 2553 flags.go:64] FLAG: --event-qps="50" Jul 02 14:01:09.064169 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057144 2553 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 02 14:01:09.064169 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057149 2553 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 02 14:01:09.064169 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057154 2553 flags.go:64] FLAG: --eviction-hard="" Jul 02 14:01:09.064169 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057160 2553 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 02 14:01:09.064169 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057165 2553 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 02 14:01:09.064169 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057170 2553 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 02 14:01:09.064169 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057175 2553 flags.go:64] FLAG: --eviction-soft="" Jul 02 14:01:09.064169 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057179 2553 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 02 14:01:09.064169 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057184 2553 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 02 14:01:09.064854 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057189 2553 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 02 14:01:09.064854 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057194 2553 flags.go:64] FLAG: --experimental-mounter-path="" Jul 02 14:01:09.064854 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057198 2553 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 02 14:01:09.064854 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057222 2553 flags.go:64] FLAG: --fail-swap-on="true" Jul 02 14:01:09.064854 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057229 2553 flags.go:64] FLAG: --feature-gates="" Jul 02 14:01:09.064854 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057236 2553 flags.go:64] FLAG: --file-check-frequency="20s" Jul 02 14:01:09.064854 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057241 2553 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 02 14:01:09.064854 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057247 2553 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 02 14:01:09.064854 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057252 2553 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 02 14:01:09.064854 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057258 2553 flags.go:64] FLAG: --healthz-port="10248" Jul 02 14:01:09.064854 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057263 2553 flags.go:64] FLAG: --help="false" Jul 02 14:01:09.064854 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057267 2553 flags.go:64] FLAG: --hostname-override="ip-10-0-133-57.ec2.internal" Jul 02 14:01:09.064854 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057272 2553 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 02 14:01:09.064854 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057277 2553 flags.go:64] FLAG: --http-check-frequency="20s" Jul 02 14:01:09.064854 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057281 2553 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 02 14:01:09.064854 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057287 2553 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 02 14:01:09.064854 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057293 2553 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 02 14:01:09.064854 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057297 2553 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 02 14:01:09.064854 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057302 2553 flags.go:64] FLAG: --image-service-endpoint="" Jul 02 14:01:09.064854 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057306 2553 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 02 14:01:09.064854 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057311 2553 flags.go:64] FLAG: --kube-api-burst="100" Jul 02 14:01:09.064854 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057316 2553 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 02 14:01:09.064854 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057320 2553 flags.go:64] FLAG: --kube-api-qps="50" Jul 02 14:01:09.064854 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057325 2553 flags.go:64] FLAG: --kube-reserved="" Jul 02 14:01:09.065455 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057329 2553 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 02 14:01:09.065455 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057334 2553 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 02 14:01:09.065455 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057340 2553 flags.go:64] FLAG: --kubelet-cgroups="" Jul 02 14:01:09.065455 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057345 2553 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 02 14:01:09.065455 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057350 2553 flags.go:64] FLAG: --lock-file="" Jul 02 14:01:09.065455 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057354 2553 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 02 14:01:09.065455 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057359 2553 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 02 14:01:09.065455 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057363 2553 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 02 14:01:09.065455 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057372 2553 flags.go:64] FLAG: --log-json-split-stream="false" Jul 02 14:01:09.065455 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057377 2553 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 02 14:01:09.065455 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057382 2553 flags.go:64] FLAG: --log-text-split-stream="false" Jul 02 14:01:09.065455 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057386 2553 flags.go:64] FLAG: --logging-format="text" Jul 02 14:01:09.065455 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057391 2553 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 02 14:01:09.065455 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057396 2553 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 02 14:01:09.065455 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057401 2553 flags.go:64] FLAG: --manifest-url="" Jul 02 14:01:09.065455 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057405 2553 flags.go:64] FLAG: --manifest-url-header="" Jul 02 14:01:09.065455 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057415 2553 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 02 14:01:09.065455 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057420 2553 flags.go:64] FLAG: --max-open-files="1000000" Jul 02 14:01:09.065455 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057426 2553 flags.go:64] FLAG: --max-pods="110" Jul 02 14:01:09.065455 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057431 2553 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 02 14:01:09.065455 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057436 2553 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 02 14:01:09.065455 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057440 2553 flags.go:64] FLAG: --memory-manager-policy="None" Jul 02 14:01:09.065455 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057444 2553 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 02 14:01:09.065455 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057450 2553 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 02 14:01:09.065455 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057455 2553 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 02 14:01:09.066041 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057460 2553 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 02 14:01:09.066041 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057471 2553 flags.go:64] FLAG: --node-status-max-images="50" Jul 02 14:01:09.066041 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057476 2553 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 02 14:01:09.066041 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057480 2553 flags.go:64] FLAG: --oom-score-adj="-999" Jul 02 14:01:09.066041 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057485 2553 flags.go:64] FLAG: --pod-cidr="" Jul 02 14:01:09.066041 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057490 2553 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04" Jul 02 14:01:09.066041 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057499 2553 flags.go:64] FLAG: --pod-manifest-path="" Jul 02 14:01:09.066041 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057504 2553 flags.go:64] FLAG: --pod-max-pids="-1" Jul 02 14:01:09.066041 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057509 2553 flags.go:64] FLAG: --pods-per-core="0" Jul 02 14:01:09.066041 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057514 2553 flags.go:64] FLAG: --port="10250" Jul 02 14:01:09.066041 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057518 2553 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 02 14:01:09.066041 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057523 2553 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0877d5b577d0ee676" Jul 02 14:01:09.066041 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057529 2553 flags.go:64] FLAG: --qos-reserved="" Jul 02 14:01:09.066041 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057534 2553 flags.go:64] FLAG: --read-only-port="10255" Jul 02 14:01:09.066041 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057539 2553 flags.go:64] FLAG: --register-node="true" Jul 02 14:01:09.066041 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057544 2553 flags.go:64] FLAG: --register-with-taints="" Jul 02 14:01:09.066041 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057550 2553 flags.go:64] FLAG: --registry-burst="10" Jul 02 14:01:09.066041 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057554 2553 flags.go:64] FLAG: --registry-qps="5" Jul 02 14:01:09.066041 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057559 2553 flags.go:64] FLAG: --reserved-cpus="" Jul 02 14:01:09.066041 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057563 2553 flags.go:64] FLAG: --reserved-memory="" Jul 02 14:01:09.066041 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057569 2553 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 02 14:01:09.066041 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057574 2553 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 02 14:01:09.066041 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057579 2553 flags.go:64] FLAG: --rotate-certificates="false" Jul 02 14:01:09.066041 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057586 2553 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 02 14:01:09.066041 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057591 2553 flags.go:64] FLAG: --runonce="false" Jul 02 14:01:09.066669 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057595 2553 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 02 14:01:09.066669 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057601 2553 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 02 14:01:09.066669 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057606 2553 flags.go:64] FLAG: --seccomp-default="false" Jul 02 14:01:09.066669 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057610 2553 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 02 14:01:09.066669 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057615 2553 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 02 14:01:09.066669 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057620 2553 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 02 14:01:09.066669 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057625 2553 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 02 14:01:09.066669 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057629 2553 flags.go:64] FLAG: --storage-driver-password="root" Jul 02 14:01:09.066669 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057634 2553 flags.go:64] FLAG: --storage-driver-secure="false" Jul 02 14:01:09.066669 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057639 2553 flags.go:64] FLAG: --storage-driver-table="stats" Jul 02 14:01:09.066669 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057643 2553 flags.go:64] FLAG: --storage-driver-user="root" Jul 02 14:01:09.066669 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057647 2553 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 02 14:01:09.066669 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057652 2553 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 02 14:01:09.066669 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057657 2553 flags.go:64] FLAG: --system-cgroups="" Jul 02 14:01:09.066669 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057662 2553 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 02 14:01:09.066669 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057671 2553 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 02 14:01:09.066669 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057675 2553 flags.go:64] FLAG: --tls-cert-file="" Jul 02 14:01:09.066669 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057680 2553 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 02 14:01:09.066669 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057685 2553 flags.go:64] FLAG: --tls-min-version="" Jul 02 14:01:09.066669 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057697 2553 flags.go:64] FLAG: --tls-private-key-file="" Jul 02 14:01:09.066669 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057702 2553 flags.go:64] FLAG: --topology-manager-policy="none" Jul 02 14:01:09.066669 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057708 2553 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 02 14:01:09.066669 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057712 2553 flags.go:64] FLAG: --topology-manager-scope="container" Jul 02 14:01:09.066669 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057717 2553 flags.go:64] FLAG: --v="2" Jul 02 14:01:09.066669 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057723 2553 flags.go:64] FLAG: --version="false" Jul 02 14:01:09.067281 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057730 2553 flags.go:64] FLAG: --vmodule="" Jul 02 14:01:09.067281 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057736 2553 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 02 14:01:09.067281 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.057741 2553 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 02 14:01:09.067281 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.057942 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 14:01:09.067281 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.057949 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 14:01:09.067281 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.057957 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 14:01:09.067281 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.057962 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 14:01:09.067281 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.057966 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 14:01:09.067281 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.057970 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 14:01:09.067281 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.057975 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 14:01:09.067281 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.057979 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 14:01:09.067281 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058001 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 14:01:09.067281 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058007 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 14:01:09.067281 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058011 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 14:01:09.067281 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058015 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 14:01:09.067281 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058020 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 14:01:09.067281 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058024 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 14:01:09.067281 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058028 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 14:01:09.067281 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058032 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 14:01:09.067281 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058036 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 14:01:09.067764 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058040 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 14:01:09.067764 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058047 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 14:01:09.067764 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058053 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 14:01:09.067764 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058057 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 14:01:09.067764 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058062 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 14:01:09.067764 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058067 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 14:01:09.067764 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058071 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 14:01:09.067764 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058084 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 14:01:09.067764 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058089 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 14:01:09.067764 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058093 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 14:01:09.067764 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058098 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 14:01:09.067764 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058102 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 14:01:09.067764 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058107 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 14:01:09.067764 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058111 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 14:01:09.067764 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058115 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 14:01:09.067764 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058119 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 14:01:09.067764 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058123 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 14:01:09.067764 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058132 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 14:01:09.067764 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058136 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 14:01:09.068233 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058141 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 14:01:09.068233 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058145 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 14:01:09.068233 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058149 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 14:01:09.068233 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058153 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 14:01:09.068233 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058158 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 14:01:09.068233 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058165 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 14:01:09.068233 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058171 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 14:01:09.068233 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058175 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 14:01:09.068233 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058180 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 14:01:09.068233 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058185 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 14:01:09.068233 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058189 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 14:01:09.068233 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058193 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 14:01:09.068233 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058197 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 14:01:09.068233 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058201 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 14:01:09.068233 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058205 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 14:01:09.068233 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058209 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 14:01:09.068233 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058213 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 14:01:09.068233 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058217 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 14:01:09.068233 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058221 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 14:01:09.068702 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058225 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 14:01:09.068702 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058230 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 14:01:09.068702 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058235 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 14:01:09.068702 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058239 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 14:01:09.068702 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058244 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 14:01:09.068702 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058248 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 14:01:09.068702 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058252 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 14:01:09.068702 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058256 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 14:01:09.068702 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058260 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 14:01:09.068702 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058264 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 14:01:09.068702 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058268 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 14:01:09.068702 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058275 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 14:01:09.068702 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058279 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 14:01:09.068702 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058284 2553 feature_gate.go:328] unrecognized feature gate: Example Jul 02 14:01:09.068702 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058288 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 14:01:09.068702 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058292 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 14:01:09.068702 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058296 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 14:01:09.068702 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058300 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 14:01:09.068702 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058304 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 14:01:09.068702 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058308 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 14:01:09.069193 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058313 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 14:01:09.069193 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058317 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 14:01:09.069193 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058321 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 14:01:09.069193 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058325 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 14:01:09.069193 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058329 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 14:01:09.069193 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058333 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 14:01:09.069193 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058338 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 14:01:09.069193 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058342 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 14:01:09.069193 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058346 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 14:01:09.069193 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058350 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 14:01:09.069193 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058354 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 14:01:09.069193 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058358 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 14:01:09.069193 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058365 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 14:01:09.069193 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058370 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 14:01:09.069193 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058374 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 14:01:09.069193 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058380 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 14:01:09.069193 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058384 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 14:01:09.069193 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058388 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 14:01:09.069193 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058392 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 14:01:09.069193 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058397 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 14:01:09.069662 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058401 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 14:01:09.069662 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058405 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 14:01:09.069662 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058409 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 14:01:09.069662 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.058416 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 14:01:09.069662 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.059129 2553 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 14:01:09.069662 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.066255 2553 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 02 14:01:09.069662 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.066273 2553 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 02 14:01:09.069662 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.066292 2553 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 02 14:01:09.069662 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.066301 2553 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 02 14:01:09.069662 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066362 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 14:01:09.069662 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066367 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 14:01:09.069662 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066370 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 14:01:09.069662 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066373 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 14:01:09.069662 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066377 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 14:01:09.070026 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066380 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 14:01:09.070026 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066383 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 14:01:09.070026 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066386 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 14:01:09.070026 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066389 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 14:01:09.070026 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066392 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 14:01:09.070026 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066395 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 14:01:09.070026 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066397 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 14:01:09.070026 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066400 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 14:01:09.070026 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066403 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 14:01:09.070026 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066405 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 14:01:09.070026 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066408 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 14:01:09.070026 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066411 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 14:01:09.070026 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066413 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 14:01:09.070026 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066416 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 14:01:09.070026 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066418 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 14:01:09.070026 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066422 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 14:01:09.070026 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066426 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 14:01:09.070026 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066428 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 14:01:09.070026 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066431 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 14:01:09.070026 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066434 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 14:01:09.070515 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066437 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 14:01:09.070515 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066439 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 14:01:09.070515 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066442 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 14:01:09.070515 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066445 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 14:01:09.070515 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066455 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 14:01:09.070515 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066458 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 14:01:09.070515 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066461 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 14:01:09.070515 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066465 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 14:01:09.070515 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066469 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 14:01:09.070515 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066472 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 14:01:09.070515 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066475 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 14:01:09.070515 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066478 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 14:01:09.070515 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066481 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 14:01:09.070515 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066484 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 14:01:09.070515 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066487 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 14:01:09.070515 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066489 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 14:01:09.070515 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066492 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 14:01:09.070515 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066494 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 14:01:09.070515 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066497 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 14:01:09.070965 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066500 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 14:01:09.070965 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066502 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 14:01:09.070965 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066505 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 14:01:09.070965 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066507 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 14:01:09.070965 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066510 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 14:01:09.070965 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066512 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 14:01:09.070965 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066515 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 14:01:09.070965 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066517 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 14:01:09.070965 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066521 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 14:01:09.070965 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066524 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 14:01:09.070965 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066528 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 14:01:09.070965 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066530 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 14:01:09.070965 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066533 2553 feature_gate.go:328] unrecognized feature gate: Example Jul 02 14:01:09.070965 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066536 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 14:01:09.070965 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066538 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 14:01:09.070965 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066541 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 14:01:09.070965 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066544 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 14:01:09.070965 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066548 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 14:01:09.070965 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066556 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 14:01:09.071428 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066558 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 14:01:09.071428 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066561 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 14:01:09.071428 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066563 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 14:01:09.071428 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066566 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 14:01:09.071428 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066569 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 14:01:09.071428 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066571 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 14:01:09.071428 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066574 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 14:01:09.071428 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066576 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 14:01:09.071428 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066579 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 14:01:09.071428 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066581 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 14:01:09.071428 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066584 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 14:01:09.071428 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066587 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 14:01:09.071428 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066589 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 14:01:09.071428 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066592 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 14:01:09.071428 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066594 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 14:01:09.071428 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066597 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 14:01:09.071428 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066599 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 14:01:09.071428 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066608 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 14:01:09.071428 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066610 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 14:01:09.071428 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066613 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 14:01:09.071919 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066615 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 14:01:09.071919 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066618 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 14:01:09.071919 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066621 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 14:01:09.071919 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066623 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 14:01:09.071919 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066625 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 14:01:09.071919 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066628 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 14:01:09.071919 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066630 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 14:01:09.071919 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066633 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 14:01:09.071919 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066636 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 14:01:09.071919 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066639 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 14:01:09.071919 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066641 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 14:01:09.071919 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066644 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 14:01:09.071919 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066652 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 14:01:09.071919 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066654 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 14:01:09.071919 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066657 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 14:01:09.071919 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066659 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 14:01:09.072321 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.066664 2553 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 14:01:09.072321 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066802 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 14:01:09.072321 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066808 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 14:01:09.072321 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066811 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 14:01:09.072321 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066814 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 14:01:09.072321 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066817 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 14:01:09.072321 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066822 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 14:01:09.072321 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066824 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 14:01:09.072321 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066827 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 14:01:09.072321 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066830 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 14:01:09.072321 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066832 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 14:01:09.072321 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066835 2553 feature_gate.go:328] unrecognized feature gate: Example Jul 02 14:01:09.072321 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066838 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 14:01:09.072321 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066840 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 14:01:09.072321 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066842 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 14:01:09.072683 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066845 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 14:01:09.072683 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066847 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 14:01:09.072683 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066850 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 14:01:09.072683 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066852 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 14:01:09.072683 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066855 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 14:01:09.072683 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066857 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 14:01:09.072683 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066860 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 14:01:09.072683 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066863 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 14:01:09.072683 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066865 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 14:01:09.072683 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066868 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 14:01:09.072683 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066871 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 14:01:09.072683 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066874 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 14:01:09.072683 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066876 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 14:01:09.072683 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066880 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 14:01:09.072683 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066890 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 14:01:09.072683 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066893 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 14:01:09.072683 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066896 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 14:01:09.072683 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066898 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 14:01:09.072683 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066901 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 14:01:09.073149 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066903 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 14:01:09.073149 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066906 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 14:01:09.073149 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066908 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 14:01:09.073149 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066911 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 14:01:09.073149 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066913 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 14:01:09.073149 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066916 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 14:01:09.073149 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066918 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 14:01:09.073149 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066920 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 14:01:09.073149 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066923 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 14:01:09.073149 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066925 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 14:01:09.073149 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066927 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 14:01:09.073149 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066930 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 14:01:09.073149 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066932 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 14:01:09.073149 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066935 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 14:01:09.073149 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066937 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 14:01:09.073149 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066940 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 14:01:09.073149 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066942 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 14:01:09.073149 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066945 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 14:01:09.073149 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066947 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 14:01:09.073149 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066950 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 14:01:09.073628 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066952 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 14:01:09.073628 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066955 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 14:01:09.073628 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066957 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 14:01:09.073628 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066960 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 14:01:09.073628 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066962 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 14:01:09.073628 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066965 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 14:01:09.073628 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066967 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 14:01:09.073628 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066970 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 14:01:09.073628 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066978 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 14:01:09.073628 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066980 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 14:01:09.073628 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.066998 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 14:01:09.073628 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.067002 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 14:01:09.073628 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.067005 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 14:01:09.073628 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.067007 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 14:01:09.073628 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.067010 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 14:01:09.073628 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.067012 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 14:01:09.073628 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.067015 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 14:01:09.073628 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.067017 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 14:01:09.073628 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.067020 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 14:01:09.073628 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.067022 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 14:01:09.074108 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.067025 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 14:01:09.074108 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.067027 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 14:01:09.074108 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.067030 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 14:01:09.074108 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.067032 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 14:01:09.074108 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.067035 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 14:01:09.074108 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.067038 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 14:01:09.074108 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.067040 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 14:01:09.074108 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.067043 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 14:01:09.074108 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.067045 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 14:01:09.074108 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.067048 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 14:01:09.074108 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.067050 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 14:01:09.074108 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.067053 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 14:01:09.074108 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.067055 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 14:01:09.074108 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.067058 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 14:01:09.074108 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.067061 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 14:01:09.074108 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.067063 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 14:01:09.074108 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.067065 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 14:01:09.074108 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.067068 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 14:01:09.074108 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.067071 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 14:01:09.074108 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.067073 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 14:01:09.074581 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.067076 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 14:01:09.074581 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.067086 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 14:01:09.074581 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.067089 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 14:01:09.074581 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.067092 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 14:01:09.074581 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.067094 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 14:01:09.074581 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:09.067097 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 14:01:09.074581 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.067102 2553 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 14:01:09.074581 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.067222 2553 server.go:962] "Client rotation is on, will bootstrap in background" Jul 02 14:01:09.074581 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.069429 2553 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 02 14:01:09.074581 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.070715 2553 server.go:1019] "Starting client certificate rotation" Jul 02 14:01:09.074581 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.070813 2553 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 14:01:09.074581 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.070847 2553 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 14:01:09.074581 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.073048 2553 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 14:01:09.077677 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.077663 2553 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 14:01:09.090166 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.090147 2553 log.go:25] "Validated CRI v1 runtime API" Jul 02 14:01:09.092335 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.092320 2553 log.go:25] "Validated CRI v1 image API" Jul 02 14:01:09.093838 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.093823 2553 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 02 14:01:09.099454 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.099430 2553 fs.go:135] Filesystem UUIDs: map[1c155a8b-9a3e-4da2-bf90-09788b610a46:/dev/nvme0n1p3 771201d3-6d78-43fb-83ed-bb6760296d08:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 02 14:01:09.099522 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.099454 2553 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 02 14:01:09.103648 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.103629 2553 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 14:01:09.104649 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.104524 2553 manager.go:216] Machine: {Timestamp:2026-07-02 14:01:09.103165321 +0000 UTC m=+0.311408094 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099502 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec291bf57b3d0d23d2ddbd536e4e342b SystemUUID:ec291bf5-7b3d-0d23-d2dd-bd536e4e342b BootID:687d55f7-56eb-40e1-a637-4f312297456a Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:aa:e4:29:03:03 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:aa:e4:29:03:03 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fa:bf:e3:d6:c3:a6 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 02 14:01:09.104649 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.104648 2553 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 02 14:01:09.104778 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.104766 2553 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 02 14:01:09.107521 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.107491 2553 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 02 14:01:09.107673 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.107524 2553 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-57.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 02 14:01:09.108877 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.108867 2553 topology_manager.go:138] "Creating topology manager with none policy" Jul 02 14:01:09.108915 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.108881 2553 container_manager_linux.go:309] "Creating device plugin manager" Jul 02 14:01:09.108915 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.108889 2553 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 14:01:09.109520 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.109510 2553 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 14:01:09.110340 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.110330 2553 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 02 14:01:09.115200 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.115188 2553 state_mem.go:36] "Initialized new in-memory state store" Jul 02 14:01:09.115317 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.115308 2553 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 02 14:01:09.115349 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.115339 2553 kubelet.go:486] "Attempting to sync node with API server" Jul 02 14:01:09.115349 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.115349 2553 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 02 14:01:09.115408 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.115367 2553 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 02 14:01:09.115408 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.115377 2553 kubelet.go:398] "Adding apiserver pod source" Jul 02 14:01:09.115408 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.115387 2553 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 02 14:01:09.115812 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.115800 2553 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 14:01:09.115856 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.115818 2553 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 14:01:09.118618 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.118603 2553 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 02 14:01:09.119856 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.119840 2553 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 02 14:01:09.119915 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.119871 2553 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 02 14:01:09.120094 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.120079 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 02 14:01:09.120094 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.120094 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 02 14:01:09.120094 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.120100 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 02 14:01:09.120094 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.120106 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 02 14:01:09.120285 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.120114 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 02 14:01:09.120285 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.120120 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 02 14:01:09.120469 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.120461 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 02 14:01:09.120469 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.120469 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 02 14:01:09.120526 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.120475 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 02 14:01:09.120526 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.120481 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 02 14:01:09.120526 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.120490 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 02 14:01:09.120526 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.120498 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 02 14:01:09.120526 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.120525 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 02 14:01:09.120659 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.120530 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 02 14:01:09.120736 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.120709 2553 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lmqbv" Jul 02 14:01:09.124046 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.124027 2553 server.go:1268] "Started kubelet" Jul 02 14:01:09.124193 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.124144 2553 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 02 14:01:09.124265 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.124252 2553 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 02 14:01:09.124327 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.124107 2553 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 02 14:01:09.128152 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.128130 2553 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 02 14:01:09.128227 ip-10-0-133-57 systemd[1]: Started Kubernetes Kubelet. Jul 02 14:01:09.130015 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.128758 2553 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lmqbv" Jul 02 14:01:09.130015 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.129688 2553 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-57.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 02 14:01:09.130015 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:09.129775 2553 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-57.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 02 14:01:09.130015 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:09.129927 2553 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 02 14:01:09.131172 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:09.131071 2553 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 02 14:01:09.131681 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.131663 2553 server.go:310] "Adding debug handlers to kubelet server" Jul 02 14:01:09.135192 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:09.134280 2553 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-57.ec2.internal.18be7dd7fe58ca74 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-57.ec2.internal,UID:ip-10-0-133-57.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-57.ec2.internal,},FirstTimestamp:2026-07-02 14:01:09.123967604 +0000 UTC m=+0.332210378,LastTimestamp:2026-07-02 14:01:09.123967604 +0000 UTC m=+0.332210378,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-57.ec2.internal,}" Jul 02 14:01:09.136191 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.136176 2553 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 02 14:01:09.136296 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.136275 2553 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 02 14:01:09.136355 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:09.136308 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-57.ec2.internal\" not found" Jul 02 14:01:09.136968 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.136831 2553 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 02 14:01:09.136968 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.136851 2553 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 02 14:01:09.136968 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.136867 2553 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 02 14:01:09.137154 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.137039 2553 reconstruct.go:97] "Volume reconstruction finished" Jul 02 14:01:09.137154 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.137046 2553 reconciler.go:29] "Reconciler: start to sync state" Jul 02 14:01:09.137154 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.137095 2553 factory.go:55] Registering systemd factory Jul 02 14:01:09.137154 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.137111 2553 factory.go:223] Registration of the systemd container factory successfully Jul 02 14:01:09.137370 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.137357 2553 factory.go:153] Registering CRI-O factory Jul 02 14:01:09.137428 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.137372 2553 factory.go:223] Registration of the crio container factory successfully Jul 02 14:01:09.137428 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.137424 2553 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 02 14:01:09.137523 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.137449 2553 factory.go:103] Registering Raw factory Jul 02 14:01:09.137523 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.137465 2553 manager.go:1196] Started watching for new ooms in manager Jul 02 14:01:09.137926 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.137913 2553 manager.go:349] Starting recovery of all containers Jul 02 14:01:09.142157 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.141644 2553 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 14:01:09.145387 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:09.145365 2553 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-133-57.ec2.internal\" not found" node="ip-10-0-133-57.ec2.internal" Jul 02 14:01:09.149687 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.149567 2553 manager.go:354] Recovery completed Jul 02 14:01:09.151081 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:09.151064 2553 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 02 14:01:09.154011 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.153998 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 14:01:09.155994 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.155962 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-57.ec2.internal" event="NodeHasSufficientMemory" Jul 02 14:01:09.156081 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.156017 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-57.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 14:01:09.156081 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.156032 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-57.ec2.internal" event="NodeHasSufficientPID" Jul 02 14:01:09.156720 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.156704 2553 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 02 14:01:09.156788 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.156719 2553 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 02 14:01:09.156788 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.156742 2553 state_mem.go:36] "Initialized new in-memory state store" Jul 02 14:01:09.156788 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.156756 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 14:01:09.157527 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.157508 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-57.ec2.internal" event="NodeHasSufficientMemory" Jul 02 14:01:09.157610 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.157544 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-57.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 14:01:09.157610 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.157565 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-57.ec2.internal" event="NodeHasSufficientPID" Jul 02 14:01:09.158079 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.158066 2553 policy_none.go:49] "None policy: Start" Jul 02 14:01:09.158119 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.158084 2553 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 02 14:01:09.158119 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.158095 2553 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 02 14:01:09.159268 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.159237 2553 policy_none.go:47] "Start" Jul 02 14:01:09.193894 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.193653 2553 manager.go:337] "Starting Device Plugin manager" Jul 02 14:01:09.193894 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:09.193890 2553 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 02 14:01:09.193894 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.193903 2553 server.go:87] "Starting device plugin registration server" Jul 02 14:01:09.205964 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.194193 2553 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 02 14:01:09.205964 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.194208 2553 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 02 14:01:09.205964 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.194314 2553 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 02 14:01:09.205964 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.194403 2553 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 02 14:01:09.205964 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.194412 2553 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 02 14:01:09.205964 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:09.196246 2553 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 02 14:01:09.205964 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:09.196526 2553 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-57.ec2.internal\" not found" Jul 02 14:01:09.205964 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.199272 2553 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 02 14:01:09.205964 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.200541 2553 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 02 14:01:09.205964 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.200587 2553 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 02 14:01:09.205964 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.200610 2553 kubelet.go:2448] "Starting kubelet main sync loop" Jul 02 14:01:09.205964 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:09.200652 2553 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 02 14:01:09.205964 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.202688 2553 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 14:01:09.294952 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.294910 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 14:01:09.295925 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.295909 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-57.ec2.internal" event="NodeHasSufficientMemory" Jul 02 14:01:09.296027 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.295939 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-57.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 14:01:09.296027 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.295951 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-57.ec2.internal" event="NodeHasSufficientPID" Jul 02 14:01:09.296027 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.295976 2553 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-57.ec2.internal" Jul 02 14:01:09.300982 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.300957 2553 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-57.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-57.ec2.internal"] Jul 02 14:01:09.301108 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.301043 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 14:01:09.301858 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.301841 2553 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-57.ec2.internal" Jul 02 14:01:09.301917 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:09.301871 2553 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-57.ec2.internal\": node \"ip-10-0-133-57.ec2.internal\" not found" Jul 02 14:01:09.302488 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.302464 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-57.ec2.internal" event="NodeHasSufficientMemory" Jul 02 14:01:09.302488 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.302492 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-57.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 14:01:09.302628 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.302502 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-57.ec2.internal" event="NodeHasSufficientPID" Jul 02 14:01:09.303871 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.303858 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 14:01:09.303998 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.303967 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-57.ec2.internal" Jul 02 14:01:09.304054 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.304011 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 14:01:09.304603 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.304586 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-57.ec2.internal" event="NodeHasSufficientMemory" Jul 02 14:01:09.304683 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.304608 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-57.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 14:01:09.304683 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.304614 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-57.ec2.internal" event="NodeHasSufficientMemory" Jul 02 14:01:09.304683 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.304638 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-57.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 14:01:09.304683 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.304653 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-57.ec2.internal" event="NodeHasSufficientPID" Jul 02 14:01:09.304683 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.304619 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-57.ec2.internal" event="NodeHasSufficientPID" Jul 02 14:01:09.306000 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.305965 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-57.ec2.internal" Jul 02 14:01:09.306093 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.306011 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 14:01:09.306636 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.306618 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-57.ec2.internal" event="NodeHasSufficientMemory" Jul 02 14:01:09.306706 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.306645 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-57.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 14:01:09.306706 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.306657 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-57.ec2.internal" event="NodeHasSufficientPID" Jul 02 14:01:09.319131 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:09.319117 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-57.ec2.internal\" not found" Jul 02 14:01:09.338730 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.338707 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c582d8238a6f3daead6044036f2a5eeb-config\") pod \"kube-apiserver-proxy-ip-10-0-133-57.ec2.internal\" (UID: \"c582d8238a6f3daead6044036f2a5eeb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-57.ec2.internal" Jul 02 14:01:09.338805 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:09.338716 2553 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-57.ec2.internal\" not found" node="ip-10-0-133-57.ec2.internal" Jul 02 14:01:09.338805 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.338745 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/469f128e84139c59dc87d077aeeac40f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-57.ec2.internal\" (UID: \"469f128e84139c59dc87d077aeeac40f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-57.ec2.internal" Jul 02 14:01:09.338805 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.338775 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/469f128e84139c59dc87d077aeeac40f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-57.ec2.internal\" (UID: \"469f128e84139c59dc87d077aeeac40f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-57.ec2.internal" Jul 02 14:01:09.343204 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:09.343190 2553 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-57.ec2.internal\" not found" node="ip-10-0-133-57.ec2.internal" Jul 02 14:01:09.420184 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:09.420105 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-57.ec2.internal\" not found" Jul 02 14:01:09.438921 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.438892 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/469f128e84139c59dc87d077aeeac40f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-57.ec2.internal\" (UID: \"469f128e84139c59dc87d077aeeac40f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-57.ec2.internal" Jul 02 14:01:09.439037 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.438924 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c582d8238a6f3daead6044036f2a5eeb-config\") pod \"kube-apiserver-proxy-ip-10-0-133-57.ec2.internal\" (UID: \"c582d8238a6f3daead6044036f2a5eeb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-57.ec2.internal" Jul 02 14:01:09.439037 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.438943 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/469f128e84139c59dc87d077aeeac40f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-57.ec2.internal\" (UID: \"469f128e84139c59dc87d077aeeac40f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-57.ec2.internal" Jul 02 14:01:09.439037 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.439012 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/469f128e84139c59dc87d077aeeac40f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-57.ec2.internal\" (UID: \"469f128e84139c59dc87d077aeeac40f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-57.ec2.internal" Jul 02 14:01:09.439148 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.439053 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c582d8238a6f3daead6044036f2a5eeb-config\") pod \"kube-apiserver-proxy-ip-10-0-133-57.ec2.internal\" (UID: \"c582d8238a6f3daead6044036f2a5eeb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-57.ec2.internal" Jul 02 14:01:09.439148 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.439083 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/469f128e84139c59dc87d077aeeac40f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-57.ec2.internal\" (UID: \"469f128e84139c59dc87d077aeeac40f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-57.ec2.internal" Jul 02 14:01:09.520527 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:09.520490 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-57.ec2.internal\" not found" Jul 02 14:01:09.621310 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:09.621274 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-57.ec2.internal\" not found" Jul 02 14:01:09.641656 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.641638 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-57.ec2.internal" Jul 02 14:01:09.646426 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:09.646187 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-57.ec2.internal" Jul 02 14:01:09.721883 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:09.721799 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-57.ec2.internal\" not found" Jul 02 14:01:09.822310 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:09.822280 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-57.ec2.internal\" not found" Jul 02 14:01:09.922870 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:09.922843 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-57.ec2.internal\" not found" Jul 02 14:01:10.023433 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:10.023343 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-57.ec2.internal\" not found" Jul 02 14:01:10.069889 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:10.069863 2553 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 02 14:01:10.070347 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:10.070040 2553 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 14:01:10.070347 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:10.070046 2553 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 14:01:10.124372 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:10.124341 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-57.ec2.internal\" not found" Jul 02 14:01:10.134207 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:10.134176 2553 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-01 13:56:09 +0000 UTC" deadline="2028-01-21 09:52:29.461074181 +0000 UTC" Jul 02 14:01:10.134207 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:10.134200 2553 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13627h51m19.326877024s" Jul 02 14:01:10.224646 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:10.224625 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-57.ec2.internal\" not found" Jul 02 14:01:10.299683 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:10.299613 2553 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 14:01:10.325750 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:10.325724 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-57.ec2.internal\" not found" Jul 02 14:01:10.426276 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:10.426241 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-57.ec2.internal\" not found" Jul 02 14:01:10.526767 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:10.526745 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-57.ec2.internal\" not found" Jul 02 14:01:10.531229 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:10.531197 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc582d8238a6f3daead6044036f2a5eeb.slice/crio-1332f308dfc40dc33d98950ebafa8c4c321c5207e6e2a61f5bacab7af8c68d95 WatchSource:0}: Error finding container 1332f308dfc40dc33d98950ebafa8c4c321c5207e6e2a61f5bacab7af8c68d95: Status 404 returned error can't find the container with id 1332f308dfc40dc33d98950ebafa8c4c321c5207e6e2a61f5bacab7af8c68d95 Jul 02 14:01:10.531571 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:10.531546 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod469f128e84139c59dc87d077aeeac40f.slice/crio-c505296338734c69abfa3cb110f287220d45ca61b0dc2f122f9c27bdd38e0c3b WatchSource:0}: Error finding container c505296338734c69abfa3cb110f287220d45ca61b0dc2f122f9c27bdd38e0c3b: Status 404 returned error can't find the container with id c505296338734c69abfa3cb110f287220d45ca61b0dc2f122f9c27bdd38e0c3b Jul 02 14:01:10.536782 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:10.536765 2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 14:01:10.555881 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:10.555838 2553 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 14:01:10.636767 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:10.636741 2553 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-57.ec2.internal" Jul 02 14:01:10.649083 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:10.649061 2553 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 14:01:10.649955 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:10.649941 2553 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-57.ec2.internal" Jul 02 14:01:10.656112 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:10.656094 2553 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 14:01:11.116607 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.116586 2553 apiserver.go:52] "Watching apiserver" Jul 02 14:01:11.123407 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.123390 2553 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 02 14:01:11.125697 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.124497 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-6czcv","openshift-image-registry/node-ca-zbkhx","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-57.ec2.internal","openshift-multus/multus-additional-cni-plugins-68vbd","openshift-multus/network-metrics-daemon-tz5k9","kube-system/konnectivity-agent-7nn4r","openshift-dns/node-resolver-lg74z","openshift-multus/multus-8l6bt","openshift-network-diagnostics/network-check-target-vfrjc","openshift-network-operator/iptables-alerter-7xkn2","openshift-ovn-kubernetes/ovnkube-node-7r445","kube-system/global-pull-secret-syncer-xvgpg","kube-system/kube-apiserver-proxy-ip-10-0-133-57.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnxgt"] Jul 02 14:01:11.126922 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.126903 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lg74z" Jul 02 14:01:11.128151 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.128127 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:01:11.129015 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.128997 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 02 14:01:11.129096 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.129042 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 02 14:01:11.129141 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.129101 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-lpvbg\"" Jul 02 14:01:11.129289 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.129273 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnxgt" Jul 02 14:01:11.130230 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.130215 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 02 14:01:11.130478 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.130461 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 02 14:01:11.130548 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.130531 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-68vbd" Jul 02 14:01:11.130600 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.130545 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 02 14:01:11.130650 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.130601 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 02 14:01:11.131629 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.131614 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 02 14:01:11.132217 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.131908 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tz5k9" Jul 02 14:01:11.132217 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:11.132008 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tz5k9" podUID="fac6f456-02a4-4216-a9ae-7ba6ba7a73b4" Jul 02 14:01:11.132217 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.132032 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-5g8x6\"" Jul 02 14:01:11.132217 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.132054 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 02 14:01:11.132217 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.132073 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 02 14:01:11.132217 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.132118 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-pkpxs\"" Jul 02 14:01:11.132217 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.132156 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 02 14:01:11.132217 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.132219 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 02 14:01:11.132797 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.132784 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 02 14:01:11.132927 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.132915 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 02 14:01:11.133255 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.133231 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 02 14:01:11.133255 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.133245 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2txrd\"" Jul 02 14:01:11.133393 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.133293 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 02 14:01:11.133393 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.133334 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 02 14:01:11.133488 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.133416 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7nn4r" Jul 02 14:01:11.134778 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.134764 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vfrjc" Jul 02 14:01:11.134899 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:11.134876 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vfrjc" podUID="c02181c0-cedc-4f2e-8786-c242fadd4eea" Jul 02 14:01:11.135615 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.135594 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 02 14:01:11.135722 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.135708 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 02 14:01:11.135783 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.135749 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-zp8nt\"" Jul 02 14:01:11.136360 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.136344 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8l6bt" Jul 02 14:01:11.136468 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.136456 2553 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 02 14:01:11.137980 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.137964 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zbkhx" Jul 02 14:01:11.138816 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.138801 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 02 14:01:11.138886 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.138859 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hn65z\"" Jul 02 14:01:11.139435 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.139418 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7xkn2" Jul 02 14:01:11.139937 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.139919 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 02 14:01:11.140452 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.140437 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 02 14:01:11.140452 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.140445 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 02 14:01:11.140617 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.140444 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-brx4g\"" Jul 02 14:01:11.140865 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.140852 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6czcv" Jul 02 14:01:11.141384 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.141243 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 02 14:01:11.141588 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.141574 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 02 14:01:11.141846 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.141829 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 02 14:01:11.142441 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.142421 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8njqf\"" Jul 02 14:01:11.142528 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.142452 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvgpg" Jul 02 14:01:11.142583 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:11.142518 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvgpg" podUID="e558c7dc-3cca-412b-b6a2-cd48bd9b430f" Jul 02 14:01:11.143092 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.143066 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 02 14:01:11.143189 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.143139 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 02 14:01:11.143189 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.143141 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qgm8k\"" Jul 02 14:01:11.149913 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.149028 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ca0f7ed3-f75b-4edb-86c2-afa842962cf5-host-slash\") pod \"ovnkube-node-7r445\" (UID: \"ca0f7ed3-f75b-4edb-86c2-afa842962cf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:01:11.149913 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.149092 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkd4f\" (UniqueName: \"kubernetes.io/projected/cfbb6333-3d89-4a46-9c46-cd02efede2e8-kube-api-access-tkd4f\") pod \"multus-8l6bt\" (UID: \"cfbb6333-3d89-4a46-9c46-cd02efede2e8\") " pod="openshift-multus/multus-8l6bt" Jul 02 14:01:11.149913 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.149122 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ca0f7ed3-f75b-4edb-86c2-afa842962cf5-host-cni-bin\") pod \"ovnkube-node-7r445\" (UID: \"ca0f7ed3-f75b-4edb-86c2-afa842962cf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:01:11.149913 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.149157 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8be1e9f8-324d-4352-83b0-7e22f0e0bfa3-registration-dir\") pod \"aws-ebs-csi-driver-node-bnxgt\" (UID: \"8be1e9f8-324d-4352-83b0-7e22f0e0bfa3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnxgt" Jul 02 14:01:11.149913 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.149187 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/070f7754-21fb-458f-b47c-a5d2820ad39d-tmp-dir\") pod \"node-resolver-lg74z\" (UID: \"070f7754-21fb-458f-b47c-a5d2820ad39d\") " pod="openshift-dns/node-resolver-lg74z" Jul 02 14:01:11.149913 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.149214 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca0f7ed3-f75b-4edb-86c2-afa842962cf5-host-run-ovn-kubernetes\") pod \"ovnkube-node-7r445\" (UID: \"ca0f7ed3-f75b-4edb-86c2-afa842962cf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:01:11.149913 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.149244 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hpxx\" (UniqueName: \"kubernetes.io/projected/b9aba121-950c-4aab-bc81-d6efedf5bfbd-kube-api-access-6hpxx\") pod \"multus-additional-cni-plugins-68vbd\" (UID: \"b9aba121-950c-4aab-bc81-d6efedf5bfbd\") " pod="openshift-multus/multus-additional-cni-plugins-68vbd" Jul 02 14:01:11.149913 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.149268 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ef367a3a-b360-4b9a-b66c-c4b8b128d70f-agent-certs\") pod \"konnectivity-agent-7nn4r\" (UID: \"ef367a3a-b360-4b9a-b66c-c4b8b128d70f\") " pod="kube-system/konnectivity-agent-7nn4r" Jul 02 14:01:11.149913 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.149296 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/070f7754-21fb-458f-b47c-a5d2820ad39d-hosts-file\") pod \"node-resolver-lg74z\" (UID: \"070f7754-21fb-458f-b47c-a5d2820ad39d\") " pod="openshift-dns/node-resolver-lg74z" Jul 02 14:01:11.149913 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.149322 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9aba121-950c-4aab-bc81-d6efedf5bfbd-system-cni-dir\") pod \"multus-additional-cni-plugins-68vbd\" (UID: \"b9aba121-950c-4aab-bc81-d6efedf5bfbd\") " pod="openshift-multus/multus-additional-cni-plugins-68vbd" Jul 02 14:01:11.149913 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.149361 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b9aba121-950c-4aab-bc81-d6efedf5bfbd-cni-binary-copy\") pod \"multus-additional-cni-plugins-68vbd\" (UID: \"b9aba121-950c-4aab-bc81-d6efedf5bfbd\") " pod="openshift-multus/multus-additional-cni-plugins-68vbd" Jul 02 14:01:11.149913 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.149389 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cfbb6333-3d89-4a46-9c46-cd02efede2e8-host-var-lib-cni-multus\") pod \"multus-8l6bt\" (UID: \"cfbb6333-3d89-4a46-9c46-cd02efede2e8\") " pod="openshift-multus/multus-8l6bt" Jul 02 14:01:11.149913 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.149418 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b9aba121-950c-4aab-bc81-d6efedf5bfbd-cnibin\") pod \"multus-additional-cni-plugins-68vbd\" (UID: \"b9aba121-950c-4aab-bc81-d6efedf5bfbd\") " pod="openshift-multus/multus-additional-cni-plugins-68vbd" Jul 02 14:01:11.149913 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.149440 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cfbb6333-3d89-4a46-9c46-cd02efede2e8-host-run-k8s-cni-cncf-io\") pod \"multus-8l6bt\" (UID: \"cfbb6333-3d89-4a46-9c46-cd02efede2e8\") " pod="openshift-multus/multus-8l6bt" Jul 02 14:01:11.149913 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.149468 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ca0f7ed3-f75b-4edb-86c2-afa842962cf5-etc-openvswitch\") pod \"ovnkube-node-7r445\" (UID: \"ca0f7ed3-f75b-4edb-86c2-afa842962cf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:01:11.149913 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.149495 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cfbb6333-3d89-4a46-9c46-cd02efede2e8-hostroot\") pod \"multus-8l6bt\" (UID: \"cfbb6333-3d89-4a46-9c46-cd02efede2e8\") " pod="openshift-multus/multus-8l6bt" Jul 02 14:01:11.150598 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.149523 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vc96c\" (UniqueName: \"kubernetes.io/projected/fac6f456-02a4-4216-a9ae-7ba6ba7a73b4-kube-api-access-vc96c\") pod \"network-metrics-daemon-tz5k9\" (UID: \"fac6f456-02a4-4216-a9ae-7ba6ba7a73b4\") " pod="openshift-multus/network-metrics-daemon-tz5k9" Jul 02 14:01:11.150598 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.149563 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b9aba121-950c-4aab-bc81-d6efedf5bfbd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-68vbd\" (UID: \"b9aba121-950c-4aab-bc81-d6efedf5bfbd\") " pod="openshift-multus/multus-additional-cni-plugins-68vbd" Jul 02 14:01:11.150598 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.149587 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cfbb6333-3d89-4a46-9c46-cd02efede2e8-os-release\") pod \"multus-8l6bt\" (UID: \"cfbb6333-3d89-4a46-9c46-cd02efede2e8\") " pod="openshift-multus/multus-8l6bt" Jul 02 14:01:11.150598 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.149616 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cfbb6333-3d89-4a46-9c46-cd02efede2e8-multus-socket-dir-parent\") pod \"multus-8l6bt\" (UID: \"cfbb6333-3d89-4a46-9c46-cd02efede2e8\") " pod="openshift-multus/multus-8l6bt" Jul 02 14:01:11.150598 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.149645 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ca0f7ed3-f75b-4edb-86c2-afa842962cf5-host-cni-netd\") pod \"ovnkube-node-7r445\" (UID: \"ca0f7ed3-f75b-4edb-86c2-afa842962cf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:01:11.150598 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.149689 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ca0f7ed3-f75b-4edb-86c2-afa842962cf5-ovnkube-config\") pod \"ovnkube-node-7r445\" (UID: \"ca0f7ed3-f75b-4edb-86c2-afa842962cf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:01:11.150598 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.149736 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b9aba121-950c-4aab-bc81-d6efedf5bfbd-os-release\") pod \"multus-additional-cni-plugins-68vbd\" (UID: \"b9aba121-950c-4aab-bc81-d6efedf5bfbd\") " pod="openshift-multus/multus-additional-cni-plugins-68vbd" Jul 02 14:01:11.150598 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.149765 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cfbb6333-3d89-4a46-9c46-cd02efede2e8-multus-cni-dir\") pod \"multus-8l6bt\" (UID: \"cfbb6333-3d89-4a46-9c46-cd02efede2e8\") " pod="openshift-multus/multus-8l6bt" Jul 02 14:01:11.150598 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.149799 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ca0f7ed3-f75b-4edb-86c2-afa842962cf5-systemd-units\") pod \"ovnkube-node-7r445\" (UID: \"ca0f7ed3-f75b-4edb-86c2-afa842962cf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:01:11.150598 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.149828 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ca0f7ed3-f75b-4edb-86c2-afa842962cf5-run-systemd\") pod \"ovnkube-node-7r445\" (UID: \"ca0f7ed3-f75b-4edb-86c2-afa842962cf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:01:11.150598 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.149859 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ca0f7ed3-f75b-4edb-86c2-afa842962cf5-var-lib-openvswitch\") pod \"ovnkube-node-7r445\" (UID: \"ca0f7ed3-f75b-4edb-86c2-afa842962cf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:01:11.150598 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.150000 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ca0f7ed3-f75b-4edb-86c2-afa842962cf5-env-overrides\") pod \"ovnkube-node-7r445\" (UID: \"ca0f7ed3-f75b-4edb-86c2-afa842962cf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:01:11.150598 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.150181 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8be1e9f8-324d-4352-83b0-7e22f0e0bfa3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bnxgt\" (UID: \"8be1e9f8-324d-4352-83b0-7e22f0e0bfa3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnxgt" Jul 02 14:01:11.150598 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.150296 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b9aba121-950c-4aab-bc81-d6efedf5bfbd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-68vbd\" (UID: \"b9aba121-950c-4aab-bc81-d6efedf5bfbd\") " pod="openshift-multus/multus-additional-cni-plugins-68vbd" Jul 02 14:01:11.150598 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.150305 2553 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 14:01:11.151285 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.150337 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ca0f7ed3-f75b-4edb-86c2-afa842962cf5-run-openvswitch\") pod \"ovnkube-node-7r445\" (UID: \"ca0f7ed3-f75b-4edb-86c2-afa842962cf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:01:11.151285 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.150655 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7r5v\" (UniqueName: \"kubernetes.io/projected/ca0f7ed3-f75b-4edb-86c2-afa842962cf5-kube-api-access-d7r5v\") pod \"ovnkube-node-7r445\" (UID: \"ca0f7ed3-f75b-4edb-86c2-afa842962cf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:01:11.151285 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.150692 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8be1e9f8-324d-4352-83b0-7e22f0e0bfa3-sys-fs\") pod \"aws-ebs-csi-driver-node-bnxgt\" (UID: \"8be1e9f8-324d-4352-83b0-7e22f0e0bfa3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnxgt" Jul 02 14:01:11.151285 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.150741 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fac6f456-02a4-4216-a9ae-7ba6ba7a73b4-metrics-certs\") pod \"network-metrics-daemon-tz5k9\" (UID: \"fac6f456-02a4-4216-a9ae-7ba6ba7a73b4\") " pod="openshift-multus/network-metrics-daemon-tz5k9" Jul 02 14:01:11.151285 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.150776 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cfbb6333-3d89-4a46-9c46-cd02efede2e8-multus-conf-dir\") pod \"multus-8l6bt\" (UID: \"cfbb6333-3d89-4a46-9c46-cd02efede2e8\") " pod="openshift-multus/multus-8l6bt" Jul 02 14:01:11.151285 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.150803 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ch9pc\" (UniqueName: \"kubernetes.io/projected/c02181c0-cedc-4f2e-8786-c242fadd4eea-kube-api-access-ch9pc\") pod \"network-check-target-vfrjc\" (UID: \"c02181c0-cedc-4f2e-8786-c242fadd4eea\") " pod="openshift-network-diagnostics/network-check-target-vfrjc" Jul 02 14:01:11.151285 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.150829 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ca0f7ed3-f75b-4edb-86c2-afa842962cf5-node-log\") pod \"ovnkube-node-7r445\" (UID: \"ca0f7ed3-f75b-4edb-86c2-afa842962cf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:01:11.151285 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.150854 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca0f7ed3-f75b-4edb-86c2-afa842962cf5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7r445\" (UID: \"ca0f7ed3-f75b-4edb-86c2-afa842962cf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:01:11.151285 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.150879 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8be1e9f8-324d-4352-83b0-7e22f0e0bfa3-etc-selinux\") pod \"aws-ebs-csi-driver-node-bnxgt\" (UID: \"8be1e9f8-324d-4352-83b0-7e22f0e0bfa3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnxgt" Jul 02 14:01:11.151285 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.150900 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cfbb6333-3d89-4a46-9c46-cd02efede2e8-cnibin\") pod \"multus-8l6bt\" (UID: \"cfbb6333-3d89-4a46-9c46-cd02efede2e8\") " pod="openshift-multus/multus-8l6bt" Jul 02 14:01:11.151285 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.150924 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ca0f7ed3-f75b-4edb-86c2-afa842962cf5-run-ovn\") pod \"ovnkube-node-7r445\" (UID: \"ca0f7ed3-f75b-4edb-86c2-afa842962cf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:01:11.151285 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.150946 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b9aba121-950c-4aab-bc81-d6efedf5bfbd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-68vbd\" (UID: \"b9aba121-950c-4aab-bc81-d6efedf5bfbd\") " pod="openshift-multus/multus-additional-cni-plugins-68vbd" Jul 02 14:01:11.151285 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.150971 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cfbb6333-3d89-4a46-9c46-cd02efede2e8-host-var-lib-cni-bin\") pod \"multus-8l6bt\" (UID: \"cfbb6333-3d89-4a46-9c46-cd02efede2e8\") " pod="openshift-multus/multus-8l6bt" Jul 02 14:01:11.151285 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.151015 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cfbb6333-3d89-4a46-9c46-cd02efede2e8-host-var-lib-kubelet\") pod \"multus-8l6bt\" (UID: \"cfbb6333-3d89-4a46-9c46-cd02efede2e8\") " pod="openshift-multus/multus-8l6bt" Jul 02 14:01:11.151285 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.151038 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cfbb6333-3d89-4a46-9c46-cd02efede2e8-host-run-multus-certs\") pod \"multus-8l6bt\" (UID: \"cfbb6333-3d89-4a46-9c46-cd02efede2e8\") " pod="openshift-multus/multus-8l6bt" Jul 02 14:01:11.151285 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.151061 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/253a79fe-da31-4f39-8017-9b6528e9e4df-host\") pod \"node-ca-zbkhx\" (UID: \"253a79fe-da31-4f39-8017-9b6528e9e4df\") " pod="openshift-image-registry/node-ca-zbkhx" Jul 02 14:01:11.151805 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.151092 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/253a79fe-da31-4f39-8017-9b6528e9e4df-serviceca\") pod \"node-ca-zbkhx\" (UID: \"253a79fe-da31-4f39-8017-9b6528e9e4df\") " pod="openshift-image-registry/node-ca-zbkhx" Jul 02 14:01:11.151805 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.151113 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca0f7ed3-f75b-4edb-86c2-afa842962cf5-host-kubelet\") pod \"ovnkube-node-7r445\" (UID: \"ca0f7ed3-f75b-4edb-86c2-afa842962cf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:01:11.151805 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.151136 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ca0f7ed3-f75b-4edb-86c2-afa842962cf5-ovn-node-metrics-cert\") pod \"ovnkube-node-7r445\" (UID: \"ca0f7ed3-f75b-4edb-86c2-afa842962cf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:01:11.151805 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.151158 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9rxz\" (UniqueName: \"kubernetes.io/projected/253a79fe-da31-4f39-8017-9b6528e9e4df-kube-api-access-t9rxz\") pod \"node-ca-zbkhx\" (UID: \"253a79fe-da31-4f39-8017-9b6528e9e4df\") " pod="openshift-image-registry/node-ca-zbkhx" Jul 02 14:01:11.151805 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.151180 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ca0f7ed3-f75b-4edb-86c2-afa842962cf5-host-run-netns\") pod \"ovnkube-node-7r445\" (UID: \"ca0f7ed3-f75b-4edb-86c2-afa842962cf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:01:11.151805 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.151212 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ca0f7ed3-f75b-4edb-86c2-afa842962cf5-ovnkube-script-lib\") pod \"ovnkube-node-7r445\" (UID: \"ca0f7ed3-f75b-4edb-86c2-afa842962cf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:01:11.151805 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.151240 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8be1e9f8-324d-4352-83b0-7e22f0e0bfa3-socket-dir\") pod \"aws-ebs-csi-driver-node-bnxgt\" (UID: \"8be1e9f8-324d-4352-83b0-7e22f0e0bfa3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnxgt" Jul 02 14:01:11.151805 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.151257 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8be1e9f8-324d-4352-83b0-7e22f0e0bfa3-device-dir\") pod \"aws-ebs-csi-driver-node-bnxgt\" (UID: \"8be1e9f8-324d-4352-83b0-7e22f0e0bfa3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnxgt" Jul 02 14:01:11.151805 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.151274 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggsf4\" (UniqueName: \"kubernetes.io/projected/8be1e9f8-324d-4352-83b0-7e22f0e0bfa3-kube-api-access-ggsf4\") pod \"aws-ebs-csi-driver-node-bnxgt\" (UID: \"8be1e9f8-324d-4352-83b0-7e22f0e0bfa3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnxgt" Jul 02 14:01:11.151805 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.151288 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ef367a3a-b360-4b9a-b66c-c4b8b128d70f-konnectivity-ca\") pod \"konnectivity-agent-7nn4r\" (UID: \"ef367a3a-b360-4b9a-b66c-c4b8b128d70f\") " pod="kube-system/konnectivity-agent-7nn4r" Jul 02 14:01:11.151805 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.151307 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cfbb6333-3d89-4a46-9c46-cd02efede2e8-system-cni-dir\") pod \"multus-8l6bt\" (UID: \"cfbb6333-3d89-4a46-9c46-cd02efede2e8\") " pod="openshift-multus/multus-8l6bt" Jul 02 14:01:11.151805 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.151330 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cfbb6333-3d89-4a46-9c46-cd02efede2e8-host-run-netns\") pod \"multus-8l6bt\" (UID: \"cfbb6333-3d89-4a46-9c46-cd02efede2e8\") " pod="openshift-multus/multus-8l6bt" Jul 02 14:01:11.151805 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.151344 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7m82\" (UniqueName: \"kubernetes.io/projected/070f7754-21fb-458f-b47c-a5d2820ad39d-kube-api-access-m7m82\") pod \"node-resolver-lg74z\" (UID: \"070f7754-21fb-458f-b47c-a5d2820ad39d\") " pod="openshift-dns/node-resolver-lg74z" Jul 02 14:01:11.151805 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.151357 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ca0f7ed3-f75b-4edb-86c2-afa842962cf5-log-socket\") pod \"ovnkube-node-7r445\" (UID: \"ca0f7ed3-f75b-4edb-86c2-afa842962cf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:01:11.151805 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.151387 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cfbb6333-3d89-4a46-9c46-cd02efede2e8-cni-binary-copy\") pod \"multus-8l6bt\" (UID: \"cfbb6333-3d89-4a46-9c46-cd02efede2e8\") " pod="openshift-multus/multus-8l6bt" Jul 02 14:01:11.151805 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.151427 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cfbb6333-3d89-4a46-9c46-cd02efede2e8-multus-daemon-config\") pod \"multus-8l6bt\" (UID: \"cfbb6333-3d89-4a46-9c46-cd02efede2e8\") " pod="openshift-multus/multus-8l6bt" Jul 02 14:01:11.152385 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.151456 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cfbb6333-3d89-4a46-9c46-cd02efede2e8-etc-kubernetes\") pod \"multus-8l6bt\" (UID: \"cfbb6333-3d89-4a46-9c46-cd02efede2e8\") " pod="openshift-multus/multus-8l6bt" Jul 02 14:01:11.172281 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.172260 2553 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-jnhlw" Jul 02 14:01:11.179347 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.179327 2553 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-jnhlw" Jul 02 14:01:11.205134 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.205083 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-57.ec2.internal" event={"ID":"469f128e84139c59dc87d077aeeac40f","Type":"ContainerStarted","Data":"c505296338734c69abfa3cb110f287220d45ca61b0dc2f122f9c27bdd38e0c3b"} Jul 02 14:01:11.206286 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.206257 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-57.ec2.internal" event={"ID":"c582d8238a6f3daead6044036f2a5eeb","Type":"ContainerStarted","Data":"1332f308dfc40dc33d98950ebafa8c4c321c5207e6e2a61f5bacab7af8c68d95"} Jul 02 14:01:11.238086 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.238061 2553 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 02 14:01:11.252289 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.252259 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ca0f7ed3-f75b-4edb-86c2-afa842962cf5-env-overrides\") pod \"ovnkube-node-7r445\" (UID: \"ca0f7ed3-f75b-4edb-86c2-afa842962cf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:01:11.252442 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.252301 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8be1e9f8-324d-4352-83b0-7e22f0e0bfa3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bnxgt\" (UID: \"8be1e9f8-324d-4352-83b0-7e22f0e0bfa3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnxgt" Jul 02 14:01:11.252442 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.252326 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jn4mx\" (UniqueName: \"kubernetes.io/projected/f7f2c7f4-5c54-434e-b13c-a12bf418b343-kube-api-access-jn4mx\") pod \"tuned-6czcv\" (UID: \"f7f2c7f4-5c54-434e-b13c-a12bf418b343\") " pod="openshift-cluster-node-tuning-operator/tuned-6czcv" Jul 02 14:01:11.252442 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.252405 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8be1e9f8-324d-4352-83b0-7e22f0e0bfa3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bnxgt\" (UID: \"8be1e9f8-324d-4352-83b0-7e22f0e0bfa3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnxgt" Jul 02 14:01:11.252442 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.252407 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b9aba121-950c-4aab-bc81-d6efedf5bfbd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-68vbd\" (UID: \"b9aba121-950c-4aab-bc81-d6efedf5bfbd\") " pod="openshift-multus/multus-additional-cni-plugins-68vbd" Jul 02 14:01:11.252646 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.252457 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ca0f7ed3-f75b-4edb-86c2-afa842962cf5-run-openvswitch\") pod \"ovnkube-node-7r445\" (UID: \"ca0f7ed3-f75b-4edb-86c2-afa842962cf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:01:11.252646 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.252483 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7r5v\" (UniqueName: \"kubernetes.io/projected/ca0f7ed3-f75b-4edb-86c2-afa842962cf5-kube-api-access-d7r5v\") pod \"ovnkube-node-7r445\" (UID: \"ca0f7ed3-f75b-4edb-86c2-afa842962cf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:01:11.252646 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.252504 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8be1e9f8-324d-4352-83b0-7e22f0e0bfa3-sys-fs\") pod \"aws-ebs-csi-driver-node-bnxgt\" (UID: \"8be1e9f8-324d-4352-83b0-7e22f0e0bfa3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnxgt" Jul 02 14:01:11.252646 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.252518 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fac6f456-02a4-4216-a9ae-7ba6ba7a73b4-metrics-certs\") pod \"network-metrics-daemon-tz5k9\" (UID: \"fac6f456-02a4-4216-a9ae-7ba6ba7a73b4\") " pod="openshift-multus/network-metrics-daemon-tz5k9" Jul 02 14:01:11.252646 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.252542 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f7f2c7f4-5c54-434e-b13c-a12bf418b343-etc-sysctl-conf\") pod \"tuned-6czcv\" (UID: \"f7f2c7f4-5c54-434e-b13c-a12bf418b343\") " pod="openshift-cluster-node-tuning-operator/tuned-6czcv" Jul 02 14:01:11.252646 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.252568 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e558c7dc-3cca-412b-b6a2-cd48bd9b430f-original-pull-secret\") pod \"global-pull-secret-syncer-xvgpg\" (UID: \"e558c7dc-3cca-412b-b6a2-cd48bd9b430f\") " pod="kube-system/global-pull-secret-syncer-xvgpg" Jul 02 14:01:11.252646 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.252587 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cfbb6333-3d89-4a46-9c46-cd02efede2e8-multus-conf-dir\") pod \"multus-8l6bt\" (UID: \"cfbb6333-3d89-4a46-9c46-cd02efede2e8\") " pod="openshift-multus/multus-8l6bt" Jul 02 14:01:11.252646 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.252594 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b9aba121-950c-4aab-bc81-d6efedf5bfbd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-68vbd\" (UID: \"b9aba121-950c-4aab-bc81-d6efedf5bfbd\") " pod="openshift-multus/multus-additional-cni-plugins-68vbd" Jul 02 14:01:11.252646 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.252613 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ch9pc\" (UniqueName: \"kubernetes.io/projected/c02181c0-cedc-4f2e-8786-c242fadd4eea-kube-api-access-ch9pc\") pod \"network-check-target-vfrjc\" (UID: \"c02181c0-cedc-4f2e-8786-c242fadd4eea\") " pod="openshift-network-diagnostics/network-check-target-vfrjc" Jul 02 14:01:11.252646 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.252643 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ca0f7ed3-f75b-4edb-86c2-afa842962cf5-node-log\") pod \"ovnkube-node-7r445\" (UID: \"ca0f7ed3-f75b-4edb-86c2-afa842962cf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:01:11.253124 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.252668 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca0f7ed3-f75b-4edb-86c2-afa842962cf5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7r445\" (UID: \"ca0f7ed3-f75b-4edb-86c2-afa842962cf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:01:11.253124 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.252688 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8be1e9f8-324d-4352-83b0-7e22f0e0bfa3-etc-selinux\") pod \"aws-ebs-csi-driver-node-bnxgt\" (UID: \"8be1e9f8-324d-4352-83b0-7e22f0e0bfa3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnxgt" Jul 02 14:01:11.253124 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:11.252702 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:01:11.253124 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.252771 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cfbb6333-3d89-4a46-9c46-cd02efede2e8-multus-conf-dir\") pod \"multus-8l6bt\" (UID: \"cfbb6333-3d89-4a46-9c46-cd02efede2e8\") " pod="openshift-multus/multus-8l6bt" Jul 02 14:01:11.253124 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:11.252788 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fac6f456-02a4-4216-a9ae-7ba6ba7a73b4-metrics-certs podName:fac6f456-02a4-4216-a9ae-7ba6ba7a73b4 nodeName:}" failed. No retries permitted until 2026-07-02 14:01:11.752768392 +0000 UTC m=+2.961011173 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fac6f456-02a4-4216-a9ae-7ba6ba7a73b4-metrics-certs") pod "network-metrics-daemon-tz5k9" (UID: "fac6f456-02a4-4216-a9ae-7ba6ba7a73b4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:01:11.253124 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.252796 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ca0f7ed3-f75b-4edb-86c2-afa842962cf5-node-log\") pod \"ovnkube-node-7r445\" (UID: \"ca0f7ed3-f75b-4edb-86c2-afa842962cf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:01:11.253124 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.252817 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca0f7ed3-f75b-4edb-86c2-afa842962cf5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7r445\" (UID: \"ca0f7ed3-f75b-4edb-86c2-afa842962cf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:01:11.253124 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.252823 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ca0f7ed3-f75b-4edb-86c2-afa842962cf5-run-openvswitch\") pod \"ovnkube-node-7r445\" (UID: \"ca0f7ed3-f75b-4edb-86c2-afa842962cf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:01:11.253124 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.252837 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8be1e9f8-324d-4352-83b0-7e22f0e0bfa3-sys-fs\") pod \"aws-ebs-csi-driver-node-bnxgt\" (UID: \"8be1e9f8-324d-4352-83b0-7e22f0e0bfa3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnxgt" Jul 02 14:01:11.253124 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.252709 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f7f2c7f4-5c54-434e-b13c-a12bf418b343-sys\") pod \"tuned-6czcv\" (UID: \"f7f2c7f4-5c54-434e-b13c-a12bf418b343\") " pod="openshift-cluster-node-tuning-operator/tuned-6czcv" Jul 02 14:01:11.253124 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.252843 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ca0f7ed3-f75b-4edb-86c2-afa842962cf5-env-overrides\") pod \"ovnkube-node-7r445\" (UID: \"ca0f7ed3-f75b-4edb-86c2-afa842962cf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:01:11.253124 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.252872 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f7f2c7f4-5c54-434e-b13c-a12bf418b343-var-lib-kubelet\") pod \"tuned-6czcv\" (UID: \"f7f2c7f4-5c54-434e-b13c-a12bf418b343\") " pod="openshift-cluster-node-tuning-operator/tuned-6czcv" Jul 02 14:01:11.253124 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.252900 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b6b9b623-5017-4948-857b-38b591d84b8a-host-slash\") pod \"iptables-alerter-7xkn2\" (UID: \"b6b9b623-5017-4948-857b-38b591d84b8a\") " pod="openshift-network-operator/iptables-alerter-7xkn2" Jul 02 14:01:11.253124 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.252927 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cfbb6333-3d89-4a46-9c46-cd02efede2e8-cnibin\") pod \"multus-8l6bt\" (UID: \"cfbb6333-3d89-4a46-9c46-cd02efede2e8\") " pod="openshift-multus/multus-8l6bt" Jul 02 14:01:11.253124 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.252973 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cfbb6333-3d89-4a46-9c46-cd02efede2e8-cnibin\") pod \"multus-8l6bt\" (UID: \"cfbb6333-3d89-4a46-9c46-cd02efede2e8\") " pod="openshift-multus/multus-8l6bt" Jul 02 14:01:11.253124 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.252974 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ca0f7ed3-f75b-4edb-86c2-afa842962cf5-run-ovn\") pod \"ovnkube-node-7r445\" (UID: \"ca0f7ed3-f75b-4edb-86c2-afa842962cf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:01:11.253124 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.253029 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f7f2c7f4-5c54-434e-b13c-a12bf418b343-tmp\") pod \"tuned-6czcv\" (UID: \"f7f2c7f4-5c54-434e-b13c-a12bf418b343\") " pod="openshift-cluster-node-tuning-operator/tuned-6czcv" Jul 02 14:01:11.253935 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.253056 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b9aba121-950c-4aab-bc81-d6efedf5bfbd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-68vbd\" (UID: \"b9aba121-950c-4aab-bc81-d6efedf5bfbd\") " pod="openshift-multus/multus-additional-cni-plugins-68vbd" Jul 02 14:01:11.253935 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.253084 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cfbb6333-3d89-4a46-9c46-cd02efede2e8-host-var-lib-cni-bin\") pod \"multus-8l6bt\" (UID: \"cfbb6333-3d89-4a46-9c46-cd02efede2e8\") " pod="openshift-multus/multus-8l6bt" Jul 02 14:01:11.253935 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.253092 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ca0f7ed3-f75b-4edb-86c2-afa842962cf5-run-ovn\") pod \"ovnkube-node-7r445\" (UID: \"ca0f7ed3-f75b-4edb-86c2-afa842962cf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:01:11.253935 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.253119 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8be1e9f8-324d-4352-83b0-7e22f0e0bfa3-etc-selinux\") pod \"aws-ebs-csi-driver-node-bnxgt\" (UID: \"8be1e9f8-324d-4352-83b0-7e22f0e0bfa3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnxgt" Jul 02 14:01:11.253935 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.253109 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cfbb6333-3d89-4a46-9c46-cd02efede2e8-host-var-lib-kubelet\") pod \"multus-8l6bt\" (UID: \"cfbb6333-3d89-4a46-9c46-cd02efede2e8\") " pod="openshift-multus/multus-8l6bt" Jul 02 14:01:11.253935 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.253138 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cfbb6333-3d89-4a46-9c46-cd02efede2e8-host-var-lib-kubelet\") pod \"multus-8l6bt\" (UID: \"cfbb6333-3d89-4a46-9c46-cd02efede2e8\") " pod="openshift-multus/multus-8l6bt" Jul 02 14:01:11.253935 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.253160 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cfbb6333-3d89-4a46-9c46-cd02efede2e8-host-run-multus-certs\") pod \"multus-8l6bt\" (UID: \"cfbb6333-3d89-4a46-9c46-cd02efede2e8\") " pod="openshift-multus/multus-8l6bt" Jul 02 14:01:11.253935 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.253166 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cfbb6333-3d89-4a46-9c46-cd02efede2e8-host-var-lib-cni-bin\") pod \"multus-8l6bt\" (UID: \"cfbb6333-3d89-4a46-9c46-cd02efede2e8\") " pod="openshift-multus/multus-8l6bt" Jul 02 14:01:11.253935 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.253208 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cfbb6333-3d89-4a46-9c46-cd02efede2e8-host-run-multus-certs\") pod \"multus-8l6bt\" (UID: \"cfbb6333-3d89-4a46-9c46-cd02efede2e8\") " pod="openshift-multus/multus-8l6bt" Jul 02 14:01:11.253935 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.253236 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/253a79fe-da31-4f39-8017-9b6528e9e4df-host\") pod \"node-ca-zbkhx\" (UID: \"253a79fe-da31-4f39-8017-9b6528e9e4df\") " pod="openshift-image-registry/node-ca-zbkhx" Jul 02 14:01:11.253935 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.253263 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/253a79fe-da31-4f39-8017-9b6528e9e4df-serviceca\") pod \"node-ca-zbkhx\" (UID: \"253a79fe-da31-4f39-8017-9b6528e9e4df\") " pod="openshift-image-registry/node-ca-zbkhx" Jul 02 14:01:11.253935 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.253273 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/253a79fe-da31-4f39-8017-9b6528e9e4df-host\") pod \"node-ca-zbkhx\" (UID: \"253a79fe-da31-4f39-8017-9b6528e9e4df\") " pod="openshift-image-registry/node-ca-zbkhx" Jul 02 14:01:11.253935 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.253287 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca0f7ed3-f75b-4edb-86c2-afa842962cf5-host-kubelet\") pod \"ovnkube-node-7r445\" (UID: \"ca0f7ed3-f75b-4edb-86c2-afa842962cf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:01:11.253935 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.253320 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ca0f7ed3-f75b-4edb-86c2-afa842962cf5-ovn-node-metrics-cert\") pod \"ovnkube-node-7r445\" (UID: \"ca0f7ed3-f75b-4edb-86c2-afa842962cf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:01:11.253935 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.253338 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca0f7ed3-f75b-4edb-86c2-afa842962cf5-host-kubelet\") pod \"ovnkube-node-7r445\" (UID: \"ca0f7ed3-f75b-4edb-86c2-afa842962cf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:01:11.253935 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.253347 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9rxz\" (UniqueName: \"kubernetes.io/projected/253a79fe-da31-4f39-8017-9b6528e9e4df-kube-api-access-t9rxz\") pod \"node-ca-zbkhx\" (UID: \"253a79fe-da31-4f39-8017-9b6528e9e4df\") " pod="openshift-image-registry/node-ca-zbkhx" Jul 02 14:01:11.253935 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.253372 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ca0f7ed3-f75b-4edb-86c2-afa842962cf5-host-run-netns\") pod \"ovnkube-node-7r445\" (UID: \"ca0f7ed3-f75b-4edb-86c2-afa842962cf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:01:11.253935 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.253395 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ca0f7ed3-f75b-4edb-86c2-afa842962cf5-ovnkube-script-lib\") pod \"ovnkube-node-7r445\" (UID: \"ca0f7ed3-f75b-4edb-86c2-afa842962cf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:01:11.254791 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.253418 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8be1e9f8-324d-4352-83b0-7e22f0e0bfa3-socket-dir\") pod \"aws-ebs-csi-driver-node-bnxgt\" (UID: \"8be1e9f8-324d-4352-83b0-7e22f0e0bfa3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnxgt" Jul 02 14:01:11.254791 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.253433 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ca0f7ed3-f75b-4edb-86c2-afa842962cf5-host-run-netns\") pod \"ovnkube-node-7r445\" (UID: \"ca0f7ed3-f75b-4edb-86c2-afa842962cf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:01:11.254791 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.253458 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8be1e9f8-324d-4352-83b0-7e22f0e0bfa3-device-dir\") pod \"aws-ebs-csi-driver-node-bnxgt\" (UID: \"8be1e9f8-324d-4352-83b0-7e22f0e0bfa3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnxgt" Jul 02 14:01:11.254791 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.253483 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggsf4\" (UniqueName: \"kubernetes.io/projected/8be1e9f8-324d-4352-83b0-7e22f0e0bfa3-kube-api-access-ggsf4\") pod \"aws-ebs-csi-driver-node-bnxgt\" (UID: \"8be1e9f8-324d-4352-83b0-7e22f0e0bfa3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnxgt" Jul 02 14:01:11.254791 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.253509 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f7f2c7f4-5c54-434e-b13c-a12bf418b343-etc-kubernetes\") pod \"tuned-6czcv\" (UID: \"f7f2c7f4-5c54-434e-b13c-a12bf418b343\") " pod="openshift-cluster-node-tuning-operator/tuned-6czcv" Jul 02 14:01:11.254791 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.253538 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ef367a3a-b360-4b9a-b66c-c4b8b128d70f-konnectivity-ca\") pod \"konnectivity-agent-7nn4r\" (UID: \"ef367a3a-b360-4b9a-b66c-c4b8b128d70f\") " pod="kube-system/konnectivity-agent-7nn4r" Jul 02 14:01:11.254791 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.253562 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cfbb6333-3d89-4a46-9c46-cd02efede2e8-system-cni-dir\") pod \"multus-8l6bt\" (UID: \"cfbb6333-3d89-4a46-9c46-cd02efede2e8\") " pod="openshift-multus/multus-8l6bt" Jul 02 14:01:11.254791 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.253585 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cfbb6333-3d89-4a46-9c46-cd02efede2e8-host-run-netns\") pod \"multus-8l6bt\" (UID: \"cfbb6333-3d89-4a46-9c46-cd02efede2e8\") " pod="openshift-multus/multus-8l6bt" Jul 02 14:01:11.254791 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.253609 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7m82\" (UniqueName: \"kubernetes.io/projected/070f7754-21fb-458f-b47c-a5d2820ad39d-kube-api-access-m7m82\") pod \"node-resolver-lg74z\" (UID: \"070f7754-21fb-458f-b47c-a5d2820ad39d\") " pod="openshift-dns/node-resolver-lg74z" Jul 02 14:01:11.254791 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.253634 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ca0f7ed3-f75b-4edb-86c2-afa842962cf5-log-socket\") pod \"ovnkube-node-7r445\" (UID: \"ca0f7ed3-f75b-4edb-86c2-afa842962cf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:01:11.254791 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.253649 2553 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 02 14:01:11.254791 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.253657 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e558c7dc-3cca-412b-b6a2-cd48bd9b430f-dbus\") pod \"global-pull-secret-syncer-xvgpg\" (UID: \"e558c7dc-3cca-412b-b6a2-cd48bd9b430f\") " pod="kube-system/global-pull-secret-syncer-xvgpg" Jul 02 14:01:11.254791 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.253680 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b9aba121-950c-4aab-bc81-d6efedf5bfbd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-68vbd\" (UID: \"b9aba121-950c-4aab-bc81-d6efedf5bfbd\") " pod="openshift-multus/multus-additional-cni-plugins-68vbd" Jul 02 14:01:11.254791 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.253683 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cfbb6333-3d89-4a46-9c46-cd02efede2e8-cni-binary-copy\") pod \"multus-8l6bt\" (UID: \"cfbb6333-3d89-4a46-9c46-cd02efede2e8\") " pod="openshift-multus/multus-8l6bt" Jul 02 14:01:11.254791 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.253713 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/253a79fe-da31-4f39-8017-9b6528e9e4df-serviceca\") pod \"node-ca-zbkhx\" (UID: \"253a79fe-da31-4f39-8017-9b6528e9e4df\") " pod="openshift-image-registry/node-ca-zbkhx" Jul 02 14:01:11.254791 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.253732 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cfbb6333-3d89-4a46-9c46-cd02efede2e8-multus-daemon-config\") pod \"multus-8l6bt\" (UID: \"cfbb6333-3d89-4a46-9c46-cd02efede2e8\") " pod="openshift-multus/multus-8l6bt" Jul 02 14:01:11.254791 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.253741 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cfbb6333-3d89-4a46-9c46-cd02efede2e8-host-run-netns\") pod \"multus-8l6bt\" (UID: \"cfbb6333-3d89-4a46-9c46-cd02efede2e8\") " pod="openshift-multus/multus-8l6bt" Jul 02 14:01:11.254791 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.253778 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cfbb6333-3d89-4a46-9c46-cd02efede2e8-etc-kubernetes\") pod \"multus-8l6bt\" (UID: \"cfbb6333-3d89-4a46-9c46-cd02efede2e8\") " pod="openshift-multus/multus-8l6bt" Jul 02 14:01:11.255656 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.253785 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8be1e9f8-324d-4352-83b0-7e22f0e0bfa3-device-dir\") pod \"aws-ebs-csi-driver-node-bnxgt\" (UID: \"8be1e9f8-324d-4352-83b0-7e22f0e0bfa3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnxgt" Jul 02 14:01:11.255656 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.253800 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ca0f7ed3-f75b-4edb-86c2-afa842962cf5-host-slash\") pod \"ovnkube-node-7r445\" (UID: \"ca0f7ed3-f75b-4edb-86c2-afa842962cf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:01:11.255656 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.253808 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ca0f7ed3-f75b-4edb-86c2-afa842962cf5-log-socket\") pod \"ovnkube-node-7r445\" (UID: \"ca0f7ed3-f75b-4edb-86c2-afa842962cf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:01:11.255656 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.253835 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f7f2c7f4-5c54-434e-b13c-a12bf418b343-host\") pod \"tuned-6czcv\" (UID: \"f7f2c7f4-5c54-434e-b13c-a12bf418b343\") " pod="openshift-cluster-node-tuning-operator/tuned-6czcv" Jul 02 14:01:11.255656 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.253839 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ca0f7ed3-f75b-4edb-86c2-afa842962cf5-host-slash\") pod \"ovnkube-node-7r445\" (UID: \"ca0f7ed3-f75b-4edb-86c2-afa842962cf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:01:11.255656 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.253869 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkd4f\" (UniqueName: \"kubernetes.io/projected/cfbb6333-3d89-4a46-9c46-cd02efede2e8-kube-api-access-tkd4f\") pod \"multus-8l6bt\" (UID: \"cfbb6333-3d89-4a46-9c46-cd02efede2e8\") " pod="openshift-multus/multus-8l6bt" Jul 02 14:01:11.255656 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.253897 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ca0f7ed3-f75b-4edb-86c2-afa842962cf5-host-cni-bin\") pod \"ovnkube-node-7r445\" (UID: \"ca0f7ed3-f75b-4edb-86c2-afa842962cf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:01:11.255656 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.253921 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8be1e9f8-324d-4352-83b0-7e22f0e0bfa3-registration-dir\") pod \"aws-ebs-csi-driver-node-bnxgt\" (UID: \"8be1e9f8-324d-4352-83b0-7e22f0e0bfa3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnxgt" Jul 02 14:01:11.255656 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.253969 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnldh\" (UniqueName: \"kubernetes.io/projected/b6b9b623-5017-4948-857b-38b591d84b8a-kube-api-access-vnldh\") pod \"iptables-alerter-7xkn2\" (UID: \"b6b9b623-5017-4948-857b-38b591d84b8a\") " pod="openshift-network-operator/iptables-alerter-7xkn2" Jul 02 14:01:11.255656 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.254013 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/070f7754-21fb-458f-b47c-a5d2820ad39d-tmp-dir\") pod \"node-resolver-lg74z\" (UID: \"070f7754-21fb-458f-b47c-a5d2820ad39d\") " pod="openshift-dns/node-resolver-lg74z" Jul 02 14:01:11.255656 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.254019 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ca0f7ed3-f75b-4edb-86c2-afa842962cf5-ovnkube-script-lib\") pod \"ovnkube-node-7r445\" (UID: \"ca0f7ed3-f75b-4edb-86c2-afa842962cf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:01:11.255656 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.254039 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca0f7ed3-f75b-4edb-86c2-afa842962cf5-host-run-ovn-kubernetes\") pod \"ovnkube-node-7r445\" (UID: \"ca0f7ed3-f75b-4edb-86c2-afa842962cf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:01:11.255656 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.253873 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cfbb6333-3d89-4a46-9c46-cd02efede2e8-etc-kubernetes\") pod \"multus-8l6bt\" (UID: \"cfbb6333-3d89-4a46-9c46-cd02efede2e8\") " pod="openshift-multus/multus-8l6bt" Jul 02 14:01:11.255656 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.253809 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8be1e9f8-324d-4352-83b0-7e22f0e0bfa3-socket-dir\") pod \"aws-ebs-csi-driver-node-bnxgt\" (UID: \"8be1e9f8-324d-4352-83b0-7e22f0e0bfa3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnxgt" Jul 02 14:01:11.255656 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.254088 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b6b9b623-5017-4948-857b-38b591d84b8a-iptables-alerter-script\") pod \"iptables-alerter-7xkn2\" (UID: \"b6b9b623-5017-4948-857b-38b591d84b8a\") " pod="openshift-network-operator/iptables-alerter-7xkn2" Jul 02 14:01:11.255656 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.254113 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ca0f7ed3-f75b-4edb-86c2-afa842962cf5-host-cni-bin\") pod \"ovnkube-node-7r445\" (UID: \"ca0f7ed3-f75b-4edb-86c2-afa842962cf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:01:11.255656 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.254138 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e558c7dc-3cca-412b-b6a2-cd48bd9b430f-kubelet-config\") pod \"global-pull-secret-syncer-xvgpg\" (UID: \"e558c7dc-3cca-412b-b6a2-cd48bd9b430f\") " pod="kube-system/global-pull-secret-syncer-xvgpg" Jul 02 14:01:11.256308 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.254162 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca0f7ed3-f75b-4edb-86c2-afa842962cf5-host-run-ovn-kubernetes\") pod \"ovnkube-node-7r445\" (UID: \"ca0f7ed3-f75b-4edb-86c2-afa842962cf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:01:11.256308 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.254168 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hpxx\" (UniqueName: \"kubernetes.io/projected/b9aba121-950c-4aab-bc81-d6efedf5bfbd-kube-api-access-6hpxx\") pod \"multus-additional-cni-plugins-68vbd\" (UID: \"b9aba121-950c-4aab-bc81-d6efedf5bfbd\") " pod="openshift-multus/multus-additional-cni-plugins-68vbd" Jul 02 14:01:11.256308 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.254196 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ef367a3a-b360-4b9a-b66c-c4b8b128d70f-agent-certs\") pod \"konnectivity-agent-7nn4r\" (UID: \"ef367a3a-b360-4b9a-b66c-c4b8b128d70f\") " pod="kube-system/konnectivity-agent-7nn4r" Jul 02 14:01:11.256308 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.254244 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cfbb6333-3d89-4a46-9c46-cd02efede2e8-cni-binary-copy\") pod \"multus-8l6bt\" (UID: \"cfbb6333-3d89-4a46-9c46-cd02efede2e8\") " pod="openshift-multus/multus-8l6bt" Jul 02 14:01:11.256308 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.254255 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/070f7754-21fb-458f-b47c-a5d2820ad39d-hosts-file\") pod \"node-resolver-lg74z\" (UID: \"070f7754-21fb-458f-b47c-a5d2820ad39d\") " pod="openshift-dns/node-resolver-lg74z" Jul 02 14:01:11.256308 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.254280 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f7f2c7f4-5c54-434e-b13c-a12bf418b343-etc-modprobe-d\") pod \"tuned-6czcv\" (UID: \"f7f2c7f4-5c54-434e-b13c-a12bf418b343\") " pod="openshift-cluster-node-tuning-operator/tuned-6czcv" Jul 02 14:01:11.256308 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.254302 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f7f2c7f4-5c54-434e-b13c-a12bf418b343-etc-sysconfig\") pod \"tuned-6czcv\" (UID: \"f7f2c7f4-5c54-434e-b13c-a12bf418b343\") " pod="openshift-cluster-node-tuning-operator/tuned-6czcv" Jul 02 14:01:11.256308 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.254317 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cfbb6333-3d89-4a46-9c46-cd02efede2e8-system-cni-dir\") pod \"multus-8l6bt\" (UID: \"cfbb6333-3d89-4a46-9c46-cd02efede2e8\") " pod="openshift-multus/multus-8l6bt" Jul 02 14:01:11.256308 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.254341 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cfbb6333-3d89-4a46-9c46-cd02efede2e8-multus-daemon-config\") pod \"multus-8l6bt\" (UID: \"cfbb6333-3d89-4a46-9c46-cd02efede2e8\") " pod="openshift-multus/multus-8l6bt" Jul 02 14:01:11.256308 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.254358 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ef367a3a-b360-4b9a-b66c-c4b8b128d70f-konnectivity-ca\") pod \"konnectivity-agent-7nn4r\" (UID: \"ef367a3a-b360-4b9a-b66c-c4b8b128d70f\") " pod="kube-system/konnectivity-agent-7nn4r" Jul 02 14:01:11.256308 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.254366 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/070f7754-21fb-458f-b47c-a5d2820ad39d-hosts-file\") pod \"node-resolver-lg74z\" (UID: \"070f7754-21fb-458f-b47c-a5d2820ad39d\") " pod="openshift-dns/node-resolver-lg74z" Jul 02 14:01:11.256308 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.254335 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9aba121-950c-4aab-bc81-d6efedf5bfbd-system-cni-dir\") pod \"multus-additional-cni-plugins-68vbd\" (UID: \"b9aba121-950c-4aab-bc81-d6efedf5bfbd\") " pod="openshift-multus/multus-additional-cni-plugins-68vbd" Jul 02 14:01:11.256308 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.254301 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8be1e9f8-324d-4352-83b0-7e22f0e0bfa3-registration-dir\") pod \"aws-ebs-csi-driver-node-bnxgt\" (UID: \"8be1e9f8-324d-4352-83b0-7e22f0e0bfa3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnxgt" Jul 02 14:01:11.256308 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.254408 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b9aba121-950c-4aab-bc81-d6efedf5bfbd-cni-binary-copy\") pod \"multus-additional-cni-plugins-68vbd\" (UID: \"b9aba121-950c-4aab-bc81-d6efedf5bfbd\") " pod="openshift-multus/multus-additional-cni-plugins-68vbd" Jul 02 14:01:11.256308 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.254420 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/070f7754-21fb-458f-b47c-a5d2820ad39d-tmp-dir\") pod \"node-resolver-lg74z\" (UID: \"070f7754-21fb-458f-b47c-a5d2820ad39d\") " pod="openshift-dns/node-resolver-lg74z" Jul 02 14:01:11.256308 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.254435 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cfbb6333-3d89-4a46-9c46-cd02efede2e8-host-var-lib-cni-multus\") pod \"multus-8l6bt\" (UID: \"cfbb6333-3d89-4a46-9c46-cd02efede2e8\") " pod="openshift-multus/multus-8l6bt" Jul 02 14:01:11.256308 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.254462 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b9aba121-950c-4aab-bc81-d6efedf5bfbd-cnibin\") pod \"multus-additional-cni-plugins-68vbd\" (UID: \"b9aba121-950c-4aab-bc81-d6efedf5bfbd\") " pod="openshift-multus/multus-additional-cni-plugins-68vbd" Jul 02 14:01:11.256849 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.254485 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cfbb6333-3d89-4a46-9c46-cd02efede2e8-host-run-k8s-cni-cncf-io\") pod \"multus-8l6bt\" (UID: \"cfbb6333-3d89-4a46-9c46-cd02efede2e8\") " pod="openshift-multus/multus-8l6bt" Jul 02 14:01:11.256849 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.254499 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cfbb6333-3d89-4a46-9c46-cd02efede2e8-host-var-lib-cni-multus\") pod \"multus-8l6bt\" (UID: \"cfbb6333-3d89-4a46-9c46-cd02efede2e8\") " pod="openshift-multus/multus-8l6bt" Jul 02 14:01:11.256849 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.254512 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f7f2c7f4-5c54-434e-b13c-a12bf418b343-lib-modules\") pod \"tuned-6czcv\" (UID: \"f7f2c7f4-5c54-434e-b13c-a12bf418b343\") " pod="openshift-cluster-node-tuning-operator/tuned-6czcv" Jul 02 14:01:11.256849 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.254537 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ca0f7ed3-f75b-4edb-86c2-afa842962cf5-etc-openvswitch\") pod \"ovnkube-node-7r445\" (UID: \"ca0f7ed3-f75b-4edb-86c2-afa842962cf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:01:11.256849 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.254559 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cfbb6333-3d89-4a46-9c46-cd02efede2e8-host-run-k8s-cni-cncf-io\") pod \"multus-8l6bt\" (UID: \"cfbb6333-3d89-4a46-9c46-cd02efede2e8\") " pod="openshift-multus/multus-8l6bt" Jul 02 14:01:11.256849 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.254564 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b9aba121-950c-4aab-bc81-d6efedf5bfbd-cnibin\") pod \"multus-additional-cni-plugins-68vbd\" (UID: \"b9aba121-950c-4aab-bc81-d6efedf5bfbd\") " pod="openshift-multus/multus-additional-cni-plugins-68vbd" Jul 02 14:01:11.256849 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.254563 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f7f2c7f4-5c54-434e-b13c-a12bf418b343-run\") pod \"tuned-6czcv\" (UID: \"f7f2c7f4-5c54-434e-b13c-a12bf418b343\") " pod="openshift-cluster-node-tuning-operator/tuned-6czcv" Jul 02 14:01:11.256849 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.254603 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f7f2c7f4-5c54-434e-b13c-a12bf418b343-etc-tuned\") pod \"tuned-6czcv\" (UID: \"f7f2c7f4-5c54-434e-b13c-a12bf418b343\") " pod="openshift-cluster-node-tuning-operator/tuned-6czcv" Jul 02 14:01:11.256849 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.254607 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9aba121-950c-4aab-bc81-d6efedf5bfbd-system-cni-dir\") pod \"multus-additional-cni-plugins-68vbd\" (UID: \"b9aba121-950c-4aab-bc81-d6efedf5bfbd\") " pod="openshift-multus/multus-additional-cni-plugins-68vbd" Jul 02 14:01:11.256849 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.254604 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ca0f7ed3-f75b-4edb-86c2-afa842962cf5-etc-openvswitch\") pod \"ovnkube-node-7r445\" (UID: \"ca0f7ed3-f75b-4edb-86c2-afa842962cf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:01:11.256849 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.254630 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cfbb6333-3d89-4a46-9c46-cd02efede2e8-hostroot\") pod \"multus-8l6bt\" (UID: \"cfbb6333-3d89-4a46-9c46-cd02efede2e8\") " pod="openshift-multus/multus-8l6bt" Jul 02 14:01:11.256849 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.254651 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vc96c\" (UniqueName: \"kubernetes.io/projected/fac6f456-02a4-4216-a9ae-7ba6ba7a73b4-kube-api-access-vc96c\") pod \"network-metrics-daemon-tz5k9\" (UID: \"fac6f456-02a4-4216-a9ae-7ba6ba7a73b4\") " pod="openshift-multus/network-metrics-daemon-tz5k9" Jul 02 14:01:11.256849 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.254677 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cfbb6333-3d89-4a46-9c46-cd02efede2e8-hostroot\") pod \"multus-8l6bt\" (UID: \"cfbb6333-3d89-4a46-9c46-cd02efede2e8\") " pod="openshift-multus/multus-8l6bt" Jul 02 14:01:11.256849 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.254682 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f7f2c7f4-5c54-434e-b13c-a12bf418b343-etc-systemd\") pod \"tuned-6czcv\" (UID: \"f7f2c7f4-5c54-434e-b13c-a12bf418b343\") " pod="openshift-cluster-node-tuning-operator/tuned-6czcv" Jul 02 14:01:11.256849 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.254725 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b9aba121-950c-4aab-bc81-d6efedf5bfbd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-68vbd\" (UID: \"b9aba121-950c-4aab-bc81-d6efedf5bfbd\") " pod="openshift-multus/multus-additional-cni-plugins-68vbd" Jul 02 14:01:11.256849 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.254758 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cfbb6333-3d89-4a46-9c46-cd02efede2e8-os-release\") pod \"multus-8l6bt\" (UID: \"cfbb6333-3d89-4a46-9c46-cd02efede2e8\") " pod="openshift-multus/multus-8l6bt" Jul 02 14:01:11.256849 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.254786 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cfbb6333-3d89-4a46-9c46-cd02efede2e8-multus-socket-dir-parent\") pod \"multus-8l6bt\" (UID: \"cfbb6333-3d89-4a46-9c46-cd02efede2e8\") " pod="openshift-multus/multus-8l6bt" Jul 02 14:01:11.257554 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.254816 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ca0f7ed3-f75b-4edb-86c2-afa842962cf5-host-cni-netd\") pod \"ovnkube-node-7r445\" (UID: \"ca0f7ed3-f75b-4edb-86c2-afa842962cf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:01:11.257554 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.254842 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ca0f7ed3-f75b-4edb-86c2-afa842962cf5-ovnkube-config\") pod \"ovnkube-node-7r445\" (UID: \"ca0f7ed3-f75b-4edb-86c2-afa842962cf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:01:11.257554 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.254870 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f7f2c7f4-5c54-434e-b13c-a12bf418b343-etc-sysctl-d\") pod \"tuned-6czcv\" (UID: \"f7f2c7f4-5c54-434e-b13c-a12bf418b343\") " pod="openshift-cluster-node-tuning-operator/tuned-6czcv" Jul 02 14:01:11.257554 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.254898 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b9aba121-950c-4aab-bc81-d6efedf5bfbd-os-release\") pod \"multus-additional-cni-plugins-68vbd\" (UID: \"b9aba121-950c-4aab-bc81-d6efedf5bfbd\") " pod="openshift-multus/multus-additional-cni-plugins-68vbd" Jul 02 14:01:11.257554 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.254927 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cfbb6333-3d89-4a46-9c46-cd02efede2e8-multus-cni-dir\") pod \"multus-8l6bt\" (UID: \"cfbb6333-3d89-4a46-9c46-cd02efede2e8\") " pod="openshift-multus/multus-8l6bt" Jul 02 14:01:11.257554 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.254954 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ca0f7ed3-f75b-4edb-86c2-afa842962cf5-systemd-units\") pod \"ovnkube-node-7r445\" (UID: \"ca0f7ed3-f75b-4edb-86c2-afa842962cf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:01:11.257554 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.254981 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ca0f7ed3-f75b-4edb-86c2-afa842962cf5-run-systemd\") pod \"ovnkube-node-7r445\" (UID: \"ca0f7ed3-f75b-4edb-86c2-afa842962cf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:01:11.257554 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.255025 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ca0f7ed3-f75b-4edb-86c2-afa842962cf5-var-lib-openvswitch\") pod \"ovnkube-node-7r445\" (UID: \"ca0f7ed3-f75b-4edb-86c2-afa842962cf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:01:11.257554 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.255193 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ca0f7ed3-f75b-4edb-86c2-afa842962cf5-var-lib-openvswitch\") pod \"ovnkube-node-7r445\" (UID: \"ca0f7ed3-f75b-4edb-86c2-afa842962cf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:01:11.257554 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.255315 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cfbb6333-3d89-4a46-9c46-cd02efede2e8-os-release\") pod \"multus-8l6bt\" (UID: \"cfbb6333-3d89-4a46-9c46-cd02efede2e8\") " pod="openshift-multus/multus-8l6bt" Jul 02 14:01:11.257554 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.255374 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b9aba121-950c-4aab-bc81-d6efedf5bfbd-os-release\") pod \"multus-additional-cni-plugins-68vbd\" (UID: \"b9aba121-950c-4aab-bc81-d6efedf5bfbd\") " pod="openshift-multus/multus-additional-cni-plugins-68vbd" Jul 02 14:01:11.257554 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.255420 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cfbb6333-3d89-4a46-9c46-cd02efede2e8-multus-socket-dir-parent\") pod \"multus-8l6bt\" (UID: \"cfbb6333-3d89-4a46-9c46-cd02efede2e8\") " pod="openshift-multus/multus-8l6bt" Jul 02 14:01:11.257554 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.255432 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b9aba121-950c-4aab-bc81-d6efedf5bfbd-cni-binary-copy\") pod \"multus-additional-cni-plugins-68vbd\" (UID: \"b9aba121-950c-4aab-bc81-d6efedf5bfbd\") " pod="openshift-multus/multus-additional-cni-plugins-68vbd" Jul 02 14:01:11.257554 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.255481 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ca0f7ed3-f75b-4edb-86c2-afa842962cf5-host-cni-netd\") pod \"ovnkube-node-7r445\" (UID: \"ca0f7ed3-f75b-4edb-86c2-afa842962cf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:01:11.257554 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.255499 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cfbb6333-3d89-4a46-9c46-cd02efede2e8-multus-cni-dir\") pod \"multus-8l6bt\" (UID: \"cfbb6333-3d89-4a46-9c46-cd02efede2e8\") " pod="openshift-multus/multus-8l6bt" Jul 02 14:01:11.257554 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.255514 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b9aba121-950c-4aab-bc81-d6efedf5bfbd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-68vbd\" (UID: \"b9aba121-950c-4aab-bc81-d6efedf5bfbd\") " pod="openshift-multus/multus-additional-cni-plugins-68vbd" Jul 02 14:01:11.257554 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.255536 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ca0f7ed3-f75b-4edb-86c2-afa842962cf5-run-systemd\") pod \"ovnkube-node-7r445\" (UID: \"ca0f7ed3-f75b-4edb-86c2-afa842962cf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:01:11.258265 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.255557 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ca0f7ed3-f75b-4edb-86c2-afa842962cf5-systemd-units\") pod \"ovnkube-node-7r445\" (UID: \"ca0f7ed3-f75b-4edb-86c2-afa842962cf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:01:11.258265 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.255880 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ca0f7ed3-f75b-4edb-86c2-afa842962cf5-ovnkube-config\") pod \"ovnkube-node-7r445\" (UID: \"ca0f7ed3-f75b-4edb-86c2-afa842962cf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:01:11.258265 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.257876 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ca0f7ed3-f75b-4edb-86c2-afa842962cf5-ovn-node-metrics-cert\") pod \"ovnkube-node-7r445\" (UID: \"ca0f7ed3-f75b-4edb-86c2-afa842962cf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:01:11.258265 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.257999 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ef367a3a-b360-4b9a-b66c-c4b8b128d70f-agent-certs\") pod \"konnectivity-agent-7nn4r\" (UID: \"ef367a3a-b360-4b9a-b66c-c4b8b128d70f\") " pod="kube-system/konnectivity-agent-7nn4r" Jul 02 14:01:11.259499 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:11.259471 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 14:01:11.259610 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:11.259505 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 14:01:11.259610 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:11.259518 2553 projected.go:196] Error preparing data for projected volume kube-api-access-ch9pc for pod openshift-network-diagnostics/network-check-target-vfrjc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:01:11.259610 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:11.259576 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c02181c0-cedc-4f2e-8786-c242fadd4eea-kube-api-access-ch9pc podName:c02181c0-cedc-4f2e-8786-c242fadd4eea nodeName:}" failed. No retries permitted until 2026-07-02 14:01:11.759560251 +0000 UTC m=+2.967803038 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ch9pc" (UniqueName: "kubernetes.io/projected/c02181c0-cedc-4f2e-8786-c242fadd4eea-kube-api-access-ch9pc") pod "network-check-target-vfrjc" (UID: "c02181c0-cedc-4f2e-8786-c242fadd4eea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:01:11.261610 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.261582 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7r5v\" (UniqueName: \"kubernetes.io/projected/ca0f7ed3-f75b-4edb-86c2-afa842962cf5-kube-api-access-d7r5v\") pod \"ovnkube-node-7r445\" (UID: \"ca0f7ed3-f75b-4edb-86c2-afa842962cf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:01:11.262081 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.262055 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9rxz\" (UniqueName: \"kubernetes.io/projected/253a79fe-da31-4f39-8017-9b6528e9e4df-kube-api-access-t9rxz\") pod \"node-ca-zbkhx\" (UID: \"253a79fe-da31-4f39-8017-9b6528e9e4df\") " pod="openshift-image-registry/node-ca-zbkhx" Jul 02 14:01:11.262503 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.262483 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7m82\" (UniqueName: \"kubernetes.io/projected/070f7754-21fb-458f-b47c-a5d2820ad39d-kube-api-access-m7m82\") pod \"node-resolver-lg74z\" (UID: \"070f7754-21fb-458f-b47c-a5d2820ad39d\") " pod="openshift-dns/node-resolver-lg74z" Jul 02 14:01:11.262921 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.262904 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vc96c\" (UniqueName: \"kubernetes.io/projected/fac6f456-02a4-4216-a9ae-7ba6ba7a73b4-kube-api-access-vc96c\") pod \"network-metrics-daemon-tz5k9\" (UID: \"fac6f456-02a4-4216-a9ae-7ba6ba7a73b4\") " pod="openshift-multus/network-metrics-daemon-tz5k9" Jul 02 14:01:11.263228 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.263211 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkd4f\" (UniqueName: \"kubernetes.io/projected/cfbb6333-3d89-4a46-9c46-cd02efede2e8-kube-api-access-tkd4f\") pod \"multus-8l6bt\" (UID: \"cfbb6333-3d89-4a46-9c46-cd02efede2e8\") " pod="openshift-multus/multus-8l6bt" Jul 02 14:01:11.263284 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.263210 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggsf4\" (UniqueName: \"kubernetes.io/projected/8be1e9f8-324d-4352-83b0-7e22f0e0bfa3-kube-api-access-ggsf4\") pod \"aws-ebs-csi-driver-node-bnxgt\" (UID: \"8be1e9f8-324d-4352-83b0-7e22f0e0bfa3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnxgt" Jul 02 14:01:11.263554 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.263538 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hpxx\" (UniqueName: \"kubernetes.io/projected/b9aba121-950c-4aab-bc81-d6efedf5bfbd-kube-api-access-6hpxx\") pod \"multus-additional-cni-plugins-68vbd\" (UID: \"b9aba121-950c-4aab-bc81-d6efedf5bfbd\") " pod="openshift-multus/multus-additional-cni-plugins-68vbd" Jul 02 14:01:11.345776 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.345747 2553 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 14:01:11.355785 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.355753 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f7f2c7f4-5c54-434e-b13c-a12bf418b343-etc-kubernetes\") pod \"tuned-6czcv\" (UID: \"f7f2c7f4-5c54-434e-b13c-a12bf418b343\") " pod="openshift-cluster-node-tuning-operator/tuned-6czcv" Jul 02 14:01:11.355900 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.355794 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e558c7dc-3cca-412b-b6a2-cd48bd9b430f-dbus\") pod \"global-pull-secret-syncer-xvgpg\" (UID: \"e558c7dc-3cca-412b-b6a2-cd48bd9b430f\") " pod="kube-system/global-pull-secret-syncer-xvgpg" Jul 02 14:01:11.355900 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.355819 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f7f2c7f4-5c54-434e-b13c-a12bf418b343-host\") pod \"tuned-6czcv\" (UID: \"f7f2c7f4-5c54-434e-b13c-a12bf418b343\") " pod="openshift-cluster-node-tuning-operator/tuned-6czcv" Jul 02 14:01:11.355900 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.355846 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnldh\" (UniqueName: \"kubernetes.io/projected/b6b9b623-5017-4948-857b-38b591d84b8a-kube-api-access-vnldh\") pod \"iptables-alerter-7xkn2\" (UID: \"b6b9b623-5017-4948-857b-38b591d84b8a\") " pod="openshift-network-operator/iptables-alerter-7xkn2" Jul 02 14:01:11.355900 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.355872 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b6b9b623-5017-4948-857b-38b591d84b8a-iptables-alerter-script\") pod \"iptables-alerter-7xkn2\" (UID: \"b6b9b623-5017-4948-857b-38b591d84b8a\") " pod="openshift-network-operator/iptables-alerter-7xkn2" Jul 02 14:01:11.355900 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.355874 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f7f2c7f4-5c54-434e-b13c-a12bf418b343-etc-kubernetes\") pod \"tuned-6czcv\" (UID: \"f7f2c7f4-5c54-434e-b13c-a12bf418b343\") " pod="openshift-cluster-node-tuning-operator/tuned-6czcv" Jul 02 14:01:11.356145 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.355900 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e558c7dc-3cca-412b-b6a2-cd48bd9b430f-dbus\") pod \"global-pull-secret-syncer-xvgpg\" (UID: \"e558c7dc-3cca-412b-b6a2-cd48bd9b430f\") " pod="kube-system/global-pull-secret-syncer-xvgpg" Jul 02 14:01:11.356145 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.355934 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f7f2c7f4-5c54-434e-b13c-a12bf418b343-host\") pod \"tuned-6czcv\" (UID: \"f7f2c7f4-5c54-434e-b13c-a12bf418b343\") " pod="openshift-cluster-node-tuning-operator/tuned-6czcv" Jul 02 14:01:11.356145 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.355998 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e558c7dc-3cca-412b-b6a2-cd48bd9b430f-kubelet-config\") pod \"global-pull-secret-syncer-xvgpg\" (UID: \"e558c7dc-3cca-412b-b6a2-cd48bd9b430f\") " pod="kube-system/global-pull-secret-syncer-xvgpg" Jul 02 14:01:11.356145 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.356035 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f7f2c7f4-5c54-434e-b13c-a12bf418b343-etc-modprobe-d\") pod \"tuned-6czcv\" (UID: \"f7f2c7f4-5c54-434e-b13c-a12bf418b343\") " pod="openshift-cluster-node-tuning-operator/tuned-6czcv" Jul 02 14:01:11.356145 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.356047 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e558c7dc-3cca-412b-b6a2-cd48bd9b430f-kubelet-config\") pod \"global-pull-secret-syncer-xvgpg\" (UID: \"e558c7dc-3cca-412b-b6a2-cd48bd9b430f\") " pod="kube-system/global-pull-secret-syncer-xvgpg" Jul 02 14:01:11.356145 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.356064 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f7f2c7f4-5c54-434e-b13c-a12bf418b343-etc-sysconfig\") pod \"tuned-6czcv\" (UID: \"f7f2c7f4-5c54-434e-b13c-a12bf418b343\") " pod="openshift-cluster-node-tuning-operator/tuned-6czcv" Jul 02 14:01:11.356145 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.356095 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f7f2c7f4-5c54-434e-b13c-a12bf418b343-lib-modules\") pod \"tuned-6czcv\" (UID: \"f7f2c7f4-5c54-434e-b13c-a12bf418b343\") " pod="openshift-cluster-node-tuning-operator/tuned-6czcv" Jul 02 14:01:11.356145 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.356118 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f7f2c7f4-5c54-434e-b13c-a12bf418b343-run\") pod \"tuned-6czcv\" (UID: \"f7f2c7f4-5c54-434e-b13c-a12bf418b343\") " pod="openshift-cluster-node-tuning-operator/tuned-6czcv" Jul 02 14:01:11.356145 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.356133 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f7f2c7f4-5c54-434e-b13c-a12bf418b343-etc-sysconfig\") pod \"tuned-6czcv\" (UID: \"f7f2c7f4-5c54-434e-b13c-a12bf418b343\") " pod="openshift-cluster-node-tuning-operator/tuned-6czcv" Jul 02 14:01:11.356518 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.356140 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f7f2c7f4-5c54-434e-b13c-a12bf418b343-etc-tuned\") pod \"tuned-6czcv\" (UID: \"f7f2c7f4-5c54-434e-b13c-a12bf418b343\") " pod="openshift-cluster-node-tuning-operator/tuned-6czcv" Jul 02 14:01:11.356518 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.356162 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f7f2c7f4-5c54-434e-b13c-a12bf418b343-etc-modprobe-d\") pod \"tuned-6czcv\" (UID: \"f7f2c7f4-5c54-434e-b13c-a12bf418b343\") " pod="openshift-cluster-node-tuning-operator/tuned-6czcv" Jul 02 14:01:11.356518 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.356184 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f7f2c7f4-5c54-434e-b13c-a12bf418b343-etc-systemd\") pod \"tuned-6czcv\" (UID: \"f7f2c7f4-5c54-434e-b13c-a12bf418b343\") " pod="openshift-cluster-node-tuning-operator/tuned-6czcv" Jul 02 14:01:11.356518 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.356215 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f7f2c7f4-5c54-434e-b13c-a12bf418b343-etc-sysctl-d\") pod \"tuned-6czcv\" (UID: \"f7f2c7f4-5c54-434e-b13c-a12bf418b343\") " pod="openshift-cluster-node-tuning-operator/tuned-6czcv" Jul 02 14:01:11.356518 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.356246 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jn4mx\" (UniqueName: \"kubernetes.io/projected/f7f2c7f4-5c54-434e-b13c-a12bf418b343-kube-api-access-jn4mx\") pod \"tuned-6czcv\" (UID: \"f7f2c7f4-5c54-434e-b13c-a12bf418b343\") " pod="openshift-cluster-node-tuning-operator/tuned-6czcv" Jul 02 14:01:11.356518 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.356261 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f7f2c7f4-5c54-434e-b13c-a12bf418b343-lib-modules\") pod \"tuned-6czcv\" (UID: \"f7f2c7f4-5c54-434e-b13c-a12bf418b343\") " pod="openshift-cluster-node-tuning-operator/tuned-6czcv" Jul 02 14:01:11.356518 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.356287 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f7f2c7f4-5c54-434e-b13c-a12bf418b343-etc-sysctl-conf\") pod \"tuned-6czcv\" (UID: \"f7f2c7f4-5c54-434e-b13c-a12bf418b343\") " pod="openshift-cluster-node-tuning-operator/tuned-6czcv" Jul 02 14:01:11.356518 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.356308 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f7f2c7f4-5c54-434e-b13c-a12bf418b343-etc-systemd\") pod \"tuned-6czcv\" (UID: \"f7f2c7f4-5c54-434e-b13c-a12bf418b343\") " pod="openshift-cluster-node-tuning-operator/tuned-6czcv" Jul 02 14:01:11.356518 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.356310 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e558c7dc-3cca-412b-b6a2-cd48bd9b430f-original-pull-secret\") pod \"global-pull-secret-syncer-xvgpg\" (UID: \"e558c7dc-3cca-412b-b6a2-cd48bd9b430f\") " pod="kube-system/global-pull-secret-syncer-xvgpg" Jul 02 14:01:11.356518 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.356368 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f7f2c7f4-5c54-434e-b13c-a12bf418b343-sys\") pod \"tuned-6czcv\" (UID: \"f7f2c7f4-5c54-434e-b13c-a12bf418b343\") " pod="openshift-cluster-node-tuning-operator/tuned-6czcv" Jul 02 14:01:11.356518 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.356393 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f7f2c7f4-5c54-434e-b13c-a12bf418b343-var-lib-kubelet\") pod \"tuned-6czcv\" (UID: \"f7f2c7f4-5c54-434e-b13c-a12bf418b343\") " pod="openshift-cluster-node-tuning-operator/tuned-6czcv" Jul 02 14:01:11.356518 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.356416 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b6b9b623-5017-4948-857b-38b591d84b8a-host-slash\") pod \"iptables-alerter-7xkn2\" (UID: \"b6b9b623-5017-4948-857b-38b591d84b8a\") " pod="openshift-network-operator/iptables-alerter-7xkn2" Jul 02 14:01:11.356518 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.356439 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f7f2c7f4-5c54-434e-b13c-a12bf418b343-tmp\") pod \"tuned-6czcv\" (UID: \"f7f2c7f4-5c54-434e-b13c-a12bf418b343\") " pod="openshift-cluster-node-tuning-operator/tuned-6czcv" Jul 02 14:01:11.356518 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.356451 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f7f2c7f4-5c54-434e-b13c-a12bf418b343-etc-sysctl-conf\") pod \"tuned-6czcv\" (UID: \"f7f2c7f4-5c54-434e-b13c-a12bf418b343\") " pod="openshift-cluster-node-tuning-operator/tuned-6czcv" Jul 02 14:01:11.356518 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.356460 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b6b9b623-5017-4948-857b-38b591d84b8a-iptables-alerter-script\") pod \"iptables-alerter-7xkn2\" (UID: \"b6b9b623-5017-4948-857b-38b591d84b8a\") " pod="openshift-network-operator/iptables-alerter-7xkn2" Jul 02 14:01:11.356518 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.356517 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f7f2c7f4-5c54-434e-b13c-a12bf418b343-sys\") pod \"tuned-6czcv\" (UID: \"f7f2c7f4-5c54-434e-b13c-a12bf418b343\") " pod="openshift-cluster-node-tuning-operator/tuned-6czcv" Jul 02 14:01:11.356518 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.356520 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f7f2c7f4-5c54-434e-b13c-a12bf418b343-var-lib-kubelet\") pod \"tuned-6czcv\" (UID: \"f7f2c7f4-5c54-434e-b13c-a12bf418b343\") " pod="openshift-cluster-node-tuning-operator/tuned-6czcv" Jul 02 14:01:11.356518 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:11.356525 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 14:01:11.357264 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.356368 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f7f2c7f4-5c54-434e-b13c-a12bf418b343-run\") pod \"tuned-6czcv\" (UID: \"f7f2c7f4-5c54-434e-b13c-a12bf418b343\") " pod="openshift-cluster-node-tuning-operator/tuned-6czcv" Jul 02 14:01:11.357264 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:11.356587 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e558c7dc-3cca-412b-b6a2-cd48bd9b430f-original-pull-secret podName:e558c7dc-3cca-412b-b6a2-cd48bd9b430f nodeName:}" failed. No retries permitted until 2026-07-02 14:01:11.856571351 +0000 UTC m=+3.064814133 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e558c7dc-3cca-412b-b6a2-cd48bd9b430f-original-pull-secret") pod "global-pull-secret-syncer-xvgpg" (UID: "e558c7dc-3cca-412b-b6a2-cd48bd9b430f") : object "kube-system"/"original-pull-secret" not registered Jul 02 14:01:11.357264 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.356591 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b6b9b623-5017-4948-857b-38b591d84b8a-host-slash\") pod \"iptables-alerter-7xkn2\" (UID: \"b6b9b623-5017-4948-857b-38b591d84b8a\") " pod="openshift-network-operator/iptables-alerter-7xkn2" Jul 02 14:01:11.357264 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.356632 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f7f2c7f4-5c54-434e-b13c-a12bf418b343-etc-sysctl-d\") pod \"tuned-6czcv\" (UID: \"f7f2c7f4-5c54-434e-b13c-a12bf418b343\") " pod="openshift-cluster-node-tuning-operator/tuned-6czcv" Jul 02 14:01:11.358648 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.358621 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f7f2c7f4-5c54-434e-b13c-a12bf418b343-tmp\") pod \"tuned-6czcv\" (UID: \"f7f2c7f4-5c54-434e-b13c-a12bf418b343\") " pod="openshift-cluster-node-tuning-operator/tuned-6czcv" Jul 02 14:01:11.358743 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.358666 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f7f2c7f4-5c54-434e-b13c-a12bf418b343-etc-tuned\") pod \"tuned-6czcv\" (UID: \"f7f2c7f4-5c54-434e-b13c-a12bf418b343\") " pod="openshift-cluster-node-tuning-operator/tuned-6czcv" Jul 02 14:01:11.364527 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.364507 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jn4mx\" (UniqueName: \"kubernetes.io/projected/f7f2c7f4-5c54-434e-b13c-a12bf418b343-kube-api-access-jn4mx\") pod \"tuned-6czcv\" (UID: \"f7f2c7f4-5c54-434e-b13c-a12bf418b343\") " pod="openshift-cluster-node-tuning-operator/tuned-6czcv" Jul 02 14:01:11.364623 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.364506 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnldh\" (UniqueName: \"kubernetes.io/projected/b6b9b623-5017-4948-857b-38b591d84b8a-kube-api-access-vnldh\") pod \"iptables-alerter-7xkn2\" (UID: \"b6b9b623-5017-4948-857b-38b591d84b8a\") " pod="openshift-network-operator/iptables-alerter-7xkn2" Jul 02 14:01:11.438675 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.438590 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lg74z" Jul 02 14:01:11.444556 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.444536 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:01:11.449344 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:11.449315 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod070f7754_21fb_458f_b47c_a5d2820ad39d.slice/crio-214fd58893d92583a1a4e9fd0a6ddbd84fcb47aecf532add69c385ec2d39b8a1 WatchSource:0}: Error finding container 214fd58893d92583a1a4e9fd0a6ddbd84fcb47aecf532add69c385ec2d39b8a1: Status 404 returned error can't find the container with id 214fd58893d92583a1a4e9fd0a6ddbd84fcb47aecf532add69c385ec2d39b8a1 Jul 02 14:01:11.453757 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:11.453732 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca0f7ed3_f75b_4edb_86c2_afa842962cf5.slice/crio-afef6ef66d8c491999f63442df8c78b7cb658c812366a98081a81a64ca9f8ba1 WatchSource:0}: Error finding container afef6ef66d8c491999f63442df8c78b7cb658c812366a98081a81a64ca9f8ba1: Status 404 returned error can't find the container with id afef6ef66d8c491999f63442df8c78b7cb658c812366a98081a81a64ca9f8ba1 Jul 02 14:01:11.454871 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.454850 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnxgt" Jul 02 14:01:11.457224 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.457048 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-68vbd" Jul 02 14:01:11.462061 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.462038 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7nn4r" Jul 02 14:01:11.466040 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:11.466013 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8be1e9f8_324d_4352_83b0_7e22f0e0bfa3.slice/crio-5f98e951e19155a9dcd46db818e49bbc26bcd8186c90c4dcb03008cc70bd124e WatchSource:0}: Error finding container 5f98e951e19155a9dcd46db818e49bbc26bcd8186c90c4dcb03008cc70bd124e: Status 404 returned error can't find the container with id 5f98e951e19155a9dcd46db818e49bbc26bcd8186c90c4dcb03008cc70bd124e Jul 02 14:01:11.468543 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.468525 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8l6bt" Jul 02 14:01:11.469005 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:11.468969 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9aba121_950c_4aab_bc81_d6efedf5bfbd.slice/crio-c2774ec9eada6d5b0f44fe5f1544a7ebb920021df2ab35dfc233ca6f5cf51574 WatchSource:0}: Error finding container c2774ec9eada6d5b0f44fe5f1544a7ebb920021df2ab35dfc233ca6f5cf51574: Status 404 returned error can't find the container with id c2774ec9eada6d5b0f44fe5f1544a7ebb920021df2ab35dfc233ca6f5cf51574 Jul 02 14:01:11.475623 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.475601 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zbkhx" Jul 02 14:01:11.476878 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:11.476848 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef367a3a_b360_4b9a_b66c_c4b8b128d70f.slice/crio-bf46ec3abe9fc81ef5f130a0db9e9c18dd71320fe837d128e9225a6c4c3ad91a WatchSource:0}: Error finding container bf46ec3abe9fc81ef5f130a0db9e9c18dd71320fe837d128e9225a6c4c3ad91a: Status 404 returned error can't find the container with id bf46ec3abe9fc81ef5f130a0db9e9c18dd71320fe837d128e9225a6c4c3ad91a Jul 02 14:01:11.480483 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:11.480460 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfbb6333_3d89_4a46_9c46_cd02efede2e8.slice/crio-622264a0ad7f0acda5e9cc70a8d8c9b2b13e3bd1a4f9f5a456793e570ecef979 WatchSource:0}: Error finding container 622264a0ad7f0acda5e9cc70a8d8c9b2b13e3bd1a4f9f5a456793e570ecef979: Status 404 returned error can't find the container with id 622264a0ad7f0acda5e9cc70a8d8c9b2b13e3bd1a4f9f5a456793e570ecef979 Jul 02 14:01:11.482828 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.482806 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7xkn2" Jul 02 14:01:11.486712 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:11.486689 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod253a79fe_da31_4f39_8017_9b6528e9e4df.slice/crio-b41f967438b7b574418aa7bc4ddbde4f247579081b601a297a732ac6ba1d42d1 WatchSource:0}: Error finding container b41f967438b7b574418aa7bc4ddbde4f247579081b601a297a732ac6ba1d42d1: Status 404 returned error can't find the container with id b41f967438b7b574418aa7bc4ddbde4f247579081b601a297a732ac6ba1d42d1 Jul 02 14:01:11.488162 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.488081 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6czcv" Jul 02 14:01:11.492217 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:11.492194 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6b9b623_5017_4948_857b_38b591d84b8a.slice/crio-fe062cfe7d540fd886e37daf486e8482fe5bf7886ea3b304a8812c96e02f6a94 WatchSource:0}: Error finding container fe062cfe7d540fd886e37daf486e8482fe5bf7886ea3b304a8812c96e02f6a94: Status 404 returned error can't find the container with id fe062cfe7d540fd886e37daf486e8482fe5bf7886ea3b304a8812c96e02f6a94 Jul 02 14:01:11.497493 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:11.497469 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7f2c7f4_5c54_434e_b13c_a12bf418b343.slice/crio-739f0c3c54b7e97200d8855ff828e1d49f2f17c32b46ef37ef98b21081d36afb WatchSource:0}: Error finding container 739f0c3c54b7e97200d8855ff828e1d49f2f17c32b46ef37ef98b21081d36afb: Status 404 returned error can't find the container with id 739f0c3c54b7e97200d8855ff828e1d49f2f17c32b46ef37ef98b21081d36afb Jul 02 14:01:11.659134 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.659109 2553 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 14:01:11.759023 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.758940 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fac6f456-02a4-4216-a9ae-7ba6ba7a73b4-metrics-certs\") pod \"network-metrics-daemon-tz5k9\" (UID: \"fac6f456-02a4-4216-a9ae-7ba6ba7a73b4\") " pod="openshift-multus/network-metrics-daemon-tz5k9" Jul 02 14:01:11.759161 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:11.759100 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:01:11.759215 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:11.759166 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fac6f456-02a4-4216-a9ae-7ba6ba7a73b4-metrics-certs podName:fac6f456-02a4-4216-a9ae-7ba6ba7a73b4 nodeName:}" failed. No retries permitted until 2026-07-02 14:01:12.759151637 +0000 UTC m=+3.967394402 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fac6f456-02a4-4216-a9ae-7ba6ba7a73b4-metrics-certs") pod "network-metrics-daemon-tz5k9" (UID: "fac6f456-02a4-4216-a9ae-7ba6ba7a73b4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:01:11.859462 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.859432 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e558c7dc-3cca-412b-b6a2-cd48bd9b430f-original-pull-secret\") pod \"global-pull-secret-syncer-xvgpg\" (UID: \"e558c7dc-3cca-412b-b6a2-cd48bd9b430f\") " pod="kube-system/global-pull-secret-syncer-xvgpg" Jul 02 14:01:11.859462 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:11.859466 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ch9pc\" (UniqueName: \"kubernetes.io/projected/c02181c0-cedc-4f2e-8786-c242fadd4eea-kube-api-access-ch9pc\") pod \"network-check-target-vfrjc\" (UID: \"c02181c0-cedc-4f2e-8786-c242fadd4eea\") " pod="openshift-network-diagnostics/network-check-target-vfrjc" Jul 02 14:01:11.859638 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:11.859567 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 14:01:11.859638 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:11.859580 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 14:01:11.859638 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:11.859596 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 14:01:11.859638 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:11.859605 2553 projected.go:196] Error preparing data for projected volume kube-api-access-ch9pc for pod openshift-network-diagnostics/network-check-target-vfrjc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:01:11.859638 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:11.859628 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e558c7dc-3cca-412b-b6a2-cd48bd9b430f-original-pull-secret podName:e558c7dc-3cca-412b-b6a2-cd48bd9b430f nodeName:}" failed. No retries permitted until 2026-07-02 14:01:12.859613807 +0000 UTC m=+4.067856568 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e558c7dc-3cca-412b-b6a2-cd48bd9b430f-original-pull-secret") pod "global-pull-secret-syncer-xvgpg" (UID: "e558c7dc-3cca-412b-b6a2-cd48bd9b430f") : object "kube-system"/"original-pull-secret" not registered Jul 02 14:01:11.859638 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:11.859642 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c02181c0-cedc-4f2e-8786-c242fadd4eea-kube-api-access-ch9pc podName:c02181c0-cedc-4f2e-8786-c242fadd4eea nodeName:}" failed. No retries permitted until 2026-07-02 14:01:12.859635485 +0000 UTC m=+4.067878245 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ch9pc" (UniqueName: "kubernetes.io/projected/c02181c0-cedc-4f2e-8786-c242fadd4eea-kube-api-access-ch9pc") pod "network-check-target-vfrjc" (UID: "c02181c0-cedc-4f2e-8786-c242fadd4eea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:01:12.182651 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:12.182556 2553 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 13:56:11 +0000 UTC" deadline="2028-02-23 08:17:48.535447581 +0000 UTC" Jul 02 14:01:12.182651 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:12.182594 2553 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14418h16m36.35285764s" Jul 02 14:01:12.214865 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:12.214760 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6czcv" event={"ID":"f7f2c7f4-5c54-434e-b13c-a12bf418b343","Type":"ContainerStarted","Data":"739f0c3c54b7e97200d8855ff828e1d49f2f17c32b46ef37ef98b21081d36afb"} Jul 02 14:01:12.217185 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:12.217074 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zbkhx" event={"ID":"253a79fe-da31-4f39-8017-9b6528e9e4df","Type":"ContainerStarted","Data":"b41f967438b7b574418aa7bc4ddbde4f247579081b601a297a732ac6ba1d42d1"} Jul 02 14:01:12.219731 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:12.219375 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8l6bt" event={"ID":"cfbb6333-3d89-4a46-9c46-cd02efede2e8","Type":"ContainerStarted","Data":"622264a0ad7f0acda5e9cc70a8d8c9b2b13e3bd1a4f9f5a456793e570ecef979"} Jul 02 14:01:12.221687 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:12.221621 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7nn4r" event={"ID":"ef367a3a-b360-4b9a-b66c-c4b8b128d70f","Type":"ContainerStarted","Data":"bf46ec3abe9fc81ef5f130a0db9e9c18dd71320fe837d128e9225a6c4c3ad91a"} Jul 02 14:01:12.224292 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:12.224231 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-68vbd" event={"ID":"b9aba121-950c-4aab-bc81-d6efedf5bfbd","Type":"ContainerStarted","Data":"c2774ec9eada6d5b0f44fe5f1544a7ebb920021df2ab35dfc233ca6f5cf51574"} Jul 02 14:01:12.232384 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:12.232360 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnxgt" event={"ID":"8be1e9f8-324d-4352-83b0-7e22f0e0bfa3","Type":"ContainerStarted","Data":"5f98e951e19155a9dcd46db818e49bbc26bcd8186c90c4dcb03008cc70bd124e"} Jul 02 14:01:12.235603 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:12.235581 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7r445" event={"ID":"ca0f7ed3-f75b-4edb-86c2-afa842962cf5","Type":"ContainerStarted","Data":"afef6ef66d8c491999f63442df8c78b7cb658c812366a98081a81a64ca9f8ba1"} Jul 02 14:01:12.239318 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:12.239260 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lg74z" event={"ID":"070f7754-21fb-458f-b47c-a5d2820ad39d","Type":"ContainerStarted","Data":"214fd58893d92583a1a4e9fd0a6ddbd84fcb47aecf532add69c385ec2d39b8a1"} Jul 02 14:01:12.244733 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:12.244675 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7xkn2" event={"ID":"b6b9b623-5017-4948-857b-38b591d84b8a","Type":"ContainerStarted","Data":"fe062cfe7d540fd886e37daf486e8482fe5bf7886ea3b304a8812c96e02f6a94"} Jul 02 14:01:12.769828 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:12.769549 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fac6f456-02a4-4216-a9ae-7ba6ba7a73b4-metrics-certs\") pod \"network-metrics-daemon-tz5k9\" (UID: \"fac6f456-02a4-4216-a9ae-7ba6ba7a73b4\") " pod="openshift-multus/network-metrics-daemon-tz5k9" Jul 02 14:01:12.770005 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:12.769794 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:01:12.770098 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:12.770076 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fac6f456-02a4-4216-a9ae-7ba6ba7a73b4-metrics-certs podName:fac6f456-02a4-4216-a9ae-7ba6ba7a73b4 nodeName:}" failed. No retries permitted until 2026-07-02 14:01:14.770052195 +0000 UTC m=+5.978294960 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fac6f456-02a4-4216-a9ae-7ba6ba7a73b4-metrics-certs") pod "network-metrics-daemon-tz5k9" (UID: "fac6f456-02a4-4216-a9ae-7ba6ba7a73b4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:01:12.871122 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:12.871081 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e558c7dc-3cca-412b-b6a2-cd48bd9b430f-original-pull-secret\") pod \"global-pull-secret-syncer-xvgpg\" (UID: \"e558c7dc-3cca-412b-b6a2-cd48bd9b430f\") " pod="kube-system/global-pull-secret-syncer-xvgpg" Jul 02 14:01:12.871122 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:12.871134 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ch9pc\" (UniqueName: \"kubernetes.io/projected/c02181c0-cedc-4f2e-8786-c242fadd4eea-kube-api-access-ch9pc\") pod \"network-check-target-vfrjc\" (UID: \"c02181c0-cedc-4f2e-8786-c242fadd4eea\") " pod="openshift-network-diagnostics/network-check-target-vfrjc" Jul 02 14:01:12.871381 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:12.871287 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 14:01:12.871381 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:12.871304 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 14:01:12.871381 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:12.871322 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 14:01:12.871381 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:12.871335 2553 projected.go:196] Error preparing data for projected volume kube-api-access-ch9pc for pod openshift-network-diagnostics/network-check-target-vfrjc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:01:12.871381 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:12.871366 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e558c7dc-3cca-412b-b6a2-cd48bd9b430f-original-pull-secret podName:e558c7dc-3cca-412b-b6a2-cd48bd9b430f nodeName:}" failed. No retries permitted until 2026-07-02 14:01:14.871346106 +0000 UTC m=+6.079588883 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e558c7dc-3cca-412b-b6a2-cd48bd9b430f-original-pull-secret") pod "global-pull-secret-syncer-xvgpg" (UID: "e558c7dc-3cca-412b-b6a2-cd48bd9b430f") : object "kube-system"/"original-pull-secret" not registered Jul 02 14:01:12.871683 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:12.871387 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c02181c0-cedc-4f2e-8786-c242fadd4eea-kube-api-access-ch9pc podName:c02181c0-cedc-4f2e-8786-c242fadd4eea nodeName:}" failed. No retries permitted until 2026-07-02 14:01:14.871376904 +0000 UTC m=+6.079619666 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ch9pc" (UniqueName: "kubernetes.io/projected/c02181c0-cedc-4f2e-8786-c242fadd4eea-kube-api-access-ch9pc") pod "network-check-target-vfrjc" (UID: "c02181c0-cedc-4f2e-8786-c242fadd4eea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:01:13.183738 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:13.183672 2553 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 13:56:11 +0000 UTC" deadline="2028-02-06 22:52:54.105618736 +0000 UTC" Jul 02 14:01:13.183738 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:13.183735 2553 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14024h51m40.921887435s" Jul 02 14:01:13.204707 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:13.204679 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvgpg" Jul 02 14:01:13.204900 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:13.204807 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vfrjc" Jul 02 14:01:13.204900 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:13.204809 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvgpg" podUID="e558c7dc-3cca-412b-b6a2-cd48bd9b430f" Jul 02 14:01:13.204900 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:13.204885 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vfrjc" podUID="c02181c0-cedc-4f2e-8786-c242fadd4eea" Jul 02 14:01:13.205166 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:13.204945 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tz5k9" Jul 02 14:01:13.205166 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:13.205043 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tz5k9" podUID="fac6f456-02a4-4216-a9ae-7ba6ba7a73b4" Jul 02 14:01:13.263147 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:13.263108 2553 generic.go:356] "Generic (PLEG): container finished" podID="469f128e84139c59dc87d077aeeac40f" containerID="2aa4abd0a4c0485840779bc7e6959c139d72ad0b2d909e01ed16258b580cdfa4" exitCode=0 Jul 02 14:01:13.263327 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:13.263157 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-57.ec2.internal" event={"ID":"469f128e84139c59dc87d077aeeac40f","Type":"ContainerDied","Data":"2aa4abd0a4c0485840779bc7e6959c139d72ad0b2d909e01ed16258b580cdfa4"} Jul 02 14:01:14.787227 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:14.787188 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fac6f456-02a4-4216-a9ae-7ba6ba7a73b4-metrics-certs\") pod \"network-metrics-daemon-tz5k9\" (UID: \"fac6f456-02a4-4216-a9ae-7ba6ba7a73b4\") " pod="openshift-multus/network-metrics-daemon-tz5k9" Jul 02 14:01:14.787704 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:14.787388 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:01:14.787704 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:14.787453 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fac6f456-02a4-4216-a9ae-7ba6ba7a73b4-metrics-certs podName:fac6f456-02a4-4216-a9ae-7ba6ba7a73b4 nodeName:}" failed. No retries permitted until 2026-07-02 14:01:18.787433339 +0000 UTC m=+9.995676112 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fac6f456-02a4-4216-a9ae-7ba6ba7a73b4-metrics-certs") pod "network-metrics-daemon-tz5k9" (UID: "fac6f456-02a4-4216-a9ae-7ba6ba7a73b4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:01:14.889073 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:14.888236 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e558c7dc-3cca-412b-b6a2-cd48bd9b430f-original-pull-secret\") pod \"global-pull-secret-syncer-xvgpg\" (UID: \"e558c7dc-3cca-412b-b6a2-cd48bd9b430f\") " pod="kube-system/global-pull-secret-syncer-xvgpg" Jul 02 14:01:14.889073 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:14.888285 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ch9pc\" (UniqueName: \"kubernetes.io/projected/c02181c0-cedc-4f2e-8786-c242fadd4eea-kube-api-access-ch9pc\") pod \"network-check-target-vfrjc\" (UID: \"c02181c0-cedc-4f2e-8786-c242fadd4eea\") " pod="openshift-network-diagnostics/network-check-target-vfrjc" Jul 02 14:01:14.889073 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:14.888443 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 14:01:14.889073 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:14.888461 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 14:01:14.889073 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:14.888474 2553 projected.go:196] Error preparing data for projected volume kube-api-access-ch9pc for pod openshift-network-diagnostics/network-check-target-vfrjc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:01:14.889073 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:14.888531 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c02181c0-cedc-4f2e-8786-c242fadd4eea-kube-api-access-ch9pc podName:c02181c0-cedc-4f2e-8786-c242fadd4eea nodeName:}" failed. No retries permitted until 2026-07-02 14:01:18.888513675 +0000 UTC m=+10.096756440 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ch9pc" (UniqueName: "kubernetes.io/projected/c02181c0-cedc-4f2e-8786-c242fadd4eea-kube-api-access-ch9pc") pod "network-check-target-vfrjc" (UID: "c02181c0-cedc-4f2e-8786-c242fadd4eea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:01:14.889073 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:14.888947 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 14:01:14.889073 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:14.889019 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e558c7dc-3cca-412b-b6a2-cd48bd9b430f-original-pull-secret podName:e558c7dc-3cca-412b-b6a2-cd48bd9b430f nodeName:}" failed. No retries permitted until 2026-07-02 14:01:18.88900107 +0000 UTC m=+10.097243845 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e558c7dc-3cca-412b-b6a2-cd48bd9b430f-original-pull-secret") pod "global-pull-secret-syncer-xvgpg" (UID: "e558c7dc-3cca-412b-b6a2-cd48bd9b430f") : object "kube-system"/"original-pull-secret" not registered Jul 02 14:01:15.201565 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:15.201477 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvgpg" Jul 02 14:01:15.201565 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:15.201477 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vfrjc" Jul 02 14:01:15.201787 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:15.201619 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvgpg" podUID="e558c7dc-3cca-412b-b6a2-cd48bd9b430f" Jul 02 14:01:15.201787 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:15.201671 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vfrjc" podUID="c02181c0-cedc-4f2e-8786-c242fadd4eea" Jul 02 14:01:15.201787 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:15.201716 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tz5k9" Jul 02 14:01:15.201953 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:15.201803 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tz5k9" podUID="fac6f456-02a4-4216-a9ae-7ba6ba7a73b4" Jul 02 14:01:17.201529 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:17.201440 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvgpg" Jul 02 14:01:17.201529 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:17.201466 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tz5k9" Jul 02 14:01:17.201529 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:17.201466 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vfrjc" Jul 02 14:01:17.202064 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:17.201557 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvgpg" podUID="e558c7dc-3cca-412b-b6a2-cd48bd9b430f" Jul 02 14:01:17.202064 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:17.201678 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tz5k9" podUID="fac6f456-02a4-4216-a9ae-7ba6ba7a73b4" Jul 02 14:01:17.202064 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:17.201800 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vfrjc" podUID="c02181c0-cedc-4f2e-8786-c242fadd4eea" Jul 02 14:01:18.819761 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:18.819649 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fac6f456-02a4-4216-a9ae-7ba6ba7a73b4-metrics-certs\") pod \"network-metrics-daemon-tz5k9\" (UID: \"fac6f456-02a4-4216-a9ae-7ba6ba7a73b4\") " pod="openshift-multus/network-metrics-daemon-tz5k9" Jul 02 14:01:18.820260 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:18.819840 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:01:18.820260 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:18.819918 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fac6f456-02a4-4216-a9ae-7ba6ba7a73b4-metrics-certs podName:fac6f456-02a4-4216-a9ae-7ba6ba7a73b4 nodeName:}" failed. No retries permitted until 2026-07-02 14:01:26.819895255 +0000 UTC m=+18.028138032 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fac6f456-02a4-4216-a9ae-7ba6ba7a73b4-metrics-certs") pod "network-metrics-daemon-tz5k9" (UID: "fac6f456-02a4-4216-a9ae-7ba6ba7a73b4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:01:18.920836 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:18.920737 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e558c7dc-3cca-412b-b6a2-cd48bd9b430f-original-pull-secret\") pod \"global-pull-secret-syncer-xvgpg\" (UID: \"e558c7dc-3cca-412b-b6a2-cd48bd9b430f\") " pod="kube-system/global-pull-secret-syncer-xvgpg" Jul 02 14:01:18.920836 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:18.920786 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ch9pc\" (UniqueName: \"kubernetes.io/projected/c02181c0-cedc-4f2e-8786-c242fadd4eea-kube-api-access-ch9pc\") pod \"network-check-target-vfrjc\" (UID: \"c02181c0-cedc-4f2e-8786-c242fadd4eea\") " pod="openshift-network-diagnostics/network-check-target-vfrjc" Jul 02 14:01:18.921093 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:18.920884 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 14:01:18.921093 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:18.920910 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 14:01:18.921093 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:18.920925 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 14:01:18.921093 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:18.920937 2553 projected.go:196] Error preparing data for projected volume kube-api-access-ch9pc for pod openshift-network-diagnostics/network-check-target-vfrjc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:01:18.921093 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:18.920949 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e558c7dc-3cca-412b-b6a2-cd48bd9b430f-original-pull-secret podName:e558c7dc-3cca-412b-b6a2-cd48bd9b430f nodeName:}" failed. No retries permitted until 2026-07-02 14:01:26.920931746 +0000 UTC m=+18.129174522 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e558c7dc-3cca-412b-b6a2-cd48bd9b430f-original-pull-secret") pod "global-pull-secret-syncer-xvgpg" (UID: "e558c7dc-3cca-412b-b6a2-cd48bd9b430f") : object "kube-system"/"original-pull-secret" not registered Jul 02 14:01:18.921093 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:18.920969 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c02181c0-cedc-4f2e-8786-c242fadd4eea-kube-api-access-ch9pc podName:c02181c0-cedc-4f2e-8786-c242fadd4eea nodeName:}" failed. No retries permitted until 2026-07-02 14:01:26.920959439 +0000 UTC m=+18.129202201 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ch9pc" (UniqueName: "kubernetes.io/projected/c02181c0-cedc-4f2e-8786-c242fadd4eea-kube-api-access-ch9pc") pod "network-check-target-vfrjc" (UID: "c02181c0-cedc-4f2e-8786-c242fadd4eea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:01:19.202197 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:19.201673 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vfrjc" Jul 02 14:01:19.202197 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:19.201777 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vfrjc" podUID="c02181c0-cedc-4f2e-8786-c242fadd4eea" Jul 02 14:01:19.202197 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:19.201852 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvgpg" Jul 02 14:01:19.202197 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:19.201932 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvgpg" podUID="e558c7dc-3cca-412b-b6a2-cd48bd9b430f" Jul 02 14:01:19.202197 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:19.202002 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tz5k9" Jul 02 14:01:19.202197 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:19.202077 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tz5k9" podUID="fac6f456-02a4-4216-a9ae-7ba6ba7a73b4" Jul 02 14:01:21.201054 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:21.201015 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vfrjc" Jul 02 14:01:21.201500 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:21.201020 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvgpg" Jul 02 14:01:21.201500 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:21.201150 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vfrjc" podUID="c02181c0-cedc-4f2e-8786-c242fadd4eea" Jul 02 14:01:21.201500 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:21.201198 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tz5k9" Jul 02 14:01:21.201500 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:21.201324 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvgpg" podUID="e558c7dc-3cca-412b-b6a2-cd48bd9b430f" Jul 02 14:01:21.201500 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:21.201442 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tz5k9" podUID="fac6f456-02a4-4216-a9ae-7ba6ba7a73b4" Jul 02 14:01:23.201559 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:23.201483 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvgpg" Jul 02 14:01:23.201559 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:23.201498 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tz5k9" Jul 02 14:01:23.202086 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:23.201609 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvgpg" podUID="e558c7dc-3cca-412b-b6a2-cd48bd9b430f" Jul 02 14:01:23.202086 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:23.201692 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tz5k9" podUID="fac6f456-02a4-4216-a9ae-7ba6ba7a73b4" Jul 02 14:01:23.202086 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:23.201750 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vfrjc" Jul 02 14:01:23.202086 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:23.201815 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vfrjc" podUID="c02181c0-cedc-4f2e-8786-c242fadd4eea" Jul 02 14:01:25.201599 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:25.201539 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tz5k9" Jul 02 14:01:25.201599 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:25.201577 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvgpg" Jul 02 14:01:25.202140 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:25.201546 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vfrjc" Jul 02 14:01:25.202140 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:25.201680 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tz5k9" podUID="fac6f456-02a4-4216-a9ae-7ba6ba7a73b4" Jul 02 14:01:25.202140 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:25.201817 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vfrjc" podUID="c02181c0-cedc-4f2e-8786-c242fadd4eea" Jul 02 14:01:25.202140 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:25.201887 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvgpg" podUID="e558c7dc-3cca-412b-b6a2-cd48bd9b430f" Jul 02 14:01:26.882726 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:26.882688 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fac6f456-02a4-4216-a9ae-7ba6ba7a73b4-metrics-certs\") pod \"network-metrics-daemon-tz5k9\" (UID: \"fac6f456-02a4-4216-a9ae-7ba6ba7a73b4\") " pod="openshift-multus/network-metrics-daemon-tz5k9" Jul 02 14:01:26.883137 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:26.882827 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:01:26.883137 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:26.882894 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fac6f456-02a4-4216-a9ae-7ba6ba7a73b4-metrics-certs podName:fac6f456-02a4-4216-a9ae-7ba6ba7a73b4 nodeName:}" failed. No retries permitted until 2026-07-02 14:01:42.882872231 +0000 UTC m=+34.091114992 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fac6f456-02a4-4216-a9ae-7ba6ba7a73b4-metrics-certs") pod "network-metrics-daemon-tz5k9" (UID: "fac6f456-02a4-4216-a9ae-7ba6ba7a73b4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:01:26.983196 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:26.983165 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e558c7dc-3cca-412b-b6a2-cd48bd9b430f-original-pull-secret\") pod \"global-pull-secret-syncer-xvgpg\" (UID: \"e558c7dc-3cca-412b-b6a2-cd48bd9b430f\") " pod="kube-system/global-pull-secret-syncer-xvgpg" Jul 02 14:01:26.983196 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:26.983195 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ch9pc\" (UniqueName: \"kubernetes.io/projected/c02181c0-cedc-4f2e-8786-c242fadd4eea-kube-api-access-ch9pc\") pod \"network-check-target-vfrjc\" (UID: \"c02181c0-cedc-4f2e-8786-c242fadd4eea\") " pod="openshift-network-diagnostics/network-check-target-vfrjc" Jul 02 14:01:26.983403 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:26.983338 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 14:01:26.983443 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:26.983404 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e558c7dc-3cca-412b-b6a2-cd48bd9b430f-original-pull-secret podName:e558c7dc-3cca-412b-b6a2-cd48bd9b430f nodeName:}" failed. No retries permitted until 2026-07-02 14:01:42.983383963 +0000 UTC m=+34.191626725 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e558c7dc-3cca-412b-b6a2-cd48bd9b430f-original-pull-secret") pod "global-pull-secret-syncer-xvgpg" (UID: "e558c7dc-3cca-412b-b6a2-cd48bd9b430f") : object "kube-system"/"original-pull-secret" not registered Jul 02 14:01:26.983443 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:26.983427 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 14:01:26.983527 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:26.983448 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 14:01:26.983527 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:26.983460 2553 projected.go:196] Error preparing data for projected volume kube-api-access-ch9pc for pod openshift-network-diagnostics/network-check-target-vfrjc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:01:26.983527 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:26.983517 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c02181c0-cedc-4f2e-8786-c242fadd4eea-kube-api-access-ch9pc podName:c02181c0-cedc-4f2e-8786-c242fadd4eea nodeName:}" failed. No retries permitted until 2026-07-02 14:01:42.983501636 +0000 UTC m=+34.191744399 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ch9pc" (UniqueName: "kubernetes.io/projected/c02181c0-cedc-4f2e-8786-c242fadd4eea-kube-api-access-ch9pc") pod "network-check-target-vfrjc" (UID: "c02181c0-cedc-4f2e-8786-c242fadd4eea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:01:27.201700 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:27.201623 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tz5k9" Jul 02 14:01:27.201846 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:27.201623 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvgpg" Jul 02 14:01:27.201846 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:27.201752 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tz5k9" podUID="fac6f456-02a4-4216-a9ae-7ba6ba7a73b4" Jul 02 14:01:27.201999 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:27.201834 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvgpg" podUID="e558c7dc-3cca-412b-b6a2-cd48bd9b430f" Jul 02 14:01:27.201999 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:27.201628 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vfrjc" Jul 02 14:01:27.201999 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:27.201934 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vfrjc" podUID="c02181c0-cedc-4f2e-8786-c242fadd4eea" Jul 02 14:01:29.201574 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:29.201537 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvgpg" Jul 02 14:01:29.202028 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:29.201640 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvgpg" podUID="e558c7dc-3cca-412b-b6a2-cd48bd9b430f" Jul 02 14:01:29.202028 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:29.201718 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tz5k9" Jul 02 14:01:29.202028 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:29.201818 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tz5k9" podUID="fac6f456-02a4-4216-a9ae-7ba6ba7a73b4" Jul 02 14:01:29.202028 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:29.201845 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vfrjc" Jul 02 14:01:29.202028 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:29.201960 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vfrjc" podUID="c02181c0-cedc-4f2e-8786-c242fadd4eea" Jul 02 14:01:31.202059 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:31.201256 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvgpg" Jul 02 14:01:31.202059 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:31.201372 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvgpg" podUID="e558c7dc-3cca-412b-b6a2-cd48bd9b430f" Jul 02 14:01:31.202059 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:31.201727 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tz5k9" Jul 02 14:01:31.202059 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:31.201842 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tz5k9" podUID="fac6f456-02a4-4216-a9ae-7ba6ba7a73b4" Jul 02 14:01:31.202059 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:31.201897 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vfrjc" Jul 02 14:01:31.202059 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:31.201959 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vfrjc" podUID="c02181c0-cedc-4f2e-8786-c242fadd4eea" Jul 02 14:01:31.311147 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:31.308281 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-57.ec2.internal" event={"ID":"469f128e84139c59dc87d077aeeac40f","Type":"ContainerStarted","Data":"d5204c97531339bacf9de085d9a08be93656ab27ca1f558329479cfe82713971"} Jul 02 14:01:31.316408 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:31.316377 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-57.ec2.internal" event={"ID":"c582d8238a6f3daead6044036f2a5eeb","Type":"ContainerStarted","Data":"8ed31209a3bb86d6d0c5d21f91c27e524f6deb2f16200c90cb62aeeb284328c4"} Jul 02 14:01:31.330136 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:31.328722 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-57.ec2.internal" podStartSLOduration=21.328692551 podStartE2EDuration="21.328692551s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:01:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:01:31.327901001 +0000 UTC m=+22.536143784" watchObservedRunningTime="2026-07-02 14:01:31.328692551 +0000 UTC m=+22.536935335" Jul 02 14:01:31.365125 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:31.364547 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7nn4r" podStartSLOduration=2.739148341 podStartE2EDuration="22.364529267s" totalImagesPullingTime="19.625380926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:01:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:01:31.364245243 +0000 UTC m=+22.572488035" watchObservedRunningTime="2026-07-02 14:01:31.364529267 +0000 UTC m=+22.572772050" Jul 02 14:01:31.365380 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:31.365341 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-57.ec2.internal" podStartSLOduration=21.365326398 podStartE2EDuration="21.365326398s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:01:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:01:31.347860574 +0000 UTC m=+22.556103357" watchObservedRunningTime="2026-07-02 14:01:31.365326398 +0000 UTC m=+22.573569182" Jul 02 14:01:32.325321 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:32.325066 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6czcv" event={"ID":"f7f2c7f4-5c54-434e-b13c-a12bf418b343","Type":"ContainerStarted","Data":"0f32542f4ec256fb720370967e0c17688937ea2d8589691b479a2a717e5dbb1c"} Jul 02 14:01:32.326577 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:32.326556 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zbkhx" event={"ID":"253a79fe-da31-4f39-8017-9b6528e9e4df","Type":"ContainerStarted","Data":"89f376828d22b0e943a1d37be7d0d5d6e16151bc4bb915a3e302bfe33207eafe"} Jul 02 14:01:32.328005 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:32.327969 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8l6bt" event={"ID":"cfbb6333-3d89-4a46-9c46-cd02efede2e8","Type":"ContainerStarted","Data":"d42d45b094b489c2a1f1e987371f1a842ebe1195797662d8e4dce125b79536e7"} Jul 02 14:01:32.329309 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:32.329290 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7nn4r" event={"ID":"ef367a3a-b360-4b9a-b66c-c4b8b128d70f","Type":"ContainerStarted","Data":"3e8b8034cc362b0f8522e29efe2a6b6cf3b4c2a0141bf04f4922d895f0adec64"} Jul 02 14:01:32.330644 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:32.330621 2553 generic.go:356] "Generic (PLEG): container finished" podID="b9aba121-950c-4aab-bc81-d6efedf5bfbd" containerID="5163da4fba667728f8a4fb1fd605b39586314b91a519a2c4bf0fa6a20e80a5e8" exitCode=0 Jul 02 14:01:32.330737 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:32.330663 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-68vbd" event={"ID":"b9aba121-950c-4aab-bc81-d6efedf5bfbd","Type":"ContainerDied","Data":"5163da4fba667728f8a4fb1fd605b39586314b91a519a2c4bf0fa6a20e80a5e8"} Jul 02 14:01:32.332070 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:32.332051 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnxgt" event={"ID":"8be1e9f8-324d-4352-83b0-7e22f0e0bfa3","Type":"ContainerStarted","Data":"2e3ba264beed4a3e06d03a5015b57dc7fe8e49f0e6ed66f57272d9f663d7de83"} Jul 02 14:01:32.334541 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:32.334526 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7r445_ca0f7ed3-f75b-4edb-86c2-afa842962cf5/ovn-acl-logging/0.log" Jul 02 14:01:32.334813 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:32.334797 2553 generic.go:356] "Generic (PLEG): container finished" podID="ca0f7ed3-f75b-4edb-86c2-afa842962cf5" containerID="8b059930542b7e7a4fe71a20fdfc54dc2c91b2f553eacb3aad9f65684061d45b" exitCode=1 Jul 02 14:01:32.334860 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:32.334848 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7r445" event={"ID":"ca0f7ed3-f75b-4edb-86c2-afa842962cf5","Type":"ContainerStarted","Data":"06b0c02232ffe99dc8347b2078d65dd63d09b1390b5a92ac9b503c2c5ee6b090"} Jul 02 14:01:32.334910 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:32.334898 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7r445" event={"ID":"ca0f7ed3-f75b-4edb-86c2-afa842962cf5","Type":"ContainerStarted","Data":"081b26edef8011f835ef9320446afa8a19361b92bf2efd61710b5d0c6e842113"} Jul 02 14:01:32.334959 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:32.334947 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7r445" event={"ID":"ca0f7ed3-f75b-4edb-86c2-afa842962cf5","Type":"ContainerStarted","Data":"333ab99fc5ffb450baf6ae5bae92c0e532464af45c6ba176c929ecdadeb27a04"} Jul 02 14:01:32.335016 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:32.334997 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7r445" event={"ID":"ca0f7ed3-f75b-4edb-86c2-afa842962cf5","Type":"ContainerStarted","Data":"46bdd545757ef19cf997dded643c3a713cbc38611cac2ed73ee56a40e54494c7"} Jul 02 14:01:32.335057 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:32.335035 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7r445" event={"ID":"ca0f7ed3-f75b-4edb-86c2-afa842962cf5","Type":"ContainerDied","Data":"8b059930542b7e7a4fe71a20fdfc54dc2c91b2f553eacb3aad9f65684061d45b"} Jul 02 14:01:32.335090 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:32.335064 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7r445" event={"ID":"ca0f7ed3-f75b-4edb-86c2-afa842962cf5","Type":"ContainerStarted","Data":"78da65599e4bfce3e8f543a8df131ed726375290866cac238c08edbbd5085d5d"} Jul 02 14:01:32.336111 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:32.336089 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lg74z" event={"ID":"070f7754-21fb-458f-b47c-a5d2820ad39d","Type":"ContainerStarted","Data":"65842a643f7931dfcb0389b0fdeb1f6b0d7af9e0abfc92f8851114dccd0210b3"} Jul 02 14:01:32.342440 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:32.342404 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-6czcv" podStartSLOduration=3.707330025 podStartE2EDuration="23.342391276s" totalImagesPullingTime="19.635061251s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:01:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:01:32.341834819 +0000 UTC m=+23.550077603" watchObservedRunningTime="2026-07-02 14:01:32.342391276 +0000 UTC m=+23.550634055" Jul 02 14:01:32.378362 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:32.378310 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-lg74z" podStartSLOduration=3.698346572 podStartE2EDuration="23.378294255s" totalImagesPullingTime="19.679947683s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:01:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:01:32.37815712 +0000 UTC m=+23.586399902" watchObservedRunningTime="2026-07-02 14:01:32.378294255 +0000 UTC m=+23.586537038" Jul 02 14:01:32.378501 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:32.378397 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-8l6bt" podStartSLOduration=3.691227193 podStartE2EDuration="23.378386781s" totalImagesPullingTime="19.687159588s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:01:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:01:32.362258757 +0000 UTC m=+23.570501539" watchObservedRunningTime="2026-07-02 14:01:32.378386781 +0000 UTC m=+23.586629565" Jul 02 14:01:32.392607 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:32.392567 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-zbkhx" podStartSLOduration=3.749707843 podStartE2EDuration="23.392554627s" totalImagesPullingTime="19.642846784s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:01:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:01:32.392460311 +0000 UTC m=+23.600703093" watchObservedRunningTime="2026-07-02 14:01:32.392554627 +0000 UTC m=+23.600797409" Jul 02 14:01:32.811453 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:32.811427 2553 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 02 14:01:33.201288 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:33.201253 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tz5k9" Jul 02 14:01:33.201675 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:33.201253 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vfrjc" Jul 02 14:01:33.201675 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:33.201403 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvgpg" Jul 02 14:01:33.201675 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:33.201403 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tz5k9" podUID="fac6f456-02a4-4216-a9ae-7ba6ba7a73b4" Jul 02 14:01:33.201675 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:33.201506 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vfrjc" podUID="c02181c0-cedc-4f2e-8786-c242fadd4eea" Jul 02 14:01:33.201675 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:33.201587 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvgpg" podUID="e558c7dc-3cca-412b-b6a2-cd48bd9b430f" Jul 02 14:01:33.204184 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:33.204076 2553 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-02T14:01:32.811447801Z","UUID":"d9fcbcae-2a1e-4262-b0e0-b132c565acca","Handler":null,"Name":"","Endpoint":""} Jul 02 14:01:33.205660 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:33.205644 2553 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 02 14:01:33.205749 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:33.205680 2553 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 02 14:01:33.341252 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:33.341214 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnxgt" event={"ID":"8be1e9f8-324d-4352-83b0-7e22f0e0bfa3","Type":"ContainerStarted","Data":"566a4310fa308c3585065a9ef64dec1e0c6fcea87a8cf495b1e6942480874a54"} Jul 02 14:01:33.342756 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:33.342723 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7xkn2" event={"ID":"b6b9b623-5017-4948-857b-38b591d84b8a","Type":"ContainerStarted","Data":"fd579fe3967b9446565db414205baf6b0fea8b95ffe9d0b043bd344c1f25c6d3"} Jul 02 14:01:33.357259 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:33.357210 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7xkn2" podStartSLOduration=4.7179704529999995 podStartE2EDuration="24.357192616s" totalImagesPullingTime="19.639222163s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:01:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:01:33.356780658 +0000 UTC m=+24.565023443" watchObservedRunningTime="2026-07-02 14:01:33.357192616 +0000 UTC m=+24.565435400" Jul 02 14:01:34.348961 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:34.348923 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7r445_ca0f7ed3-f75b-4edb-86c2-afa842962cf5/ovn-acl-logging/0.log" Jul 02 14:01:34.349463 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:34.349414 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7r445" event={"ID":"ca0f7ed3-f75b-4edb-86c2-afa842962cf5","Type":"ContainerStarted","Data":"178990efc50fc1007d85facf06f936756d0b8a896d9ea96f03a9c7559b18faed"} Jul 02 14:01:35.201914 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:35.201709 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vfrjc" Jul 02 14:01:35.202134 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:35.201716 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvgpg" Jul 02 14:01:35.202134 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:35.202017 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vfrjc" podUID="c02181c0-cedc-4f2e-8786-c242fadd4eea" Jul 02 14:01:35.202134 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:35.201764 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tz5k9" Jul 02 14:01:35.202311 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:35.202111 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvgpg" podUID="e558c7dc-3cca-412b-b6a2-cd48bd9b430f" Jul 02 14:01:35.202311 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:35.202227 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tz5k9" podUID="fac6f456-02a4-4216-a9ae-7ba6ba7a73b4" Jul 02 14:01:35.353654 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:35.353608 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnxgt" event={"ID":"8be1e9f8-324d-4352-83b0-7e22f0e0bfa3","Type":"ContainerStarted","Data":"b1bf07d90f0d38ca173cfef51d1872ce46e33e64a58254f801b90327100c1b1b"} Jul 02 14:01:35.371499 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:35.371453 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnxgt" podStartSLOduration=3.810616971 podStartE2EDuration="26.37143842s" totalImagesPullingTime="22.560821449s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:01:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:01:35.369680384 +0000 UTC m=+26.577923167" watchObservedRunningTime="2026-07-02 14:01:35.37143842 +0000 UTC m=+26.579681202" Jul 02 14:01:35.821454 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:35.821421 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7nn4r" Jul 02 14:01:35.822072 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:35.822055 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7nn4r" Jul 02 14:01:36.356391 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:36.356349 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7nn4r" Jul 02 14:01:36.356940 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:36.356805 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7nn4r" Jul 02 14:01:37.201292 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:37.201104 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tz5k9" Jul 02 14:01:37.201470 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:37.201109 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vfrjc" Jul 02 14:01:37.201470 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:37.201380 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tz5k9" podUID="fac6f456-02a4-4216-a9ae-7ba6ba7a73b4" Jul 02 14:01:37.201470 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:37.201113 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvgpg" Jul 02 14:01:37.201685 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:37.201448 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vfrjc" podUID="c02181c0-cedc-4f2e-8786-c242fadd4eea" Jul 02 14:01:37.202143 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:37.201954 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvgpg" podUID="e558c7dc-3cca-412b-b6a2-cd48bd9b430f" Jul 02 14:01:37.359594 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:37.359553 2553 generic.go:356] "Generic (PLEG): container finished" podID="b9aba121-950c-4aab-bc81-d6efedf5bfbd" containerID="7632faa0f7c2ea056cf8c70fc70eb5d50de8384b70710c58ad1f1576a32ddeee" exitCode=0 Jul 02 14:01:37.360321 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:37.359607 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-68vbd" event={"ID":"b9aba121-950c-4aab-bc81-d6efedf5bfbd","Type":"ContainerDied","Data":"7632faa0f7c2ea056cf8c70fc70eb5d50de8384b70710c58ad1f1576a32ddeee"} Jul 02 14:01:37.363324 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:37.363309 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7r445_ca0f7ed3-f75b-4edb-86c2-afa842962cf5/ovn-acl-logging/0.log" Jul 02 14:01:37.363691 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:37.363671 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7r445" event={"ID":"ca0f7ed3-f75b-4edb-86c2-afa842962cf5","Type":"ContainerStarted","Data":"e980cbe69fdbbe3ce26ea328c61bcc47d30799b302de72a9aa3db3ffe33c7091"} Jul 02 14:01:37.364096 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:37.364083 2553 scope.go:117] "RemoveContainer" containerID="8b059930542b7e7a4fe71a20fdfc54dc2c91b2f553eacb3aad9f65684061d45b" Jul 02 14:01:38.296007 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:38.295944 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:01:38.369598 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:38.369573 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7r445_ca0f7ed3-f75b-4edb-86c2-afa842962cf5/ovn-acl-logging/0.log" Jul 02 14:01:38.370042 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:38.369956 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7r445" event={"ID":"ca0f7ed3-f75b-4edb-86c2-afa842962cf5","Type":"ContainerStarted","Data":"a578a4ef3ccb5ae2318983dc6f4038fbe9061fa6d157cdcb026382ff12f87107"} Jul 02 14:01:38.370261 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:38.370232 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:01:38.370380 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:38.370331 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:01:38.370430 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:38.370388 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:01:38.378530 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:38.378500 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:01:38.385616 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:38.385599 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:01:38.385717 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:38.385687 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:01:38.397171 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:38.397133 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-7r445" podStartSLOduration=9.485489326 podStartE2EDuration="29.397119533s" totalImagesPullingTime="19.911630207s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:01:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:01:38.396075737 +0000 UTC m=+29.604318520" watchObservedRunningTime="2026-07-02 14:01:38.397119533 +0000 UTC m=+29.605362315" Jul 02 14:01:38.456074 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:38.456042 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xvgpg"] Jul 02 14:01:38.456274 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:38.456206 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvgpg" Jul 02 14:01:38.456350 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:38.456320 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvgpg" podUID="e558c7dc-3cca-412b-b6a2-cd48bd9b430f" Jul 02 14:01:38.459366 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:38.459338 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vfrjc"] Jul 02 14:01:38.459492 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:38.459438 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vfrjc" Jul 02 14:01:38.459554 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:38.459530 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vfrjc" podUID="c02181c0-cedc-4f2e-8786-c242fadd4eea" Jul 02 14:01:38.459924 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:38.459900 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tz5k9"] Jul 02 14:01:38.460038 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:38.460026 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tz5k9" Jul 02 14:01:38.460141 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:38.460120 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tz5k9" podUID="fac6f456-02a4-4216-a9ae-7ba6ba7a73b4" Jul 02 14:01:38.931105 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:38.931070 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:01:39.020270 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:39.020236 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:01:39.120651 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:39.120436 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:01:39.373981 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:39.373947 2553 generic.go:356] "Generic (PLEG): container finished" podID="b9aba121-950c-4aab-bc81-d6efedf5bfbd" containerID="976a86cb21248298aea54e681bc726cf73b7809699e41b7bb9c4376ce11810d6" exitCode=0 Jul 02 14:01:39.374477 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:39.374004 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-68vbd" event={"ID":"b9aba121-950c-4aab-bc81-d6efedf5bfbd","Type":"ContainerDied","Data":"976a86cb21248298aea54e681bc726cf73b7809699e41b7bb9c4376ce11810d6"} Jul 02 14:01:39.946615 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:39.946571 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:01:40.047290 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:40.047261 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:01:40.201125 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:40.201058 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tz5k9" Jul 02 14:01:40.201265 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:40.201062 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvgpg" Jul 02 14:01:40.201265 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:40.201177 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tz5k9" podUID="fac6f456-02a4-4216-a9ae-7ba6ba7a73b4" Jul 02 14:01:40.201265 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:40.201070 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vfrjc" Jul 02 14:01:40.201265 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:40.201244 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvgpg" podUID="e558c7dc-3cca-412b-b6a2-cd48bd9b430f" Jul 02 14:01:40.201405 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:40.201384 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vfrjc" podUID="c02181c0-cedc-4f2e-8786-c242fadd4eea" Jul 02 14:01:41.382315 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:41.382241 2553 generic.go:356] "Generic (PLEG): container finished" podID="b9aba121-950c-4aab-bc81-d6efedf5bfbd" containerID="101a39e32995bc96258405a9e4e2ed51c489568c0d35b7ce5be6da8e6bd4b271" exitCode=0 Jul 02 14:01:41.382315 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:41.382282 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-68vbd" event={"ID":"b9aba121-950c-4aab-bc81-d6efedf5bfbd","Type":"ContainerDied","Data":"101a39e32995bc96258405a9e4e2ed51c489568c0d35b7ce5be6da8e6bd4b271"} Jul 02 14:01:41.901210 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:41.901164 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:01:42.200946 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:42.200864 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tz5k9" Jul 02 14:01:42.200946 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:42.200885 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vfrjc" Jul 02 14:01:42.201152 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:42.201002 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvgpg" Jul 02 14:01:42.201152 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:42.201015 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tz5k9" podUID="fac6f456-02a4-4216-a9ae-7ba6ba7a73b4" Jul 02 14:01:42.201152 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:42.201090 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvgpg" podUID="e558c7dc-3cca-412b-b6a2-cd48bd9b430f" Jul 02 14:01:42.201276 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:42.201165 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vfrjc" podUID="c02181c0-cedc-4f2e-8786-c242fadd4eea" Jul 02 14:01:42.898437 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:42.898387 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:01:42.907273 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:42.907211 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fac6f456-02a4-4216-a9ae-7ba6ba7a73b4-metrics-certs\") pod \"network-metrics-daemon-tz5k9\" (UID: \"fac6f456-02a4-4216-a9ae-7ba6ba7a73b4\") " pod="openshift-multus/network-metrics-daemon-tz5k9" Jul 02 14:01:42.907412 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:42.907339 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:01:42.907412 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:42.907391 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fac6f456-02a4-4216-a9ae-7ba6ba7a73b4-metrics-certs podName:fac6f456-02a4-4216-a9ae-7ba6ba7a73b4 nodeName:}" failed. No retries permitted until 2026-07-02 14:02:14.907375526 +0000 UTC m=+66.115618300 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fac6f456-02a4-4216-a9ae-7ba6ba7a73b4-metrics-certs") pod "network-metrics-daemon-tz5k9" (UID: "fac6f456-02a4-4216-a9ae-7ba6ba7a73b4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:01:42.999018 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:42.998967 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:01:43.007925 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:43.007899 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ch9pc\" (UniqueName: \"kubernetes.io/projected/c02181c0-cedc-4f2e-8786-c242fadd4eea-kube-api-access-ch9pc\") pod \"network-check-target-vfrjc\" (UID: \"c02181c0-cedc-4f2e-8786-c242fadd4eea\") " pod="openshift-network-diagnostics/network-check-target-vfrjc" Jul 02 14:01:43.008075 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:43.007981 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e558c7dc-3cca-412b-b6a2-cd48bd9b430f-original-pull-secret\") pod \"global-pull-secret-syncer-xvgpg\" (UID: \"e558c7dc-3cca-412b-b6a2-cd48bd9b430f\") " pod="kube-system/global-pull-secret-syncer-xvgpg" Jul 02 14:01:43.008139 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:43.008088 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 14:01:43.008139 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:43.008111 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 14:01:43.008139 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:43.008123 2553 projected.go:196] Error preparing data for projected volume kube-api-access-ch9pc for pod openshift-network-diagnostics/network-check-target-vfrjc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:01:43.008277 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:43.008184 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 14:01:43.008277 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:43.008189 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c02181c0-cedc-4f2e-8786-c242fadd4eea-kube-api-access-ch9pc podName:c02181c0-cedc-4f2e-8786-c242fadd4eea nodeName:}" failed. No retries permitted until 2026-07-02 14:02:15.008170881 +0000 UTC m=+66.216413644 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ch9pc" (UniqueName: "kubernetes.io/projected/c02181c0-cedc-4f2e-8786-c242fadd4eea-kube-api-access-ch9pc") pod "network-check-target-vfrjc" (UID: "c02181c0-cedc-4f2e-8786-c242fadd4eea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:01:43.008277 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:43.008257 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e558c7dc-3cca-412b-b6a2-cd48bd9b430f-original-pull-secret podName:e558c7dc-3cca-412b-b6a2-cd48bd9b430f nodeName:}" failed. No retries permitted until 2026-07-02 14:02:15.00823873 +0000 UTC m=+66.216481504 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e558c7dc-3cca-412b-b6a2-cd48bd9b430f-original-pull-secret") pod "global-pull-secret-syncer-xvgpg" (UID: "e558c7dc-3cca-412b-b6a2-cd48bd9b430f") : object "kube-system"/"original-pull-secret" not registered Jul 02 14:01:44.201450 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:44.201416 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tz5k9" Jul 02 14:01:44.201886 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:44.201458 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvgpg" Jul 02 14:01:44.201886 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:44.201458 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vfrjc" Jul 02 14:01:44.201886 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:44.201545 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tz5k9" podUID="fac6f456-02a4-4216-a9ae-7ba6ba7a73b4" Jul 02 14:01:44.201886 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:44.201623 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvgpg" podUID="e558c7dc-3cca-412b-b6a2-cd48bd9b430f" Jul 02 14:01:44.201886 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:44.201684 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vfrjc" podUID="c02181c0-cedc-4f2e-8786-c242fadd4eea" Jul 02 14:01:45.048654 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:45.048580 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-57.ec2.internal" event="NodeReady" Jul 02 14:01:45.048801 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:45.048718 2553 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 02 14:01:45.091492 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:45.091462 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-2f9dr"] Jul 02 14:01:45.094463 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:45.094442 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6m2l6"] Jul 02 14:01:45.094586 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:45.094492 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2f9dr" Jul 02 14:01:45.096089 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:45.096067 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6m2l6" Jul 02 14:01:45.096978 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:45.096956 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-h8n4j\"" Jul 02 14:01:45.097309 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:45.096955 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 02 14:01:45.097309 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:45.096962 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 02 14:01:45.098758 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:45.098694 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 02 14:01:45.098758 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:45.098709 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rsdvs\"" Jul 02 14:01:45.098922 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:45.098889 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 02 14:01:45.099133 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:45.099117 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 02 14:01:45.104780 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:45.104557 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2f9dr"] Jul 02 14:01:45.107546 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:45.107495 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6m2l6"] Jul 02 14:01:45.216464 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:45.216417 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:01:45.226324 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:45.226298 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a21a391-4a45-4143-a680-df9abc1cee3b-tmp-dir\") pod \"dns-default-2f9dr\" (UID: \"5a21a391-4a45-4143-a680-df9abc1cee3b\") " pod="openshift-dns/dns-default-2f9dr" Jul 02 14:01:45.226430 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:45.226336 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ln8ht\" (UniqueName: \"kubernetes.io/projected/5a21a391-4a45-4143-a680-df9abc1cee3b-kube-api-access-ln8ht\") pod \"dns-default-2f9dr\" (UID: \"5a21a391-4a45-4143-a680-df9abc1cee3b\") " pod="openshift-dns/dns-default-2f9dr" Jul 02 14:01:45.226430 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:45.226364 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5a21a391-4a45-4143-a680-df9abc1cee3b-config-volume\") pod \"dns-default-2f9dr\" (UID: \"5a21a391-4a45-4143-a680-df9abc1cee3b\") " pod="openshift-dns/dns-default-2f9dr" Jul 02 14:01:45.226430 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:45.226386 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f157d300-722a-4edc-84a9-cda9534aafd5-cert\") pod \"ingress-canary-6m2l6\" (UID: \"f157d300-722a-4edc-84a9-cda9534aafd5\") " pod="openshift-ingress-canary/ingress-canary-6m2l6" Jul 02 14:01:45.226596 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:45.226440 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a21a391-4a45-4143-a680-df9abc1cee3b-metrics-tls\") pod \"dns-default-2f9dr\" (UID: \"5a21a391-4a45-4143-a680-df9abc1cee3b\") " pod="openshift-dns/dns-default-2f9dr" Jul 02 14:01:45.226596 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:45.226497 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tk9h4\" (UniqueName: \"kubernetes.io/projected/f157d300-722a-4edc-84a9-cda9534aafd5-kube-api-access-tk9h4\") pod \"ingress-canary-6m2l6\" (UID: \"f157d300-722a-4edc-84a9-cda9534aafd5\") " pod="openshift-ingress-canary/ingress-canary-6m2l6" Jul 02 14:01:45.317679 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:45.317593 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:01:45.327303 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:45.327274 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tk9h4\" (UniqueName: \"kubernetes.io/projected/f157d300-722a-4edc-84a9-cda9534aafd5-kube-api-access-tk9h4\") pod \"ingress-canary-6m2l6\" (UID: \"f157d300-722a-4edc-84a9-cda9534aafd5\") " pod="openshift-ingress-canary/ingress-canary-6m2l6" Jul 02 14:01:45.327506 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:45.327476 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a21a391-4a45-4143-a680-df9abc1cee3b-tmp-dir\") pod \"dns-default-2f9dr\" (UID: \"5a21a391-4a45-4143-a680-df9abc1cee3b\") " pod="openshift-dns/dns-default-2f9dr" Jul 02 14:01:45.327638 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:45.327517 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ln8ht\" (UniqueName: \"kubernetes.io/projected/5a21a391-4a45-4143-a680-df9abc1cee3b-kube-api-access-ln8ht\") pod \"dns-default-2f9dr\" (UID: \"5a21a391-4a45-4143-a680-df9abc1cee3b\") " pod="openshift-dns/dns-default-2f9dr" Jul 02 14:01:45.327638 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:45.327547 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5a21a391-4a45-4143-a680-df9abc1cee3b-config-volume\") pod \"dns-default-2f9dr\" (UID: \"5a21a391-4a45-4143-a680-df9abc1cee3b\") " pod="openshift-dns/dns-default-2f9dr" Jul 02 14:01:45.327638 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:45.327569 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f157d300-722a-4edc-84a9-cda9534aafd5-cert\") pod \"ingress-canary-6m2l6\" (UID: \"f157d300-722a-4edc-84a9-cda9534aafd5\") " pod="openshift-ingress-canary/ingress-canary-6m2l6" Jul 02 14:01:45.327798 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:45.327705 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a21a391-4a45-4143-a680-df9abc1cee3b-metrics-tls\") pod \"dns-default-2f9dr\" (UID: \"5a21a391-4a45-4143-a680-df9abc1cee3b\") " pod="openshift-dns/dns-default-2f9dr" Jul 02 14:01:45.327851 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:45.327832 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 14:01:45.327913 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:45.327885 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a21a391-4a45-4143-a680-df9abc1cee3b-tmp-dir\") pod \"dns-default-2f9dr\" (UID: \"5a21a391-4a45-4143-a680-df9abc1cee3b\") " pod="openshift-dns/dns-default-2f9dr" Jul 02 14:01:45.328023 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:45.327893 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a21a391-4a45-4143-a680-df9abc1cee3b-metrics-tls podName:5a21a391-4a45-4143-a680-df9abc1cee3b nodeName:}" failed. No retries permitted until 2026-07-02 14:01:45.82787377 +0000 UTC m=+37.036116551 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5a21a391-4a45-4143-a680-df9abc1cee3b-metrics-tls") pod "dns-default-2f9dr" (UID: "5a21a391-4a45-4143-a680-df9abc1cee3b") : secret "dns-default-metrics-tls" not found Jul 02 14:01:45.328225 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:45.328206 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5a21a391-4a45-4143-a680-df9abc1cee3b-config-volume\") pod \"dns-default-2f9dr\" (UID: \"5a21a391-4a45-4143-a680-df9abc1cee3b\") " pod="openshift-dns/dns-default-2f9dr" Jul 02 14:01:45.332276 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:45.332259 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f157d300-722a-4edc-84a9-cda9534aafd5-cert\") pod \"ingress-canary-6m2l6\" (UID: \"f157d300-722a-4edc-84a9-cda9534aafd5\") " pod="openshift-ingress-canary/ingress-canary-6m2l6" Jul 02 14:01:45.336354 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:45.336311 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ln8ht\" (UniqueName: \"kubernetes.io/projected/5a21a391-4a45-4143-a680-df9abc1cee3b-kube-api-access-ln8ht\") pod \"dns-default-2f9dr\" (UID: \"5a21a391-4a45-4143-a680-df9abc1cee3b\") " pod="openshift-dns/dns-default-2f9dr" Jul 02 14:01:45.336669 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:45.336652 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tk9h4\" (UniqueName: \"kubernetes.io/projected/f157d300-722a-4edc-84a9-cda9534aafd5-kube-api-access-tk9h4\") pod \"ingress-canary-6m2l6\" (UID: \"f157d300-722a-4edc-84a9-cda9534aafd5\") " pod="openshift-ingress-canary/ingress-canary-6m2l6" Jul 02 14:01:45.414339 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:45.414300 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6m2l6" Jul 02 14:01:45.684243 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:45.684214 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6m2l6"] Jul 02 14:01:45.688241 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:01:45.688211 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf157d300_722a_4edc_84a9_cda9534aafd5.slice/crio-db3b57c2e27e609aa202a380e477c6f36806501128a6e23e9e0b88061cc1f65a WatchSource:0}: Error finding container db3b57c2e27e609aa202a380e477c6f36806501128a6e23e9e0b88061cc1f65a: Status 404 returned error can't find the container with id db3b57c2e27e609aa202a380e477c6f36806501128a6e23e9e0b88061cc1f65a Jul 02 14:01:45.831258 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:45.831231 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a21a391-4a45-4143-a680-df9abc1cee3b-metrics-tls\") pod \"dns-default-2f9dr\" (UID: \"5a21a391-4a45-4143-a680-df9abc1cee3b\") " pod="openshift-dns/dns-default-2f9dr" Jul 02 14:01:45.831356 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:45.831345 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 14:01:45.831413 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:45.831403 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a21a391-4a45-4143-a680-df9abc1cee3b-metrics-tls podName:5a21a391-4a45-4143-a680-df9abc1cee3b nodeName:}" failed. No retries permitted until 2026-07-02 14:01:46.831388436 +0000 UTC m=+38.039631202 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5a21a391-4a45-4143-a680-df9abc1cee3b-metrics-tls") pod "dns-default-2f9dr" (UID: "5a21a391-4a45-4143-a680-df9abc1cee3b") : secret "dns-default-metrics-tls" not found Jul 02 14:01:46.200933 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:46.200882 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvgpg" Jul 02 14:01:46.200933 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:46.200925 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vfrjc" Jul 02 14:01:46.200933 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:46.200937 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tz5k9" Jul 02 14:01:46.204422 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:46.204323 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wxltc\"" Jul 02 14:01:46.204422 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:46.204367 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 14:01:46.204422 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:46.204373 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 14:01:46.204422 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:46.204383 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 14:01:46.204422 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:46.204390 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 14:01:46.204422 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:46.204380 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-c8jwt\"" Jul 02 14:01:46.397185 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:46.397153 2553 generic.go:356] "Generic (PLEG): container finished" podID="b9aba121-950c-4aab-bc81-d6efedf5bfbd" containerID="fb94f82d9a3ab6582702ed93d42724ec1f8df3b6f2327a4120922ebd0650a29a" exitCode=0 Jul 02 14:01:46.397581 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:46.397236 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-68vbd" event={"ID":"b9aba121-950c-4aab-bc81-d6efedf5bfbd","Type":"ContainerDied","Data":"fb94f82d9a3ab6582702ed93d42724ec1f8df3b6f2327a4120922ebd0650a29a"} Jul 02 14:01:46.398333 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:46.398316 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6m2l6" event={"ID":"f157d300-722a-4edc-84a9-cda9534aafd5","Type":"ContainerStarted","Data":"db3b57c2e27e609aa202a380e477c6f36806501128a6e23e9e0b88061cc1f65a"} Jul 02 14:01:46.840597 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:46.840512 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a21a391-4a45-4143-a680-df9abc1cee3b-metrics-tls\") pod \"dns-default-2f9dr\" (UID: \"5a21a391-4a45-4143-a680-df9abc1cee3b\") " pod="openshift-dns/dns-default-2f9dr" Jul 02 14:01:46.840741 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:46.840624 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 14:01:46.840741 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:46.840702 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a21a391-4a45-4143-a680-df9abc1cee3b-metrics-tls podName:5a21a391-4a45-4143-a680-df9abc1cee3b nodeName:}" failed. No retries permitted until 2026-07-02 14:01:48.840681022 +0000 UTC m=+40.048923805 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5a21a391-4a45-4143-a680-df9abc1cee3b-metrics-tls") pod "dns-default-2f9dr" (UID: "5a21a391-4a45-4143-a680-df9abc1cee3b") : secret "dns-default-metrics-tls" not found Jul 02 14:01:47.405156 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:47.404824 2553 generic.go:356] "Generic (PLEG): container finished" podID="b9aba121-950c-4aab-bc81-d6efedf5bfbd" containerID="f1a24527d30db33af9292e1505fd98bc8a97a97e1667976ed818e4140fd99c59" exitCode=0 Jul 02 14:01:47.405156 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:47.404905 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-68vbd" event={"ID":"b9aba121-950c-4aab-bc81-d6efedf5bfbd","Type":"ContainerDied","Data":"f1a24527d30db33af9292e1505fd98bc8a97a97e1667976ed818e4140fd99c59"} Jul 02 14:01:48.411737 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:48.411647 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-68vbd" event={"ID":"b9aba121-950c-4aab-bc81-d6efedf5bfbd","Type":"ContainerStarted","Data":"0692ea892c968f86807525590045ac5a40c1b5c1875029f96ad8ca46507a8b68"} Jul 02 14:01:48.434684 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:48.434631 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-68vbd" podStartSLOduration=8.668348536 podStartE2EDuration="39.434610918s" totalImagesPullingTime="30.766262382s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:01:09 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:01:48.433452435 +0000 UTC m=+39.641695222" watchObservedRunningTime="2026-07-02 14:01:48.434610918 +0000 UTC m=+39.642853701" Jul 02 14:01:48.554922 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:48.554886 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:01:48.855592 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:48.855550 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a21a391-4a45-4143-a680-df9abc1cee3b-metrics-tls\") pod \"dns-default-2f9dr\" (UID: \"5a21a391-4a45-4143-a680-df9abc1cee3b\") " pod="openshift-dns/dns-default-2f9dr" Jul 02 14:01:48.855768 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:48.855694 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 14:01:48.855768 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:48.855759 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a21a391-4a45-4143-a680-df9abc1cee3b-metrics-tls podName:5a21a391-4a45-4143-a680-df9abc1cee3b nodeName:}" failed. No retries permitted until 2026-07-02 14:01:52.855741949 +0000 UTC m=+44.063984711 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5a21a391-4a45-4143-a680-df9abc1cee3b-metrics-tls") pod "dns-default-2f9dr" (UID: "5a21a391-4a45-4143-a680-df9abc1cee3b") : secret "dns-default-metrics-tls" not found Jul 02 14:01:49.055932 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:49.055854 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:01:49.114912 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:49.114879 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:01:49.415220 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:49.415129 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6m2l6" event={"ID":"f157d300-722a-4edc-84a9-cda9534aafd5","Type":"ContainerStarted","Data":"69186b255f40f6ff69337d67da649d3c648c9fd316d52adcde83a61dad3ffd5c"} Jul 02 14:01:49.434897 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:49.434844 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6m2l6" podStartSLOduration=1.4633790260000001 podStartE2EDuration="4.434828595s" totalImagesPullingTime="2.971449569s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:01:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:01:49.434306133 +0000 UTC m=+40.642548916" watchObservedRunningTime="2026-07-02 14:01:49.434828595 +0000 UTC m=+40.643071375" Jul 02 14:01:51.020844 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:51.020811 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:01:51.121409 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:51.121383 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:01:52.882307 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:52.882275 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a21a391-4a45-4143-a680-df9abc1cee3b-metrics-tls\") pod \"dns-default-2f9dr\" (UID: \"5a21a391-4a45-4143-a680-df9abc1cee3b\") " pod="openshift-dns/dns-default-2f9dr" Jul 02 14:01:52.882696 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:52.882448 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 14:01:52.882696 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:01:52.882519 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a21a391-4a45-4143-a680-df9abc1cee3b-metrics-tls podName:5a21a391-4a45-4143-a680-df9abc1cee3b nodeName:}" failed. No retries permitted until 2026-07-02 14:02:00.882501359 +0000 UTC m=+52.090744120 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5a21a391-4a45-4143-a680-df9abc1cee3b-metrics-tls") pod "dns-default-2f9dr" (UID: "5a21a391-4a45-4143-a680-df9abc1cee3b") : secret "dns-default-metrics-tls" not found Jul 02 14:01:55.035546 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:55.035511 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:01:55.116698 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:55.116667 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:01:56.431299 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:56.431266 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:01:56.520456 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:01:56.520423 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:02:00.941282 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:02:00.941242 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a21a391-4a45-4143-a680-df9abc1cee3b-metrics-tls\") pod \"dns-default-2f9dr\" (UID: \"5a21a391-4a45-4143-a680-df9abc1cee3b\") " pod="openshift-dns/dns-default-2f9dr" Jul 02 14:02:00.941736 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:02:00.941383 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 14:02:00.941736 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:02:00.941465 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a21a391-4a45-4143-a680-df9abc1cee3b-metrics-tls podName:5a21a391-4a45-4143-a680-df9abc1cee3b nodeName:}" failed. No retries permitted until 2026-07-02 14:02:16.941445124 +0000 UTC m=+68.149687888 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5a21a391-4a45-4143-a680-df9abc1cee3b-metrics-tls") pod "dns-default-2f9dr" (UID: "5a21a391-4a45-4143-a680-df9abc1cee3b") : secret "dns-default-metrics-tls" not found Jul 02 14:02:04.587893 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:02:04.587859 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:02:04.646041 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:02:04.646008 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:02:10.396519 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:02:10.396490 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7r445" Jul 02 14:02:10.550011 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:02:10.549961 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:02:10.609005 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:02:10.608946 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:02:14.936494 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:02:14.936462 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fac6f456-02a4-4216-a9ae-7ba6ba7a73b4-metrics-certs\") pod \"network-metrics-daemon-tz5k9\" (UID: \"fac6f456-02a4-4216-a9ae-7ba6ba7a73b4\") " pod="openshift-multus/network-metrics-daemon-tz5k9" Jul 02 14:02:14.939031 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:02:14.939012 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 14:02:14.946939 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:02:14.946919 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 02 14:02:14.947017 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:02:14.946982 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fac6f456-02a4-4216-a9ae-7ba6ba7a73b4-metrics-certs podName:fac6f456-02a4-4216-a9ae-7ba6ba7a73b4 nodeName:}" failed. No retries permitted until 2026-07-02 14:03:18.946964761 +0000 UTC m=+130.155207527 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fac6f456-02a4-4216-a9ae-7ba6ba7a73b4-metrics-certs") pod "network-metrics-daemon-tz5k9" (UID: "fac6f456-02a4-4216-a9ae-7ba6ba7a73b4") : secret "metrics-daemon-secret" not found Jul 02 14:02:15.037059 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:02:15.037027 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e558c7dc-3cca-412b-b6a2-cd48bd9b430f-original-pull-secret\") pod \"global-pull-secret-syncer-xvgpg\" (UID: \"e558c7dc-3cca-412b-b6a2-cd48bd9b430f\") " pod="kube-system/global-pull-secret-syncer-xvgpg" Jul 02 14:02:15.037059 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:02:15.037062 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ch9pc\" (UniqueName: \"kubernetes.io/projected/c02181c0-cedc-4f2e-8786-c242fadd4eea-kube-api-access-ch9pc\") pod \"network-check-target-vfrjc\" (UID: \"c02181c0-cedc-4f2e-8786-c242fadd4eea\") " pod="openshift-network-diagnostics/network-check-target-vfrjc" Jul 02 14:02:15.039329 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:02:15.039308 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 14:02:15.039450 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:02:15.039431 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 14:02:15.050275 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:02:15.050246 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 14:02:15.051400 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:02:15.051367 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e558c7dc-3cca-412b-b6a2-cd48bd9b430f-original-pull-secret\") pod \"global-pull-secret-syncer-xvgpg\" (UID: \"e558c7dc-3cca-412b-b6a2-cd48bd9b430f\") " pod="kube-system/global-pull-secret-syncer-xvgpg" Jul 02 14:02:15.061207 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:02:15.061183 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ch9pc\" (UniqueName: \"kubernetes.io/projected/c02181c0-cedc-4f2e-8786-c242fadd4eea-kube-api-access-ch9pc\") pod \"network-check-target-vfrjc\" (UID: \"c02181c0-cedc-4f2e-8786-c242fadd4eea\") " pod="openshift-network-diagnostics/network-check-target-vfrjc" Jul 02 14:02:15.310360 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:02:15.310259 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvgpg" Jul 02 14:02:15.318574 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:02:15.318552 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wxltc\"" Jul 02 14:02:15.326559 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:02:15.326526 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vfrjc" Jul 02 14:02:15.456390 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:02:15.456354 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xvgpg"] Jul 02 14:02:15.470640 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:02:15.470614 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vfrjc"] Jul 02 14:02:15.473963 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:02:15.473924 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xvgpg" event={"ID":"e558c7dc-3cca-412b-b6a2-cd48bd9b430f","Type":"ContainerStarted","Data":"1fc56ec83cea70f62e580c58e3d33d901d253743c4ad3033fe53ef6ea8739532"} Jul 02 14:02:15.474366 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:02:15.474345 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc02181c0_cedc_4f2e_8786_c242fadd4eea.slice/crio-a66b1a9625f6be26440ac9b6e9e5eca29b61387769b2f3a8d26d641d8b31fedc WatchSource:0}: Error finding container a66b1a9625f6be26440ac9b6e9e5eca29b61387769b2f3a8d26d641d8b31fedc: Status 404 returned error can't find the container with id a66b1a9625f6be26440ac9b6e9e5eca29b61387769b2f3a8d26d641d8b31fedc Jul 02 14:02:16.479007 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:02:16.478947 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vfrjc" event={"ID":"c02181c0-cedc-4f2e-8786-c242fadd4eea","Type":"ContainerStarted","Data":"a66b1a9625f6be26440ac9b6e9e5eca29b61387769b2f3a8d26d641d8b31fedc"} Jul 02 14:02:16.951318 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:02:16.951247 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a21a391-4a45-4143-a680-df9abc1cee3b-metrics-tls\") pod \"dns-default-2f9dr\" (UID: \"5a21a391-4a45-4143-a680-df9abc1cee3b\") " pod="openshift-dns/dns-default-2f9dr" Jul 02 14:02:16.951504 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:02:16.951405 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 14:02:16.951504 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:02:16.951487 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a21a391-4a45-4143-a680-df9abc1cee3b-metrics-tls podName:5a21a391-4a45-4143-a680-df9abc1cee3b nodeName:}" failed. No retries permitted until 2026-07-02 14:02:48.951465758 +0000 UTC m=+100.159708534 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5a21a391-4a45-4143-a680-df9abc1cee3b-metrics-tls") pod "dns-default-2f9dr" (UID: "5a21a391-4a45-4143-a680-df9abc1cee3b") : secret "dns-default-metrics-tls" not found Jul 02 14:02:16.978527 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:02:16.978486 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:02:17.040835 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:02:17.040801 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:02:17.102861 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:02:17.102812 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:02:20.491042 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:02:20.491001 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xvgpg" event={"ID":"e558c7dc-3cca-412b-b6a2-cd48bd9b430f","Type":"ContainerStarted","Data":"bf8e3caec2c48c650a2a74c3e29e5d2243717c8fd3885ff54431c71a0665a4f5"} Jul 02 14:02:20.492640 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:02:20.492617 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vfrjc" event={"ID":"c02181c0-cedc-4f2e-8786-c242fadd4eea","Type":"ContainerStarted","Data":"bc11b60353b8ebda02b9232576d3a4cf5b276a3b2d8c58a798c6b0b607f6cb77"} Jul 02 14:02:20.492745 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:02:20.492672 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vfrjc" Jul 02 14:02:20.505978 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:02:20.505894 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-xvgpg" podStartSLOduration=67.046506035 podStartE2EDuration="1m11.505877005s" totalImagesPullingTime="4.45937097s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:01:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:02:20.505633559 +0000 UTC m=+71.713876361" watchObservedRunningTime="2026-07-02 14:02:20.505877005 +0000 UTC m=+71.714119790" Jul 02 14:02:41.292576 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:02:41.292461 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:02:41.350954 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:02:41.350921 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:02:46.310417 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:02:46.310367 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vfrjc" podStartSLOduration=92.8664932 podStartE2EDuration="1m37.310351613s" totalImagesPullingTime="4.443858413s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:01:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:02:20.519614529 +0000 UTC m=+71.727857313" watchObservedRunningTime="2026-07-02 14:02:46.310351613 +0000 UTC m=+97.518594427" Jul 02 14:02:46.310798 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:02:46.310505 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9ffd7464-jkjqz"] Jul 02 14:02:46.313583 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:02:46.313567 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9ffd7464-jkjqz" Jul 02 14:02:46.316179 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:02:46.316158 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 02 14:02:46.316344 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:02:46.316326 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 02 14:02:46.316671 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:02:46.316658 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 02 14:02:46.317328 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:02:46.317310 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 02 14:02:46.323564 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:02:46.323542 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9ffd7464-jkjqz"] Jul 02 14:02:46.461597 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:02:46.461561 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d183502-5ea1-43a9-9ec1-a47288369b8f-tmp\") pod \"klusterlet-addon-workmgr-6b9ffd7464-jkjqz\" (UID: \"1d183502-5ea1-43a9-9ec1-a47288369b8f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9ffd7464-jkjqz" Jul 02 14:02:46.461848 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:02:46.461616 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/1d183502-5ea1-43a9-9ec1-a47288369b8f-klusterlet-config\") pod \"klusterlet-addon-workmgr-6b9ffd7464-jkjqz\" (UID: \"1d183502-5ea1-43a9-9ec1-a47288369b8f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9ffd7464-jkjqz" Jul 02 14:02:46.461848 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:02:46.461655 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69h6r\" (UniqueName: \"kubernetes.io/projected/1d183502-5ea1-43a9-9ec1-a47288369b8f-kube-api-access-69h6r\") pod \"klusterlet-addon-workmgr-6b9ffd7464-jkjqz\" (UID: \"1d183502-5ea1-43a9-9ec1-a47288369b8f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9ffd7464-jkjqz" Jul 02 14:02:46.563108 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:02:46.563013 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d183502-5ea1-43a9-9ec1-a47288369b8f-tmp\") pod \"klusterlet-addon-workmgr-6b9ffd7464-jkjqz\" (UID: \"1d183502-5ea1-43a9-9ec1-a47288369b8f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9ffd7464-jkjqz" Jul 02 14:02:46.563108 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:02:46.563061 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/1d183502-5ea1-43a9-9ec1-a47288369b8f-klusterlet-config\") pod \"klusterlet-addon-workmgr-6b9ffd7464-jkjqz\" (UID: \"1d183502-5ea1-43a9-9ec1-a47288369b8f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9ffd7464-jkjqz" Jul 02 14:02:46.563289 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:02:46.563173 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69h6r\" (UniqueName: \"kubernetes.io/projected/1d183502-5ea1-43a9-9ec1-a47288369b8f-kube-api-access-69h6r\") pod \"klusterlet-addon-workmgr-6b9ffd7464-jkjqz\" (UID: \"1d183502-5ea1-43a9-9ec1-a47288369b8f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9ffd7464-jkjqz" Jul 02 14:02:46.563425 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:02:46.563406 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d183502-5ea1-43a9-9ec1-a47288369b8f-tmp\") pod \"klusterlet-addon-workmgr-6b9ffd7464-jkjqz\" (UID: \"1d183502-5ea1-43a9-9ec1-a47288369b8f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9ffd7464-jkjqz" Jul 02 14:02:46.565615 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:02:46.565599 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/1d183502-5ea1-43a9-9ec1-a47288369b8f-klusterlet-config\") pod \"klusterlet-addon-workmgr-6b9ffd7464-jkjqz\" (UID: \"1d183502-5ea1-43a9-9ec1-a47288369b8f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9ffd7464-jkjqz" Jul 02 14:02:46.571925 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:02:46.571905 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-69h6r\" (UniqueName: \"kubernetes.io/projected/1d183502-5ea1-43a9-9ec1-a47288369b8f-kube-api-access-69h6r\") pod \"klusterlet-addon-workmgr-6b9ffd7464-jkjqz\" (UID: \"1d183502-5ea1-43a9-9ec1-a47288369b8f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9ffd7464-jkjqz" Jul 02 14:02:46.622395 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:02:46.622345 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9ffd7464-jkjqz" Jul 02 14:02:46.741585 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:02:46.741554 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9ffd7464-jkjqz"] Jul 02 14:02:46.745327 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:02:46.745303 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d183502_5ea1_43a9_9ec1_a47288369b8f.slice/crio-9e3e2a2ceb85ed30458c84183a490ba31e8245206fd406ea51420d221ebcced5 WatchSource:0}: Error finding container 9e3e2a2ceb85ed30458c84183a490ba31e8245206fd406ea51420d221ebcced5: Status 404 returned error can't find the container with id 9e3e2a2ceb85ed30458c84183a490ba31e8245206fd406ea51420d221ebcced5 Jul 02 14:02:47.556667 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:02:47.556627 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9ffd7464-jkjqz" event={"ID":"1d183502-5ea1-43a9-9ec1-a47288369b8f","Type":"ContainerStarted","Data":"9e3e2a2ceb85ed30458c84183a490ba31e8245206fd406ea51420d221ebcced5"} Jul 02 14:02:48.978909 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:02:48.978869 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a21a391-4a45-4143-a680-df9abc1cee3b-metrics-tls\") pod \"dns-default-2f9dr\" (UID: \"5a21a391-4a45-4143-a680-df9abc1cee3b\") " pod="openshift-dns/dns-default-2f9dr" Jul 02 14:02:48.979313 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:02:48.979002 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 14:02:48.979313 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:02:48.979081 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a21a391-4a45-4143-a680-df9abc1cee3b-metrics-tls podName:5a21a391-4a45-4143-a680-df9abc1cee3b nodeName:}" failed. No retries permitted until 2026-07-02 14:03:52.979059593 +0000 UTC m=+164.187302354 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5a21a391-4a45-4143-a680-df9abc1cee3b-metrics-tls") pod "dns-default-2f9dr" (UID: "5a21a391-4a45-4143-a680-df9abc1cee3b") : secret "dns-default-metrics-tls" not found Jul 02 14:02:50.565901 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:02:50.565868 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9ffd7464-jkjqz" event={"ID":"1d183502-5ea1-43a9-9ec1-a47288369b8f","Type":"ContainerStarted","Data":"4d6719740a600ff1e955d9be4de5e5e50e6874831eb24b9fea3c5698c1b9c28c"} Jul 02 14:02:50.566357 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:02:50.566082 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9ffd7464-jkjqz" Jul 02 14:02:50.567570 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:02:50.567552 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9ffd7464-jkjqz" Jul 02 14:02:50.580460 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:02:50.580409 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9ffd7464-jkjqz" podStartSLOduration=0.923403553 podStartE2EDuration="4.580396531s" totalImagesPullingTime="3.656992978s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:02:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:02:50.579723762 +0000 UTC m=+101.787966545" watchObservedRunningTime="2026-07-02 14:02:50.580396531 +0000 UTC m=+101.788639292" Jul 02 14:02:51.497579 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:02:51.497551 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vfrjc" Jul 02 14:03:18.993247 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:03:18.993184 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fac6f456-02a4-4216-a9ae-7ba6ba7a73b4-metrics-certs\") pod \"network-metrics-daemon-tz5k9\" (UID: \"fac6f456-02a4-4216-a9ae-7ba6ba7a73b4\") " pod="openshift-multus/network-metrics-daemon-tz5k9" Jul 02 14:03:18.993747 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:03:18.993339 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 02 14:03:18.993747 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:03:18.993422 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fac6f456-02a4-4216-a9ae-7ba6ba7a73b4-metrics-certs podName:fac6f456-02a4-4216-a9ae-7ba6ba7a73b4 nodeName:}" failed. No retries permitted until 2026-07-02 14:05:20.993405311 +0000 UTC m=+252.201648073 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fac6f456-02a4-4216-a9ae-7ba6ba7a73b4-metrics-certs") pod "network-metrics-daemon-tz5k9" (UID: "fac6f456-02a4-4216-a9ae-7ba6ba7a73b4") : secret "metrics-daemon-secret" not found Jul 02 14:03:48.106762 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:03:48.106699 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-2f9dr" podUID="5a21a391-4a45-4143-a680-df9abc1cee3b" Jul 02 14:03:48.703879 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:03:48.703841 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2f9dr" Jul 02 14:03:49.220078 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:03:49.220047 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-tz5k9" podUID="fac6f456-02a4-4216-a9ae-7ba6ba7a73b4" Jul 02 14:03:53.018170 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:03:53.018127 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a21a391-4a45-4143-a680-df9abc1cee3b-metrics-tls\") pod \"dns-default-2f9dr\" (UID: \"5a21a391-4a45-4143-a680-df9abc1cee3b\") " pod="openshift-dns/dns-default-2f9dr" Jul 02 14:03:53.018649 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:03:53.018253 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 14:03:53.018649 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:03:53.018315 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a21a391-4a45-4143-a680-df9abc1cee3b-metrics-tls podName:5a21a391-4a45-4143-a680-df9abc1cee3b nodeName:}" failed. No retries permitted until 2026-07-02 14:05:55.018301845 +0000 UTC m=+286.226544606 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5a21a391-4a45-4143-a680-df9abc1cee3b-metrics-tls") pod "dns-default-2f9dr" (UID: "5a21a391-4a45-4143-a680-df9abc1cee3b") : secret "dns-default-metrics-tls" not found Jul 02 14:04:02.201840 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:04:02.201766 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tz5k9" Jul 02 14:04:29.432207 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:04:29.432147 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:04:50.566665 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:04:50.566609 2553 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9ffd7464-jkjqz" podUID="1d183502-5ea1-43a9-9ec1-a47288369b8f" containerName="acm-agent" probeResult="failure" output="Get \"http://10.133.0.8:8000/readyz\": dial tcp 10.133.0.8:8000: connect: connection refused" Jul 02 14:04:50.854109 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:04:50.854025 2553 generic.go:356] "Generic (PLEG): container finished" podID="1d183502-5ea1-43a9-9ec1-a47288369b8f" containerID="4d6719740a600ff1e955d9be4de5e5e50e6874831eb24b9fea3c5698c1b9c28c" exitCode=1 Jul 02 14:04:50.854109 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:04:50.854072 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9ffd7464-jkjqz" event={"ID":"1d183502-5ea1-43a9-9ec1-a47288369b8f","Type":"ContainerDied","Data":"4d6719740a600ff1e955d9be4de5e5e50e6874831eb24b9fea3c5698c1b9c28c"} Jul 02 14:04:50.854425 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:04:50.854409 2553 scope.go:117] "RemoveContainer" containerID="4d6719740a600ff1e955d9be4de5e5e50e6874831eb24b9fea3c5698c1b9c28c" Jul 02 14:04:51.858905 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:04:51.858870 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9ffd7464-jkjqz" event={"ID":"1d183502-5ea1-43a9-9ec1-a47288369b8f","Type":"ContainerStarted","Data":"745c3881dbe1f06372f1d6f36565ebf4ff2a333b0b2a7f1fe6496573334300fa"} Jul 02 14:04:51.859407 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:04:51.859170 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9ffd7464-jkjqz" Jul 02 14:04:51.859808 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:04:51.859792 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9ffd7464-jkjqz" Jul 02 14:04:55.967331 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:04:55.967295 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:21.027391 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:21.027349 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fac6f456-02a4-4216-a9ae-7ba6ba7a73b4-metrics-certs\") pod \"network-metrics-daemon-tz5k9\" (UID: \"fac6f456-02a4-4216-a9ae-7ba6ba7a73b4\") " pod="openshift-multus/network-metrics-daemon-tz5k9" Jul 02 14:05:21.027873 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:21.027467 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 02 14:05:21.027873 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:21.027521 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fac6f456-02a4-4216-a9ae-7ba6ba7a73b4-metrics-certs podName:fac6f456-02a4-4216-a9ae-7ba6ba7a73b4 nodeName:}" failed. No retries permitted until 2026-07-02 14:07:23.027506261 +0000 UTC m=+374.235749021 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fac6f456-02a4-4216-a9ae-7ba6ba7a73b4-metrics-certs") pod "network-metrics-daemon-tz5k9" (UID: "fac6f456-02a4-4216-a9ae-7ba6ba7a73b4") : secret "metrics-daemon-secret" not found Jul 02 14:05:26.652668 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.652636 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-g7qmz"] Jul 02 14:05:26.655655 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.655635 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-g7qmz" Jul 02 14:05:26.660048 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.660027 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 02 14:05:26.661296 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.661272 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-l68fp\"" Jul 02 14:05:26.661448 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.661274 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 02 14:05:26.661516 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.661468 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 02 14:05:26.661586 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.661568 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 02 14:05:26.662478 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.662457 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-684cbf6d5c-l2rsv"] Jul 02 14:05:26.665233 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.665218 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5df66df7fd-95wdf"] Jul 02 14:05:26.665336 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.665324 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-684cbf6d5c-l2rsv" Jul 02 14:05:26.667800 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.667778 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5df66df7fd-95wdf" Jul 02 14:05:26.672798 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.672778 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-tn8cj\"" Jul 02 14:05:26.672916 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.672899 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-qhppl\"" Jul 02 14:05:26.673103 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.673086 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 02 14:05:26.673184 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.673102 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 02 14:05:26.673400 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.673177 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 02 14:05:26.673502 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.673488 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 02 14:05:26.673655 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.673226 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 02 14:05:26.673726 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.673262 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 02 14:05:26.673726 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.673302 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 02 14:05:26.673830 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.673366 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 02 14:05:26.673830 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.673221 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 02 14:05:26.674017 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.673998 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-g7qmz"] Jul 02 14:05:26.681495 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.681479 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 02 14:05:26.697897 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.697877 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-684cbf6d5c-l2rsv"] Jul 02 14:05:26.703737 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.703720 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5df66df7fd-95wdf"] Jul 02 14:05:26.758149 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.758114 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7fdbdf9c99-7gq54"] Jul 02 14:05:26.761075 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.761053 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7fdbdf9c99-7gq54" Jul 02 14:05:26.764776 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.764757 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d45432e4-b5f5-429c-bc73-8b2518047065-stats-auth\") pod \"router-default-684cbf6d5c-l2rsv\" (UID: \"d45432e4-b5f5-429c-bc73-8b2518047065\") " pod="openshift-ingress/router-default-684cbf6d5c-l2rsv" Jul 02 14:05:26.764887 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.764790 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d2e31ddc-f8bc-489e-b978-c6abb94c5a04-registry-tls\") pod \"image-registry-5df66df7fd-95wdf\" (UID: \"d2e31ddc-f8bc-489e-b978-c6abb94c5a04\") " pod="openshift-image-registry/image-registry-5df66df7fd-95wdf" Jul 02 14:05:26.764887 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.764841 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d2e31ddc-f8bc-489e-b978-c6abb94c5a04-registry-certificates\") pod \"image-registry-5df66df7fd-95wdf\" (UID: \"d2e31ddc-f8bc-489e-b978-c6abb94c5a04\") " pod="openshift-image-registry/image-registry-5df66df7fd-95wdf" Jul 02 14:05:26.764887 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.764856 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d2e31ddc-f8bc-489e-b978-c6abb94c5a04-trusted-ca\") pod \"image-registry-5df66df7fd-95wdf\" (UID: \"d2e31ddc-f8bc-489e-b978-c6abb94c5a04\") " pod="openshift-image-registry/image-registry-5df66df7fd-95wdf" Jul 02 14:05:26.764887 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.764875 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d2e31ddc-f8bc-489e-b978-c6abb94c5a04-image-registry-private-configuration\") pod \"image-registry-5df66df7fd-95wdf\" (UID: \"d2e31ddc-f8bc-489e-b978-c6abb94c5a04\") " pod="openshift-image-registry/image-registry-5df66df7fd-95wdf" Jul 02 14:05:26.765108 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.764895 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d2e31ddc-f8bc-489e-b978-c6abb94c5a04-ca-trust-extracted\") pod \"image-registry-5df66df7fd-95wdf\" (UID: \"d2e31ddc-f8bc-489e-b978-c6abb94c5a04\") " pod="openshift-image-registry/image-registry-5df66df7fd-95wdf" Jul 02 14:05:26.765108 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.764916 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qznbt\" (UniqueName: \"kubernetes.io/projected/d2e31ddc-f8bc-489e-b978-c6abb94c5a04-kube-api-access-qznbt\") pod \"image-registry-5df66df7fd-95wdf\" (UID: \"d2e31ddc-f8bc-489e-b978-c6abb94c5a04\") " pod="openshift-image-registry/image-registry-5df66df7fd-95wdf" Jul 02 14:05:26.765108 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.764940 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cd3f94a9-f70e-497f-9b2e-4c7c3a0bd79e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-g7qmz\" (UID: \"cd3f94a9-f70e-497f-9b2e-4c7c3a0bd79e\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-g7qmz" Jul 02 14:05:26.765108 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.764966 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ppkj\" (UniqueName: \"kubernetes.io/projected/cd3f94a9-f70e-497f-9b2e-4c7c3a0bd79e-kube-api-access-9ppkj\") pod \"cluster-monitoring-operator-54cb84584-g7qmz\" (UID: \"cd3f94a9-f70e-497f-9b2e-4c7c3a0bd79e\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-g7qmz" Jul 02 14:05:26.765108 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.765001 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d45432e4-b5f5-429c-bc73-8b2518047065-metrics-certs\") pod \"router-default-684cbf6d5c-l2rsv\" (UID: \"d45432e4-b5f5-429c-bc73-8b2518047065\") " pod="openshift-ingress/router-default-684cbf6d5c-l2rsv" Jul 02 14:05:26.765108 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.765018 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 02 14:05:26.765108 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.765026 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2wnz\" (UniqueName: \"kubernetes.io/projected/d45432e4-b5f5-429c-bc73-8b2518047065-kube-api-access-k2wnz\") pod \"router-default-684cbf6d5c-l2rsv\" (UID: \"d45432e4-b5f5-429c-bc73-8b2518047065\") " pod="openshift-ingress/router-default-684cbf6d5c-l2rsv" Jul 02 14:05:26.765108 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.765053 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d45432e4-b5f5-429c-bc73-8b2518047065-default-certificate\") pod \"router-default-684cbf6d5c-l2rsv\" (UID: \"d45432e4-b5f5-429c-bc73-8b2518047065\") " pod="openshift-ingress/router-default-684cbf6d5c-l2rsv" Jul 02 14:05:26.765108 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.765055 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 02 14:05:26.765108 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.765079 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-5k8dk\"" Jul 02 14:05:26.765108 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.765109 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 02 14:05:26.765550 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.765112 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d2e31ddc-f8bc-489e-b978-c6abb94c5a04-bound-sa-token\") pod \"image-registry-5df66df7fd-95wdf\" (UID: \"d2e31ddc-f8bc-489e-b978-c6abb94c5a04\") " pod="openshift-image-registry/image-registry-5df66df7fd-95wdf" Jul 02 14:05:26.765550 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.765141 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/cd3f94a9-f70e-497f-9b2e-4c7c3a0bd79e-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-g7qmz\" (UID: \"cd3f94a9-f70e-497f-9b2e-4c7c3a0bd79e\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-g7qmz" Jul 02 14:05:26.765550 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.765197 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d2e31ddc-f8bc-489e-b978-c6abb94c5a04-installation-pull-secrets\") pod \"image-registry-5df66df7fd-95wdf\" (UID: \"d2e31ddc-f8bc-489e-b978-c6abb94c5a04\") " pod="openshift-image-registry/image-registry-5df66df7fd-95wdf" Jul 02 14:05:26.765550 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.765220 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d45432e4-b5f5-429c-bc73-8b2518047065-service-ca-bundle\") pod \"router-default-684cbf6d5c-l2rsv\" (UID: \"d45432e4-b5f5-429c-bc73-8b2518047065\") " pod="openshift-ingress/router-default-684cbf6d5c-l2rsv" Jul 02 14:05:26.765550 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.765444 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 02 14:05:26.770251 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.770234 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 02 14:05:26.777032 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.777011 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7fdbdf9c99-7gq54"] Jul 02 14:05:26.866002 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.865962 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d2e31ddc-f8bc-489e-b978-c6abb94c5a04-trusted-ca\") pod \"image-registry-5df66df7fd-95wdf\" (UID: \"d2e31ddc-f8bc-489e-b978-c6abb94c5a04\") " pod="openshift-image-registry/image-registry-5df66df7fd-95wdf" Jul 02 14:05:26.866205 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.866028 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4ff6194a-8b82-4387-a950-0ee9961b6012-trusted-ca\") pod \"console-operator-7fdbdf9c99-7gq54\" (UID: \"4ff6194a-8b82-4387-a950-0ee9961b6012\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-7gq54" Jul 02 14:05:26.866205 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.866048 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d2e31ddc-f8bc-489e-b978-c6abb94c5a04-registry-certificates\") pod \"image-registry-5df66df7fd-95wdf\" (UID: \"d2e31ddc-f8bc-489e-b978-c6abb94c5a04\") " pod="openshift-image-registry/image-registry-5df66df7fd-95wdf" Jul 02 14:05:26.866205 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.866066 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cd3f94a9-f70e-497f-9b2e-4c7c3a0bd79e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-g7qmz\" (UID: \"cd3f94a9-f70e-497f-9b2e-4c7c3a0bd79e\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-g7qmz" Jul 02 14:05:26.866205 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.866084 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ppkj\" (UniqueName: \"kubernetes.io/projected/cd3f94a9-f70e-497f-9b2e-4c7c3a0bd79e-kube-api-access-9ppkj\") pod \"cluster-monitoring-operator-54cb84584-g7qmz\" (UID: \"cd3f94a9-f70e-497f-9b2e-4c7c3a0bd79e\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-g7qmz" Jul 02 14:05:26.866205 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.866103 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d2e31ddc-f8bc-489e-b978-c6abb94c5a04-bound-sa-token\") pod \"image-registry-5df66df7fd-95wdf\" (UID: \"d2e31ddc-f8bc-489e-b978-c6abb94c5a04\") " pod="openshift-image-registry/image-registry-5df66df7fd-95wdf" Jul 02 14:05:26.866205 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.866127 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/cd3f94a9-f70e-497f-9b2e-4c7c3a0bd79e-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-g7qmz\" (UID: \"cd3f94a9-f70e-497f-9b2e-4c7c3a0bd79e\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-g7qmz" Jul 02 14:05:26.866205 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.866154 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d45432e4-b5f5-429c-bc73-8b2518047065-stats-auth\") pod \"router-default-684cbf6d5c-l2rsv\" (UID: \"d45432e4-b5f5-429c-bc73-8b2518047065\") " pod="openshift-ingress/router-default-684cbf6d5c-l2rsv" Jul 02 14:05:26.866205 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.866176 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qznbt\" (UniqueName: \"kubernetes.io/projected/d2e31ddc-f8bc-489e-b978-c6abb94c5a04-kube-api-access-qznbt\") pod \"image-registry-5df66df7fd-95wdf\" (UID: \"d2e31ddc-f8bc-489e-b978-c6abb94c5a04\") " pod="openshift-image-registry/image-registry-5df66df7fd-95wdf" Jul 02 14:05:26.866584 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:26.866209 2553 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 14:05:26.866584 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.866216 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d45432e4-b5f5-429c-bc73-8b2518047065-service-ca-bundle\") pod \"router-default-684cbf6d5c-l2rsv\" (UID: \"d45432e4-b5f5-429c-bc73-8b2518047065\") " pod="openshift-ingress/router-default-684cbf6d5c-l2rsv" Jul 02 14:05:26.866584 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.866262 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d45432e4-b5f5-429c-bc73-8b2518047065-metrics-certs\") pod \"router-default-684cbf6d5c-l2rsv\" (UID: \"d45432e4-b5f5-429c-bc73-8b2518047065\") " pod="openshift-ingress/router-default-684cbf6d5c-l2rsv" Jul 02 14:05:26.866584 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:26.866281 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd3f94a9-f70e-497f-9b2e-4c7c3a0bd79e-cluster-monitoring-operator-tls podName:cd3f94a9-f70e-497f-9b2e-4c7c3a0bd79e nodeName:}" failed. No retries permitted until 2026-07-02 14:05:27.366259625 +0000 UTC m=+258.574502387 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cd3f94a9-f70e-497f-9b2e-4c7c3a0bd79e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-g7qmz" (UID: "cd3f94a9-f70e-497f-9b2e-4c7c3a0bd79e") : secret "cluster-monitoring-operator-tls" not found Jul 02 14:05:26.866584 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.866309 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2wnz\" (UniqueName: \"kubernetes.io/projected/d45432e4-b5f5-429c-bc73-8b2518047065-kube-api-access-k2wnz\") pod \"router-default-684cbf6d5c-l2rsv\" (UID: \"d45432e4-b5f5-429c-bc73-8b2518047065\") " pod="openshift-ingress/router-default-684cbf6d5c-l2rsv" Jul 02 14:05:26.866584 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.866338 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmzkc\" (UniqueName: \"kubernetes.io/projected/4ff6194a-8b82-4387-a950-0ee9961b6012-kube-api-access-bmzkc\") pod \"console-operator-7fdbdf9c99-7gq54\" (UID: \"4ff6194a-8b82-4387-a950-0ee9961b6012\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-7gq54" Jul 02 14:05:26.866584 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.866363 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d45432e4-b5f5-429c-bc73-8b2518047065-default-certificate\") pod \"router-default-684cbf6d5c-l2rsv\" (UID: \"d45432e4-b5f5-429c-bc73-8b2518047065\") " pod="openshift-ingress/router-default-684cbf6d5c-l2rsv" Jul 02 14:05:26.866584 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.866395 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d2e31ddc-f8bc-489e-b978-c6abb94c5a04-image-registry-private-configuration\") pod \"image-registry-5df66df7fd-95wdf\" (UID: \"d2e31ddc-f8bc-489e-b978-c6abb94c5a04\") " pod="openshift-image-registry/image-registry-5df66df7fd-95wdf" Jul 02 14:05:26.866584 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:26.866546 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d45432e4-b5f5-429c-bc73-8b2518047065-service-ca-bundle podName:d45432e4-b5f5-429c-bc73-8b2518047065 nodeName:}" failed. No retries permitted until 2026-07-02 14:05:27.36653034 +0000 UTC m=+258.574773115 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d45432e4-b5f5-429c-bc73-8b2518047065-service-ca-bundle") pod "router-default-684cbf6d5c-l2rsv" (UID: "d45432e4-b5f5-429c-bc73-8b2518047065") : configmap references non-existent config key: service-ca.crt Jul 02 14:05:26.866584 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.866570 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4ff6194a-8b82-4387-a950-0ee9961b6012-config\") pod \"console-operator-7fdbdf9c99-7gq54\" (UID: \"4ff6194a-8b82-4387-a950-0ee9961b6012\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-7gq54" Jul 02 14:05:26.867110 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.866595 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4ff6194a-8b82-4387-a950-0ee9961b6012-serving-cert\") pod \"console-operator-7fdbdf9c99-7gq54\" (UID: \"4ff6194a-8b82-4387-a950-0ee9961b6012\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-7gq54" Jul 02 14:05:26.867110 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.866626 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d2e31ddc-f8bc-489e-b978-c6abb94c5a04-installation-pull-secrets\") pod \"image-registry-5df66df7fd-95wdf\" (UID: \"d2e31ddc-f8bc-489e-b978-c6abb94c5a04\") " pod="openshift-image-registry/image-registry-5df66df7fd-95wdf" Jul 02 14:05:26.867110 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.866658 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d2e31ddc-f8bc-489e-b978-c6abb94c5a04-ca-trust-extracted\") pod \"image-registry-5df66df7fd-95wdf\" (UID: \"d2e31ddc-f8bc-489e-b978-c6abb94c5a04\") " pod="openshift-image-registry/image-registry-5df66df7fd-95wdf" Jul 02 14:05:26.867110 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.866683 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d2e31ddc-f8bc-489e-b978-c6abb94c5a04-registry-tls\") pod \"image-registry-5df66df7fd-95wdf\" (UID: \"d2e31ddc-f8bc-489e-b978-c6abb94c5a04\") " pod="openshift-image-registry/image-registry-5df66df7fd-95wdf" Jul 02 14:05:26.867110 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.866733 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d2e31ddc-f8bc-489e-b978-c6abb94c5a04-registry-certificates\") pod \"image-registry-5df66df7fd-95wdf\" (UID: \"d2e31ddc-f8bc-489e-b978-c6abb94c5a04\") " pod="openshift-image-registry/image-registry-5df66df7fd-95wdf" Jul 02 14:05:26.867110 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:26.866785 2553 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 14:05:26.867110 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:26.866791 2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 14:05:26.867110 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:26.866802 2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5df66df7fd-95wdf: secret "image-registry-tls" not found Jul 02 14:05:26.867110 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:26.866831 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d45432e4-b5f5-429c-bc73-8b2518047065-metrics-certs podName:d45432e4-b5f5-429c-bc73-8b2518047065 nodeName:}" failed. No retries permitted until 2026-07-02 14:05:27.366816216 +0000 UTC m=+258.575058978 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d45432e4-b5f5-429c-bc73-8b2518047065-metrics-certs") pod "router-default-684cbf6d5c-l2rsv" (UID: "d45432e4-b5f5-429c-bc73-8b2518047065") : secret "router-metrics-certs-default" not found Jul 02 14:05:26.867110 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:26.866849 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d2e31ddc-f8bc-489e-b978-c6abb94c5a04-registry-tls podName:d2e31ddc-f8bc-489e-b978-c6abb94c5a04 nodeName:}" failed. No retries permitted until 2026-07-02 14:05:27.366839956 +0000 UTC m=+258.575082724 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d2e31ddc-f8bc-489e-b978-c6abb94c5a04-registry-tls") pod "image-registry-5df66df7fd-95wdf" (UID: "d2e31ddc-f8bc-489e-b978-c6abb94c5a04") : secret "image-registry-tls" not found Jul 02 14:05:26.867110 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.866890 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/cd3f94a9-f70e-497f-9b2e-4c7c3a0bd79e-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-g7qmz\" (UID: \"cd3f94a9-f70e-497f-9b2e-4c7c3a0bd79e\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-g7qmz" Jul 02 14:05:26.867552 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.867159 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d2e31ddc-f8bc-489e-b978-c6abb94c5a04-ca-trust-extracted\") pod \"image-registry-5df66df7fd-95wdf\" (UID: \"d2e31ddc-f8bc-489e-b978-c6abb94c5a04\") " pod="openshift-image-registry/image-registry-5df66df7fd-95wdf" Jul 02 14:05:26.867552 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.867290 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d2e31ddc-f8bc-489e-b978-c6abb94c5a04-trusted-ca\") pod \"image-registry-5df66df7fd-95wdf\" (UID: \"d2e31ddc-f8bc-489e-b978-c6abb94c5a04\") " pod="openshift-image-registry/image-registry-5df66df7fd-95wdf" Jul 02 14:05:26.869089 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.869062 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d45432e4-b5f5-429c-bc73-8b2518047065-stats-auth\") pod \"router-default-684cbf6d5c-l2rsv\" (UID: \"d45432e4-b5f5-429c-bc73-8b2518047065\") " pod="openshift-ingress/router-default-684cbf6d5c-l2rsv" Jul 02 14:05:26.869189 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.869160 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d45432e4-b5f5-429c-bc73-8b2518047065-default-certificate\") pod \"router-default-684cbf6d5c-l2rsv\" (UID: \"d45432e4-b5f5-429c-bc73-8b2518047065\") " pod="openshift-ingress/router-default-684cbf6d5c-l2rsv" Jul 02 14:05:26.869300 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.869282 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d2e31ddc-f8bc-489e-b978-c6abb94c5a04-image-registry-private-configuration\") pod \"image-registry-5df66df7fd-95wdf\" (UID: \"d2e31ddc-f8bc-489e-b978-c6abb94c5a04\") " pod="openshift-image-registry/image-registry-5df66df7fd-95wdf" Jul 02 14:05:26.869335 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.869315 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d2e31ddc-f8bc-489e-b978-c6abb94c5a04-installation-pull-secrets\") pod \"image-registry-5df66df7fd-95wdf\" (UID: \"d2e31ddc-f8bc-489e-b978-c6abb94c5a04\") " pod="openshift-image-registry/image-registry-5df66df7fd-95wdf" Jul 02 14:05:26.879381 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.879360 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d2e31ddc-f8bc-489e-b978-c6abb94c5a04-bound-sa-token\") pod \"image-registry-5df66df7fd-95wdf\" (UID: \"d2e31ddc-f8bc-489e-b978-c6abb94c5a04\") " pod="openshift-image-registry/image-registry-5df66df7fd-95wdf" Jul 02 14:05:26.879476 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.879386 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ppkj\" (UniqueName: \"kubernetes.io/projected/cd3f94a9-f70e-497f-9b2e-4c7c3a0bd79e-kube-api-access-9ppkj\") pod \"cluster-monitoring-operator-54cb84584-g7qmz\" (UID: \"cd3f94a9-f70e-497f-9b2e-4c7c3a0bd79e\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-g7qmz" Jul 02 14:05:26.879476 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.879393 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qznbt\" (UniqueName: \"kubernetes.io/projected/d2e31ddc-f8bc-489e-b978-c6abb94c5a04-kube-api-access-qznbt\") pod \"image-registry-5df66df7fd-95wdf\" (UID: \"d2e31ddc-f8bc-489e-b978-c6abb94c5a04\") " pod="openshift-image-registry/image-registry-5df66df7fd-95wdf" Jul 02 14:05:26.879745 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.879729 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2wnz\" (UniqueName: \"kubernetes.io/projected/d45432e4-b5f5-429c-bc73-8b2518047065-kube-api-access-k2wnz\") pod \"router-default-684cbf6d5c-l2rsv\" (UID: \"d45432e4-b5f5-429c-bc73-8b2518047065\") " pod="openshift-ingress/router-default-684cbf6d5c-l2rsv" Jul 02 14:05:26.899575 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.899551 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:26.955949 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.955884 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:26.967042 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.967010 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmzkc\" (UniqueName: \"kubernetes.io/projected/4ff6194a-8b82-4387-a950-0ee9961b6012-kube-api-access-bmzkc\") pod \"console-operator-7fdbdf9c99-7gq54\" (UID: \"4ff6194a-8b82-4387-a950-0ee9961b6012\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-7gq54" Jul 02 14:05:26.967152 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.967054 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4ff6194a-8b82-4387-a950-0ee9961b6012-config\") pod \"console-operator-7fdbdf9c99-7gq54\" (UID: \"4ff6194a-8b82-4387-a950-0ee9961b6012\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-7gq54" Jul 02 14:05:26.967152 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.967095 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4ff6194a-8b82-4387-a950-0ee9961b6012-serving-cert\") pod \"console-operator-7fdbdf9c99-7gq54\" (UID: \"4ff6194a-8b82-4387-a950-0ee9961b6012\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-7gq54" Jul 02 14:05:26.967254 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.967152 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4ff6194a-8b82-4387-a950-0ee9961b6012-trusted-ca\") pod \"console-operator-7fdbdf9c99-7gq54\" (UID: \"4ff6194a-8b82-4387-a950-0ee9961b6012\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-7gq54" Jul 02 14:05:26.967677 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.967654 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4ff6194a-8b82-4387-a950-0ee9961b6012-config\") pod \"console-operator-7fdbdf9c99-7gq54\" (UID: \"4ff6194a-8b82-4387-a950-0ee9961b6012\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-7gq54" Jul 02 14:05:26.967953 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.967936 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4ff6194a-8b82-4387-a950-0ee9961b6012-trusted-ca\") pod \"console-operator-7fdbdf9c99-7gq54\" (UID: \"4ff6194a-8b82-4387-a950-0ee9961b6012\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-7gq54" Jul 02 14:05:26.969310 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.969296 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4ff6194a-8b82-4387-a950-0ee9961b6012-serving-cert\") pod \"console-operator-7fdbdf9c99-7gq54\" (UID: \"4ff6194a-8b82-4387-a950-0ee9961b6012\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-7gq54" Jul 02 14:05:26.975178 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:26.975153 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmzkc\" (UniqueName: \"kubernetes.io/projected/4ff6194a-8b82-4387-a950-0ee9961b6012-kube-api-access-bmzkc\") pod \"console-operator-7fdbdf9c99-7gq54\" (UID: \"4ff6194a-8b82-4387-a950-0ee9961b6012\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-7gq54" Jul 02 14:05:27.070441 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:27.070403 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7fdbdf9c99-7gq54" Jul 02 14:05:27.188582 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:27.188553 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7fdbdf9c99-7gq54"] Jul 02 14:05:27.191670 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:05:27.191643 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ff6194a_8b82_4387_a950_0ee9961b6012.slice/crio-c91a6a052386403cdcd303fc1671cfb2ecc66b0d8f3f081643f34c9103aecd3e WatchSource:0}: Error finding container c91a6a052386403cdcd303fc1671cfb2ecc66b0d8f3f081643f34c9103aecd3e: Status 404 returned error can't find the container with id c91a6a052386403cdcd303fc1671cfb2ecc66b0d8f3f081643f34c9103aecd3e Jul 02 14:05:27.371333 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:27.371304 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d45432e4-b5f5-429c-bc73-8b2518047065-service-ca-bundle\") pod \"router-default-684cbf6d5c-l2rsv\" (UID: \"d45432e4-b5f5-429c-bc73-8b2518047065\") " pod="openshift-ingress/router-default-684cbf6d5c-l2rsv" Jul 02 14:05:27.371492 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:27.371347 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d45432e4-b5f5-429c-bc73-8b2518047065-metrics-certs\") pod \"router-default-684cbf6d5c-l2rsv\" (UID: \"d45432e4-b5f5-429c-bc73-8b2518047065\") " pod="openshift-ingress/router-default-684cbf6d5c-l2rsv" Jul 02 14:05:27.371492 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:27.371433 2553 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 14:05:27.371492 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:27.371463 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d2e31ddc-f8bc-489e-b978-c6abb94c5a04-registry-tls\") pod \"image-registry-5df66df7fd-95wdf\" (UID: \"d2e31ddc-f8bc-489e-b978-c6abb94c5a04\") " pod="openshift-image-registry/image-registry-5df66df7fd-95wdf" Jul 02 14:05:27.371492 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:27.371485 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d45432e4-b5f5-429c-bc73-8b2518047065-metrics-certs podName:d45432e4-b5f5-429c-bc73-8b2518047065 nodeName:}" failed. No retries permitted until 2026-07-02 14:05:28.37146626 +0000 UTC m=+259.579709041 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d45432e4-b5f5-429c-bc73-8b2518047065-metrics-certs") pod "router-default-684cbf6d5c-l2rsv" (UID: "d45432e4-b5f5-429c-bc73-8b2518047065") : secret "router-metrics-certs-default" not found Jul 02 14:05:27.371624 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:27.371511 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d45432e4-b5f5-429c-bc73-8b2518047065-service-ca-bundle podName:d45432e4-b5f5-429c-bc73-8b2518047065 nodeName:}" failed. No retries permitted until 2026-07-02 14:05:28.37150213 +0000 UTC m=+259.579744890 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d45432e4-b5f5-429c-bc73-8b2518047065-service-ca-bundle") pod "router-default-684cbf6d5c-l2rsv" (UID: "d45432e4-b5f5-429c-bc73-8b2518047065") : configmap references non-existent config key: service-ca.crt Jul 02 14:05:27.371624 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:27.371524 2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 14:05:27.371624 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:27.371539 2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5df66df7fd-95wdf: secret "image-registry-tls" not found Jul 02 14:05:27.371624 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:27.371562 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cd3f94a9-f70e-497f-9b2e-4c7c3a0bd79e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-g7qmz\" (UID: \"cd3f94a9-f70e-497f-9b2e-4c7c3a0bd79e\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-g7qmz" Jul 02 14:05:27.371624 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:27.371574 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d2e31ddc-f8bc-489e-b978-c6abb94c5a04-registry-tls podName:d2e31ddc-f8bc-489e-b978-c6abb94c5a04 nodeName:}" failed. No retries permitted until 2026-07-02 14:05:28.371561908 +0000 UTC m=+259.579804686 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d2e31ddc-f8bc-489e-b978-c6abb94c5a04-registry-tls") pod "image-registry-5df66df7fd-95wdf" (UID: "d2e31ddc-f8bc-489e-b978-c6abb94c5a04") : secret "image-registry-tls" not found Jul 02 14:05:27.371624 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:27.371621 2553 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 14:05:27.371801 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:27.371644 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd3f94a9-f70e-497f-9b2e-4c7c3a0bd79e-cluster-monitoring-operator-tls podName:cd3f94a9-f70e-497f-9b2e-4c7c3a0bd79e nodeName:}" failed. No retries permitted until 2026-07-02 14:05:28.371637938 +0000 UTC m=+259.579880699 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cd3f94a9-f70e-497f-9b2e-4c7c3a0bd79e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-g7qmz" (UID: "cd3f94a9-f70e-497f-9b2e-4c7c3a0bd79e") : secret "cluster-monitoring-operator-tls" not found Jul 02 14:05:27.954633 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:27.954588 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-7gq54" event={"ID":"4ff6194a-8b82-4387-a950-0ee9961b6012","Type":"ContainerStarted","Data":"c91a6a052386403cdcd303fc1671cfb2ecc66b0d8f3f081643f34c9103aecd3e"} Jul 02 14:05:28.379870 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:28.379841 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d45432e4-b5f5-429c-bc73-8b2518047065-metrics-certs\") pod \"router-default-684cbf6d5c-l2rsv\" (UID: \"d45432e4-b5f5-429c-bc73-8b2518047065\") " pod="openshift-ingress/router-default-684cbf6d5c-l2rsv" Jul 02 14:05:28.380056 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:28.379906 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d2e31ddc-f8bc-489e-b978-c6abb94c5a04-registry-tls\") pod \"image-registry-5df66df7fd-95wdf\" (UID: \"d2e31ddc-f8bc-489e-b978-c6abb94c5a04\") " pod="openshift-image-registry/image-registry-5df66df7fd-95wdf" Jul 02 14:05:28.380056 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:28.379962 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cd3f94a9-f70e-497f-9b2e-4c7c3a0bd79e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-g7qmz\" (UID: \"cd3f94a9-f70e-497f-9b2e-4c7c3a0bd79e\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-g7qmz" Jul 02 14:05:28.380056 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:28.380015 2553 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 14:05:28.380056 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:28.380035 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d45432e4-b5f5-429c-bc73-8b2518047065-service-ca-bundle\") pod \"router-default-684cbf6d5c-l2rsv\" (UID: \"d45432e4-b5f5-429c-bc73-8b2518047065\") " pod="openshift-ingress/router-default-684cbf6d5c-l2rsv" Jul 02 14:05:28.380279 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:28.380089 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d45432e4-b5f5-429c-bc73-8b2518047065-metrics-certs podName:d45432e4-b5f5-429c-bc73-8b2518047065 nodeName:}" failed. No retries permitted until 2026-07-02 14:05:30.380069462 +0000 UTC m=+261.588312224 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d45432e4-b5f5-429c-bc73-8b2518047065-metrics-certs") pod "router-default-684cbf6d5c-l2rsv" (UID: "d45432e4-b5f5-429c-bc73-8b2518047065") : secret "router-metrics-certs-default" not found Jul 02 14:05:28.380279 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:28.380119 2553 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 14:05:28.380279 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:28.380164 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d45432e4-b5f5-429c-bc73-8b2518047065-service-ca-bundle podName:d45432e4-b5f5-429c-bc73-8b2518047065 nodeName:}" failed. No retries permitted until 2026-07-02 14:05:30.380148158 +0000 UTC m=+261.588390932 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d45432e4-b5f5-429c-bc73-8b2518047065-service-ca-bundle") pod "router-default-684cbf6d5c-l2rsv" (UID: "d45432e4-b5f5-429c-bc73-8b2518047065") : configmap references non-existent config key: service-ca.crt Jul 02 14:05:28.380279 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:28.380185 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd3f94a9-f70e-497f-9b2e-4c7c3a0bd79e-cluster-monitoring-operator-tls podName:cd3f94a9-f70e-497f-9b2e-4c7c3a0bd79e nodeName:}" failed. No retries permitted until 2026-07-02 14:05:30.380175395 +0000 UTC m=+261.588418158 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cd3f94a9-f70e-497f-9b2e-4c7c3a0bd79e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-g7qmz" (UID: "cd3f94a9-f70e-497f-9b2e-4c7c3a0bd79e") : secret "cluster-monitoring-operator-tls" not found Jul 02 14:05:28.380279 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:28.380231 2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 14:05:28.380279 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:28.380242 2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5df66df7fd-95wdf: secret "image-registry-tls" not found Jul 02 14:05:28.380566 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:28.380285 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d2e31ddc-f8bc-489e-b978-c6abb94c5a04-registry-tls podName:d2e31ddc-f8bc-489e-b978-c6abb94c5a04 nodeName:}" failed. No retries permitted until 2026-07-02 14:05:30.380273854 +0000 UTC m=+261.588516636 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d2e31ddc-f8bc-489e-b978-c6abb94c5a04-registry-tls") pod "image-registry-5df66df7fd-95wdf" (UID: "d2e31ddc-f8bc-489e-b978-c6abb94c5a04") : secret "image-registry-tls" not found Jul 02 14:05:29.121841 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:29.121810 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:29.206453 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:29.206412 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:29.962661 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:29.962633 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-7gq54_4ff6194a-8b82-4387-a950-0ee9961b6012/console-operator/0.log" Jul 02 14:05:29.962815 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:29.962671 2553 generic.go:356] "Generic (PLEG): container finished" podID="4ff6194a-8b82-4387-a950-0ee9961b6012" containerID="eb463458a134bdc05c9f46be9a45a70d7e0f3c01e46c7503806b8c0f670062af" exitCode=255 Jul 02 14:05:29.962815 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:29.962716 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-7gq54" event={"ID":"4ff6194a-8b82-4387-a950-0ee9961b6012","Type":"ContainerDied","Data":"eb463458a134bdc05c9f46be9a45a70d7e0f3c01e46c7503806b8c0f670062af"} Jul 02 14:05:29.962959 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:29.962944 2553 scope.go:117] "RemoveContainer" containerID="eb463458a134bdc05c9f46be9a45a70d7e0f3c01e46c7503806b8c0f670062af" Jul 02 14:05:30.397003 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:30.396951 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d45432e4-b5f5-429c-bc73-8b2518047065-service-ca-bundle\") pod \"router-default-684cbf6d5c-l2rsv\" (UID: \"d45432e4-b5f5-429c-bc73-8b2518047065\") " pod="openshift-ingress/router-default-684cbf6d5c-l2rsv" Jul 02 14:05:30.397428 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:30.397015 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d45432e4-b5f5-429c-bc73-8b2518047065-metrics-certs\") pod \"router-default-684cbf6d5c-l2rsv\" (UID: \"d45432e4-b5f5-429c-bc73-8b2518047065\") " pod="openshift-ingress/router-default-684cbf6d5c-l2rsv" Jul 02 14:05:30.397428 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:30.397046 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d2e31ddc-f8bc-489e-b978-c6abb94c5a04-registry-tls\") pod \"image-registry-5df66df7fd-95wdf\" (UID: \"d2e31ddc-f8bc-489e-b978-c6abb94c5a04\") " pod="openshift-image-registry/image-registry-5df66df7fd-95wdf" Jul 02 14:05:30.397428 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:30.397079 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cd3f94a9-f70e-497f-9b2e-4c7c3a0bd79e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-g7qmz\" (UID: \"cd3f94a9-f70e-497f-9b2e-4c7c3a0bd79e\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-g7qmz" Jul 02 14:05:30.397428 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:30.397121 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d45432e4-b5f5-429c-bc73-8b2518047065-service-ca-bundle podName:d45432e4-b5f5-429c-bc73-8b2518047065 nodeName:}" failed. No retries permitted until 2026-07-02 14:05:34.397104253 +0000 UTC m=+265.605347014 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d45432e4-b5f5-429c-bc73-8b2518047065-service-ca-bundle") pod "router-default-684cbf6d5c-l2rsv" (UID: "d45432e4-b5f5-429c-bc73-8b2518047065") : configmap references non-existent config key: service-ca.crt Jul 02 14:05:30.397428 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:30.397178 2553 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 14:05:30.397428 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:30.397179 2553 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 14:05:30.397428 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:30.397181 2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 14:05:30.397428 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:30.397235 2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5df66df7fd-95wdf: secret "image-registry-tls" not found Jul 02 14:05:30.397428 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:30.397226 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd3f94a9-f70e-497f-9b2e-4c7c3a0bd79e-cluster-monitoring-operator-tls podName:cd3f94a9-f70e-497f-9b2e-4c7c3a0bd79e nodeName:}" failed. No retries permitted until 2026-07-02 14:05:34.397214334 +0000 UTC m=+265.605457094 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cd3f94a9-f70e-497f-9b2e-4c7c3a0bd79e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-g7qmz" (UID: "cd3f94a9-f70e-497f-9b2e-4c7c3a0bd79e") : secret "cluster-monitoring-operator-tls" not found Jul 02 14:05:30.397428 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:30.397282 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d45432e4-b5f5-429c-bc73-8b2518047065-metrics-certs podName:d45432e4-b5f5-429c-bc73-8b2518047065 nodeName:}" failed. No retries permitted until 2026-07-02 14:05:34.397266906 +0000 UTC m=+265.605509671 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d45432e4-b5f5-429c-bc73-8b2518047065-metrics-certs") pod "router-default-684cbf6d5c-l2rsv" (UID: "d45432e4-b5f5-429c-bc73-8b2518047065") : secret "router-metrics-certs-default" not found Jul 02 14:05:30.397428 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:30.397296 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d2e31ddc-f8bc-489e-b978-c6abb94c5a04-registry-tls podName:d2e31ddc-f8bc-489e-b978-c6abb94c5a04 nodeName:}" failed. No retries permitted until 2026-07-02 14:05:34.397287922 +0000 UTC m=+265.605530682 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d2e31ddc-f8bc-489e-b978-c6abb94c5a04-registry-tls") pod "image-registry-5df66df7fd-95wdf" (UID: "d2e31ddc-f8bc-489e-b978-c6abb94c5a04") : secret "image-registry-tls" not found Jul 02 14:05:30.966617 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:30.966588 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-7gq54_4ff6194a-8b82-4387-a950-0ee9961b6012/console-operator/1.log" Jul 02 14:05:30.966965 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:30.966949 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-7gq54_4ff6194a-8b82-4387-a950-0ee9961b6012/console-operator/0.log" Jul 02 14:05:30.967122 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:30.967004 2553 generic.go:356] "Generic (PLEG): container finished" podID="4ff6194a-8b82-4387-a950-0ee9961b6012" containerID="70ca55d16cd92db51bec06e9825778e48b6194956dae1c7296ec3ddc002c39d2" exitCode=255 Jul 02 14:05:30.967122 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:30.967046 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-7gq54" event={"ID":"4ff6194a-8b82-4387-a950-0ee9961b6012","Type":"ContainerDied","Data":"70ca55d16cd92db51bec06e9825778e48b6194956dae1c7296ec3ddc002c39d2"} Jul 02 14:05:30.967122 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:30.967118 2553 scope.go:117] "RemoveContainer" containerID="eb463458a134bdc05c9f46be9a45a70d7e0f3c01e46c7503806b8c0f670062af" Jul 02 14:05:30.967315 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:30.967297 2553 scope.go:117] "RemoveContainer" containerID="70ca55d16cd92db51bec06e9825778e48b6194956dae1c7296ec3ddc002c39d2" Jul 02 14:05:30.967492 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:30.967469 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-7gq54_openshift-console-operator(4ff6194a-8b82-4387-a950-0ee9961b6012)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-7gq54" podUID="4ff6194a-8b82-4387-a950-0ee9961b6012" Jul 02 14:05:31.971340 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:31.971313 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-7gq54_4ff6194a-8b82-4387-a950-0ee9961b6012/console-operator/1.log" Jul 02 14:05:31.971740 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:31.971671 2553 scope.go:117] "RemoveContainer" containerID="70ca55d16cd92db51bec06e9825778e48b6194956dae1c7296ec3ddc002c39d2" Jul 02 14:05:31.971848 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:31.971828 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-7gq54_openshift-console-operator(4ff6194a-8b82-4387-a950-0ee9961b6012)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-7gq54" podUID="4ff6194a-8b82-4387-a950-0ee9961b6012" Jul 02 14:05:32.265488 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:32.265416 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-cn8gp"] Jul 02 14:05:32.269405 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:32.269378 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cn8gp" Jul 02 14:05:32.280381 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:32.280362 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 02 14:05:32.287812 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:32.287788 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 02 14:05:32.287812 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:32.287798 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 02 14:05:32.288134 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:32.288121 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 02 14:05:32.291054 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:32.291039 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-cfxtg\"" Jul 02 14:05:32.297752 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:32.297709 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:32.311627 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:32.311607 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/73f73c80-abc8-4c51-b3f3-82971c4aaaf1-crio-socket\") pod \"insights-runtime-extractor-cn8gp\" (UID: \"73f73c80-abc8-4c51-b3f3-82971c4aaaf1\") " pod="openshift-insights/insights-runtime-extractor-cn8gp" Jul 02 14:05:32.311723 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:32.311650 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nvql\" (UniqueName: \"kubernetes.io/projected/73f73c80-abc8-4c51-b3f3-82971c4aaaf1-kube-api-access-6nvql\") pod \"insights-runtime-extractor-cn8gp\" (UID: \"73f73c80-abc8-4c51-b3f3-82971c4aaaf1\") " pod="openshift-insights/insights-runtime-extractor-cn8gp" Jul 02 14:05:32.311772 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:32.311725 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/73f73c80-abc8-4c51-b3f3-82971c4aaaf1-data-volume\") pod \"insights-runtime-extractor-cn8gp\" (UID: \"73f73c80-abc8-4c51-b3f3-82971c4aaaf1\") " pod="openshift-insights/insights-runtime-extractor-cn8gp" Jul 02 14:05:32.311772 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:32.311752 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/73f73c80-abc8-4c51-b3f3-82971c4aaaf1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cn8gp\" (UID: \"73f73c80-abc8-4c51-b3f3-82971c4aaaf1\") " pod="openshift-insights/insights-runtime-extractor-cn8gp" Jul 02 14:05:32.315292 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:32.311777 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/73f73c80-abc8-4c51-b3f3-82971c4aaaf1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cn8gp\" (UID: \"73f73c80-abc8-4c51-b3f3-82971c4aaaf1\") " pod="openshift-insights/insights-runtime-extractor-cn8gp" Jul 02 14:05:32.342647 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:32.342622 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cn8gp"] Jul 02 14:05:32.373679 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:32.373649 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:32.412934 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:32.412910 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/73f73c80-abc8-4c51-b3f3-82971c4aaaf1-data-volume\") pod \"insights-runtime-extractor-cn8gp\" (UID: \"73f73c80-abc8-4c51-b3f3-82971c4aaaf1\") " pod="openshift-insights/insights-runtime-extractor-cn8gp" Jul 02 14:05:32.413064 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:32.412940 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/73f73c80-abc8-4c51-b3f3-82971c4aaaf1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cn8gp\" (UID: \"73f73c80-abc8-4c51-b3f3-82971c4aaaf1\") " pod="openshift-insights/insights-runtime-extractor-cn8gp" Jul 02 14:05:32.413064 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:32.412969 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/73f73c80-abc8-4c51-b3f3-82971c4aaaf1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cn8gp\" (UID: \"73f73c80-abc8-4c51-b3f3-82971c4aaaf1\") " pod="openshift-insights/insights-runtime-extractor-cn8gp" Jul 02 14:05:32.413064 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:32.413043 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/73f73c80-abc8-4c51-b3f3-82971c4aaaf1-crio-socket\") pod \"insights-runtime-extractor-cn8gp\" (UID: \"73f73c80-abc8-4c51-b3f3-82971c4aaaf1\") " pod="openshift-insights/insights-runtime-extractor-cn8gp" Jul 02 14:05:32.413177 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:32.413064 2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 14:05:32.413177 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:32.413126 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/73f73c80-abc8-4c51-b3f3-82971c4aaaf1-kube-rbac-proxy-cm podName:73f73c80-abc8-4c51-b3f3-82971c4aaaf1 nodeName:}" failed. No retries permitted until 2026-07-02 14:05:32.913107526 +0000 UTC m=+264.121350290 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/73f73c80-abc8-4c51-b3f3-82971c4aaaf1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cn8gp" (UID: "73f73c80-abc8-4c51-b3f3-82971c4aaaf1") : configmap "kube-rbac-proxy" not found Jul 02 14:05:32.413177 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:32.413136 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/73f73c80-abc8-4c51-b3f3-82971c4aaaf1-crio-socket\") pod \"insights-runtime-extractor-cn8gp\" (UID: \"73f73c80-abc8-4c51-b3f3-82971c4aaaf1\") " pod="openshift-insights/insights-runtime-extractor-cn8gp" Jul 02 14:05:32.413332 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:32.413180 2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 14:05:32.413332 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:32.413202 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nvql\" (UniqueName: \"kubernetes.io/projected/73f73c80-abc8-4c51-b3f3-82971c4aaaf1-kube-api-access-6nvql\") pod \"insights-runtime-extractor-cn8gp\" (UID: \"73f73c80-abc8-4c51-b3f3-82971c4aaaf1\") " pod="openshift-insights/insights-runtime-extractor-cn8gp" Jul 02 14:05:32.413332 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:32.413230 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73f73c80-abc8-4c51-b3f3-82971c4aaaf1-insights-runtime-extractor-tls podName:73f73c80-abc8-4c51-b3f3-82971c4aaaf1 nodeName:}" failed. No retries permitted until 2026-07-02 14:05:32.913216261 +0000 UTC m=+264.121459022 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/73f73c80-abc8-4c51-b3f3-82971c4aaaf1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cn8gp" (UID: "73f73c80-abc8-4c51-b3f3-82971c4aaaf1") : secret "insights-runtime-extractor-tls" not found Jul 02 14:05:32.413332 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:32.413256 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/73f73c80-abc8-4c51-b3f3-82971c4aaaf1-data-volume\") pod \"insights-runtime-extractor-cn8gp\" (UID: \"73f73c80-abc8-4c51-b3f3-82971c4aaaf1\") " pod="openshift-insights/insights-runtime-extractor-cn8gp" Jul 02 14:05:32.421728 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:32.421711 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nvql\" (UniqueName: \"kubernetes.io/projected/73f73c80-abc8-4c51-b3f3-82971c4aaaf1-kube-api-access-6nvql\") pod \"insights-runtime-extractor-cn8gp\" (UID: \"73f73c80-abc8-4c51-b3f3-82971c4aaaf1\") " pod="openshift-insights/insights-runtime-extractor-cn8gp" Jul 02 14:05:32.521246 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:32.521167 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:32.607964 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:32.607930 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:32.708736 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:32.708705 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:32.917285 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:32.917246 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/73f73c80-abc8-4c51-b3f3-82971c4aaaf1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cn8gp\" (UID: \"73f73c80-abc8-4c51-b3f3-82971c4aaaf1\") " pod="openshift-insights/insights-runtime-extractor-cn8gp" Jul 02 14:05:32.917472 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:32.917300 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/73f73c80-abc8-4c51-b3f3-82971c4aaaf1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cn8gp\" (UID: \"73f73c80-abc8-4c51-b3f3-82971c4aaaf1\") " pod="openshift-insights/insights-runtime-extractor-cn8gp" Jul 02 14:05:32.917472 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:32.917381 2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 14:05:32.917472 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:32.917456 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/73f73c80-abc8-4c51-b3f3-82971c4aaaf1-kube-rbac-proxy-cm podName:73f73c80-abc8-4c51-b3f3-82971c4aaaf1 nodeName:}" failed. No retries permitted until 2026-07-02 14:05:33.917435495 +0000 UTC m=+265.125678269 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/73f73c80-abc8-4c51-b3f3-82971c4aaaf1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cn8gp" (UID: "73f73c80-abc8-4c51-b3f3-82971c4aaaf1") : configmap "kube-rbac-proxy" not found Jul 02 14:05:32.917472 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:32.917388 2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 14:05:32.917664 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:32.917522 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73f73c80-abc8-4c51-b3f3-82971c4aaaf1-insights-runtime-extractor-tls podName:73f73c80-abc8-4c51-b3f3-82971c4aaaf1 nodeName:}" failed. No retries permitted until 2026-07-02 14:05:33.917511442 +0000 UTC m=+265.125754202 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/73f73c80-abc8-4c51-b3f3-82971c4aaaf1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cn8gp" (UID: "73f73c80-abc8-4c51-b3f3-82971c4aaaf1") : secret "insights-runtime-extractor-tls" not found Jul 02 14:05:33.066773 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:33.066744 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:33.166145 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:33.166114 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:33.299257 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:33.299177 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:33.371820 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:33.371787 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:33.804141 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:33.804091 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:33.904535 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:33.904499 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:33.925726 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:33.925702 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/73f73c80-abc8-4c51-b3f3-82971c4aaaf1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cn8gp\" (UID: \"73f73c80-abc8-4c51-b3f3-82971c4aaaf1\") " pod="openshift-insights/insights-runtime-extractor-cn8gp" Jul 02 14:05:33.925822 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:33.925798 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/73f73c80-abc8-4c51-b3f3-82971c4aaaf1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cn8gp\" (UID: \"73f73c80-abc8-4c51-b3f3-82971c4aaaf1\") " pod="openshift-insights/insights-runtime-extractor-cn8gp" Jul 02 14:05:33.925877 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:33.925862 2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 14:05:33.925946 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:33.925934 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/73f73c80-abc8-4c51-b3f3-82971c4aaaf1-kube-rbac-proxy-cm podName:73f73c80-abc8-4c51-b3f3-82971c4aaaf1 nodeName:}" failed. No retries permitted until 2026-07-02 14:05:35.925918001 +0000 UTC m=+267.134160766 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/73f73c80-abc8-4c51-b3f3-82971c4aaaf1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cn8gp" (UID: "73f73c80-abc8-4c51-b3f3-82971c4aaaf1") : configmap "kube-rbac-proxy" not found Jul 02 14:05:33.926040 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:33.925863 2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 14:05:33.926040 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:33.926027 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73f73c80-abc8-4c51-b3f3-82971c4aaaf1-insights-runtime-extractor-tls podName:73f73c80-abc8-4c51-b3f3-82971c4aaaf1 nodeName:}" failed. No retries permitted until 2026-07-02 14:05:35.926010247 +0000 UTC m=+267.134253027 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/73f73c80-abc8-4c51-b3f3-82971c4aaaf1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cn8gp" (UID: "73f73c80-abc8-4c51-b3f3-82971c4aaaf1") : secret "insights-runtime-extractor-tls" not found Jul 02 14:05:34.175380 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:34.175353 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lg74z_070f7754-21fb-458f-b47c-a5d2820ad39d/dns-node-resolver/0.log" Jul 02 14:05:34.431004 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:34.430900 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d45432e4-b5f5-429c-bc73-8b2518047065-service-ca-bundle\") pod \"router-default-684cbf6d5c-l2rsv\" (UID: \"d45432e4-b5f5-429c-bc73-8b2518047065\") " pod="openshift-ingress/router-default-684cbf6d5c-l2rsv" Jul 02 14:05:34.431004 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:34.430951 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d45432e4-b5f5-429c-bc73-8b2518047065-metrics-certs\") pod \"router-default-684cbf6d5c-l2rsv\" (UID: \"d45432e4-b5f5-429c-bc73-8b2518047065\") " pod="openshift-ingress/router-default-684cbf6d5c-l2rsv" Jul 02 14:05:34.431249 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:34.431018 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d2e31ddc-f8bc-489e-b978-c6abb94c5a04-registry-tls\") pod \"image-registry-5df66df7fd-95wdf\" (UID: \"d2e31ddc-f8bc-489e-b978-c6abb94c5a04\") " pod="openshift-image-registry/image-registry-5df66df7fd-95wdf" Jul 02 14:05:34.431249 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:34.431076 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cd3f94a9-f70e-497f-9b2e-4c7c3a0bd79e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-g7qmz\" (UID: \"cd3f94a9-f70e-497f-9b2e-4c7c3a0bd79e\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-g7qmz" Jul 02 14:05:34.431249 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:34.431104 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d45432e4-b5f5-429c-bc73-8b2518047065-service-ca-bundle podName:d45432e4-b5f5-429c-bc73-8b2518047065 nodeName:}" failed. No retries permitted until 2026-07-02 14:05:42.43108274 +0000 UTC m=+273.639325534 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d45432e4-b5f5-429c-bc73-8b2518047065-service-ca-bundle") pod "router-default-684cbf6d5c-l2rsv" (UID: "d45432e4-b5f5-429c-bc73-8b2518047065") : configmap references non-existent config key: service-ca.crt Jul 02 14:05:34.431249 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:34.431138 2553 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 14:05:34.431249 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:34.431138 2553 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 14:05:34.431249 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:34.431195 2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 14:05:34.431249 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:34.431182 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d45432e4-b5f5-429c-bc73-8b2518047065-metrics-certs podName:d45432e4-b5f5-429c-bc73-8b2518047065 nodeName:}" failed. No retries permitted until 2026-07-02 14:05:42.431171405 +0000 UTC m=+273.639414172 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d45432e4-b5f5-429c-bc73-8b2518047065-metrics-certs") pod "router-default-684cbf6d5c-l2rsv" (UID: "d45432e4-b5f5-429c-bc73-8b2518047065") : secret "router-metrics-certs-default" not found Jul 02 14:05:34.431249 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:34.431214 2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5df66df7fd-95wdf: secret "image-registry-tls" not found Jul 02 14:05:34.431249 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:34.431227 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd3f94a9-f70e-497f-9b2e-4c7c3a0bd79e-cluster-monitoring-operator-tls podName:cd3f94a9-f70e-497f-9b2e-4c7c3a0bd79e nodeName:}" failed. No retries permitted until 2026-07-02 14:05:42.431215222 +0000 UTC m=+273.639457983 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cd3f94a9-f70e-497f-9b2e-4c7c3a0bd79e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-g7qmz" (UID: "cd3f94a9-f70e-497f-9b2e-4c7c3a0bd79e") : secret "cluster-monitoring-operator-tls" not found Jul 02 14:05:34.431249 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:34.431250 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d2e31ddc-f8bc-489e-b978-c6abb94c5a04-registry-tls podName:d2e31ddc-f8bc-489e-b978-c6abb94c5a04 nodeName:}" failed. No retries permitted until 2026-07-02 14:05:42.43124033 +0000 UTC m=+273.639483120 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d2e31ddc-f8bc-489e-b978-c6abb94c5a04-registry-tls") pod "image-registry-5df66df7fd-95wdf" (UID: "d2e31ddc-f8bc-489e-b978-c6abb94c5a04") : secret "image-registry-tls" not found Jul 02 14:05:35.126005 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:35.125952 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:35.248876 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:35.248844 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:35.385853 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:35.385783 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zbkhx_253a79fe-da31-4f39-8017-9b6528e9e4df/node-ca/0.log" Jul 02 14:05:35.490586 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:35.490555 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:35.591121 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:35.591086 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:35.775336 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:35.775259 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6m2l6_f157d300-722a-4edc-84a9-cda9534aafd5/serve-healthcheck-canary/0.log" Jul 02 14:05:35.942800 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:35.942767 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/73f73c80-abc8-4c51-b3f3-82971c4aaaf1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cn8gp\" (UID: \"73f73c80-abc8-4c51-b3f3-82971c4aaaf1\") " pod="openshift-insights/insights-runtime-extractor-cn8gp" Jul 02 14:05:35.942972 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:35.942811 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/73f73c80-abc8-4c51-b3f3-82971c4aaaf1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cn8gp\" (UID: \"73f73c80-abc8-4c51-b3f3-82971c4aaaf1\") " pod="openshift-insights/insights-runtime-extractor-cn8gp" Jul 02 14:05:35.942972 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:35.942888 2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 14:05:35.942972 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:35.942905 2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 14:05:35.942972 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:35.942950 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/73f73c80-abc8-4c51-b3f3-82971c4aaaf1-kube-rbac-proxy-cm podName:73f73c80-abc8-4c51-b3f3-82971c4aaaf1 nodeName:}" failed. No retries permitted until 2026-07-02 14:05:39.942935371 +0000 UTC m=+271.151178132 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/73f73c80-abc8-4c51-b3f3-82971c4aaaf1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cn8gp" (UID: "73f73c80-abc8-4c51-b3f3-82971c4aaaf1") : configmap "kube-rbac-proxy" not found Jul 02 14:05:35.942972 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:35.942965 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73f73c80-abc8-4c51-b3f3-82971c4aaaf1-insights-runtime-extractor-tls podName:73f73c80-abc8-4c51-b3f3-82971c4aaaf1 nodeName:}" failed. No retries permitted until 2026-07-02 14:05:39.9429589 +0000 UTC m=+271.151201661 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/73f73c80-abc8-4c51-b3f3-82971c4aaaf1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cn8gp" (UID: "73f73c80-abc8-4c51-b3f3-82971c4aaaf1") : secret "insights-runtime-extractor-tls" not found Jul 02 14:05:36.474386 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:36.474351 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:37.071080 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:37.071025 2553 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7fdbdf9c99-7gq54" Jul 02 14:05:37.071080 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:37.071099 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-7gq54" Jul 02 14:05:37.071422 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:37.071410 2553 scope.go:117] "RemoveContainer" containerID="70ca55d16cd92db51bec06e9825778e48b6194956dae1c7296ec3ddc002c39d2" Jul 02 14:05:37.071566 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:37.071548 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-7gq54_openshift-console-operator(4ff6194a-8b82-4387-a950-0ee9961b6012)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-7gq54" podUID="4ff6194a-8b82-4387-a950-0ee9961b6012" Jul 02 14:05:37.262724 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:37.262691 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:37.486714 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:37.486677 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:37.594624 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:37.594593 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:37.744956 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:37.744861 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:37.880733 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:37.880696 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:37.970447 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:37.970407 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:38.650920 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:38.650868 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:39.165775 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:39.165744 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:39.582077 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:39.581932 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:39.917338 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:39.917303 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:39.978073 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:39.978043 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/73f73c80-abc8-4c51-b3f3-82971c4aaaf1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cn8gp\" (UID: \"73f73c80-abc8-4c51-b3f3-82971c4aaaf1\") " pod="openshift-insights/insights-runtime-extractor-cn8gp" Jul 02 14:05:39.978249 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:39.978084 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/73f73c80-abc8-4c51-b3f3-82971c4aaaf1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cn8gp\" (UID: \"73f73c80-abc8-4c51-b3f3-82971c4aaaf1\") " pod="openshift-insights/insights-runtime-extractor-cn8gp" Jul 02 14:05:39.978249 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:39.978174 2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 14:05:39.978249 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:39.978250 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/73f73c80-abc8-4c51-b3f3-82971c4aaaf1-kube-rbac-proxy-cm podName:73f73c80-abc8-4c51-b3f3-82971c4aaaf1 nodeName:}" failed. No retries permitted until 2026-07-02 14:05:47.978229889 +0000 UTC m=+279.186472665 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/73f73c80-abc8-4c51-b3f3-82971c4aaaf1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cn8gp" (UID: "73f73c80-abc8-4c51-b3f3-82971c4aaaf1") : configmap "kube-rbac-proxy" not found Jul 02 14:05:39.978410 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:39.978257 2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 14:05:39.978410 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:39.978302 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73f73c80-abc8-4c51-b3f3-82971c4aaaf1-insights-runtime-extractor-tls podName:73f73c80-abc8-4c51-b3f3-82971c4aaaf1 nodeName:}" failed. No retries permitted until 2026-07-02 14:05:47.978289688 +0000 UTC m=+279.186532453 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/73f73c80-abc8-4c51-b3f3-82971c4aaaf1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cn8gp" (UID: "73f73c80-abc8-4c51-b3f3-82971c4aaaf1") : secret "insights-runtime-extractor-tls" not found Jul 02 14:05:40.344179 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:40.344079 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:40.514886 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:40.514852 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:40.615547 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:40.615517 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:40.892792 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:40.892707 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:41.105279 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:41.105246 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:41.357545 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:41.357470 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:41.713662 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:41.713624 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:41.913966 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:41.913932 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:42.126873 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:42.126848 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:42.498119 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:42.498037 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d45432e4-b5f5-429c-bc73-8b2518047065-metrics-certs\") pod \"router-default-684cbf6d5c-l2rsv\" (UID: \"d45432e4-b5f5-429c-bc73-8b2518047065\") " pod="openshift-ingress/router-default-684cbf6d5c-l2rsv" Jul 02 14:05:42.498119 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:42.498090 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d2e31ddc-f8bc-489e-b978-c6abb94c5a04-registry-tls\") pod \"image-registry-5df66df7fd-95wdf\" (UID: \"d2e31ddc-f8bc-489e-b978-c6abb94c5a04\") " pod="openshift-image-registry/image-registry-5df66df7fd-95wdf" Jul 02 14:05:42.498301 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:42.498127 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cd3f94a9-f70e-497f-9b2e-4c7c3a0bd79e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-g7qmz\" (UID: \"cd3f94a9-f70e-497f-9b2e-4c7c3a0bd79e\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-g7qmz" Jul 02 14:05:42.498301 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:42.498162 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d45432e4-b5f5-429c-bc73-8b2518047065-service-ca-bundle\") pod \"router-default-684cbf6d5c-l2rsv\" (UID: \"d45432e4-b5f5-429c-bc73-8b2518047065\") " pod="openshift-ingress/router-default-684cbf6d5c-l2rsv" Jul 02 14:05:42.498301 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:42.498271 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d45432e4-b5f5-429c-bc73-8b2518047065-service-ca-bundle podName:d45432e4-b5f5-429c-bc73-8b2518047065 nodeName:}" failed. No retries permitted until 2026-07-02 14:05:58.498255168 +0000 UTC m=+289.706497930 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d45432e4-b5f5-429c-bc73-8b2518047065-service-ca-bundle") pod "router-default-684cbf6d5c-l2rsv" (UID: "d45432e4-b5f5-429c-bc73-8b2518047065") : configmap references non-existent config key: service-ca.crt Jul 02 14:05:42.498301 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:42.498267 2553 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 14:05:42.498301 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:42.498301 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd3f94a9-f70e-497f-9b2e-4c7c3a0bd79e-cluster-monitoring-operator-tls podName:cd3f94a9-f70e-497f-9b2e-4c7c3a0bd79e nodeName:}" failed. No retries permitted until 2026-07-02 14:05:58.498295356 +0000 UTC m=+289.706538117 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cd3f94a9-f70e-497f-9b2e-4c7c3a0bd79e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-g7qmz" (UID: "cd3f94a9-f70e-497f-9b2e-4c7c3a0bd79e") : secret "cluster-monitoring-operator-tls" not found Jul 02 14:05:42.500487 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:42.500460 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d2e31ddc-f8bc-489e-b978-c6abb94c5a04-registry-tls\") pod \"image-registry-5df66df7fd-95wdf\" (UID: \"d2e31ddc-f8bc-489e-b978-c6abb94c5a04\") " pod="openshift-image-registry/image-registry-5df66df7fd-95wdf" Jul 02 14:05:42.500487 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:42.500487 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d45432e4-b5f5-429c-bc73-8b2518047065-metrics-certs\") pod \"router-default-684cbf6d5c-l2rsv\" (UID: \"d45432e4-b5f5-429c-bc73-8b2518047065\") " pod="openshift-ingress/router-default-684cbf6d5c-l2rsv" Jul 02 14:05:42.510911 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:42.510886 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:42.581125 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:42.581082 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5df66df7fd-95wdf" Jul 02 14:05:42.707381 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:42.707361 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5df66df7fd-95wdf"] Jul 02 14:05:42.709753 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:05:42.709725 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2e31ddc_f8bc_489e_b978_c6abb94c5a04.slice/crio-d2b3be250bf795dcd609357d0c0d357b351c19d415065f51752288be2c83c87a WatchSource:0}: Error finding container d2b3be250bf795dcd609357d0c0d357b351c19d415065f51752288be2c83c87a: Status 404 returned error can't find the container with id d2b3be250bf795dcd609357d0c0d357b351c19d415065f51752288be2c83c87a Jul 02 14:05:43.007814 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:43.007725 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5df66df7fd-95wdf" event={"ID":"d2e31ddc-f8bc-489e-b978-c6abb94c5a04","Type":"ContainerStarted","Data":"6d977a12669786b34c9cb8dbfbf26db75603ef9b1e7b752091219ef32183e00e"} Jul 02 14:05:43.007814 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:43.007778 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5df66df7fd-95wdf" event={"ID":"d2e31ddc-f8bc-489e-b978-c6abb94c5a04","Type":"ContainerStarted","Data":"d2b3be250bf795dcd609357d0c0d357b351c19d415065f51752288be2c83c87a"} Jul 02 14:05:43.007814 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:43.007806 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5df66df7fd-95wdf" Jul 02 14:05:43.037161 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:43.037112 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5df66df7fd-95wdf" podStartSLOduration=17.03709752 podStartE2EDuration="17.03709752s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:05:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:05:43.035704752 +0000 UTC m=+274.243947535" watchObservedRunningTime="2026-07-02 14:05:43.03709752 +0000 UTC m=+274.245340302" Jul 02 14:05:43.111408 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:43.111380 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:43.472142 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:43.472112 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:43.688577 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:43.688548 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:43.908435 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:43.908404 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:44.114727 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:44.114701 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:44.490609 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:44.490579 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:45.104825 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:45.104767 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:45.337113 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:45.337083 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:45.537721 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:45.537681 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:45.862582 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:45.862500 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:46.304352 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:46.304323 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:46.733279 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:46.733250 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:47.211628 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:47.211601 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:47.578910 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:47.578826 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:47.840177 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:47.840095 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:48.046775 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:48.046735 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/73f73c80-abc8-4c51-b3f3-82971c4aaaf1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cn8gp\" (UID: \"73f73c80-abc8-4c51-b3f3-82971c4aaaf1\") " pod="openshift-insights/insights-runtime-extractor-cn8gp" Jul 02 14:05:48.046959 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:48.046782 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/73f73c80-abc8-4c51-b3f3-82971c4aaaf1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cn8gp\" (UID: \"73f73c80-abc8-4c51-b3f3-82971c4aaaf1\") " pod="openshift-insights/insights-runtime-extractor-cn8gp" Jul 02 14:05:48.047346 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:48.047326 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/73f73c80-abc8-4c51-b3f3-82971c4aaaf1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cn8gp\" (UID: \"73f73c80-abc8-4c51-b3f3-82971c4aaaf1\") " pod="openshift-insights/insights-runtime-extractor-cn8gp" Jul 02 14:05:48.049091 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:48.049070 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/73f73c80-abc8-4c51-b3f3-82971c4aaaf1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cn8gp\" (UID: \"73f73c80-abc8-4c51-b3f3-82971c4aaaf1\") " pod="openshift-insights/insights-runtime-extractor-cn8gp" Jul 02 14:05:48.075719 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:48.075689 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:48.178318 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:48.178293 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cn8gp" Jul 02 14:05:48.220971 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:48.220940 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:48.320588 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:48.320558 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cn8gp"] Jul 02 14:05:48.323768 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:05:48.323739 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73f73c80_abc8_4c51_b3f3_82971c4aaaf1.slice/crio-5dc0f43955a1928f233a7ea40a7241149153737bd249f7e0f600114ddff4e0f6 WatchSource:0}: Error finding container 5dc0f43955a1928f233a7ea40a7241149153737bd249f7e0f600114ddff4e0f6: Status 404 returned error can't find the container with id 5dc0f43955a1928f233a7ea40a7241149153737bd249f7e0f600114ddff4e0f6 Jul 02 14:05:48.916331 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:48.916294 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:49.004194 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:49.004135 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:49.027137 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:49.027102 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cn8gp" event={"ID":"73f73c80-abc8-4c51-b3f3-82971c4aaaf1","Type":"ContainerStarted","Data":"5dc0f43955a1928f233a7ea40a7241149153737bd249f7e0f600114ddff4e0f6"} Jul 02 14:05:51.705240 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:05:51.705194 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-2f9dr" podUID="5a21a391-4a45-4143-a680-df9abc1cee3b" Jul 02 14:05:52.038197 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:52.038172 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2f9dr" Jul 02 14:05:52.201336 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:52.201307 2553 scope.go:117] "RemoveContainer" containerID="70ca55d16cd92db51bec06e9825778e48b6194956dae1c7296ec3ddc002c39d2" Jul 02 14:05:53.045142 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:53.045048 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cn8gp" event={"ID":"73f73c80-abc8-4c51-b3f3-82971c4aaaf1","Type":"ContainerStarted","Data":"5de5c92778278b23e7e32e4d5f77f3e0063a1c6e46cae75937f2209a4f54000b"} Jul 02 14:05:53.045142 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:53.045114 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cn8gp" event={"ID":"73f73c80-abc8-4c51-b3f3-82971c4aaaf1","Type":"ContainerStarted","Data":"3eb9152f3f1df93f18658ac350575bcfdc42884308fbe9646e8e06356f205941"} Jul 02 14:05:53.046753 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:53.046734 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-7gq54_4ff6194a-8b82-4387-a950-0ee9961b6012/console-operator/1.log" Jul 02 14:05:53.046857 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:53.046784 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-7gq54" event={"ID":"4ff6194a-8b82-4387-a950-0ee9961b6012","Type":"ContainerStarted","Data":"bcfda3ec303c721a3037a60bfbd9073810d183440a6d2edc1b8842be6d40ecc2"} Jul 02 14:05:53.047086 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:53.047056 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-7gq54" Jul 02 14:05:53.088895 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:53.088843 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7fdbdf9c99-7gq54" podStartSLOduration=24.692166756 podStartE2EDuration="27.088827436s" totalImagesPullingTime="2.39666068s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:05:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:05:53.087533541 +0000 UTC m=+284.295776327" watchObservedRunningTime="2026-07-02 14:05:53.088827436 +0000 UTC m=+284.297070218" Jul 02 14:05:53.548950 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:53.548919 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-7gq54" Jul 02 14:05:53.801097 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:53.801006 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:53.903415 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:53.903379 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:54.069250 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:54.069165 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:54.444708 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:54.444676 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:54.624558 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:54.624524 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:54.849574 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:54.849492 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:55.008706 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:55.008674 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:55.110800 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:55.110670 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a21a391-4a45-4143-a680-df9abc1cee3b-metrics-tls\") pod \"dns-default-2f9dr\" (UID: \"5a21a391-4a45-4143-a680-df9abc1cee3b\") " pod="openshift-dns/dns-default-2f9dr" Jul 02 14:05:55.117737 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:55.117698 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a21a391-4a45-4143-a680-df9abc1cee3b-metrics-tls\") pod \"dns-default-2f9dr\" (UID: \"5a21a391-4a45-4143-a680-df9abc1cee3b\") " pod="openshift-dns/dns-default-2f9dr" Jul 02 14:05:55.304131 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:55.304084 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:55.341494 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:55.341469 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-h8n4j\"" Jul 02 14:05:55.349357 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:55.349333 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2f9dr" Jul 02 14:05:55.454654 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:55.454618 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:55.485490 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:55.485460 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2f9dr"] Jul 02 14:05:55.488951 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:05:55.488931 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a21a391_4a45_4143_a680_df9abc1cee3b.slice/crio-94d2a06fc233402b2a6f9668f7969719c3d8d34b3d2cdac3a20d2c7d7037ba1a WatchSource:0}: Error finding container 94d2a06fc233402b2a6f9668f7969719c3d8d34b3d2cdac3a20d2c7d7037ba1a: Status 404 returned error can't find the container with id 94d2a06fc233402b2a6f9668f7969719c3d8d34b3d2cdac3a20d2c7d7037ba1a Jul 02 14:05:55.664091 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:55.664004 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:56.058604 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:56.058511 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cn8gp" event={"ID":"73f73c80-abc8-4c51-b3f3-82971c4aaaf1","Type":"ContainerStarted","Data":"94ff1107fdd8d080351a5645e9547195edaf15085d757b0565ef47d607db9ed8"} Jul 02 14:05:56.059523 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:56.059501 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2f9dr" event={"ID":"5a21a391-4a45-4143-a680-df9abc1cee3b","Type":"ContainerStarted","Data":"94d2a06fc233402b2a6f9668f7969719c3d8d34b3d2cdac3a20d2c7d7037ba1a"} Jul 02 14:05:56.467197 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:56.467156 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:56.571862 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:56.571826 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:57.082465 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:57.082413 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-cn8gp" podStartSLOduration=18.241597443 podStartE2EDuration="25.0823924s" totalImagesPullingTime="6.840794957s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:05:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:05:56.095104277 +0000 UTC m=+287.303347061" watchObservedRunningTime="2026-07-02 14:05:57.0823924 +0000 UTC m=+288.290635183" Jul 02 14:05:57.083237 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:57.083213 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5df66df7fd-95wdf"] Jul 02 14:05:57.087809 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:57.087783 2553 patch_prober.go:28] interesting pod/image-registry-5df66df7fd-95wdf container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 02 14:05:57.087924 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:57.087829 2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5df66df7fd-95wdf" podUID="d2e31ddc-f8bc-489e-b978-c6abb94c5a04" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 14:05:57.271632 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:57.271599 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:57.392549 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:57.392521 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:05:58.068015 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:58.067909 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2f9dr" event={"ID":"5a21a391-4a45-4143-a680-df9abc1cee3b","Type":"ContainerStarted","Data":"f57452be1b41702c649f6a7bc1b001de2ca3c837e2de957bcf99f08cd5881be0"} Jul 02 14:05:58.068015 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:58.067961 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2f9dr" event={"ID":"5a21a391-4a45-4143-a680-df9abc1cee3b","Type":"ContainerStarted","Data":"f830d33ec010be1bc111d55f1d1a6000d58a3d51126b7d47fcdc295a03f0a910"} Jul 02 14:05:58.068393 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:58.068035 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-2f9dr" Jul 02 14:05:58.099895 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:58.099833 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-2f9dr" podStartSLOduration=250.948510636 podStartE2EDuration="4m13.09981752s" totalImagesPullingTime="2.151306884s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:01:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:05:58.099022124 +0000 UTC m=+289.307264907" watchObservedRunningTime="2026-07-02 14:05:58.09981752 +0000 UTC m=+289.308060302" Jul 02 14:05:58.539293 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:58.539257 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d45432e4-b5f5-429c-bc73-8b2518047065-service-ca-bundle\") pod \"router-default-684cbf6d5c-l2rsv\" (UID: \"d45432e4-b5f5-429c-bc73-8b2518047065\") " pod="openshift-ingress/router-default-684cbf6d5c-l2rsv" Jul 02 14:05:58.539468 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:58.539321 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cd3f94a9-f70e-497f-9b2e-4c7c3a0bd79e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-g7qmz\" (UID: \"cd3f94a9-f70e-497f-9b2e-4c7c3a0bd79e\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-g7qmz" Jul 02 14:05:58.539933 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:58.539905 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d45432e4-b5f5-429c-bc73-8b2518047065-service-ca-bundle\") pod \"router-default-684cbf6d5c-l2rsv\" (UID: \"d45432e4-b5f5-429c-bc73-8b2518047065\") " pod="openshift-ingress/router-default-684cbf6d5c-l2rsv" Jul 02 14:05:58.541545 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:58.541523 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cd3f94a9-f70e-497f-9b2e-4c7c3a0bd79e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-g7qmz\" (UID: \"cd3f94a9-f70e-497f-9b2e-4c7c3a0bd79e\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-g7qmz" Jul 02 14:05:58.764890 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:58.764860 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-g7qmz" Jul 02 14:05:58.775034 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:58.775001 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-684cbf6d5c-l2rsv" Jul 02 14:05:58.899321 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:58.899287 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-g7qmz"] Jul 02 14:05:58.903149 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:05:58.903123 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd3f94a9_f70e_497f_9b2e_4c7c3a0bd79e.slice/crio-bdc0f8e82e7c6ff9d941422fec9cf90939869dcaa6ea4837bc30c4d07f79b98a WatchSource:0}: Error finding container bdc0f8e82e7c6ff9d941422fec9cf90939869dcaa6ea4837bc30c4d07f79b98a: Status 404 returned error can't find the container with id bdc0f8e82e7c6ff9d941422fec9cf90939869dcaa6ea4837bc30c4d07f79b98a Jul 02 14:05:58.917234 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:58.917209 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-684cbf6d5c-l2rsv"] Jul 02 14:05:58.920176 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:05:58.920153 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd45432e4_b5f5_429c_bc73_8b2518047065.slice/crio-2e40053d7f78861ac5cb9bc3792f8e40d0d028d4add1b93d7b056620854e3dc7 WatchSource:0}: Error finding container 2e40053d7f78861ac5cb9bc3792f8e40d0d028d4add1b93d7b056620854e3dc7: Status 404 returned error can't find the container with id 2e40053d7f78861ac5cb9bc3792f8e40d0d028d4add1b93d7b056620854e3dc7 Jul 02 14:05:59.074627 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:59.074535 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-g7qmz" event={"ID":"cd3f94a9-f70e-497f-9b2e-4c7c3a0bd79e","Type":"ContainerStarted","Data":"bdc0f8e82e7c6ff9d941422fec9cf90939869dcaa6ea4837bc30c4d07f79b98a"} Jul 02 14:05:59.076282 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:59.076251 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-684cbf6d5c-l2rsv" event={"ID":"d45432e4-b5f5-429c-bc73-8b2518047065","Type":"ContainerStarted","Data":"959f4b8c46571fb169a08acd65376490f02aa0049b6a431dd234200bdc83cabf"} Jul 02 14:05:59.076412 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:59.076294 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-684cbf6d5c-l2rsv" event={"ID":"d45432e4-b5f5-429c-bc73-8b2518047065","Type":"ContainerStarted","Data":"2e40053d7f78861ac5cb9bc3792f8e40d0d028d4add1b93d7b056620854e3dc7"} Jul 02 14:05:59.098482 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:59.098440 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-684cbf6d5c-l2rsv" podStartSLOduration=33.098426364 podStartE2EDuration="33.098426364s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:05:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:05:59.097775604 +0000 UTC m=+290.306018388" watchObservedRunningTime="2026-07-02 14:05:59.098426364 +0000 UTC m=+290.306669125" Jul 02 14:05:59.775222 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:59.775182 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-684cbf6d5c-l2rsv" Jul 02 14:05:59.778163 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:05:59.778123 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-684cbf6d5c-l2rsv" Jul 02 14:06:00.079893 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:00.079814 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-684cbf6d5c-l2rsv" Jul 02 14:06:00.081036 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:00.080982 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-684cbf6d5c-l2rsv" Jul 02 14:06:01.084399 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:01.084365 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-g7qmz" event={"ID":"cd3f94a9-f70e-497f-9b2e-4c7c3a0bd79e","Type":"ContainerStarted","Data":"4862b6bda6217b0c9ade6c8d8df8eb136075bd673c092ca7deed727b969eaea4"} Jul 02 14:06:01.129184 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:01.129117 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-g7qmz" podStartSLOduration=33.075297919 podStartE2EDuration="35.129093784s" totalImagesPullingTime="2.053795865s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:05:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:06:01.128360967 +0000 UTC m=+292.336603750" watchObservedRunningTime="2026-07-02 14:06:01.129093784 +0000 UTC m=+292.337336563" Jul 02 14:06:01.333860 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:01.333767 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:06:01.431494 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:01.431461 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:06:01.494849 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:01.494810 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-zgm8b"] Jul 02 14:06:01.498220 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:01.498197 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-zgm8b" Jul 02 14:06:01.500610 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:01.500587 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-fmjb9\"" Jul 02 14:06:01.500718 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:01.500620 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 02 14:06:01.506447 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:01.506422 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-zgm8b"] Jul 02 14:06:01.511684 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:01.511651 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:06:01.564030 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:01.563971 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/52d9c9f7-ba13-4b8f-923e-f04137c174e3-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-zgm8b\" (UID: \"52d9c9f7-ba13-4b8f-923e-f04137c174e3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-zgm8b" Jul 02 14:06:01.665235 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:01.665206 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/52d9c9f7-ba13-4b8f-923e-f04137c174e3-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-zgm8b\" (UID: \"52d9c9f7-ba13-4b8f-923e-f04137c174e3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-zgm8b" Jul 02 14:06:01.665439 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:06:01.665331 2553 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 02 14:06:01.665439 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:06:01.665393 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52d9c9f7-ba13-4b8f-923e-f04137c174e3-tls-certificates podName:52d9c9f7-ba13-4b8f-923e-f04137c174e3 nodeName:}" failed. No retries permitted until 2026-07-02 14:06:02.165377446 +0000 UTC m=+293.373620219 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/52d9c9f7-ba13-4b8f-923e-f04137c174e3-tls-certificates") pod "prometheus-operator-admission-webhook-7ddc8784d4-zgm8b" (UID: "52d9c9f7-ba13-4b8f-923e-f04137c174e3") : secret "prometheus-operator-admission-webhook-tls" not found Jul 02 14:06:01.747704 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:01.747673 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:06:01.866981 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:01.866947 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-d74748d4-clkcr"] Jul 02 14:06:01.869870 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:01.869854 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d74748d4-clkcr" Jul 02 14:06:01.873458 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:01.873438 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 02 14:06:01.873597 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:01.873478 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 02 14:06:01.873956 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:01.873935 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 02 14:06:01.874065 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:01.873960 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 02 14:06:01.874065 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:01.874028 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 02 14:06:01.874065 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:01.874055 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-pkv6w\"" Jul 02 14:06:01.874218 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:01.874111 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 02 14:06:01.874679 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:01.874656 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 02 14:06:01.882933 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:01.882906 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d74748d4-clkcr"] Jul 02 14:06:01.967908 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:01.967816 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cb5884a8-d8c7-43fb-8e4b-185bba477794-console-serving-cert\") pod \"console-d74748d4-clkcr\" (UID: \"cb5884a8-d8c7-43fb-8e4b-185bba477794\") " pod="openshift-console/console-d74748d4-clkcr" Jul 02 14:06:01.967908 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:01.967865 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cb5884a8-d8c7-43fb-8e4b-185bba477794-oauth-serving-cert\") pod \"console-d74748d4-clkcr\" (UID: \"cb5884a8-d8c7-43fb-8e4b-185bba477794\") " pod="openshift-console/console-d74748d4-clkcr" Jul 02 14:06:01.968167 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:01.967925 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cb5884a8-d8c7-43fb-8e4b-185bba477794-console-config\") pod \"console-d74748d4-clkcr\" (UID: \"cb5884a8-d8c7-43fb-8e4b-185bba477794\") " pod="openshift-console/console-d74748d4-clkcr" Jul 02 14:06:01.968167 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:01.967971 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cb5884a8-d8c7-43fb-8e4b-185bba477794-service-ca\") pod \"console-d74748d4-clkcr\" (UID: \"cb5884a8-d8c7-43fb-8e4b-185bba477794\") " pod="openshift-console/console-d74748d4-clkcr" Jul 02 14:06:01.968167 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:01.968037 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cb5884a8-d8c7-43fb-8e4b-185bba477794-console-oauth-config\") pod \"console-d74748d4-clkcr\" (UID: \"cb5884a8-d8c7-43fb-8e4b-185bba477794\") " pod="openshift-console/console-d74748d4-clkcr" Jul 02 14:06:01.968167 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:01.968064 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jt7vw\" (UniqueName: \"kubernetes.io/projected/cb5884a8-d8c7-43fb-8e4b-185bba477794-kube-api-access-jt7vw\") pod \"console-d74748d4-clkcr\" (UID: \"cb5884a8-d8c7-43fb-8e4b-185bba477794\") " pod="openshift-console/console-d74748d4-clkcr" Jul 02 14:06:02.068687 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:02.068648 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cb5884a8-d8c7-43fb-8e4b-185bba477794-console-config\") pod \"console-d74748d4-clkcr\" (UID: \"cb5884a8-d8c7-43fb-8e4b-185bba477794\") " pod="openshift-console/console-d74748d4-clkcr" Jul 02 14:06:02.068687 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:02.068690 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cb5884a8-d8c7-43fb-8e4b-185bba477794-service-ca\") pod \"console-d74748d4-clkcr\" (UID: \"cb5884a8-d8c7-43fb-8e4b-185bba477794\") " pod="openshift-console/console-d74748d4-clkcr" Jul 02 14:06:02.068903 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:02.068716 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cb5884a8-d8c7-43fb-8e4b-185bba477794-console-oauth-config\") pod \"console-d74748d4-clkcr\" (UID: \"cb5884a8-d8c7-43fb-8e4b-185bba477794\") " pod="openshift-console/console-d74748d4-clkcr" Jul 02 14:06:02.068903 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:02.068733 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jt7vw\" (UniqueName: \"kubernetes.io/projected/cb5884a8-d8c7-43fb-8e4b-185bba477794-kube-api-access-jt7vw\") pod \"console-d74748d4-clkcr\" (UID: \"cb5884a8-d8c7-43fb-8e4b-185bba477794\") " pod="openshift-console/console-d74748d4-clkcr" Jul 02 14:06:02.068903 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:02.068786 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cb5884a8-d8c7-43fb-8e4b-185bba477794-console-serving-cert\") pod \"console-d74748d4-clkcr\" (UID: \"cb5884a8-d8c7-43fb-8e4b-185bba477794\") " pod="openshift-console/console-d74748d4-clkcr" Jul 02 14:06:02.068903 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:02.068823 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cb5884a8-d8c7-43fb-8e4b-185bba477794-oauth-serving-cert\") pod \"console-d74748d4-clkcr\" (UID: \"cb5884a8-d8c7-43fb-8e4b-185bba477794\") " pod="openshift-console/console-d74748d4-clkcr" Jul 02 14:06:02.069495 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:02.069471 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cb5884a8-d8c7-43fb-8e4b-185bba477794-service-ca\") pod \"console-d74748d4-clkcr\" (UID: \"cb5884a8-d8c7-43fb-8e4b-185bba477794\") " pod="openshift-console/console-d74748d4-clkcr" Jul 02 14:06:02.069595 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:02.069531 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cb5884a8-d8c7-43fb-8e4b-185bba477794-console-config\") pod \"console-d74748d4-clkcr\" (UID: \"cb5884a8-d8c7-43fb-8e4b-185bba477794\") " pod="openshift-console/console-d74748d4-clkcr" Jul 02 14:06:02.069635 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:02.069609 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cb5884a8-d8c7-43fb-8e4b-185bba477794-oauth-serving-cert\") pod \"console-d74748d4-clkcr\" (UID: \"cb5884a8-d8c7-43fb-8e4b-185bba477794\") " pod="openshift-console/console-d74748d4-clkcr" Jul 02 14:06:02.071747 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:02.071727 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cb5884a8-d8c7-43fb-8e4b-185bba477794-console-oauth-config\") pod \"console-d74748d4-clkcr\" (UID: \"cb5884a8-d8c7-43fb-8e4b-185bba477794\") " pod="openshift-console/console-d74748d4-clkcr" Jul 02 14:06:02.071825 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:02.071735 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cb5884a8-d8c7-43fb-8e4b-185bba477794-console-serving-cert\") pod \"console-d74748d4-clkcr\" (UID: \"cb5884a8-d8c7-43fb-8e4b-185bba477794\") " pod="openshift-console/console-d74748d4-clkcr" Jul 02 14:06:02.078058 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:02.078031 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jt7vw\" (UniqueName: \"kubernetes.io/projected/cb5884a8-d8c7-43fb-8e4b-185bba477794-kube-api-access-jt7vw\") pod \"console-d74748d4-clkcr\" (UID: \"cb5884a8-d8c7-43fb-8e4b-185bba477794\") " pod="openshift-console/console-d74748d4-clkcr" Jul 02 14:06:02.170054 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:02.169982 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/52d9c9f7-ba13-4b8f-923e-f04137c174e3-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-zgm8b\" (UID: \"52d9c9f7-ba13-4b8f-923e-f04137c174e3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-zgm8b" Jul 02 14:06:02.172399 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:02.172379 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/52d9c9f7-ba13-4b8f-923e-f04137c174e3-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-zgm8b\" (UID: \"52d9c9f7-ba13-4b8f-923e-f04137c174e3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-zgm8b" Jul 02 14:06:02.179277 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:02.179252 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d74748d4-clkcr" Jul 02 14:06:02.335754 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:02.335724 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d74748d4-clkcr"] Jul 02 14:06:02.338595 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:06:02.338570 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb5884a8_d8c7_43fb_8e4b_185bba477794.slice/crio-bde7b227cee0a648ad683dde089fdf32e8da6c17fc9c04a677fcc2f06a2edbf2 WatchSource:0}: Error finding container bde7b227cee0a648ad683dde089fdf32e8da6c17fc9c04a677fcc2f06a2edbf2: Status 404 returned error can't find the container with id bde7b227cee0a648ad683dde089fdf32e8da6c17fc9c04a677fcc2f06a2edbf2 Jul 02 14:06:02.407673 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:02.407639 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-zgm8b" Jul 02 14:06:02.538602 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:02.535863 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-zgm8b"] Jul 02 14:06:02.540645 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:06:02.540613 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52d9c9f7_ba13_4b8f_923e_f04137c174e3.slice/crio-08f0dc79aa7668edc413fde17ba8be8f7ad0431b8d52a06304ae4aad455ff5e7 WatchSource:0}: Error finding container 08f0dc79aa7668edc413fde17ba8be8f7ad0431b8d52a06304ae4aad455ff5e7: Status 404 returned error can't find the container with id 08f0dc79aa7668edc413fde17ba8be8f7ad0431b8d52a06304ae4aad455ff5e7 Jul 02 14:06:03.092141 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:03.092107 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d74748d4-clkcr" event={"ID":"cb5884a8-d8c7-43fb-8e4b-185bba477794","Type":"ContainerStarted","Data":"bde7b227cee0a648ad683dde089fdf32e8da6c17fc9c04a677fcc2f06a2edbf2"} Jul 02 14:06:03.093162 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:03.093141 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-zgm8b" event={"ID":"52d9c9f7-ba13-4b8f-923e-f04137c174e3","Type":"ContainerStarted","Data":"08f0dc79aa7668edc413fde17ba8be8f7ad0431b8d52a06304ae4aad455ff5e7"} Jul 02 14:06:04.099300 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:04.099262 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-zgm8b" event={"ID":"52d9c9f7-ba13-4b8f-923e-f04137c174e3","Type":"ContainerStarted","Data":"70d6fb1a30e2577c2a1f0ab87c57f0acb2dfeab1d52495950a6a28b6b237bc52"} Jul 02 14:06:04.099837 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:04.099628 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-zgm8b" Jul 02 14:06:04.104961 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:04.104935 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-zgm8b" Jul 02 14:06:04.114976 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:04.114918 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-zgm8b" podStartSLOduration=1.708916478 podStartE2EDuration="3.114899205s" totalImagesPullingTime="1.405982727s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:06:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:06:04.11421246 +0000 UTC m=+295.322455244" watchObservedRunningTime="2026-07-02 14:06:04.114899205 +0000 UTC m=+295.323141989" Jul 02 14:06:04.518578 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:04.518543 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:06:04.598090 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:04.598057 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-wd6xh"] Jul 02 14:06:04.601327 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:04.601306 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7b7d896497-wd6xh" Jul 02 14:06:04.603745 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:04.603716 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 02 14:06:04.603872 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:04.603820 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 02 14:06:04.603872 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:04.603860 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-vdgqp\"" Jul 02 14:06:04.604653 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:04.604638 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 02 14:06:04.612690 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:04.612666 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-wd6xh"] Jul 02 14:06:04.629671 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:04.629638 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:06:04.693678 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:04.693641 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/628da1c5-41dc-47fa-be44-35389a1f6bd4-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-wd6xh\" (UID: \"628da1c5-41dc-47fa-be44-35389a1f6bd4\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-wd6xh" Jul 02 14:06:04.693887 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:04.693702 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/628da1c5-41dc-47fa-be44-35389a1f6bd4-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-wd6xh\" (UID: \"628da1c5-41dc-47fa-be44-35389a1f6bd4\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-wd6xh" Jul 02 14:06:04.693887 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:04.693765 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/628da1c5-41dc-47fa-be44-35389a1f6bd4-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-wd6xh\" (UID: \"628da1c5-41dc-47fa-be44-35389a1f6bd4\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-wd6xh" Jul 02 14:06:04.693887 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:04.693806 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44sxh\" (UniqueName: \"kubernetes.io/projected/628da1c5-41dc-47fa-be44-35389a1f6bd4-kube-api-access-44sxh\") pod \"prometheus-operator-7b7d896497-wd6xh\" (UID: \"628da1c5-41dc-47fa-be44-35389a1f6bd4\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-wd6xh" Jul 02 14:06:04.795343 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:04.795243 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/628da1c5-41dc-47fa-be44-35389a1f6bd4-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-wd6xh\" (UID: \"628da1c5-41dc-47fa-be44-35389a1f6bd4\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-wd6xh" Jul 02 14:06:04.795343 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:04.795312 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/628da1c5-41dc-47fa-be44-35389a1f6bd4-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-wd6xh\" (UID: \"628da1c5-41dc-47fa-be44-35389a1f6bd4\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-wd6xh" Jul 02 14:06:04.795343 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:04.795343 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/628da1c5-41dc-47fa-be44-35389a1f6bd4-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-wd6xh\" (UID: \"628da1c5-41dc-47fa-be44-35389a1f6bd4\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-wd6xh" Jul 02 14:06:04.795638 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:04.795370 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44sxh\" (UniqueName: \"kubernetes.io/projected/628da1c5-41dc-47fa-be44-35389a1f6bd4-kube-api-access-44sxh\") pod \"prometheus-operator-7b7d896497-wd6xh\" (UID: \"628da1c5-41dc-47fa-be44-35389a1f6bd4\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-wd6xh" Jul 02 14:06:04.795638 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:06:04.795539 2553 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 02 14:06:04.795638 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:06:04.795626 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/628da1c5-41dc-47fa-be44-35389a1f6bd4-prometheus-operator-tls podName:628da1c5-41dc-47fa-be44-35389a1f6bd4 nodeName:}" failed. No retries permitted until 2026-07-02 14:06:05.295603211 +0000 UTC m=+296.503845989 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/628da1c5-41dc-47fa-be44-35389a1f6bd4-prometheus-operator-tls") pod "prometheus-operator-7b7d896497-wd6xh" (UID: "628da1c5-41dc-47fa-be44-35389a1f6bd4") : secret "prometheus-operator-tls" not found Jul 02 14:06:04.796095 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:04.796074 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/628da1c5-41dc-47fa-be44-35389a1f6bd4-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-wd6xh\" (UID: \"628da1c5-41dc-47fa-be44-35389a1f6bd4\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-wd6xh" Jul 02 14:06:04.798357 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:04.798332 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/628da1c5-41dc-47fa-be44-35389a1f6bd4-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-wd6xh\" (UID: \"628da1c5-41dc-47fa-be44-35389a1f6bd4\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-wd6xh" Jul 02 14:06:04.805270 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:04.805244 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44sxh\" (UniqueName: \"kubernetes.io/projected/628da1c5-41dc-47fa-be44-35389a1f6bd4-kube-api-access-44sxh\") pod \"prometheus-operator-7b7d896497-wd6xh\" (UID: \"628da1c5-41dc-47fa-be44-35389a1f6bd4\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-wd6xh" Jul 02 14:06:05.202731 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:06:05.202686 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-tz5k9" podUID="fac6f456-02a4-4216-a9ae-7ba6ba7a73b4" Jul 02 14:06:05.300404 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:05.300362 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/628da1c5-41dc-47fa-be44-35389a1f6bd4-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-wd6xh\" (UID: \"628da1c5-41dc-47fa-be44-35389a1f6bd4\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-wd6xh" Jul 02 14:06:05.303234 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:05.303203 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/628da1c5-41dc-47fa-be44-35389a1f6bd4-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-wd6xh\" (UID: \"628da1c5-41dc-47fa-be44-35389a1f6bd4\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-wd6xh" Jul 02 14:06:05.510073 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:05.509999 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7b7d896497-wd6xh" Jul 02 14:06:05.918566 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:05.918540 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-wd6xh"] Jul 02 14:06:05.920744 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:06:05.920711 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod628da1c5_41dc_47fa_be44_35389a1f6bd4.slice/crio-94a12dbccc2f3c8aec6d2497ce9cf6ab457ff274cfc0a95caa094bd224d3d9b7 WatchSource:0}: Error finding container 94a12dbccc2f3c8aec6d2497ce9cf6ab457ff274cfc0a95caa094bd224d3d9b7: Status 404 returned error can't find the container with id 94a12dbccc2f3c8aec6d2497ce9cf6ab457ff274cfc0a95caa094bd224d3d9b7 Jul 02 14:06:06.107888 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:06.107796 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-wd6xh" event={"ID":"628da1c5-41dc-47fa-be44-35389a1f6bd4","Type":"ContainerStarted","Data":"94a12dbccc2f3c8aec6d2497ce9cf6ab457ff274cfc0a95caa094bd224d3d9b7"} Jul 02 14:06:06.109262 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:06.109230 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d74748d4-clkcr" event={"ID":"cb5884a8-d8c7-43fb-8e4b-185bba477794","Type":"ContainerStarted","Data":"cd1d845f1f93c989049ba8abf05bdc5533f9dc43c57472afcc0a9d12de744070"} Jul 02 14:06:06.127115 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:06.127060 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-d74748d4-clkcr" podStartSLOduration=1.615024092 podStartE2EDuration="5.127042379s" totalImagesPullingTime="3.512018287s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:06:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:06:06.12639396 +0000 UTC m=+297.334636744" watchObservedRunningTime="2026-07-02 14:06:06.127042379 +0000 UTC m=+297.335285161" Jul 02 14:06:06.131276 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:06.131255 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:06:07.088365 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:07.088328 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5df66df7fd-95wdf" Jul 02 14:06:07.971489 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:07.971406 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:06:08.079115 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:08.079085 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-2f9dr" Jul 02 14:06:08.119121 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:08.119083 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-wd6xh" event={"ID":"628da1c5-41dc-47fa-be44-35389a1f6bd4","Type":"ContainerStarted","Data":"46174809064aa6224606524086a3518bef151b345053bee8a98b1e16e04efe9f"} Jul 02 14:06:08.119481 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:08.119151 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-wd6xh" event={"ID":"628da1c5-41dc-47fa-be44-35389a1f6bd4","Type":"ContainerStarted","Data":"7413df23fb36faee610e5685f634dfdce2ecac6ea175c29ec6d75194c7e8aded"} Jul 02 14:06:08.136605 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:08.136552 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7b7d896497-wd6xh" podStartSLOduration=2.345054572 podStartE2EDuration="4.136537582s" totalImagesPullingTime="1.79148301s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:06:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:06:08.1360029 +0000 UTC m=+299.344245693" watchObservedRunningTime="2026-07-02 14:06:08.136537582 +0000 UTC m=+299.344780365" Jul 02 14:06:09.053888 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:09.053840 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:06:09.135248 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:09.135216 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:06:09.147735 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:09.147713 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-7gq54_4ff6194a-8b82-4387-a950-0ee9961b6012/console-operator/1.log" Jul 02 14:06:09.147919 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:09.147903 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-7gq54_4ff6194a-8b82-4387-a950-0ee9961b6012/console-operator/1.log" Jul 02 14:06:09.155174 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:09.155149 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7r445_ca0f7ed3-f75b-4edb-86c2-afa842962cf5/ovn-acl-logging/0.log" Jul 02 14:06:09.155385 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:09.155365 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7r445_ca0f7ed3-f75b-4edb-86c2-afa842962cf5/ovn-acl-logging/0.log" Jul 02 14:06:09.157818 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:09.157801 2553 kubelet.go:1648] "Image garbage collection succeeded" Jul 02 14:06:09.731787 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:09.731750 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:06:09.889685 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:09.889642 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:06:09.986864 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:09.986763 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:06:10.023485 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:10.023453 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-vllp7"] Jul 02 14:06:10.026431 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:10.026413 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-vllp7" Jul 02 14:06:10.028594 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:10.028575 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 02 14:06:10.028981 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:10.028960 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 02 14:06:10.029112 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:10.029093 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-rxgrz\"" Jul 02 14:06:10.037719 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:10.037695 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-vllp7"] Jul 02 14:06:10.059316 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:10.059292 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8vzlm"] Jul 02 14:06:10.062407 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:10.062388 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8vzlm" Jul 02 14:06:10.064866 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:10.064849 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-r5gz6\"" Jul 02 14:06:10.065068 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:10.065049 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 02 14:06:10.065148 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:10.065109 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 02 14:06:10.065313 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:10.065297 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 02 14:06:10.089629 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:10.089593 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:06:10.142903 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:10.142871 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/07691aba-8df2-4270-ba7e-04cd91be1b0a-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-vllp7\" (UID: \"07691aba-8df2-4270-ba7e-04cd91be1b0a\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-vllp7" Jul 02 14:06:10.143290 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:10.142924 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/07691aba-8df2-4270-ba7e-04cd91be1b0a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-vllp7\" (UID: \"07691aba-8df2-4270-ba7e-04cd91be1b0a\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-vllp7" Jul 02 14:06:10.143290 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:10.143009 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/07691aba-8df2-4270-ba7e-04cd91be1b0a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-vllp7\" (UID: \"07691aba-8df2-4270-ba7e-04cd91be1b0a\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-vllp7" Jul 02 14:06:10.143290 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:10.143073 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79q7w\" (UniqueName: \"kubernetes.io/projected/07691aba-8df2-4270-ba7e-04cd91be1b0a-kube-api-access-79q7w\") pod \"openshift-state-metrics-57f99c8b49-vllp7\" (UID: \"07691aba-8df2-4270-ba7e-04cd91be1b0a\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-vllp7" Jul 02 14:06:10.174687 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:10.174651 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:06:10.244476 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:10.244398 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9793b3be-8c64-46f7-a09f-99cdca3b0ffa-node-exporter-tls\") pod \"node-exporter-8vzlm\" (UID: \"9793b3be-8c64-46f7-a09f-99cdca3b0ffa\") " pod="openshift-monitoring/node-exporter-8vzlm" Jul 02 14:06:10.244476 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:10.244436 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9793b3be-8c64-46f7-a09f-99cdca3b0ffa-node-exporter-accelerators-collector-config\") pod \"node-exporter-8vzlm\" (UID: \"9793b3be-8c64-46f7-a09f-99cdca3b0ffa\") " pod="openshift-monitoring/node-exporter-8vzlm" Jul 02 14:06:10.244476 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:10.244457 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9793b3be-8c64-46f7-a09f-99cdca3b0ffa-sys\") pod \"node-exporter-8vzlm\" (UID: \"9793b3be-8c64-46f7-a09f-99cdca3b0ffa\") " pod="openshift-monitoring/node-exporter-8vzlm" Jul 02 14:06:10.244705 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:10.244485 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/07691aba-8df2-4270-ba7e-04cd91be1b0a-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-vllp7\" (UID: \"07691aba-8df2-4270-ba7e-04cd91be1b0a\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-vllp7" Jul 02 14:06:10.244705 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:10.244527 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/07691aba-8df2-4270-ba7e-04cd91be1b0a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-vllp7\" (UID: \"07691aba-8df2-4270-ba7e-04cd91be1b0a\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-vllp7" Jul 02 14:06:10.244705 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:10.244553 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9793b3be-8c64-46f7-a09f-99cdca3b0ffa-metrics-client-ca\") pod \"node-exporter-8vzlm\" (UID: \"9793b3be-8c64-46f7-a09f-99cdca3b0ffa\") " pod="openshift-monitoring/node-exporter-8vzlm" Jul 02 14:06:10.244705 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:10.244569 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9793b3be-8c64-46f7-a09f-99cdca3b0ffa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8vzlm\" (UID: \"9793b3be-8c64-46f7-a09f-99cdca3b0ffa\") " pod="openshift-monitoring/node-exporter-8vzlm" Jul 02 14:06:10.244705 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:10.244587 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/07691aba-8df2-4270-ba7e-04cd91be1b0a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-vllp7\" (UID: \"07691aba-8df2-4270-ba7e-04cd91be1b0a\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-vllp7" Jul 02 14:06:10.244705 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:10.244603 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79q7w\" (UniqueName: \"kubernetes.io/projected/07691aba-8df2-4270-ba7e-04cd91be1b0a-kube-api-access-79q7w\") pod \"openshift-state-metrics-57f99c8b49-vllp7\" (UID: \"07691aba-8df2-4270-ba7e-04cd91be1b0a\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-vllp7" Jul 02 14:06:10.244705 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:10.244617 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9793b3be-8c64-46f7-a09f-99cdca3b0ffa-root\") pod \"node-exporter-8vzlm\" (UID: \"9793b3be-8c64-46f7-a09f-99cdca3b0ffa\") " pod="openshift-monitoring/node-exporter-8vzlm" Jul 02 14:06:10.244705 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:10.244631 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9793b3be-8c64-46f7-a09f-99cdca3b0ffa-node-exporter-textfile\") pod \"node-exporter-8vzlm\" (UID: \"9793b3be-8c64-46f7-a09f-99cdca3b0ffa\") " pod="openshift-monitoring/node-exporter-8vzlm" Jul 02 14:06:10.244705 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:06:10.244630 2553 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 02 14:06:10.244705 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:06:10.244696 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07691aba-8df2-4270-ba7e-04cd91be1b0a-openshift-state-metrics-tls podName:07691aba-8df2-4270-ba7e-04cd91be1b0a nodeName:}" failed. No retries permitted until 2026-07-02 14:06:10.744681275 +0000 UTC m=+301.952924054 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/07691aba-8df2-4270-ba7e-04cd91be1b0a-openshift-state-metrics-tls") pod "openshift-state-metrics-57f99c8b49-vllp7" (UID: "07691aba-8df2-4270-ba7e-04cd91be1b0a") : secret "openshift-state-metrics-tls" not found Jul 02 14:06:10.245070 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:10.244800 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9793b3be-8c64-46f7-a09f-99cdca3b0ffa-node-exporter-wtmp\") pod \"node-exporter-8vzlm\" (UID: \"9793b3be-8c64-46f7-a09f-99cdca3b0ffa\") " pod="openshift-monitoring/node-exporter-8vzlm" Jul 02 14:06:10.245070 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:10.244840 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbj7x\" (UniqueName: \"kubernetes.io/projected/9793b3be-8c64-46f7-a09f-99cdca3b0ffa-kube-api-access-kbj7x\") pod \"node-exporter-8vzlm\" (UID: \"9793b3be-8c64-46f7-a09f-99cdca3b0ffa\") " pod="openshift-monitoring/node-exporter-8vzlm" Jul 02 14:06:10.245184 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:10.245168 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/07691aba-8df2-4270-ba7e-04cd91be1b0a-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-vllp7\" (UID: \"07691aba-8df2-4270-ba7e-04cd91be1b0a\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-vllp7" Jul 02 14:06:10.246906 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:10.246889 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/07691aba-8df2-4270-ba7e-04cd91be1b0a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-vllp7\" (UID: \"07691aba-8df2-4270-ba7e-04cd91be1b0a\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-vllp7" Jul 02 14:06:10.254534 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:10.254515 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79q7w\" (UniqueName: \"kubernetes.io/projected/07691aba-8df2-4270-ba7e-04cd91be1b0a-kube-api-access-79q7w\") pod \"openshift-state-metrics-57f99c8b49-vllp7\" (UID: \"07691aba-8df2-4270-ba7e-04cd91be1b0a\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-vllp7" Jul 02 14:06:10.277540 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:10.277514 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:06:10.345926 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:10.345895 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9793b3be-8c64-46f7-a09f-99cdca3b0ffa-node-exporter-accelerators-collector-config\") pod \"node-exporter-8vzlm\" (UID: \"9793b3be-8c64-46f7-a09f-99cdca3b0ffa\") " pod="openshift-monitoring/node-exporter-8vzlm" Jul 02 14:06:10.346135 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:10.345934 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9793b3be-8c64-46f7-a09f-99cdca3b0ffa-sys\") pod \"node-exporter-8vzlm\" (UID: \"9793b3be-8c64-46f7-a09f-99cdca3b0ffa\") " pod="openshift-monitoring/node-exporter-8vzlm" Jul 02 14:06:10.346135 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:10.346027 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9793b3be-8c64-46f7-a09f-99cdca3b0ffa-metrics-client-ca\") pod \"node-exporter-8vzlm\" (UID: \"9793b3be-8c64-46f7-a09f-99cdca3b0ffa\") " pod="openshift-monitoring/node-exporter-8vzlm" Jul 02 14:06:10.346135 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:10.346053 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9793b3be-8c64-46f7-a09f-99cdca3b0ffa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8vzlm\" (UID: \"9793b3be-8c64-46f7-a09f-99cdca3b0ffa\") " pod="openshift-monitoring/node-exporter-8vzlm" Jul 02 14:06:10.346135 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:10.346090 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9793b3be-8c64-46f7-a09f-99cdca3b0ffa-sys\") pod \"node-exporter-8vzlm\" (UID: \"9793b3be-8c64-46f7-a09f-99cdca3b0ffa\") " pod="openshift-monitoring/node-exporter-8vzlm" Jul 02 14:06:10.346135 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:10.346115 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9793b3be-8c64-46f7-a09f-99cdca3b0ffa-root\") pod \"node-exporter-8vzlm\" (UID: \"9793b3be-8c64-46f7-a09f-99cdca3b0ffa\") " pod="openshift-monitoring/node-exporter-8vzlm" Jul 02 14:06:10.346398 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:10.346146 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9793b3be-8c64-46f7-a09f-99cdca3b0ffa-node-exporter-textfile\") pod \"node-exporter-8vzlm\" (UID: \"9793b3be-8c64-46f7-a09f-99cdca3b0ffa\") " pod="openshift-monitoring/node-exporter-8vzlm" Jul 02 14:06:10.346398 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:10.346185 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9793b3be-8c64-46f7-a09f-99cdca3b0ffa-node-exporter-wtmp\") pod \"node-exporter-8vzlm\" (UID: \"9793b3be-8c64-46f7-a09f-99cdca3b0ffa\") " pod="openshift-monitoring/node-exporter-8vzlm" Jul 02 14:06:10.346398 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:10.346222 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbj7x\" (UniqueName: \"kubernetes.io/projected/9793b3be-8c64-46f7-a09f-99cdca3b0ffa-kube-api-access-kbj7x\") pod \"node-exporter-8vzlm\" (UID: \"9793b3be-8c64-46f7-a09f-99cdca3b0ffa\") " pod="openshift-monitoring/node-exporter-8vzlm" Jul 02 14:06:10.346398 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:10.346248 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9793b3be-8c64-46f7-a09f-99cdca3b0ffa-node-exporter-tls\") pod \"node-exporter-8vzlm\" (UID: \"9793b3be-8c64-46f7-a09f-99cdca3b0ffa\") " pod="openshift-monitoring/node-exporter-8vzlm" Jul 02 14:06:10.346398 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:10.346266 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9793b3be-8c64-46f7-a09f-99cdca3b0ffa-root\") pod \"node-exporter-8vzlm\" (UID: \"9793b3be-8c64-46f7-a09f-99cdca3b0ffa\") " pod="openshift-monitoring/node-exporter-8vzlm" Jul 02 14:06:10.346398 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:10.346374 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9793b3be-8c64-46f7-a09f-99cdca3b0ffa-node-exporter-wtmp\") pod \"node-exporter-8vzlm\" (UID: \"9793b3be-8c64-46f7-a09f-99cdca3b0ffa\") " pod="openshift-monitoring/node-exporter-8vzlm" Jul 02 14:06:10.346692 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:10.346591 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9793b3be-8c64-46f7-a09f-99cdca3b0ffa-node-exporter-textfile\") pod \"node-exporter-8vzlm\" (UID: \"9793b3be-8c64-46f7-a09f-99cdca3b0ffa\") " pod="openshift-monitoring/node-exporter-8vzlm" Jul 02 14:06:10.346692 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:10.346622 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9793b3be-8c64-46f7-a09f-99cdca3b0ffa-node-exporter-accelerators-collector-config\") pod \"node-exporter-8vzlm\" (UID: \"9793b3be-8c64-46f7-a09f-99cdca3b0ffa\") " pod="openshift-monitoring/node-exporter-8vzlm" Jul 02 14:06:10.346872 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:10.346852 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9793b3be-8c64-46f7-a09f-99cdca3b0ffa-metrics-client-ca\") pod \"node-exporter-8vzlm\" (UID: \"9793b3be-8c64-46f7-a09f-99cdca3b0ffa\") " pod="openshift-monitoring/node-exporter-8vzlm" Jul 02 14:06:10.348829 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:10.348808 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9793b3be-8c64-46f7-a09f-99cdca3b0ffa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8vzlm\" (UID: \"9793b3be-8c64-46f7-a09f-99cdca3b0ffa\") " pod="openshift-monitoring/node-exporter-8vzlm" Jul 02 14:06:10.348915 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:10.348853 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9793b3be-8c64-46f7-a09f-99cdca3b0ffa-node-exporter-tls\") pod \"node-exporter-8vzlm\" (UID: \"9793b3be-8c64-46f7-a09f-99cdca3b0ffa\") " pod="openshift-monitoring/node-exporter-8vzlm" Jul 02 14:06:10.354949 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:10.354922 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbj7x\" (UniqueName: \"kubernetes.io/projected/9793b3be-8c64-46f7-a09f-99cdca3b0ffa-kube-api-access-kbj7x\") pod \"node-exporter-8vzlm\" (UID: \"9793b3be-8c64-46f7-a09f-99cdca3b0ffa\") " pod="openshift-monitoring/node-exporter-8vzlm" Jul 02 14:06:10.372030 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:10.372005 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8vzlm" Jul 02 14:06:10.378674 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:10.378642 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:06:10.383648 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:06:10.383624 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9793b3be_8c64_46f7_a09f_99cdca3b0ffa.slice/crio-202bd18fc39ce97f4947131cc9a1a188d64e2b0059549f128e30ccf7a9bfa360 WatchSource:0}: Error finding container 202bd18fc39ce97f4947131cc9a1a188d64e2b0059549f128e30ccf7a9bfa360: Status 404 returned error can't find the container with id 202bd18fc39ce97f4947131cc9a1a188d64e2b0059549f128e30ccf7a9bfa360 Jul 02 14:06:10.494776 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:10.494699 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:06:10.602655 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:10.602624 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:06:10.751463 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:10.751380 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/07691aba-8df2-4270-ba7e-04cd91be1b0a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-vllp7\" (UID: \"07691aba-8df2-4270-ba7e-04cd91be1b0a\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-vllp7" Jul 02 14:06:10.753629 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:10.753610 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/07691aba-8df2-4270-ba7e-04cd91be1b0a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-vllp7\" (UID: \"07691aba-8df2-4270-ba7e-04cd91be1b0a\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-vllp7" Jul 02 14:06:10.876478 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:10.876446 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:06:10.935639 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:10.935612 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-vllp7" Jul 02 14:06:10.947875 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:10.947849 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:06:11.076901 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:11.076869 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-vllp7"] Jul 02 14:06:11.079916 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:06:11.079890 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07691aba_8df2_4270_ba7e_04cd91be1b0a.slice/crio-192fcf14f637b4d950050d2c05e6f795441a464e095ec6309ce0e265ebf79b51 WatchSource:0}: Error finding container 192fcf14f637b4d950050d2c05e6f795441a464e095ec6309ce0e265ebf79b51: Status 404 returned error can't find the container with id 192fcf14f637b4d950050d2c05e6f795441a464e095ec6309ce0e265ebf79b51 Jul 02 14:06:11.130840 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:11.130806 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-vllp7" event={"ID":"07691aba-8df2-4270-ba7e-04cd91be1b0a","Type":"ContainerStarted","Data":"192fcf14f637b4d950050d2c05e6f795441a464e095ec6309ce0e265ebf79b51"} Jul 02 14:06:11.132053 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:11.132020 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8vzlm" event={"ID":"9793b3be-8c64-46f7-a09f-99cdca3b0ffa","Type":"ContainerStarted","Data":"202bd18fc39ce97f4947131cc9a1a188d64e2b0059549f128e30ccf7a9bfa360"} Jul 02 14:06:11.208178 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:11.208159 2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 14:06:11.279769 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:11.279670 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:06:11.378785 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:11.378734 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:06:11.478676 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:11.478642 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:06:12.136770 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:12.136734 2553 generic.go:356] "Generic (PLEG): container finished" podID="9793b3be-8c64-46f7-a09f-99cdca3b0ffa" containerID="c26efc04c1755de3a7f9efc273faa664c0f74dbd6f3070150e4d53b511408a7c" exitCode=0 Jul 02 14:06:12.136952 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:12.136819 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8vzlm" event={"ID":"9793b3be-8c64-46f7-a09f-99cdca3b0ffa","Type":"ContainerDied","Data":"c26efc04c1755de3a7f9efc273faa664c0f74dbd6f3070150e4d53b511408a7c"} Jul 02 14:06:12.138640 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:12.138618 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-vllp7" event={"ID":"07691aba-8df2-4270-ba7e-04cd91be1b0a","Type":"ContainerStarted","Data":"77639e4fa291ae68c50ab96816763c799fd0872cd6b4b44d204e3035eb181754"} Jul 02 14:06:12.138748 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:12.138661 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-vllp7" event={"ID":"07691aba-8df2-4270-ba7e-04cd91be1b0a","Type":"ContainerStarted","Data":"44309bae8631a196b284910144a746cc94708434c40892781e2d4578b22a728f"} Jul 02 14:06:12.179816 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:12.179767 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d74748d4-clkcr" Jul 02 14:06:12.179937 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:12.179838 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-d74748d4-clkcr" Jul 02 14:06:12.185618 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:12.185582 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-d74748d4-clkcr" Jul 02 14:06:12.247441 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:12.247400 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:06:12.349727 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:12.349656 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:06:12.939285 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:12.939255 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:06:13.026136 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:13.026108 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:06:13.125037 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:13.124979 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:06:13.144177 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:13.144150 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8vzlm" event={"ID":"9793b3be-8c64-46f7-a09f-99cdca3b0ffa","Type":"ContainerStarted","Data":"30f4a02a0c2b0f9ddeb49ea6ea5ee178ac6457d9fd0041b345d89054fa68a7d0"} Jul 02 14:06:13.144339 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:13.144243 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8vzlm" event={"ID":"9793b3be-8c64-46f7-a09f-99cdca3b0ffa","Type":"ContainerStarted","Data":"b55aa874a4dab744dda9c685ad32a73e220edbb69b3284615889c045c6508418"} Jul 02 14:06:13.146154 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:13.146123 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-vllp7" event={"ID":"07691aba-8df2-4270-ba7e-04cd91be1b0a","Type":"ContainerStarted","Data":"84a1b6843b742343e31379bdef3cfa19e1e7dcb51564e0a60a01db9cb57473eb"} Jul 02 14:06:13.149851 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:13.149832 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-d74748d4-clkcr" Jul 02 14:06:13.171672 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:13.171626 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8vzlm" podStartSLOduration=1.74214735 podStartE2EDuration="3.171612417s" totalImagesPullingTime="1.367009255s" totalInitContainerRuntime="62.455812ms" isStatefulPod=true podCreationTimestamp="2026-07-02 14:06:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:06:13.170800083 +0000 UTC m=+304.379042865" watchObservedRunningTime="2026-07-02 14:06:13.171612417 +0000 UTC m=+304.379855213" Jul 02 14:06:13.195432 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:13.195325 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-vllp7" podStartSLOduration=1.919467976 podStartE2EDuration="3.195310558s" totalImagesPullingTime="1.275842582s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:06:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:06:13.195125387 +0000 UTC m=+304.403368195" watchObservedRunningTime="2026-07-02 14:06:13.195310558 +0000 UTC m=+304.403553341" Jul 02 14:06:13.698848 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:13.698812 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:06:13.899116 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:13.899081 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:06:14.507400 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:14.507367 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:06:14.608501 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:14.608467 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:06:14.875763 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:14.875727 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:06:14.998968 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:14.998913 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:06:15.306155 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:15.306074 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:06:16.193694 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:16.193657 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:06:16.201780 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:16.201750 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tz5k9" Jul 02 14:06:16.314412 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:16.314379 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-687cc6f874-gkrgw"] Jul 02 14:06:16.317865 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:16.317840 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-687cc6f874-gkrgw" Jul 02 14:06:16.325765 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:16.325737 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 02 14:06:16.327945 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:16.327919 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-687cc6f874-gkrgw"] Jul 02 14:06:16.395552 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:16.395512 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd33e6c1-2232-493b-834a-d5e6cf44ef48-service-ca\") pod \"console-687cc6f874-gkrgw\" (UID: \"cd33e6c1-2232-493b-834a-d5e6cf44ef48\") " pod="openshift-console/console-687cc6f874-gkrgw" Jul 02 14:06:16.395823 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:16.395806 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd33e6c1-2232-493b-834a-d5e6cf44ef48-console-config\") pod \"console-687cc6f874-gkrgw\" (UID: \"cd33e6c1-2232-493b-834a-d5e6cf44ef48\") " pod="openshift-console/console-687cc6f874-gkrgw" Jul 02 14:06:16.395962 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:16.395946 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd33e6c1-2232-493b-834a-d5e6cf44ef48-console-serving-cert\") pod \"console-687cc6f874-gkrgw\" (UID: \"cd33e6c1-2232-493b-834a-d5e6cf44ef48\") " pod="openshift-console/console-687cc6f874-gkrgw" Jul 02 14:06:16.396093 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:16.396079 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd33e6c1-2232-493b-834a-d5e6cf44ef48-trusted-ca-bundle\") pod \"console-687cc6f874-gkrgw\" (UID: \"cd33e6c1-2232-493b-834a-d5e6cf44ef48\") " pod="openshift-console/console-687cc6f874-gkrgw" Jul 02 14:06:16.396202 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:16.396190 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd33e6c1-2232-493b-834a-d5e6cf44ef48-console-oauth-config\") pod \"console-687cc6f874-gkrgw\" (UID: \"cd33e6c1-2232-493b-834a-d5e6cf44ef48\") " pod="openshift-console/console-687cc6f874-gkrgw" Jul 02 14:06:16.396305 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:16.396292 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd33e6c1-2232-493b-834a-d5e6cf44ef48-oauth-serving-cert\") pod \"console-687cc6f874-gkrgw\" (UID: \"cd33e6c1-2232-493b-834a-d5e6cf44ef48\") " pod="openshift-console/console-687cc6f874-gkrgw" Jul 02 14:06:16.396391 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:16.396380 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6jws\" (UniqueName: \"kubernetes.io/projected/cd33e6c1-2232-493b-834a-d5e6cf44ef48-kube-api-access-s6jws\") pod \"console-687cc6f874-gkrgw\" (UID: \"cd33e6c1-2232-493b-834a-d5e6cf44ef48\") " pod="openshift-console/console-687cc6f874-gkrgw" Jul 02 14:06:16.496900 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:16.496813 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd33e6c1-2232-493b-834a-d5e6cf44ef48-service-ca\") pod \"console-687cc6f874-gkrgw\" (UID: \"cd33e6c1-2232-493b-834a-d5e6cf44ef48\") " pod="openshift-console/console-687cc6f874-gkrgw" Jul 02 14:06:16.496900 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:16.496854 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd33e6c1-2232-493b-834a-d5e6cf44ef48-console-config\") pod \"console-687cc6f874-gkrgw\" (UID: \"cd33e6c1-2232-493b-834a-d5e6cf44ef48\") " pod="openshift-console/console-687cc6f874-gkrgw" Jul 02 14:06:16.497171 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:16.496900 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd33e6c1-2232-493b-834a-d5e6cf44ef48-console-serving-cert\") pod \"console-687cc6f874-gkrgw\" (UID: \"cd33e6c1-2232-493b-834a-d5e6cf44ef48\") " pod="openshift-console/console-687cc6f874-gkrgw" Jul 02 14:06:16.497171 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:16.496925 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd33e6c1-2232-493b-834a-d5e6cf44ef48-trusted-ca-bundle\") pod \"console-687cc6f874-gkrgw\" (UID: \"cd33e6c1-2232-493b-834a-d5e6cf44ef48\") " pod="openshift-console/console-687cc6f874-gkrgw" Jul 02 14:06:16.497171 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:16.496961 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd33e6c1-2232-493b-834a-d5e6cf44ef48-console-oauth-config\") pod \"console-687cc6f874-gkrgw\" (UID: \"cd33e6c1-2232-493b-834a-d5e6cf44ef48\") " pod="openshift-console/console-687cc6f874-gkrgw" Jul 02 14:06:16.497171 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:16.497018 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd33e6c1-2232-493b-834a-d5e6cf44ef48-oauth-serving-cert\") pod \"console-687cc6f874-gkrgw\" (UID: \"cd33e6c1-2232-493b-834a-d5e6cf44ef48\") " pod="openshift-console/console-687cc6f874-gkrgw" Jul 02 14:06:16.497171 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:16.497043 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6jws\" (UniqueName: \"kubernetes.io/projected/cd33e6c1-2232-493b-834a-d5e6cf44ef48-kube-api-access-s6jws\") pod \"console-687cc6f874-gkrgw\" (UID: \"cd33e6c1-2232-493b-834a-d5e6cf44ef48\") " pod="openshift-console/console-687cc6f874-gkrgw" Jul 02 14:06:16.497714 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:16.497687 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd33e6c1-2232-493b-834a-d5e6cf44ef48-service-ca\") pod \"console-687cc6f874-gkrgw\" (UID: \"cd33e6c1-2232-493b-834a-d5e6cf44ef48\") " pod="openshift-console/console-687cc6f874-gkrgw" Jul 02 14:06:16.497819 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:16.497746 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd33e6c1-2232-493b-834a-d5e6cf44ef48-console-config\") pod \"console-687cc6f874-gkrgw\" (UID: \"cd33e6c1-2232-493b-834a-d5e6cf44ef48\") " pod="openshift-console/console-687cc6f874-gkrgw" Jul 02 14:06:16.497868 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:16.497823 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd33e6c1-2232-493b-834a-d5e6cf44ef48-trusted-ca-bundle\") pod \"console-687cc6f874-gkrgw\" (UID: \"cd33e6c1-2232-493b-834a-d5e6cf44ef48\") " pod="openshift-console/console-687cc6f874-gkrgw" Jul 02 14:06:16.497868 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:16.497829 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd33e6c1-2232-493b-834a-d5e6cf44ef48-oauth-serving-cert\") pod \"console-687cc6f874-gkrgw\" (UID: \"cd33e6c1-2232-493b-834a-d5e6cf44ef48\") " pod="openshift-console/console-687cc6f874-gkrgw" Jul 02 14:06:16.500035 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:16.499997 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd33e6c1-2232-493b-834a-d5e6cf44ef48-console-serving-cert\") pod \"console-687cc6f874-gkrgw\" (UID: \"cd33e6c1-2232-493b-834a-d5e6cf44ef48\") " pod="openshift-console/console-687cc6f874-gkrgw" Jul 02 14:06:16.500130 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:16.500116 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd33e6c1-2232-493b-834a-d5e6cf44ef48-console-oauth-config\") pod \"console-687cc6f874-gkrgw\" (UID: \"cd33e6c1-2232-493b-834a-d5e6cf44ef48\") " pod="openshift-console/console-687cc6f874-gkrgw" Jul 02 14:06:16.506295 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:16.506271 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6jws\" (UniqueName: \"kubernetes.io/projected/cd33e6c1-2232-493b-834a-d5e6cf44ef48-kube-api-access-s6jws\") pod \"console-687cc6f874-gkrgw\" (UID: \"cd33e6c1-2232-493b-834a-d5e6cf44ef48\") " pod="openshift-console/console-687cc6f874-gkrgw" Jul 02 14:06:16.628640 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:16.628608 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-687cc6f874-gkrgw" Jul 02 14:06:16.760699 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:16.760620 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-687cc6f874-gkrgw"] Jul 02 14:06:16.763596 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:06:16.763568 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd33e6c1_2232_493b_834a_d5e6cf44ef48.slice/crio-0df025b685d5d20319321c6213a0ae7e372b09c2b40fbbf1a1f720ee1f458f78 WatchSource:0}: Error finding container 0df025b685d5d20319321c6213a0ae7e372b09c2b40fbbf1a1f720ee1f458f78: Status 404 returned error can't find the container with id 0df025b685d5d20319321c6213a0ae7e372b09c2b40fbbf1a1f720ee1f458f78 Jul 02 14:06:17.162411 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:17.162377 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-687cc6f874-gkrgw" event={"ID":"cd33e6c1-2232-493b-834a-d5e6cf44ef48","Type":"ContainerStarted","Data":"558145e3b2e1eac95898f9cb14e0fd1c39e775a7a7ba244cfec6077e2556d678"} Jul 02 14:06:17.162626 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:17.162430 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-687cc6f874-gkrgw" event={"ID":"cd33e6c1-2232-493b-834a-d5e6cf44ef48","Type":"ContainerStarted","Data":"0df025b685d5d20319321c6213a0ae7e372b09c2b40fbbf1a1f720ee1f458f78"} Jul 02 14:06:17.181055 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:17.181007 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-687cc6f874-gkrgw" podStartSLOduration=1.180972912 podStartE2EDuration="1.180972912s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:06:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:06:17.179393851 +0000 UTC m=+308.387636634" watchObservedRunningTime="2026-07-02 14:06:17.180972912 +0000 UTC m=+308.389215695" Jul 02 14:06:17.447621 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:17.447517 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:06:18.100489 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:18.100454 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:06:18.200838 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:18.200737 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:06:18.950031 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:18.949978 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:06:19.009131 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:19.009098 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:06:19.730204 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:19.730168 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:06:19.791141 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:19.791108 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:06:19.884325 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:19.884294 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:06:19.995360 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:19.995281 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:06:20.656378 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:20.656347 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:06:20.761128 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:20.761089 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:06:21.248754 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:21.248726 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:06:21.306982 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:21.306942 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:06:22.106029 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:22.105965 2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5df66df7fd-95wdf" podUID="d2e31ddc-f8bc-489e-b978-c6abb94c5a04" containerName="registry" containerID="cri-o://6d977a12669786b34c9cb8dbfbf26db75603ef9b1e7b752091219ef32183e00e" gracePeriod=30 Jul 02 14:06:22.347640 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:22.347611 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5df66df7fd-95wdf" Jul 02 14:06:22.445743 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:22.445713 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d2e31ddc-f8bc-489e-b978-c6abb94c5a04-installation-pull-secrets\") pod \"d2e31ddc-f8bc-489e-b978-c6abb94c5a04\" (UID: \"d2e31ddc-f8bc-489e-b978-c6abb94c5a04\") " Jul 02 14:06:22.445937 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:22.445769 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d2e31ddc-f8bc-489e-b978-c6abb94c5a04-image-registry-private-configuration\") pod \"d2e31ddc-f8bc-489e-b978-c6abb94c5a04\" (UID: \"d2e31ddc-f8bc-489e-b978-c6abb94c5a04\") " Jul 02 14:06:22.445937 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:22.445800 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qznbt\" (UniqueName: \"kubernetes.io/projected/d2e31ddc-f8bc-489e-b978-c6abb94c5a04-kube-api-access-qznbt\") pod \"d2e31ddc-f8bc-489e-b978-c6abb94c5a04\" (UID: \"d2e31ddc-f8bc-489e-b978-c6abb94c5a04\") " Jul 02 14:06:22.445937 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:22.445839 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d2e31ddc-f8bc-489e-b978-c6abb94c5a04-ca-trust-extracted\") pod \"d2e31ddc-f8bc-489e-b978-c6abb94c5a04\" (UID: \"d2e31ddc-f8bc-489e-b978-c6abb94c5a04\") " Jul 02 14:06:22.445937 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:22.445863 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d2e31ddc-f8bc-489e-b978-c6abb94c5a04-bound-sa-token\") pod \"d2e31ddc-f8bc-489e-b978-c6abb94c5a04\" (UID: \"d2e31ddc-f8bc-489e-b978-c6abb94c5a04\") " Jul 02 14:06:22.445937 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:22.445926 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d2e31ddc-f8bc-489e-b978-c6abb94c5a04-registry-tls\") pod \"d2e31ddc-f8bc-489e-b978-c6abb94c5a04\" (UID: \"d2e31ddc-f8bc-489e-b978-c6abb94c5a04\") " Jul 02 14:06:22.446229 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:22.445959 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d2e31ddc-f8bc-489e-b978-c6abb94c5a04-trusted-ca\") pod \"d2e31ddc-f8bc-489e-b978-c6abb94c5a04\" (UID: \"d2e31ddc-f8bc-489e-b978-c6abb94c5a04\") " Jul 02 14:06:22.446229 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:22.446011 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d2e31ddc-f8bc-489e-b978-c6abb94c5a04-registry-certificates\") pod \"d2e31ddc-f8bc-489e-b978-c6abb94c5a04\" (UID: \"d2e31ddc-f8bc-489e-b978-c6abb94c5a04\") " Jul 02 14:06:22.446496 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:22.446461 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2e31ddc-f8bc-489e-b978-c6abb94c5a04-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d2e31ddc-f8bc-489e-b978-c6abb94c5a04" (UID: "d2e31ddc-f8bc-489e-b978-c6abb94c5a04"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 14:06:22.446565 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:22.446507 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2e31ddc-f8bc-489e-b978-c6abb94c5a04-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d2e31ddc-f8bc-489e-b978-c6abb94c5a04" (UID: "d2e31ddc-f8bc-489e-b978-c6abb94c5a04"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 14:06:22.448286 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:22.448252 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2e31ddc-f8bc-489e-b978-c6abb94c5a04-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d2e31ddc-f8bc-489e-b978-c6abb94c5a04" (UID: "d2e31ddc-f8bc-489e-b978-c6abb94c5a04"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 14:06:22.448388 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:22.448333 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2e31ddc-f8bc-489e-b978-c6abb94c5a04-kube-api-access-qznbt" (OuterVolumeSpecName: "kube-api-access-qznbt") pod "d2e31ddc-f8bc-489e-b978-c6abb94c5a04" (UID: "d2e31ddc-f8bc-489e-b978-c6abb94c5a04"). InnerVolumeSpecName "kube-api-access-qznbt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 14:06:22.448683 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:22.448656 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2e31ddc-f8bc-489e-b978-c6abb94c5a04-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d2e31ddc-f8bc-489e-b978-c6abb94c5a04" (UID: "d2e31ddc-f8bc-489e-b978-c6abb94c5a04"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 14:06:22.448796 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:22.448776 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2e31ddc-f8bc-489e-b978-c6abb94c5a04-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d2e31ddc-f8bc-489e-b978-c6abb94c5a04" (UID: "d2e31ddc-f8bc-489e-b978-c6abb94c5a04"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 14:06:22.448867 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:22.448814 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2e31ddc-f8bc-489e-b978-c6abb94c5a04-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d2e31ddc-f8bc-489e-b978-c6abb94c5a04" (UID: "d2e31ddc-f8bc-489e-b978-c6abb94c5a04"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 14:06:22.454875 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:22.454851 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2e31ddc-f8bc-489e-b978-c6abb94c5a04-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d2e31ddc-f8bc-489e-b978-c6abb94c5a04" (UID: "d2e31ddc-f8bc-489e-b978-c6abb94c5a04"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 14:06:22.547045 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:22.547014 2553 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d2e31ddc-f8bc-489e-b978-c6abb94c5a04-trusted-ca\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:06:22.547045 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:22.547041 2553 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d2e31ddc-f8bc-489e-b978-c6abb94c5a04-registry-certificates\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:06:22.547045 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:22.547052 2553 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d2e31ddc-f8bc-489e-b978-c6abb94c5a04-installation-pull-secrets\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:06:22.547267 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:22.547062 2553 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d2e31ddc-f8bc-489e-b978-c6abb94c5a04-image-registry-private-configuration\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:06:22.547267 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:22.547071 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qznbt\" (UniqueName: \"kubernetes.io/projected/d2e31ddc-f8bc-489e-b978-c6abb94c5a04-kube-api-access-qznbt\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:06:22.547267 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:22.547089 2553 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d2e31ddc-f8bc-489e-b978-c6abb94c5a04-ca-trust-extracted\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:06:22.547267 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:22.547098 2553 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d2e31ddc-f8bc-489e-b978-c6abb94c5a04-bound-sa-token\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:06:22.547267 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:22.547106 2553 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d2e31ddc-f8bc-489e-b978-c6abb94c5a04-registry-tls\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:06:23.184195 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:23.184159 2553 generic.go:356] "Generic (PLEG): container finished" podID="d2e31ddc-f8bc-489e-b978-c6abb94c5a04" containerID="6d977a12669786b34c9cb8dbfbf26db75603ef9b1e7b752091219ef32183e00e" exitCode=0 Jul 02 14:06:23.184513 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:23.184213 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5df66df7fd-95wdf" Jul 02 14:06:23.184513 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:23.184218 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5df66df7fd-95wdf" event={"ID":"d2e31ddc-f8bc-489e-b978-c6abb94c5a04","Type":"ContainerDied","Data":"6d977a12669786b34c9cb8dbfbf26db75603ef9b1e7b752091219ef32183e00e"} Jul 02 14:06:23.184513 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:23.184330 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5df66df7fd-95wdf" event={"ID":"d2e31ddc-f8bc-489e-b978-c6abb94c5a04","Type":"ContainerDied","Data":"d2b3be250bf795dcd609357d0c0d357b351c19d415065f51752288be2c83c87a"} Jul 02 14:06:23.184513 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:23.184351 2553 scope.go:117] "RemoveContainer" containerID="6d977a12669786b34c9cb8dbfbf26db75603ef9b1e7b752091219ef32183e00e" Jul 02 14:06:23.192630 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:23.192613 2553 scope.go:117] "RemoveContainer" containerID="6d977a12669786b34c9cb8dbfbf26db75603ef9b1e7b752091219ef32183e00e" Jul 02 14:06:23.192879 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:06:23.192861 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d977a12669786b34c9cb8dbfbf26db75603ef9b1e7b752091219ef32183e00e\": container with ID starting with 6d977a12669786b34c9cb8dbfbf26db75603ef9b1e7b752091219ef32183e00e not found: ID does not exist" containerID="6d977a12669786b34c9cb8dbfbf26db75603ef9b1e7b752091219ef32183e00e" Jul 02 14:06:23.192944 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:23.192886 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d977a12669786b34c9cb8dbfbf26db75603ef9b1e7b752091219ef32183e00e"} err="failed to get container status \"6d977a12669786b34c9cb8dbfbf26db75603ef9b1e7b752091219ef32183e00e\": rpc error: code = NotFound desc = could not find container \"6d977a12669786b34c9cb8dbfbf26db75603ef9b1e7b752091219ef32183e00e\": container with ID starting with 6d977a12669786b34c9cb8dbfbf26db75603ef9b1e7b752091219ef32183e00e not found: ID does not exist" Jul 02 14:06:23.211441 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:23.211417 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5df66df7fd-95wdf"] Jul 02 14:06:23.216235 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:23.216214 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5df66df7fd-95wdf"] Jul 02 14:06:25.206366 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:25.206330 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2e31ddc-f8bc-489e-b978-c6abb94c5a04" path="/var/lib/kubelet/pods/d2e31ddc-f8bc-489e-b978-c6abb94c5a04/volumes" Jul 02 14:06:26.185405 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:26.185374 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-687cc6f874-gkrgw"] Jul 02 14:06:26.214716 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:26.214688 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d44c6b5b-t46gq"] Jul 02 14:06:26.215114 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:26.214980 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2e31ddc-f8bc-489e-b978-c6abb94c5a04" containerName="registry" Jul 02 14:06:26.215114 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:26.215007 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2e31ddc-f8bc-489e-b978-c6abb94c5a04" containerName="registry" Jul 02 14:06:26.215114 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:26.215093 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2e31ddc-f8bc-489e-b978-c6abb94c5a04" containerName="registry" Jul 02 14:06:26.337554 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:26.337506 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d44c6b5b-t46gq"] Jul 02 14:06:26.337721 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:26.337620 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d44c6b5b-t46gq" Jul 02 14:06:26.381869 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:26.381526 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f41c9201-2931-44c8-a32c-b051a4d0d036-console-oauth-config\") pod \"console-7d44c6b5b-t46gq\" (UID: \"f41c9201-2931-44c8-a32c-b051a4d0d036\") " pod="openshift-console/console-7d44c6b5b-t46gq" Jul 02 14:06:26.381869 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:26.381580 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f41c9201-2931-44c8-a32c-b051a4d0d036-oauth-serving-cert\") pod \"console-7d44c6b5b-t46gq\" (UID: \"f41c9201-2931-44c8-a32c-b051a4d0d036\") " pod="openshift-console/console-7d44c6b5b-t46gq" Jul 02 14:06:26.381869 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:26.381614 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f41c9201-2931-44c8-a32c-b051a4d0d036-service-ca\") pod \"console-7d44c6b5b-t46gq\" (UID: \"f41c9201-2931-44c8-a32c-b051a4d0d036\") " pod="openshift-console/console-7d44c6b5b-t46gq" Jul 02 14:06:26.381869 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:26.381665 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f41c9201-2931-44c8-a32c-b051a4d0d036-trusted-ca-bundle\") pod \"console-7d44c6b5b-t46gq\" (UID: \"f41c9201-2931-44c8-a32c-b051a4d0d036\") " pod="openshift-console/console-7d44c6b5b-t46gq" Jul 02 14:06:26.381869 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:26.381704 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f41c9201-2931-44c8-a32c-b051a4d0d036-console-serving-cert\") pod \"console-7d44c6b5b-t46gq\" (UID: \"f41c9201-2931-44c8-a32c-b051a4d0d036\") " pod="openshift-console/console-7d44c6b5b-t46gq" Jul 02 14:06:26.381869 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:26.381751 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f41c9201-2931-44c8-a32c-b051a4d0d036-console-config\") pod \"console-7d44c6b5b-t46gq\" (UID: \"f41c9201-2931-44c8-a32c-b051a4d0d036\") " pod="openshift-console/console-7d44c6b5b-t46gq" Jul 02 14:06:26.381869 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:26.381783 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxrhq\" (UniqueName: \"kubernetes.io/projected/f41c9201-2931-44c8-a32c-b051a4d0d036-kube-api-access-mxrhq\") pod \"console-7d44c6b5b-t46gq\" (UID: \"f41c9201-2931-44c8-a32c-b051a4d0d036\") " pod="openshift-console/console-7d44c6b5b-t46gq" Jul 02 14:06:26.482758 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:26.482672 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f41c9201-2931-44c8-a32c-b051a4d0d036-trusted-ca-bundle\") pod \"console-7d44c6b5b-t46gq\" (UID: \"f41c9201-2931-44c8-a32c-b051a4d0d036\") " pod="openshift-console/console-7d44c6b5b-t46gq" Jul 02 14:06:26.482758 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:26.482716 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f41c9201-2931-44c8-a32c-b051a4d0d036-console-serving-cert\") pod \"console-7d44c6b5b-t46gq\" (UID: \"f41c9201-2931-44c8-a32c-b051a4d0d036\") " pod="openshift-console/console-7d44c6b5b-t46gq" Jul 02 14:06:26.482758 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:26.482749 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f41c9201-2931-44c8-a32c-b051a4d0d036-console-config\") pod \"console-7d44c6b5b-t46gq\" (UID: \"f41c9201-2931-44c8-a32c-b051a4d0d036\") " pod="openshift-console/console-7d44c6b5b-t46gq" Jul 02 14:06:26.483211 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:26.482769 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxrhq\" (UniqueName: \"kubernetes.io/projected/f41c9201-2931-44c8-a32c-b051a4d0d036-kube-api-access-mxrhq\") pod \"console-7d44c6b5b-t46gq\" (UID: \"f41c9201-2931-44c8-a32c-b051a4d0d036\") " pod="openshift-console/console-7d44c6b5b-t46gq" Jul 02 14:06:26.483211 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:26.482796 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f41c9201-2931-44c8-a32c-b051a4d0d036-console-oauth-config\") pod \"console-7d44c6b5b-t46gq\" (UID: \"f41c9201-2931-44c8-a32c-b051a4d0d036\") " pod="openshift-console/console-7d44c6b5b-t46gq" Jul 02 14:06:26.483211 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:26.482812 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f41c9201-2931-44c8-a32c-b051a4d0d036-oauth-serving-cert\") pod \"console-7d44c6b5b-t46gq\" (UID: \"f41c9201-2931-44c8-a32c-b051a4d0d036\") " pod="openshift-console/console-7d44c6b5b-t46gq" Jul 02 14:06:26.483211 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:26.482829 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f41c9201-2931-44c8-a32c-b051a4d0d036-service-ca\") pod \"console-7d44c6b5b-t46gq\" (UID: \"f41c9201-2931-44c8-a32c-b051a4d0d036\") " pod="openshift-console/console-7d44c6b5b-t46gq" Jul 02 14:06:26.483646 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:26.483616 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f41c9201-2931-44c8-a32c-b051a4d0d036-console-config\") pod \"console-7d44c6b5b-t46gq\" (UID: \"f41c9201-2931-44c8-a32c-b051a4d0d036\") " pod="openshift-console/console-7d44c6b5b-t46gq" Jul 02 14:06:26.483750 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:26.483683 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f41c9201-2931-44c8-a32c-b051a4d0d036-trusted-ca-bundle\") pod \"console-7d44c6b5b-t46gq\" (UID: \"f41c9201-2931-44c8-a32c-b051a4d0d036\") " pod="openshift-console/console-7d44c6b5b-t46gq" Jul 02 14:06:26.483954 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:26.483929 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f41c9201-2931-44c8-a32c-b051a4d0d036-service-ca\") pod \"console-7d44c6b5b-t46gq\" (UID: \"f41c9201-2931-44c8-a32c-b051a4d0d036\") " pod="openshift-console/console-7d44c6b5b-t46gq" Jul 02 14:06:26.484045 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:26.483931 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f41c9201-2931-44c8-a32c-b051a4d0d036-oauth-serving-cert\") pod \"console-7d44c6b5b-t46gq\" (UID: \"f41c9201-2931-44c8-a32c-b051a4d0d036\") " pod="openshift-console/console-7d44c6b5b-t46gq" Jul 02 14:06:26.485914 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:26.485886 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f41c9201-2931-44c8-a32c-b051a4d0d036-console-oauth-config\") pod \"console-7d44c6b5b-t46gq\" (UID: \"f41c9201-2931-44c8-a32c-b051a4d0d036\") " pod="openshift-console/console-7d44c6b5b-t46gq" Jul 02 14:06:26.486038 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:26.485972 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f41c9201-2931-44c8-a32c-b051a4d0d036-console-serving-cert\") pod \"console-7d44c6b5b-t46gq\" (UID: \"f41c9201-2931-44c8-a32c-b051a4d0d036\") " pod="openshift-console/console-7d44c6b5b-t46gq" Jul 02 14:06:26.491503 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:26.491475 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxrhq\" (UniqueName: \"kubernetes.io/projected/f41c9201-2931-44c8-a32c-b051a4d0d036-kube-api-access-mxrhq\") pod \"console-7d44c6b5b-t46gq\" (UID: \"f41c9201-2931-44c8-a32c-b051a4d0d036\") " pod="openshift-console/console-7d44c6b5b-t46gq" Jul 02 14:06:26.628921 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:26.628887 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-687cc6f874-gkrgw" Jul 02 14:06:26.647178 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:26.647149 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d44c6b5b-t46gq" Jul 02 14:06:26.821693 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:26.821667 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d44c6b5b-t46gq"] Jul 02 14:06:26.824061 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:06:26.824030 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf41c9201_2931_44c8_a32c_b051a4d0d036.slice/crio-99d66a243ec859c00fb1b81d7cb8d5d954cc5cb4bf75b6cb02fd9db5d548cc58 WatchSource:0}: Error finding container 99d66a243ec859c00fb1b81d7cb8d5d954cc5cb4bf75b6cb02fd9db5d548cc58: Status 404 returned error can't find the container with id 99d66a243ec859c00fb1b81d7cb8d5d954cc5cb4bf75b6cb02fd9db5d548cc58 Jul 02 14:06:27.205041 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:27.205010 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d44c6b5b-t46gq" event={"ID":"f41c9201-2931-44c8-a32c-b051a4d0d036","Type":"ContainerStarted","Data":"5d1421cdecc7d7b77cd4640091442dc7ba0fe67be309a8dcb60e8725d211626d"} Jul 02 14:06:27.205206 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:27.205056 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d44c6b5b-t46gq" event={"ID":"f41c9201-2931-44c8-a32c-b051a4d0d036","Type":"ContainerStarted","Data":"99d66a243ec859c00fb1b81d7cb8d5d954cc5cb4bf75b6cb02fd9db5d548cc58"} Jul 02 14:06:27.219040 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:27.218972 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7d44c6b5b-t46gq" podStartSLOduration=1.218955349 podStartE2EDuration="1.218955349s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:06:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:06:27.218425188 +0000 UTC m=+318.426667997" watchObservedRunningTime="2026-07-02 14:06:27.218955349 +0000 UTC m=+318.427198132" Jul 02 14:06:30.119874 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:30.119835 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:06:30.221523 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:30.221488 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:06:30.327763 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:30.327723 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:06:33.885610 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:33.885578 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:06:33.945528 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:33.945495 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:06:36.647515 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:36.647462 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7d44c6b5b-t46gq" Jul 02 14:06:36.647515 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:36.647528 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d44c6b5b-t46gq" Jul 02 14:06:36.652266 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:36.652244 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7d44c6b5b-t46gq" Jul 02 14:06:37.242042 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:37.242011 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7d44c6b5b-t46gq" Jul 02 14:06:37.287742 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:37.287710 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d74748d4-clkcr"] Jul 02 14:06:37.403651 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:37.403620 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:06:37.504152 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:37.504056 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:06:51.207571 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:51.207411 2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-687cc6f874-gkrgw" podUID="cd33e6c1-2232-493b-834a-d5e6cf44ef48" containerName="console" containerID="cri-o://558145e3b2e1eac95898f9cb14e0fd1c39e775a7a7ba244cfec6077e2556d678" gracePeriod=15 Jul 02 14:06:51.451499 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:51.451478 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-687cc6f874-gkrgw" Jul 02 14:06:51.605753 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:51.605656 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd33e6c1-2232-493b-834a-d5e6cf44ef48-trusted-ca-bundle\") pod \"cd33e6c1-2232-493b-834a-d5e6cf44ef48\" (UID: \"cd33e6c1-2232-493b-834a-d5e6cf44ef48\") " Jul 02 14:06:51.605753 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:51.605701 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd33e6c1-2232-493b-834a-d5e6cf44ef48-service-ca\") pod \"cd33e6c1-2232-493b-834a-d5e6cf44ef48\" (UID: \"cd33e6c1-2232-493b-834a-d5e6cf44ef48\") " Jul 02 14:06:51.605753 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:51.605729 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd33e6c1-2232-493b-834a-d5e6cf44ef48-console-oauth-config\") pod \"cd33e6c1-2232-493b-834a-d5e6cf44ef48\" (UID: \"cd33e6c1-2232-493b-834a-d5e6cf44ef48\") " Jul 02 14:06:51.606056 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:51.605787 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd33e6c1-2232-493b-834a-d5e6cf44ef48-console-serving-cert\") pod \"cd33e6c1-2232-493b-834a-d5e6cf44ef48\" (UID: \"cd33e6c1-2232-493b-834a-d5e6cf44ef48\") " Jul 02 14:06:51.606056 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:51.605838 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s6jws\" (UniqueName: \"kubernetes.io/projected/cd33e6c1-2232-493b-834a-d5e6cf44ef48-kube-api-access-s6jws\") pod \"cd33e6c1-2232-493b-834a-d5e6cf44ef48\" (UID: \"cd33e6c1-2232-493b-834a-d5e6cf44ef48\") " Jul 02 14:06:51.606056 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:51.605888 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd33e6c1-2232-493b-834a-d5e6cf44ef48-console-config\") pod \"cd33e6c1-2232-493b-834a-d5e6cf44ef48\" (UID: \"cd33e6c1-2232-493b-834a-d5e6cf44ef48\") " Jul 02 14:06:51.606056 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:51.605915 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd33e6c1-2232-493b-834a-d5e6cf44ef48-oauth-serving-cert\") pod \"cd33e6c1-2232-493b-834a-d5e6cf44ef48\" (UID: \"cd33e6c1-2232-493b-834a-d5e6cf44ef48\") " Jul 02 14:06:51.606258 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:51.606113 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd33e6c1-2232-493b-834a-d5e6cf44ef48-service-ca" (OuterVolumeSpecName: "service-ca") pod "cd33e6c1-2232-493b-834a-d5e6cf44ef48" (UID: "cd33e6c1-2232-493b-834a-d5e6cf44ef48"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 14:06:51.606377 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:51.606347 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd33e6c1-2232-493b-834a-d5e6cf44ef48-console-config" (OuterVolumeSpecName: "console-config") pod "cd33e6c1-2232-493b-834a-d5e6cf44ef48" (UID: "cd33e6c1-2232-493b-834a-d5e6cf44ef48"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 14:06:51.606443 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:51.606356 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd33e6c1-2232-493b-834a-d5e6cf44ef48-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "cd33e6c1-2232-493b-834a-d5e6cf44ef48" (UID: "cd33e6c1-2232-493b-834a-d5e6cf44ef48"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 14:06:51.606494 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:51.606438 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd33e6c1-2232-493b-834a-d5e6cf44ef48-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cd33e6c1-2232-493b-834a-d5e6cf44ef48" (UID: "cd33e6c1-2232-493b-834a-d5e6cf44ef48"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 14:06:51.608253 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:51.608229 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd33e6c1-2232-493b-834a-d5e6cf44ef48-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cd33e6c1-2232-493b-834a-d5e6cf44ef48" (UID: "cd33e6c1-2232-493b-834a-d5e6cf44ef48"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 14:06:51.608400 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:51.608379 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd33e6c1-2232-493b-834a-d5e6cf44ef48-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cd33e6c1-2232-493b-834a-d5e6cf44ef48" (UID: "cd33e6c1-2232-493b-834a-d5e6cf44ef48"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 14:06:51.608445 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:51.608416 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd33e6c1-2232-493b-834a-d5e6cf44ef48-kube-api-access-s6jws" (OuterVolumeSpecName: "kube-api-access-s6jws") pod "cd33e6c1-2232-493b-834a-d5e6cf44ef48" (UID: "cd33e6c1-2232-493b-834a-d5e6cf44ef48"). InnerVolumeSpecName "kube-api-access-s6jws". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 14:06:51.707352 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:51.707326 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s6jws\" (UniqueName: \"kubernetes.io/projected/cd33e6c1-2232-493b-834a-d5e6cf44ef48-kube-api-access-s6jws\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:06:51.707352 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:51.707348 2553 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd33e6c1-2232-493b-834a-d5e6cf44ef48-console-config\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:06:51.707352 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:51.707357 2553 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd33e6c1-2232-493b-834a-d5e6cf44ef48-oauth-serving-cert\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:06:51.707553 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:51.707365 2553 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd33e6c1-2232-493b-834a-d5e6cf44ef48-trusted-ca-bundle\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:06:51.707553 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:51.707374 2553 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd33e6c1-2232-493b-834a-d5e6cf44ef48-service-ca\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:06:51.707553 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:51.707383 2553 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd33e6c1-2232-493b-834a-d5e6cf44ef48-console-oauth-config\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:06:51.707553 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:51.707393 2553 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd33e6c1-2232-493b-834a-d5e6cf44ef48-console-serving-cert\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:06:52.290761 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:52.290727 2553 generic.go:356] "Generic (PLEG): container finished" podID="cd33e6c1-2232-493b-834a-d5e6cf44ef48" containerID="558145e3b2e1eac95898f9cb14e0fd1c39e775a7a7ba244cfec6077e2556d678" exitCode=0 Jul 02 14:06:52.291219 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:52.290771 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-687cc6f874-gkrgw" Jul 02 14:06:52.291219 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:52.290776 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-687cc6f874-gkrgw" event={"ID":"cd33e6c1-2232-493b-834a-d5e6cf44ef48","Type":"ContainerDied","Data":"558145e3b2e1eac95898f9cb14e0fd1c39e775a7a7ba244cfec6077e2556d678"} Jul 02 14:06:52.291219 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:52.290826 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-687cc6f874-gkrgw" event={"ID":"cd33e6c1-2232-493b-834a-d5e6cf44ef48","Type":"ContainerDied","Data":"0df025b685d5d20319321c6213a0ae7e372b09c2b40fbbf1a1f720ee1f458f78"} Jul 02 14:06:52.291219 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:52.290846 2553 scope.go:117] "RemoveContainer" containerID="558145e3b2e1eac95898f9cb14e0fd1c39e775a7a7ba244cfec6077e2556d678" Jul 02 14:06:52.299063 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:52.299047 2553 scope.go:117] "RemoveContainer" containerID="558145e3b2e1eac95898f9cb14e0fd1c39e775a7a7ba244cfec6077e2556d678" Jul 02 14:06:52.299303 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:06:52.299284 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"558145e3b2e1eac95898f9cb14e0fd1c39e775a7a7ba244cfec6077e2556d678\": container with ID starting with 558145e3b2e1eac95898f9cb14e0fd1c39e775a7a7ba244cfec6077e2556d678 not found: ID does not exist" containerID="558145e3b2e1eac95898f9cb14e0fd1c39e775a7a7ba244cfec6077e2556d678" Jul 02 14:06:52.299349 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:52.299311 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"558145e3b2e1eac95898f9cb14e0fd1c39e775a7a7ba244cfec6077e2556d678"} err="failed to get container status \"558145e3b2e1eac95898f9cb14e0fd1c39e775a7a7ba244cfec6077e2556d678\": rpc error: code = NotFound desc = could not find container \"558145e3b2e1eac95898f9cb14e0fd1c39e775a7a7ba244cfec6077e2556d678\": container with ID starting with 558145e3b2e1eac95898f9cb14e0fd1c39e775a7a7ba244cfec6077e2556d678 not found: ID does not exist" Jul 02 14:06:52.322329 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:52.322305 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-687cc6f874-gkrgw"] Jul 02 14:06:52.332026 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:52.332000 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-687cc6f874-gkrgw"] Jul 02 14:06:53.206929 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:06:53.206896 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd33e6c1-2232-493b-834a-d5e6cf44ef48" path="/var/lib/kubelet/pods/cd33e6c1-2232-493b-834a-d5e6cf44ef48/volumes" Jul 02 14:07:02.310052 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:02.309931 2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-d74748d4-clkcr" podUID="cb5884a8-d8c7-43fb-8e4b-185bba477794" containerName="console" containerID="cri-o://cd1d845f1f93c989049ba8abf05bdc5533f9dc43c57472afcc0a9d12de744070" gracePeriod=15 Jul 02 14:07:02.551777 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:02.551749 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d74748d4-clkcr" Jul 02 14:07:02.590780 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:02.590714 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cb5884a8-d8c7-43fb-8e4b-185bba477794-console-config\") pod \"cb5884a8-d8c7-43fb-8e4b-185bba477794\" (UID: \"cb5884a8-d8c7-43fb-8e4b-185bba477794\") " Jul 02 14:07:02.590780 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:02.590762 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jt7vw\" (UniqueName: \"kubernetes.io/projected/cb5884a8-d8c7-43fb-8e4b-185bba477794-kube-api-access-jt7vw\") pod \"cb5884a8-d8c7-43fb-8e4b-185bba477794\" (UID: \"cb5884a8-d8c7-43fb-8e4b-185bba477794\") " Jul 02 14:07:02.590963 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:02.590800 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cb5884a8-d8c7-43fb-8e4b-185bba477794-oauth-serving-cert\") pod \"cb5884a8-d8c7-43fb-8e4b-185bba477794\" (UID: \"cb5884a8-d8c7-43fb-8e4b-185bba477794\") " Jul 02 14:07:02.590963 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:02.590830 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cb5884a8-d8c7-43fb-8e4b-185bba477794-console-oauth-config\") pod \"cb5884a8-d8c7-43fb-8e4b-185bba477794\" (UID: \"cb5884a8-d8c7-43fb-8e4b-185bba477794\") " Jul 02 14:07:02.590963 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:02.590885 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cb5884a8-d8c7-43fb-8e4b-185bba477794-service-ca\") pod \"cb5884a8-d8c7-43fb-8e4b-185bba477794\" (UID: \"cb5884a8-d8c7-43fb-8e4b-185bba477794\") " Jul 02 14:07:02.591202 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:02.591180 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb5884a8-d8c7-43fb-8e4b-185bba477794-console-config" (OuterVolumeSpecName: "console-config") pod "cb5884a8-d8c7-43fb-8e4b-185bba477794" (UID: "cb5884a8-d8c7-43fb-8e4b-185bba477794"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 14:07:02.591257 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:02.591217 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb5884a8-d8c7-43fb-8e4b-185bba477794-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cb5884a8-d8c7-43fb-8e4b-185bba477794" (UID: "cb5884a8-d8c7-43fb-8e4b-185bba477794"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 14:07:02.591304 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:02.591277 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb5884a8-d8c7-43fb-8e4b-185bba477794-service-ca" (OuterVolumeSpecName: "service-ca") pod "cb5884a8-d8c7-43fb-8e4b-185bba477794" (UID: "cb5884a8-d8c7-43fb-8e4b-185bba477794"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 14:07:02.593081 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:02.593052 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb5884a8-d8c7-43fb-8e4b-185bba477794-kube-api-access-jt7vw" (OuterVolumeSpecName: "kube-api-access-jt7vw") pod "cb5884a8-d8c7-43fb-8e4b-185bba477794" (UID: "cb5884a8-d8c7-43fb-8e4b-185bba477794"). InnerVolumeSpecName "kube-api-access-jt7vw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 14:07:02.593081 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:02.593070 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb5884a8-d8c7-43fb-8e4b-185bba477794-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cb5884a8-d8c7-43fb-8e4b-185bba477794" (UID: "cb5884a8-d8c7-43fb-8e4b-185bba477794"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 14:07:02.692213 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:02.692182 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cb5884a8-d8c7-43fb-8e4b-185bba477794-console-serving-cert\") pod \"cb5884a8-d8c7-43fb-8e4b-185bba477794\" (UID: \"cb5884a8-d8c7-43fb-8e4b-185bba477794\") " Jul 02 14:07:02.692355 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:02.692331 2553 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cb5884a8-d8c7-43fb-8e4b-185bba477794-service-ca\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:07:02.692355 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:02.692341 2553 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cb5884a8-d8c7-43fb-8e4b-185bba477794-console-config\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:07:02.692355 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:02.692349 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jt7vw\" (UniqueName: \"kubernetes.io/projected/cb5884a8-d8c7-43fb-8e4b-185bba477794-kube-api-access-jt7vw\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:07:02.692453 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:02.692359 2553 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cb5884a8-d8c7-43fb-8e4b-185bba477794-oauth-serving-cert\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:07:02.692453 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:02.692368 2553 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cb5884a8-d8c7-43fb-8e4b-185bba477794-console-oauth-config\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:07:02.694093 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:02.694072 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb5884a8-d8c7-43fb-8e4b-185bba477794-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cb5884a8-d8c7-43fb-8e4b-185bba477794" (UID: "cb5884a8-d8c7-43fb-8e4b-185bba477794"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 14:07:02.792756 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:02.792729 2553 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cb5884a8-d8c7-43fb-8e4b-185bba477794-console-serving-cert\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:07:03.329541 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:03.329512 2553 generic.go:356] "Generic (PLEG): container finished" podID="cb5884a8-d8c7-43fb-8e4b-185bba477794" containerID="cd1d845f1f93c989049ba8abf05bdc5533f9dc43c57472afcc0a9d12de744070" exitCode=0 Jul 02 14:07:03.329933 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:03.329552 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d74748d4-clkcr" Jul 02 14:07:03.329933 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:03.329571 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d74748d4-clkcr" event={"ID":"cb5884a8-d8c7-43fb-8e4b-185bba477794","Type":"ContainerDied","Data":"cd1d845f1f93c989049ba8abf05bdc5533f9dc43c57472afcc0a9d12de744070"} Jul 02 14:07:03.329933 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:03.329622 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d74748d4-clkcr" event={"ID":"cb5884a8-d8c7-43fb-8e4b-185bba477794","Type":"ContainerDied","Data":"bde7b227cee0a648ad683dde089fdf32e8da6c17fc9c04a677fcc2f06a2edbf2"} Jul 02 14:07:03.329933 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:03.329651 2553 scope.go:117] "RemoveContainer" containerID="cd1d845f1f93c989049ba8abf05bdc5533f9dc43c57472afcc0a9d12de744070" Jul 02 14:07:03.339316 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:03.339295 2553 scope.go:117] "RemoveContainer" containerID="cd1d845f1f93c989049ba8abf05bdc5533f9dc43c57472afcc0a9d12de744070" Jul 02 14:07:03.339596 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:07:03.339578 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd1d845f1f93c989049ba8abf05bdc5533f9dc43c57472afcc0a9d12de744070\": container with ID starting with cd1d845f1f93c989049ba8abf05bdc5533f9dc43c57472afcc0a9d12de744070 not found: ID does not exist" containerID="cd1d845f1f93c989049ba8abf05bdc5533f9dc43c57472afcc0a9d12de744070" Jul 02 14:07:03.339639 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:03.339605 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd1d845f1f93c989049ba8abf05bdc5533f9dc43c57472afcc0a9d12de744070"} err="failed to get container status \"cd1d845f1f93c989049ba8abf05bdc5533f9dc43c57472afcc0a9d12de744070\": rpc error: code = NotFound desc = could not find container \"cd1d845f1f93c989049ba8abf05bdc5533f9dc43c57472afcc0a9d12de744070\": container with ID starting with cd1d845f1f93c989049ba8abf05bdc5533f9dc43c57472afcc0a9d12de744070 not found: ID does not exist" Jul 02 14:07:03.348300 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:03.348277 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d74748d4-clkcr"] Jul 02 14:07:03.351292 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:03.351274 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-d74748d4-clkcr"] Jul 02 14:07:04.062286 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:04.062251 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:07:04.125223 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:04.125187 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:07:05.205842 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:05.205809 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb5884a8-d8c7-43fb-8e4b-185bba477794" path="/var/lib/kubelet/pods/cb5884a8-d8c7-43fb-8e4b-185bba477794/volumes" Jul 02 14:07:08.739888 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:08.739857 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:07:18.703956 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:18.703920 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:07:18.769144 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:18.769105 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:07:23.041885 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:23.041853 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fac6f456-02a4-4216-a9ae-7ba6ba7a73b4-metrics-certs\") pod \"network-metrics-daemon-tz5k9\" (UID: \"fac6f456-02a4-4216-a9ae-7ba6ba7a73b4\") " pod="openshift-multus/network-metrics-daemon-tz5k9" Jul 02 14:07:23.044167 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:23.044148 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fac6f456-02a4-4216-a9ae-7ba6ba7a73b4-metrics-certs\") pod \"network-metrics-daemon-tz5k9\" (UID: \"fac6f456-02a4-4216-a9ae-7ba6ba7a73b4\") " pod="openshift-multus/network-metrics-daemon-tz5k9" Jul 02 14:07:23.105578 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:23.105552 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-c8jwt\"" Jul 02 14:07:23.113797 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:23.113779 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tz5k9" Jul 02 14:07:23.246429 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:23.246399 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tz5k9"] Jul 02 14:07:23.249586 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:07:23.249557 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfac6f456_02a4_4216_a9ae_7ba6ba7a73b4.slice/crio-2c71483edbcc28d812e6f8e4deb1b5257a9c5527a9e36b1c53827dc48e51689a WatchSource:0}: Error finding container 2c71483edbcc28d812e6f8e4deb1b5257a9c5527a9e36b1c53827dc48e51689a: Status 404 returned error can't find the container with id 2c71483edbcc28d812e6f8e4deb1b5257a9c5527a9e36b1c53827dc48e51689a Jul 02 14:07:23.398939 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:23.398901 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tz5k9" event={"ID":"fac6f456-02a4-4216-a9ae-7ba6ba7a73b4","Type":"ContainerStarted","Data":"2c71483edbcc28d812e6f8e4deb1b5257a9c5527a9e36b1c53827dc48e51689a"} Jul 02 14:07:24.403944 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:24.403859 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tz5k9" event={"ID":"fac6f456-02a4-4216-a9ae-7ba6ba7a73b4","Type":"ContainerStarted","Data":"f539e6be4a131de4cec72a881216d44a075a98e7a913159df164820e2f060d65"} Jul 02 14:07:24.403944 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:24.403910 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tz5k9" event={"ID":"fac6f456-02a4-4216-a9ae-7ba6ba7a73b4","Type":"ContainerStarted","Data":"658920f4ea77a7680a520f97aca0563582fa916129c3d764049d336f58a4b021"} Jul 02 14:07:24.420602 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:24.420543 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-tz5k9" podStartSLOduration=374.52174835 podStartE2EDuration="6m15.420524863s" totalImagesPullingTime="898.776513ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:01:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:07:24.420210493 +0000 UTC m=+375.628453276" watchObservedRunningTime="2026-07-02 14:07:24.420524863 +0000 UTC m=+375.628767645" Jul 02 14:07:24.519485 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:24.519459 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:07:24.583924 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:24.583895 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:07:25.682182 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:25.682155 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:07:26.116884 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:26.116854 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:07:26.188069 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:26.188035 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:07:31.066517 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:31.066485 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:07:31.165029 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:31.164982 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:07:31.837480 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:31.837451 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-57d644bdc9-fhdk7"] Jul 02 14:07:31.837798 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:31.837781 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb5884a8-d8c7-43fb-8e4b-185bba477794" containerName="console" Jul 02 14:07:31.837888 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:31.837800 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb5884a8-d8c7-43fb-8e4b-185bba477794" containerName="console" Jul 02 14:07:31.837888 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:31.837833 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd33e6c1-2232-493b-834a-d5e6cf44ef48" containerName="console" Jul 02 14:07:31.837888 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:31.837842 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd33e6c1-2232-493b-834a-d5e6cf44ef48" containerName="console" Jul 02 14:07:31.838057 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:31.837904 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb5884a8-d8c7-43fb-8e4b-185bba477794" containerName="console" Jul 02 14:07:31.838057 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:31.837917 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd33e6c1-2232-493b-834a-d5e6cf44ef48" containerName="console" Jul 02 14:07:31.839807 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:31.839787 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57d644bdc9-fhdk7" Jul 02 14:07:31.860628 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:31.860606 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57d644bdc9-fhdk7"] Jul 02 14:07:31.910509 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:31.910475 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03df0d30-b56c-49e8-99d6-ff0128814f4b-service-ca\") pod \"console-57d644bdc9-fhdk7\" (UID: \"03df0d30-b56c-49e8-99d6-ff0128814f4b\") " pod="openshift-console/console-57d644bdc9-fhdk7" Jul 02 14:07:31.910509 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:31.910509 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2d2hm\" (UniqueName: \"kubernetes.io/projected/03df0d30-b56c-49e8-99d6-ff0128814f4b-kube-api-access-2d2hm\") pod \"console-57d644bdc9-fhdk7\" (UID: \"03df0d30-b56c-49e8-99d6-ff0128814f4b\") " pod="openshift-console/console-57d644bdc9-fhdk7" Jul 02 14:07:31.910700 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:31.910533 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03df0d30-b56c-49e8-99d6-ff0128814f4b-oauth-serving-cert\") pod \"console-57d644bdc9-fhdk7\" (UID: \"03df0d30-b56c-49e8-99d6-ff0128814f4b\") " pod="openshift-console/console-57d644bdc9-fhdk7" Jul 02 14:07:31.910700 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:31.910555 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03df0d30-b56c-49e8-99d6-ff0128814f4b-console-oauth-config\") pod \"console-57d644bdc9-fhdk7\" (UID: \"03df0d30-b56c-49e8-99d6-ff0128814f4b\") " pod="openshift-console/console-57d644bdc9-fhdk7" Jul 02 14:07:31.910700 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:31.910587 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03df0d30-b56c-49e8-99d6-ff0128814f4b-console-serving-cert\") pod \"console-57d644bdc9-fhdk7\" (UID: \"03df0d30-b56c-49e8-99d6-ff0128814f4b\") " pod="openshift-console/console-57d644bdc9-fhdk7" Jul 02 14:07:31.910700 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:31.910607 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03df0d30-b56c-49e8-99d6-ff0128814f4b-trusted-ca-bundle\") pod \"console-57d644bdc9-fhdk7\" (UID: \"03df0d30-b56c-49e8-99d6-ff0128814f4b\") " pod="openshift-console/console-57d644bdc9-fhdk7" Jul 02 14:07:31.910700 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:31.910629 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03df0d30-b56c-49e8-99d6-ff0128814f4b-console-config\") pod \"console-57d644bdc9-fhdk7\" (UID: \"03df0d30-b56c-49e8-99d6-ff0128814f4b\") " pod="openshift-console/console-57d644bdc9-fhdk7" Jul 02 14:07:31.930029 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:31.929981 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:07:32.011523 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:32.011493 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03df0d30-b56c-49e8-99d6-ff0128814f4b-service-ca\") pod \"console-57d644bdc9-fhdk7\" (UID: \"03df0d30-b56c-49e8-99d6-ff0128814f4b\") " pod="openshift-console/console-57d644bdc9-fhdk7" Jul 02 14:07:32.011523 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:32.011524 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2d2hm\" (UniqueName: \"kubernetes.io/projected/03df0d30-b56c-49e8-99d6-ff0128814f4b-kube-api-access-2d2hm\") pod \"console-57d644bdc9-fhdk7\" (UID: \"03df0d30-b56c-49e8-99d6-ff0128814f4b\") " pod="openshift-console/console-57d644bdc9-fhdk7" Jul 02 14:07:32.011688 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:32.011545 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03df0d30-b56c-49e8-99d6-ff0128814f4b-oauth-serving-cert\") pod \"console-57d644bdc9-fhdk7\" (UID: \"03df0d30-b56c-49e8-99d6-ff0128814f4b\") " pod="openshift-console/console-57d644bdc9-fhdk7" Jul 02 14:07:32.011688 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:32.011675 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03df0d30-b56c-49e8-99d6-ff0128814f4b-console-oauth-config\") pod \"console-57d644bdc9-fhdk7\" (UID: \"03df0d30-b56c-49e8-99d6-ff0128814f4b\") " pod="openshift-console/console-57d644bdc9-fhdk7" Jul 02 14:07:32.011762 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:32.011715 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03df0d30-b56c-49e8-99d6-ff0128814f4b-console-serving-cert\") pod \"console-57d644bdc9-fhdk7\" (UID: \"03df0d30-b56c-49e8-99d6-ff0128814f4b\") " pod="openshift-console/console-57d644bdc9-fhdk7" Jul 02 14:07:32.011762 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:32.011754 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03df0d30-b56c-49e8-99d6-ff0128814f4b-trusted-ca-bundle\") pod \"console-57d644bdc9-fhdk7\" (UID: \"03df0d30-b56c-49e8-99d6-ff0128814f4b\") " pod="openshift-console/console-57d644bdc9-fhdk7" Jul 02 14:07:32.011857 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:32.011793 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03df0d30-b56c-49e8-99d6-ff0128814f4b-console-config\") pod \"console-57d644bdc9-fhdk7\" (UID: \"03df0d30-b56c-49e8-99d6-ff0128814f4b\") " pod="openshift-console/console-57d644bdc9-fhdk7" Jul 02 14:07:32.012369 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:32.012341 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03df0d30-b56c-49e8-99d6-ff0128814f4b-service-ca\") pod \"console-57d644bdc9-fhdk7\" (UID: \"03df0d30-b56c-49e8-99d6-ff0128814f4b\") " pod="openshift-console/console-57d644bdc9-fhdk7" Jul 02 14:07:32.012485 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:32.012353 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03df0d30-b56c-49e8-99d6-ff0128814f4b-oauth-serving-cert\") pod \"console-57d644bdc9-fhdk7\" (UID: \"03df0d30-b56c-49e8-99d6-ff0128814f4b\") " pod="openshift-console/console-57d644bdc9-fhdk7" Jul 02 14:07:32.012485 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:32.012423 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03df0d30-b56c-49e8-99d6-ff0128814f4b-console-config\") pod \"console-57d644bdc9-fhdk7\" (UID: \"03df0d30-b56c-49e8-99d6-ff0128814f4b\") " pod="openshift-console/console-57d644bdc9-fhdk7" Jul 02 14:07:32.012653 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:32.012562 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03df0d30-b56c-49e8-99d6-ff0128814f4b-trusted-ca-bundle\") pod \"console-57d644bdc9-fhdk7\" (UID: \"03df0d30-b56c-49e8-99d6-ff0128814f4b\") " pod="openshift-console/console-57d644bdc9-fhdk7" Jul 02 14:07:32.014112 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:32.014090 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03df0d30-b56c-49e8-99d6-ff0128814f4b-console-oauth-config\") pod \"console-57d644bdc9-fhdk7\" (UID: \"03df0d30-b56c-49e8-99d6-ff0128814f4b\") " pod="openshift-console/console-57d644bdc9-fhdk7" Jul 02 14:07:32.014231 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:32.014174 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03df0d30-b56c-49e8-99d6-ff0128814f4b-console-serving-cert\") pod \"console-57d644bdc9-fhdk7\" (UID: \"03df0d30-b56c-49e8-99d6-ff0128814f4b\") " pod="openshift-console/console-57d644bdc9-fhdk7" Jul 02 14:07:32.019933 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:32.019902 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:07:32.022349 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:32.022321 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2d2hm\" (UniqueName: \"kubernetes.io/projected/03df0d30-b56c-49e8-99d6-ff0128814f4b-kube-api-access-2d2hm\") pod \"console-57d644bdc9-fhdk7\" (UID: \"03df0d30-b56c-49e8-99d6-ff0128814f4b\") " pod="openshift-console/console-57d644bdc9-fhdk7" Jul 02 14:07:32.149906 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:32.149880 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57d644bdc9-fhdk7" Jul 02 14:07:32.280480 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:32.280425 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57d644bdc9-fhdk7"] Jul 02 14:07:32.285847 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:07:32.285823 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03df0d30_b56c_49e8_99d6_ff0128814f4b.slice/crio-a7b81ae9bc405a2bdb279fa1a7949a0028ac65636bb38ecf008c0e234f0dfec2 WatchSource:0}: Error finding container a7b81ae9bc405a2bdb279fa1a7949a0028ac65636bb38ecf008c0e234f0dfec2: Status 404 returned error can't find the container with id a7b81ae9bc405a2bdb279fa1a7949a0028ac65636bb38ecf008c0e234f0dfec2 Jul 02 14:07:32.433004 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:32.432907 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57d644bdc9-fhdk7" event={"ID":"03df0d30-b56c-49e8-99d6-ff0128814f4b","Type":"ContainerStarted","Data":"4c328b5e15ed5c1249144f4a43b8cf97a94501bd4a11ba7241551d514ea8a088"} Jul 02 14:07:32.433004 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:32.432957 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57d644bdc9-fhdk7" event={"ID":"03df0d30-b56c-49e8-99d6-ff0128814f4b","Type":"ContainerStarted","Data":"a7b81ae9bc405a2bdb279fa1a7949a0028ac65636bb38ecf008c0e234f0dfec2"} Jul 02 14:07:32.454402 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:32.454347 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-57d644bdc9-fhdk7" podStartSLOduration=1.4543306839999999 podStartE2EDuration="1.454330684s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:07:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:07:32.453315093 +0000 UTC m=+383.661557876" watchObservedRunningTime="2026-07-02 14:07:32.454330684 +0000 UTC m=+383.662573527" Jul 02 14:07:37.995034 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:37.994983 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:07:38.095281 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:38.095227 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:07:42.151009 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:42.150950 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-57d644bdc9-fhdk7" Jul 02 14:07:42.151513 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:42.151044 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57d644bdc9-fhdk7" Jul 02 14:07:42.155638 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:42.155612 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-57d644bdc9-fhdk7" Jul 02 14:07:42.472283 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:42.472197 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-57d644bdc9-fhdk7" Jul 02 14:07:42.531390 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:42.531346 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d44c6b5b-t46gq"] Jul 02 14:07:42.651469 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:42.651436 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:07:42.754217 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:42.754121 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:07:42.827749 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:42.827715 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:07:48.901526 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:48.901492 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:07:49.006191 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:07:49.006153 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:08:07.554275 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:07.554230 2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7d44c6b5b-t46gq" podUID="f41c9201-2931-44c8-a32c-b051a4d0d036" containerName="console" containerID="cri-o://5d1421cdecc7d7b77cd4640091442dc7ba0fe67be309a8dcb60e8725d211626d" gracePeriod=15 Jul 02 14:08:07.797606 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:07.797581 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d44c6b5b-t46gq" Jul 02 14:08:07.889224 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:07.889191 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f41c9201-2931-44c8-a32c-b051a4d0d036-service-ca\") pod \"f41c9201-2931-44c8-a32c-b051a4d0d036\" (UID: \"f41c9201-2931-44c8-a32c-b051a4d0d036\") " Jul 02 14:08:07.889435 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:07.889258 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mxrhq\" (UniqueName: \"kubernetes.io/projected/f41c9201-2931-44c8-a32c-b051a4d0d036-kube-api-access-mxrhq\") pod \"f41c9201-2931-44c8-a32c-b051a4d0d036\" (UID: \"f41c9201-2931-44c8-a32c-b051a4d0d036\") " Jul 02 14:08:07.889435 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:07.889287 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f41c9201-2931-44c8-a32c-b051a4d0d036-console-serving-cert\") pod \"f41c9201-2931-44c8-a32c-b051a4d0d036\" (UID: \"f41c9201-2931-44c8-a32c-b051a4d0d036\") " Jul 02 14:08:07.889435 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:07.889394 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f41c9201-2931-44c8-a32c-b051a4d0d036-trusted-ca-bundle\") pod \"f41c9201-2931-44c8-a32c-b051a4d0d036\" (UID: \"f41c9201-2931-44c8-a32c-b051a4d0d036\") " Jul 02 14:08:07.889435 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:07.889432 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f41c9201-2931-44c8-a32c-b051a4d0d036-oauth-serving-cert\") pod \"f41c9201-2931-44c8-a32c-b051a4d0d036\" (UID: \"f41c9201-2931-44c8-a32c-b051a4d0d036\") " Jul 02 14:08:07.889653 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:07.889507 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f41c9201-2931-44c8-a32c-b051a4d0d036-console-oauth-config\") pod \"f41c9201-2931-44c8-a32c-b051a4d0d036\" (UID: \"f41c9201-2931-44c8-a32c-b051a4d0d036\") " Jul 02 14:08:07.889653 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:07.889522 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f41c9201-2931-44c8-a32c-b051a4d0d036-console-config\") pod \"f41c9201-2931-44c8-a32c-b051a4d0d036\" (UID: \"f41c9201-2931-44c8-a32c-b051a4d0d036\") " Jul 02 14:08:07.889759 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:07.889647 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f41c9201-2931-44c8-a32c-b051a4d0d036-service-ca" (OuterVolumeSpecName: "service-ca") pod "f41c9201-2931-44c8-a32c-b051a4d0d036" (UID: "f41c9201-2931-44c8-a32c-b051a4d0d036"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 14:08:07.889869 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:07.889842 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f41c9201-2931-44c8-a32c-b051a4d0d036-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f41c9201-2931-44c8-a32c-b051a4d0d036" (UID: "f41c9201-2931-44c8-a32c-b051a4d0d036"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 14:08:07.890030 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:07.889972 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f41c9201-2931-44c8-a32c-b051a4d0d036-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f41c9201-2931-44c8-a32c-b051a4d0d036" (UID: "f41c9201-2931-44c8-a32c-b051a4d0d036"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 14:08:07.890169 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:07.890048 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f41c9201-2931-44c8-a32c-b051a4d0d036-console-config" (OuterVolumeSpecName: "console-config") pod "f41c9201-2931-44c8-a32c-b051a4d0d036" (UID: "f41c9201-2931-44c8-a32c-b051a4d0d036"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 14:08:07.891573 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:07.891544 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f41c9201-2931-44c8-a32c-b051a4d0d036-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f41c9201-2931-44c8-a32c-b051a4d0d036" (UID: "f41c9201-2931-44c8-a32c-b051a4d0d036"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 14:08:07.891573 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:07.891555 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f41c9201-2931-44c8-a32c-b051a4d0d036-kube-api-access-mxrhq" (OuterVolumeSpecName: "kube-api-access-mxrhq") pod "f41c9201-2931-44c8-a32c-b051a4d0d036" (UID: "f41c9201-2931-44c8-a32c-b051a4d0d036"). InnerVolumeSpecName "kube-api-access-mxrhq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 14:08:07.891692 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:07.891578 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f41c9201-2931-44c8-a32c-b051a4d0d036-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f41c9201-2931-44c8-a32c-b051a4d0d036" (UID: "f41c9201-2931-44c8-a32c-b051a4d0d036"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 14:08:07.990265 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:07.990222 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mxrhq\" (UniqueName: \"kubernetes.io/projected/f41c9201-2931-44c8-a32c-b051a4d0d036-kube-api-access-mxrhq\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:08:07.990265 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:07.990253 2553 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f41c9201-2931-44c8-a32c-b051a4d0d036-console-serving-cert\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:08:07.990265 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:07.990262 2553 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f41c9201-2931-44c8-a32c-b051a4d0d036-trusted-ca-bundle\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:08:07.990265 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:07.990272 2553 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f41c9201-2931-44c8-a32c-b051a4d0d036-oauth-serving-cert\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:08:07.990521 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:07.990280 2553 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f41c9201-2931-44c8-a32c-b051a4d0d036-console-oauth-config\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:08:07.990521 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:07.990289 2553 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f41c9201-2931-44c8-a32c-b051a4d0d036-console-config\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:08:07.990521 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:07.990297 2553 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f41c9201-2931-44c8-a32c-b051a4d0d036-service-ca\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:08:08.477505 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:08.477473 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:08:08.547371 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:08.547338 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:08:08.559350 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:08.559319 2553 generic.go:356] "Generic (PLEG): container finished" podID="f41c9201-2931-44c8-a32c-b051a4d0d036" containerID="5d1421cdecc7d7b77cd4640091442dc7ba0fe67be309a8dcb60e8725d211626d" exitCode=0 Jul 02 14:08:08.559765 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:08.559359 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d44c6b5b-t46gq" event={"ID":"f41c9201-2931-44c8-a32c-b051a4d0d036","Type":"ContainerDied","Data":"5d1421cdecc7d7b77cd4640091442dc7ba0fe67be309a8dcb60e8725d211626d"} Jul 02 14:08:08.559765 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:08.559366 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d44c6b5b-t46gq" Jul 02 14:08:08.559765 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:08.559398 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d44c6b5b-t46gq" event={"ID":"f41c9201-2931-44c8-a32c-b051a4d0d036","Type":"ContainerDied","Data":"99d66a243ec859c00fb1b81d7cb8d5d954cc5cb4bf75b6cb02fd9db5d548cc58"} Jul 02 14:08:08.559765 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:08.559418 2553 scope.go:117] "RemoveContainer" containerID="5d1421cdecc7d7b77cd4640091442dc7ba0fe67be309a8dcb60e8725d211626d" Jul 02 14:08:08.568015 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:08.567999 2553 scope.go:117] "RemoveContainer" containerID="5d1421cdecc7d7b77cd4640091442dc7ba0fe67be309a8dcb60e8725d211626d" Jul 02 14:08:08.568306 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:08:08.568285 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d1421cdecc7d7b77cd4640091442dc7ba0fe67be309a8dcb60e8725d211626d\": container with ID starting with 5d1421cdecc7d7b77cd4640091442dc7ba0fe67be309a8dcb60e8725d211626d not found: ID does not exist" containerID="5d1421cdecc7d7b77cd4640091442dc7ba0fe67be309a8dcb60e8725d211626d" Jul 02 14:08:08.568369 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:08.568317 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d1421cdecc7d7b77cd4640091442dc7ba0fe67be309a8dcb60e8725d211626d"} err="failed to get container status \"5d1421cdecc7d7b77cd4640091442dc7ba0fe67be309a8dcb60e8725d211626d\": rpc error: code = NotFound desc = could not find container \"5d1421cdecc7d7b77cd4640091442dc7ba0fe67be309a8dcb60e8725d211626d\": container with ID starting with 5d1421cdecc7d7b77cd4640091442dc7ba0fe67be309a8dcb60e8725d211626d not found: ID does not exist" Jul 02 14:08:08.586932 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:08.586901 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d44c6b5b-t46gq"] Jul 02 14:08:08.590927 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:08.590895 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7d44c6b5b-t46gq"] Jul 02 14:08:09.205831 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:09.205802 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f41c9201-2931-44c8-a32c-b051a4d0d036" path="/var/lib/kubelet/pods/f41c9201-2931-44c8-a32c-b051a4d0d036/volumes" Jul 02 14:08:22.517857 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:22.517822 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:08:22.618374 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:22.618339 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:08:23.538974 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:23.538937 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvs54n"] Jul 02 14:08:23.539416 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:23.539241 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f41c9201-2931-44c8-a32c-b051a4d0d036" containerName="console" Jul 02 14:08:23.539416 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:23.539256 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="f41c9201-2931-44c8-a32c-b051a4d0d036" containerName="console" Jul 02 14:08:23.539416 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:23.539309 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="f41c9201-2931-44c8-a32c-b051a4d0d036" containerName="console" Jul 02 14:08:23.542187 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:23.542172 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvs54n" Jul 02 14:08:23.544795 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:23.544770 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 02 14:08:23.545075 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:23.545060 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gb8hw\"" Jul 02 14:08:23.545835 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:23.545820 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 02 14:08:23.553240 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:23.553212 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvs54n"] Jul 02 14:08:23.601874 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:23.601836 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5j2q\" (UniqueName: \"kubernetes.io/projected/e8cac813-2cbd-41ab-be77-1a7e75ddd411-kube-api-access-q5j2q\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvs54n\" (UID: \"e8cac813-2cbd-41ab-be77-1a7e75ddd411\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvs54n" Jul 02 14:08:23.601874 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:23.601881 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e8cac813-2cbd-41ab-be77-1a7e75ddd411-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvs54n\" (UID: \"e8cac813-2cbd-41ab-be77-1a7e75ddd411\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvs54n" Jul 02 14:08:23.602134 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:23.601956 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e8cac813-2cbd-41ab-be77-1a7e75ddd411-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvs54n\" (UID: \"e8cac813-2cbd-41ab-be77-1a7e75ddd411\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvs54n" Jul 02 14:08:23.702849 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:23.702816 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e8cac813-2cbd-41ab-be77-1a7e75ddd411-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvs54n\" (UID: \"e8cac813-2cbd-41ab-be77-1a7e75ddd411\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvs54n" Jul 02 14:08:23.703011 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:23.702871 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5j2q\" (UniqueName: \"kubernetes.io/projected/e8cac813-2cbd-41ab-be77-1a7e75ddd411-kube-api-access-q5j2q\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvs54n\" (UID: \"e8cac813-2cbd-41ab-be77-1a7e75ddd411\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvs54n" Jul 02 14:08:23.703011 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:23.702916 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e8cac813-2cbd-41ab-be77-1a7e75ddd411-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvs54n\" (UID: \"e8cac813-2cbd-41ab-be77-1a7e75ddd411\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvs54n" Jul 02 14:08:23.703302 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:23.703283 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e8cac813-2cbd-41ab-be77-1a7e75ddd411-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvs54n\" (UID: \"e8cac813-2cbd-41ab-be77-1a7e75ddd411\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvs54n" Jul 02 14:08:23.703348 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:23.703292 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e8cac813-2cbd-41ab-be77-1a7e75ddd411-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvs54n\" (UID: \"e8cac813-2cbd-41ab-be77-1a7e75ddd411\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvs54n" Jul 02 14:08:23.713336 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:23.713310 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5j2q\" (UniqueName: \"kubernetes.io/projected/e8cac813-2cbd-41ab-be77-1a7e75ddd411-kube-api-access-q5j2q\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvs54n\" (UID: \"e8cac813-2cbd-41ab-be77-1a7e75ddd411\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvs54n" Jul 02 14:08:23.851383 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:23.851290 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvs54n" Jul 02 14:08:23.986816 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:23.986777 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvs54n"] Jul 02 14:08:23.990382 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:08:23.990343 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8cac813_2cbd_41ab_be77_1a7e75ddd411.slice/crio-54770fec76ec9bf3d98c16f526c359b41da472e0f4c5b8340d7db36038ffc400 WatchSource:0}: Error finding container 54770fec76ec9bf3d98c16f526c359b41da472e0f4c5b8340d7db36038ffc400: Status 404 returned error can't find the container with id 54770fec76ec9bf3d98c16f526c359b41da472e0f4c5b8340d7db36038ffc400 Jul 02 14:08:24.621949 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:24.621911 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvs54n" event={"ID":"e8cac813-2cbd-41ab-be77-1a7e75ddd411","Type":"ContainerStarted","Data":"54770fec76ec9bf3d98c16f526c359b41da472e0f4c5b8340d7db36038ffc400"} Jul 02 14:08:33.657735 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:33.657699 2553 generic.go:356] "Generic (PLEG): container finished" podID="e8cac813-2cbd-41ab-be77-1a7e75ddd411" containerID="ea743359d9a85b655c3179121853fb91157ce0fc3abe551c7ebe0a590be8775f" exitCode=0 Jul 02 14:08:33.658159 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:33.657790 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvs54n" event={"ID":"e8cac813-2cbd-41ab-be77-1a7e75ddd411","Type":"ContainerDied","Data":"ea743359d9a85b655c3179121853fb91157ce0fc3abe551c7ebe0a590be8775f"} Jul 02 14:08:35.667512 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:35.667477 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvs54n" event={"ID":"e8cac813-2cbd-41ab-be77-1a7e75ddd411","Type":"ContainerStarted","Data":"f9da8be49cc3dbb6a0b43ff74d5ecc59e72c666e30d8de1128011d2a917d921f"} Jul 02 14:08:36.673447 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:36.673407 2553 generic.go:356] "Generic (PLEG): container finished" podID="e8cac813-2cbd-41ab-be77-1a7e75ddd411" containerID="f9da8be49cc3dbb6a0b43ff74d5ecc59e72c666e30d8de1128011d2a917d921f" exitCode=0 Jul 02 14:08:36.673838 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:36.673491 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvs54n" event={"ID":"e8cac813-2cbd-41ab-be77-1a7e75ddd411","Type":"ContainerDied","Data":"f9da8be49cc3dbb6a0b43ff74d5ecc59e72c666e30d8de1128011d2a917d921f"} Jul 02 14:08:36.838853 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:36.838813 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:08:36.931173 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:36.931072 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:08:45.712341 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:45.712249 2553 generic.go:356] "Generic (PLEG): container finished" podID="e8cac813-2cbd-41ab-be77-1a7e75ddd411" containerID="a2ed5947c816666996272aee7413596db7399f1fed5804919bbbf05445b8a992" exitCode=0 Jul 02 14:08:45.712341 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:45.712312 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvs54n" event={"ID":"e8cac813-2cbd-41ab-be77-1a7e75ddd411","Type":"ContainerDied","Data":"a2ed5947c816666996272aee7413596db7399f1fed5804919bbbf05445b8a992"} Jul 02 14:08:46.860390 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:46.860354 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvs54n" Jul 02 14:08:46.886400 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:46.886374 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e8cac813-2cbd-41ab-be77-1a7e75ddd411-util\") pod \"e8cac813-2cbd-41ab-be77-1a7e75ddd411\" (UID: \"e8cac813-2cbd-41ab-be77-1a7e75ddd411\") " Jul 02 14:08:46.886586 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:46.886451 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q5j2q\" (UniqueName: \"kubernetes.io/projected/e8cac813-2cbd-41ab-be77-1a7e75ddd411-kube-api-access-q5j2q\") pod \"e8cac813-2cbd-41ab-be77-1a7e75ddd411\" (UID: \"e8cac813-2cbd-41ab-be77-1a7e75ddd411\") " Jul 02 14:08:46.886586 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:46.886471 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e8cac813-2cbd-41ab-be77-1a7e75ddd411-bundle\") pod \"e8cac813-2cbd-41ab-be77-1a7e75ddd411\" (UID: \"e8cac813-2cbd-41ab-be77-1a7e75ddd411\") " Jul 02 14:08:46.887155 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:46.887128 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8cac813-2cbd-41ab-be77-1a7e75ddd411-bundle" (OuterVolumeSpecName: "bundle") pod "e8cac813-2cbd-41ab-be77-1a7e75ddd411" (UID: "e8cac813-2cbd-41ab-be77-1a7e75ddd411"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 14:08:46.888738 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:46.888709 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8cac813-2cbd-41ab-be77-1a7e75ddd411-kube-api-access-q5j2q" (OuterVolumeSpecName: "kube-api-access-q5j2q") pod "e8cac813-2cbd-41ab-be77-1a7e75ddd411" (UID: "e8cac813-2cbd-41ab-be77-1a7e75ddd411"). InnerVolumeSpecName "kube-api-access-q5j2q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 14:08:46.892181 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:46.892146 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8cac813-2cbd-41ab-be77-1a7e75ddd411-util" (OuterVolumeSpecName: "util") pod "e8cac813-2cbd-41ab-be77-1a7e75ddd411" (UID: "e8cac813-2cbd-41ab-be77-1a7e75ddd411"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 14:08:46.987383 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:46.987289 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q5j2q\" (UniqueName: \"kubernetes.io/projected/e8cac813-2cbd-41ab-be77-1a7e75ddd411-kube-api-access-q5j2q\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:08:46.987383 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:46.987320 2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e8cac813-2cbd-41ab-be77-1a7e75ddd411-bundle\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:08:46.987383 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:46.987331 2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e8cac813-2cbd-41ab-be77-1a7e75ddd411-util\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:08:47.721805 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:47.721773 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvs54n" event={"ID":"e8cac813-2cbd-41ab-be77-1a7e75ddd411","Type":"ContainerDied","Data":"54770fec76ec9bf3d98c16f526c359b41da472e0f4c5b8340d7db36038ffc400"} Jul 02 14:08:47.721805 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:47.721808 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvs54n" Jul 02 14:08:47.722050 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:47.721844 2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="54770fec76ec9bf3d98c16f526c359b41da472e0f4c5b8340d7db36038ffc400" Jul 02 14:08:49.806916 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:49.806884 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:08:50.236081 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:50.236050 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:08:51.880728 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:51.880691 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-crbdm"] Jul 02 14:08:51.881263 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:51.881084 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8cac813-2cbd-41ab-be77-1a7e75ddd411" containerName="util" Jul 02 14:08:51.881263 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:51.881103 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8cac813-2cbd-41ab-be77-1a7e75ddd411" containerName="util" Jul 02 14:08:51.881263 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:51.881116 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8cac813-2cbd-41ab-be77-1a7e75ddd411" containerName="extract" Jul 02 14:08:51.881263 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:51.881125 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8cac813-2cbd-41ab-be77-1a7e75ddd411" containerName="extract" Jul 02 14:08:51.881263 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:51.881148 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8cac813-2cbd-41ab-be77-1a7e75ddd411" containerName="pull" Jul 02 14:08:51.881263 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:51.881155 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8cac813-2cbd-41ab-be77-1a7e75ddd411" containerName="pull" Jul 02 14:08:51.881263 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:51.881218 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8cac813-2cbd-41ab-be77-1a7e75ddd411" containerName="extract" Jul 02 14:08:51.883193 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:51.883172 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-crbdm" Jul 02 14:08:51.886650 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:51.886619 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-q2j6r\"" Jul 02 14:08:51.889193 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:51.889128 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 02 14:08:51.889436 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:51.889416 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 02 14:08:51.902734 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:51.902704 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-crbdm"] Jul 02 14:08:51.932072 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:51.932038 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/754d81ad-3b07-4848-b4af-42c3718816d0-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-crbdm\" (UID: \"754d81ad-3b07-4848-b4af-42c3718816d0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-crbdm" Jul 02 14:08:51.932221 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:51.932104 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jstgj\" (UniqueName: \"kubernetes.io/projected/754d81ad-3b07-4848-b4af-42c3718816d0-kube-api-access-jstgj\") pod \"cert-manager-operator-controller-manager-57757f7cfc-crbdm\" (UID: \"754d81ad-3b07-4848-b4af-42c3718816d0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-crbdm" Jul 02 14:08:52.033552 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:52.033507 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/754d81ad-3b07-4848-b4af-42c3718816d0-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-crbdm\" (UID: \"754d81ad-3b07-4848-b4af-42c3718816d0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-crbdm" Jul 02 14:08:52.033737 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:52.033623 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jstgj\" (UniqueName: \"kubernetes.io/projected/754d81ad-3b07-4848-b4af-42c3718816d0-kube-api-access-jstgj\") pod \"cert-manager-operator-controller-manager-57757f7cfc-crbdm\" (UID: \"754d81ad-3b07-4848-b4af-42c3718816d0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-crbdm" Jul 02 14:08:52.033945 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:52.033923 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/754d81ad-3b07-4848-b4af-42c3718816d0-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-crbdm\" (UID: \"754d81ad-3b07-4848-b4af-42c3718816d0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-crbdm" Jul 02 14:08:52.046189 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:52.046154 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jstgj\" (UniqueName: \"kubernetes.io/projected/754d81ad-3b07-4848-b4af-42c3718816d0-kube-api-access-jstgj\") pod \"cert-manager-operator-controller-manager-57757f7cfc-crbdm\" (UID: \"754d81ad-3b07-4848-b4af-42c3718816d0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-crbdm" Jul 02 14:08:52.194729 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:52.194638 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-crbdm" Jul 02 14:08:52.336044 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:52.336016 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-crbdm"] Jul 02 14:08:52.339772 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:08:52.339742 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod754d81ad_3b07_4848_b4af_42c3718816d0.slice/crio-632e69830ebf69bab18b903e6053dd7f425632f0f23ee6609edb32817880b5ba WatchSource:0}: Error finding container 632e69830ebf69bab18b903e6053dd7f425632f0f23ee6609edb32817880b5ba: Status 404 returned error can't find the container with id 632e69830ebf69bab18b903e6053dd7f425632f0f23ee6609edb32817880b5ba Jul 02 14:08:52.741387 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:52.741356 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-crbdm" event={"ID":"754d81ad-3b07-4848-b4af-42c3718816d0","Type":"ContainerStarted","Data":"632e69830ebf69bab18b903e6053dd7f425632f0f23ee6609edb32817880b5ba"} Jul 02 14:08:53.841180 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:53.841142 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:08:54.003727 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:54.003690 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:08:55.568032 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:55.567980 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:08:55.666486 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:55.666449 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:08:55.755183 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:55.755147 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-crbdm" event={"ID":"754d81ad-3b07-4848-b4af-42c3718816d0","Type":"ContainerStarted","Data":"46ec34c439984e492a71dca53a9b943cd3d5d3ababbc6c212c3875a430bb2a30"} Jul 02 14:08:55.777672 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:55.777611 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-crbdm" podStartSLOduration=2.3687662290000002 podStartE2EDuration="4.777591887s" totalImagesPullingTime="2.408825658s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:08:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:08:55.7761858 +0000 UTC m=+466.984428573" watchObservedRunningTime="2026-07-02 14:08:55.777591887 +0000 UTC m=+466.985834669" Jul 02 14:08:56.195830 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:56.195795 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:08:56.336453 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:56.336420 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:08:56.406444 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:56.406410 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdz85f"] Jul 02 14:08:56.408786 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:56.408769 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdz85f" Jul 02 14:08:56.412881 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:56.412864 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 02 14:08:56.413022 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:56.412900 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gb8hw\"" Jul 02 14:08:56.416184 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:56.416163 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 02 14:08:56.436676 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:56.436648 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdz85f"] Jul 02 14:08:56.475493 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:56.475393 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/193b70f5-d7aa-4aa9-9c09-9be634432a51-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdz85f\" (UID: \"193b70f5-d7aa-4aa9-9c09-9be634432a51\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdz85f" Jul 02 14:08:56.475493 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:56.475446 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z288c\" (UniqueName: \"kubernetes.io/projected/193b70f5-d7aa-4aa9-9c09-9be634432a51-kube-api-access-z288c\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdz85f\" (UID: \"193b70f5-d7aa-4aa9-9c09-9be634432a51\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdz85f" Jul 02 14:08:56.475680 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:56.475532 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/193b70f5-d7aa-4aa9-9c09-9be634432a51-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdz85f\" (UID: \"193b70f5-d7aa-4aa9-9c09-9be634432a51\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdz85f" Jul 02 14:08:56.576197 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:56.576160 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/193b70f5-d7aa-4aa9-9c09-9be634432a51-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdz85f\" (UID: \"193b70f5-d7aa-4aa9-9c09-9be634432a51\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdz85f" Jul 02 14:08:56.576683 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:56.576210 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z288c\" (UniqueName: \"kubernetes.io/projected/193b70f5-d7aa-4aa9-9c09-9be634432a51-kube-api-access-z288c\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdz85f\" (UID: \"193b70f5-d7aa-4aa9-9c09-9be634432a51\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdz85f" Jul 02 14:08:56.576683 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:56.576260 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/193b70f5-d7aa-4aa9-9c09-9be634432a51-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdz85f\" (UID: \"193b70f5-d7aa-4aa9-9c09-9be634432a51\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdz85f" Jul 02 14:08:56.576683 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:56.576541 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/193b70f5-d7aa-4aa9-9c09-9be634432a51-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdz85f\" (UID: \"193b70f5-d7aa-4aa9-9c09-9be634432a51\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdz85f" Jul 02 14:08:56.576683 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:56.576605 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/193b70f5-d7aa-4aa9-9c09-9be634432a51-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdz85f\" (UID: \"193b70f5-d7aa-4aa9-9c09-9be634432a51\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdz85f" Jul 02 14:08:56.593796 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:56.593761 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z288c\" (UniqueName: \"kubernetes.io/projected/193b70f5-d7aa-4aa9-9c09-9be634432a51-kube-api-access-z288c\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdz85f\" (UID: \"193b70f5-d7aa-4aa9-9c09-9be634432a51\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdz85f" Jul 02 14:08:56.717600 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:56.717564 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdz85f" Jul 02 14:08:56.865290 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:56.865253 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdz85f"] Jul 02 14:08:56.868543 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:08:56.868517 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod193b70f5_d7aa_4aa9_9c09_9be634432a51.slice/crio-c78ef5e2fcb99f13103cc821acc3f42fe2233054d53db879e6ac28dda70135b2 WatchSource:0}: Error finding container c78ef5e2fcb99f13103cc821acc3f42fe2233054d53db879e6ac28dda70135b2: Status 404 returned error can't find the container with id c78ef5e2fcb99f13103cc821acc3f42fe2233054d53db879e6ac28dda70135b2 Jul 02 14:08:57.764561 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:57.764523 2553 generic.go:356] "Generic (PLEG): container finished" podID="193b70f5-d7aa-4aa9-9c09-9be634432a51" containerID="5144e14740b31088f77687f4713f10a1473b77e0d8c84b6ba075ac46ef0f2607" exitCode=0 Jul 02 14:08:57.764973 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:57.764609 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdz85f" event={"ID":"193b70f5-d7aa-4aa9-9c09-9be634432a51","Type":"ContainerDied","Data":"5144e14740b31088f77687f4713f10a1473b77e0d8c84b6ba075ac46ef0f2607"} Jul 02 14:08:57.764973 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:57.764670 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdz85f" event={"ID":"193b70f5-d7aa-4aa9-9c09-9be634432a51","Type":"ContainerStarted","Data":"c78ef5e2fcb99f13103cc821acc3f42fe2233054d53db879e6ac28dda70135b2"} Jul 02 14:08:59.056966 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:59.056930 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:08:59.543512 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:08:59.543478 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:09:00.616815 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:00.616765 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:09:00.687458 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:00.687428 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:09:01.782167 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:01.782133 2553 generic.go:356] "Generic (PLEG): container finished" podID="193b70f5-d7aa-4aa9-9c09-9be634432a51" containerID="fd4e307be51b5759dfe4f57dbc5cdebe8e924f809a01003c5ea8a7a63f8e286b" exitCode=0 Jul 02 14:09:01.782549 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:01.782191 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdz85f" event={"ID":"193b70f5-d7aa-4aa9-9c09-9be634432a51","Type":"ContainerDied","Data":"fd4e307be51b5759dfe4f57dbc5cdebe8e924f809a01003c5ea8a7a63f8e286b"} Jul 02 14:09:02.788412 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:02.788374 2553 generic.go:356] "Generic (PLEG): container finished" podID="193b70f5-d7aa-4aa9-9c09-9be634432a51" containerID="d033c2e64dcc26f215dea705670144e7ee54149398f5feb42368f2599faa8d7c" exitCode=0 Jul 02 14:09:02.788790 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:02.788457 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdz85f" event={"ID":"193b70f5-d7aa-4aa9-9c09-9be634432a51","Type":"ContainerDied","Data":"d033c2e64dcc26f215dea705670144e7ee54149398f5feb42368f2599faa8d7c"} Jul 02 14:09:03.912907 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:03.912884 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdz85f" Jul 02 14:09:04.037802 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:04.037767 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/193b70f5-d7aa-4aa9-9c09-9be634432a51-bundle\") pod \"193b70f5-d7aa-4aa9-9c09-9be634432a51\" (UID: \"193b70f5-d7aa-4aa9-9c09-9be634432a51\") " Jul 02 14:09:04.037981 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:04.037844 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z288c\" (UniqueName: \"kubernetes.io/projected/193b70f5-d7aa-4aa9-9c09-9be634432a51-kube-api-access-z288c\") pod \"193b70f5-d7aa-4aa9-9c09-9be634432a51\" (UID: \"193b70f5-d7aa-4aa9-9c09-9be634432a51\") " Jul 02 14:09:04.037981 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:04.037879 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/193b70f5-d7aa-4aa9-9c09-9be634432a51-util\") pod \"193b70f5-d7aa-4aa9-9c09-9be634432a51\" (UID: \"193b70f5-d7aa-4aa9-9c09-9be634432a51\") " Jul 02 14:09:04.038266 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:04.038236 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/193b70f5-d7aa-4aa9-9c09-9be634432a51-bundle" (OuterVolumeSpecName: "bundle") pod "193b70f5-d7aa-4aa9-9c09-9be634432a51" (UID: "193b70f5-d7aa-4aa9-9c09-9be634432a51"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 14:09:04.039929 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:04.039895 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/193b70f5-d7aa-4aa9-9c09-9be634432a51-kube-api-access-z288c" (OuterVolumeSpecName: "kube-api-access-z288c") pod "193b70f5-d7aa-4aa9-9c09-9be634432a51" (UID: "193b70f5-d7aa-4aa9-9c09-9be634432a51"). InnerVolumeSpecName "kube-api-access-z288c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 14:09:04.042276 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:04.042252 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/193b70f5-d7aa-4aa9-9c09-9be634432a51-util" (OuterVolumeSpecName: "util") pod "193b70f5-d7aa-4aa9-9c09-9be634432a51" (UID: "193b70f5-d7aa-4aa9-9c09-9be634432a51"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 14:09:04.138767 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:04.138713 2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/193b70f5-d7aa-4aa9-9c09-9be634432a51-bundle\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:09:04.138767 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:04.138760 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z288c\" (UniqueName: \"kubernetes.io/projected/193b70f5-d7aa-4aa9-9c09-9be634432a51-kube-api-access-z288c\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:09:04.138767 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:04.138771 2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/193b70f5-d7aa-4aa9-9c09-9be634432a51-util\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:09:04.798115 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:04.798078 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdz85f" event={"ID":"193b70f5-d7aa-4aa9-9c09-9be634432a51","Type":"ContainerDied","Data":"c78ef5e2fcb99f13103cc821acc3f42fe2233054d53db879e6ac28dda70135b2"} Jul 02 14:09:04.798115 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:04.798117 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdz85f" Jul 02 14:09:04.798328 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:04.798131 2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c78ef5e2fcb99f13103cc821acc3f42fe2233054d53db879e6ac28dda70135b2" Jul 02 14:09:05.093745 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:05.093679 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:09:05.210971 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:05.210940 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:09:06.680886 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:06.680851 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:09:07.578131 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:07.578096 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:09:07.676271 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:07.676238 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:09:09.212694 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:09.212663 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9786s"] Jul 02 14:09:09.213132 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:09.213028 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="193b70f5-d7aa-4aa9-9c09-9be634432a51" containerName="pull" Jul 02 14:09:09.213132 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:09.213045 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="193b70f5-d7aa-4aa9-9c09-9be634432a51" containerName="pull" Jul 02 14:09:09.213132 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:09.213063 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="193b70f5-d7aa-4aa9-9c09-9be634432a51" containerName="util" Jul 02 14:09:09.213132 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:09.213071 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="193b70f5-d7aa-4aa9-9c09-9be634432a51" containerName="util" Jul 02 14:09:09.213132 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:09.213087 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="193b70f5-d7aa-4aa9-9c09-9be634432a51" containerName="extract" Jul 02 14:09:09.213132 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:09.213095 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="193b70f5-d7aa-4aa9-9c09-9be634432a51" containerName="extract" Jul 02 14:09:09.213466 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:09.213158 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="193b70f5-d7aa-4aa9-9c09-9be634432a51" containerName="extract" Jul 02 14:09:09.244159 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:09.244135 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9786s"] Jul 02 14:09:09.244280 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:09.244214 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9786s" Jul 02 14:09:09.246843 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:09.246819 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 02 14:09:09.247783 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:09.247766 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-swfth\"" Jul 02 14:09:09.247874 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:09.247829 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 02 14:09:09.388118 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:09.388081 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7hhw\" (UniqueName: \"kubernetes.io/projected/b481a8f4-61d5-4fac-a2dc-4b0b6e47281a-kube-api-access-p7hhw\") pod \"openshift-lws-operator-fd8ccff4c-9786s\" (UID: \"b481a8f4-61d5-4fac-a2dc-4b0b6e47281a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9786s" Jul 02 14:09:09.388275 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:09.388147 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b481a8f4-61d5-4fac-a2dc-4b0b6e47281a-tmp\") pod \"openshift-lws-operator-fd8ccff4c-9786s\" (UID: \"b481a8f4-61d5-4fac-a2dc-4b0b6e47281a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9786s" Jul 02 14:09:09.489350 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:09.489268 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b481a8f4-61d5-4fac-a2dc-4b0b6e47281a-tmp\") pod \"openshift-lws-operator-fd8ccff4c-9786s\" (UID: \"b481a8f4-61d5-4fac-a2dc-4b0b6e47281a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9786s" Jul 02 14:09:09.489350 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:09.489314 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7hhw\" (UniqueName: \"kubernetes.io/projected/b481a8f4-61d5-4fac-a2dc-4b0b6e47281a-kube-api-access-p7hhw\") pod \"openshift-lws-operator-fd8ccff4c-9786s\" (UID: \"b481a8f4-61d5-4fac-a2dc-4b0b6e47281a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9786s" Jul 02 14:09:09.489654 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:09.489633 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b481a8f4-61d5-4fac-a2dc-4b0b6e47281a-tmp\") pod \"openshift-lws-operator-fd8ccff4c-9786s\" (UID: \"b481a8f4-61d5-4fac-a2dc-4b0b6e47281a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9786s" Jul 02 14:09:09.498401 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:09.498368 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7hhw\" (UniqueName: \"kubernetes.io/projected/b481a8f4-61d5-4fac-a2dc-4b0b6e47281a-kube-api-access-p7hhw\") pod \"openshift-lws-operator-fd8ccff4c-9786s\" (UID: \"b481a8f4-61d5-4fac-a2dc-4b0b6e47281a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9786s" Jul 02 14:09:09.563330 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:09.563292 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9786s" Jul 02 14:09:09.715619 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:09.715593 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9786s"] Jul 02 14:09:09.717792 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:09:09.717766 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb481a8f4_61d5_4fac_a2dc_4b0b6e47281a.slice/crio-a05106388b182a97f39089d4cedeb84b9a715a95fdbf514bf48a4ed29a656c06 WatchSource:0}: Error finding container a05106388b182a97f39089d4cedeb84b9a715a95fdbf514bf48a4ed29a656c06: Status 404 returned error can't find the container with id a05106388b182a97f39089d4cedeb84b9a715a95fdbf514bf48a4ed29a656c06 Jul 02 14:09:09.819133 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:09.819047 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9786s" event={"ID":"b481a8f4-61d5-4fac-a2dc-4b0b6e47281a","Type":"ContainerStarted","Data":"a05106388b182a97f39089d4cedeb84b9a715a95fdbf514bf48a4ed29a656c06"} Jul 02 14:09:12.835651 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:12.835616 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9786s" event={"ID":"b481a8f4-61d5-4fac-a2dc-4b0b6e47281a","Type":"ContainerStarted","Data":"dd93dd7e632b8f7afc4724af7c61e80b0fa382b355979f2268b4a026a75be446"} Jul 02 14:09:12.856550 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:12.856501 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9786s" podStartSLOduration=1.394262729 podStartE2EDuration="3.856485611s" totalImagesPullingTime="2.462222882s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:09:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:09:12.854868006 +0000 UTC m=+484.063110811" watchObservedRunningTime="2026-07-02 14:09:12.856485611 +0000 UTC m=+484.064728394" Jul 02 14:09:13.726977 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:13.726930 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:09:13.838967 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:13.838927 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:09:15.563554 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:15.563519 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:09:15.945447 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:15.945411 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affg24q"] Jul 02 14:09:15.947828 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:15.947813 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affg24q" Jul 02 14:09:15.950440 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:15.950414 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gb8hw\"" Jul 02 14:09:15.950571 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:15.950446 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 02 14:09:15.951444 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:15.951431 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 02 14:09:15.964219 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:15.964199 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affg24q"] Jul 02 14:09:16.041316 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:16.041286 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4da78d1b-59f1-4c37-b94f-73129070f8a8-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affg24q\" (UID: \"4da78d1b-59f1-4c37-b94f-73129070f8a8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affg24q" Jul 02 14:09:16.041470 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:16.041345 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4da78d1b-59f1-4c37-b94f-73129070f8a8-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affg24q\" (UID: \"4da78d1b-59f1-4c37-b94f-73129070f8a8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affg24q" Jul 02 14:09:16.041470 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:16.041406 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vsjm\" (UniqueName: \"kubernetes.io/projected/4da78d1b-59f1-4c37-b94f-73129070f8a8-kube-api-access-8vsjm\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affg24q\" (UID: \"4da78d1b-59f1-4c37-b94f-73129070f8a8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affg24q" Jul 02 14:09:16.142345 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:16.142310 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vsjm\" (UniqueName: \"kubernetes.io/projected/4da78d1b-59f1-4c37-b94f-73129070f8a8-kube-api-access-8vsjm\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affg24q\" (UID: \"4da78d1b-59f1-4c37-b94f-73129070f8a8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affg24q" Jul 02 14:09:16.142345 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:16.142348 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4da78d1b-59f1-4c37-b94f-73129070f8a8-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affg24q\" (UID: \"4da78d1b-59f1-4c37-b94f-73129070f8a8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affg24q" Jul 02 14:09:16.142525 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:16.142373 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4da78d1b-59f1-4c37-b94f-73129070f8a8-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affg24q\" (UID: \"4da78d1b-59f1-4c37-b94f-73129070f8a8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affg24q" Jul 02 14:09:16.142827 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:16.142803 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4da78d1b-59f1-4c37-b94f-73129070f8a8-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affg24q\" (UID: \"4da78d1b-59f1-4c37-b94f-73129070f8a8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affg24q" Jul 02 14:09:16.142867 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:16.142814 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4da78d1b-59f1-4c37-b94f-73129070f8a8-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affg24q\" (UID: \"4da78d1b-59f1-4c37-b94f-73129070f8a8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affg24q" Jul 02 14:09:16.153395 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:16.153368 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vsjm\" (UniqueName: \"kubernetes.io/projected/4da78d1b-59f1-4c37-b94f-73129070f8a8-kube-api-access-8vsjm\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affg24q\" (UID: \"4da78d1b-59f1-4c37-b94f-73129070f8a8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affg24q" Jul 02 14:09:16.256709 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:16.256622 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affg24q" Jul 02 14:09:16.385714 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:16.385690 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affg24q"] Jul 02 14:09:16.387641 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:09:16.387617 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4da78d1b_59f1_4c37_b94f_73129070f8a8.slice/crio-273f65f8a3b9039bf81c408fd5eb9c3fe9e7012e55fe1cfa07e50fb4dac7be34 WatchSource:0}: Error finding container 273f65f8a3b9039bf81c408fd5eb9c3fe9e7012e55fe1cfa07e50fb4dac7be34: Status 404 returned error can't find the container with id 273f65f8a3b9039bf81c408fd5eb9c3fe9e7012e55fe1cfa07e50fb4dac7be34 Jul 02 14:09:16.672845 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:16.672815 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-2kckz"] Jul 02 14:09:16.674796 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:16.674781 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-2kckz" Jul 02 14:09:16.677469 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:16.677453 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 02 14:09:16.678419 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:16.678401 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 02 14:09:16.678482 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:16.678405 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-94c5d\"" Jul 02 14:09:16.687873 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:16.687853 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-2kckz"] Jul 02 14:09:16.848425 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:16.848392 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8a05ab47-4939-4adc-85e0-2ec03b7fe16c-bound-sa-token\") pod \"cert-manager-59c77684cc-2kckz\" (UID: \"8a05ab47-4939-4adc-85e0-2ec03b7fe16c\") " pod="cert-manager/cert-manager-59c77684cc-2kckz" Jul 02 14:09:16.848425 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:16.848427 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kb8v\" (UniqueName: \"kubernetes.io/projected/8a05ab47-4939-4adc-85e0-2ec03b7fe16c-kube-api-access-9kb8v\") pod \"cert-manager-59c77684cc-2kckz\" (UID: \"8a05ab47-4939-4adc-85e0-2ec03b7fe16c\") " pod="cert-manager/cert-manager-59c77684cc-2kckz" Jul 02 14:09:16.855254 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:16.855223 2553 generic.go:356] "Generic (PLEG): container finished" podID="4da78d1b-59f1-4c37-b94f-73129070f8a8" containerID="4dd74f352b333451011d9f78b0a5f65e0657dd2a660ebb95e201ae8a37ddb8ad" exitCode=0 Jul 02 14:09:16.855402 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:16.855309 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affg24q" event={"ID":"4da78d1b-59f1-4c37-b94f-73129070f8a8","Type":"ContainerDied","Data":"4dd74f352b333451011d9f78b0a5f65e0657dd2a660ebb95e201ae8a37ddb8ad"} Jul 02 14:09:16.855402 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:16.855354 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affg24q" event={"ID":"4da78d1b-59f1-4c37-b94f-73129070f8a8","Type":"ContainerStarted","Data":"273f65f8a3b9039bf81c408fd5eb9c3fe9e7012e55fe1cfa07e50fb4dac7be34"} Jul 02 14:09:16.949438 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:16.949346 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8a05ab47-4939-4adc-85e0-2ec03b7fe16c-bound-sa-token\") pod \"cert-manager-59c77684cc-2kckz\" (UID: \"8a05ab47-4939-4adc-85e0-2ec03b7fe16c\") " pod="cert-manager/cert-manager-59c77684cc-2kckz" Jul 02 14:09:16.949438 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:16.949384 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kb8v\" (UniqueName: \"kubernetes.io/projected/8a05ab47-4939-4adc-85e0-2ec03b7fe16c-kube-api-access-9kb8v\") pod \"cert-manager-59c77684cc-2kckz\" (UID: \"8a05ab47-4939-4adc-85e0-2ec03b7fe16c\") " pod="cert-manager/cert-manager-59c77684cc-2kckz" Jul 02 14:09:16.959748 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:16.959722 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kb8v\" (UniqueName: \"kubernetes.io/projected/8a05ab47-4939-4adc-85e0-2ec03b7fe16c-kube-api-access-9kb8v\") pod \"cert-manager-59c77684cc-2kckz\" (UID: \"8a05ab47-4939-4adc-85e0-2ec03b7fe16c\") " pod="cert-manager/cert-manager-59c77684cc-2kckz" Jul 02 14:09:16.960968 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:16.960945 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8a05ab47-4939-4adc-85e0-2ec03b7fe16c-bound-sa-token\") pod \"cert-manager-59c77684cc-2kckz\" (UID: \"8a05ab47-4939-4adc-85e0-2ec03b7fe16c\") " pod="cert-manager/cert-manager-59c77684cc-2kckz" Jul 02 14:09:16.982848 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:16.982824 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-2kckz" Jul 02 14:09:17.108336 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:17.108313 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-2kckz"] Jul 02 14:09:17.110662 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:09:17.110637 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8a05ab47_4939_4adc_85e0_2ec03b7fe16c.slice/crio-b80372f6f2e06aa55a949d6e60b9e1781a7234f0ece57f49625519495fbd64e3 WatchSource:0}: Error finding container b80372f6f2e06aa55a949d6e60b9e1781a7234f0ece57f49625519495fbd64e3: Status 404 returned error can't find the container with id b80372f6f2e06aa55a949d6e60b9e1781a7234f0ece57f49625519495fbd64e3 Jul 02 14:09:17.861356 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:17.861271 2553 generic.go:356] "Generic (PLEG): container finished" podID="4da78d1b-59f1-4c37-b94f-73129070f8a8" containerID="e0d797bed536c454fbf5fe5eb6cebf66c4fde16a0c236e418e4ad3a0182d7ac5" exitCode=0 Jul 02 14:09:17.861761 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:17.861354 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affg24q" event={"ID":"4da78d1b-59f1-4c37-b94f-73129070f8a8","Type":"ContainerDied","Data":"e0d797bed536c454fbf5fe5eb6cebf66c4fde16a0c236e418e4ad3a0182d7ac5"} Jul 02 14:09:17.862597 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:17.862577 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-2kckz" event={"ID":"8a05ab47-4939-4adc-85e0-2ec03b7fe16c","Type":"ContainerStarted","Data":"b80372f6f2e06aa55a949d6e60b9e1781a7234f0ece57f49625519495fbd64e3"} Jul 02 14:09:18.870425 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:18.870386 2553 generic.go:356] "Generic (PLEG): container finished" podID="4da78d1b-59f1-4c37-b94f-73129070f8a8" containerID="69114d137ff7b92c8230847edc8aef2db83914c81b5696a140c04933619176b4" exitCode=0 Jul 02 14:09:18.870848 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:18.870466 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affg24q" event={"ID":"4da78d1b-59f1-4c37-b94f-73129070f8a8","Type":"ContainerDied","Data":"69114d137ff7b92c8230847edc8aef2db83914c81b5696a140c04933619176b4"} Jul 02 14:09:19.876632 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:19.876599 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-2kckz" event={"ID":"8a05ab47-4939-4adc-85e0-2ec03b7fe16c","Type":"ContainerStarted","Data":"15b54f709822cdecc469c6c6440fb44df44dd660392176aa1322d600b202866a"} Jul 02 14:09:19.911494 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:19.911444 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-2kckz" podStartSLOduration=1.223271568 podStartE2EDuration="3.911422094s" totalImagesPullingTime="2.688150526s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:09:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:09:19.91000742 +0000 UTC m=+491.118250204" watchObservedRunningTime="2026-07-02 14:09:19.911422094 +0000 UTC m=+491.119664876" Jul 02 14:09:20.016196 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:20.016175 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affg24q" Jul 02 14:09:20.176486 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:20.176452 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8vsjm\" (UniqueName: \"kubernetes.io/projected/4da78d1b-59f1-4c37-b94f-73129070f8a8-kube-api-access-8vsjm\") pod \"4da78d1b-59f1-4c37-b94f-73129070f8a8\" (UID: \"4da78d1b-59f1-4c37-b94f-73129070f8a8\") " Jul 02 14:09:20.176657 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:20.176523 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4da78d1b-59f1-4c37-b94f-73129070f8a8-bundle\") pod \"4da78d1b-59f1-4c37-b94f-73129070f8a8\" (UID: \"4da78d1b-59f1-4c37-b94f-73129070f8a8\") " Jul 02 14:09:20.176657 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:20.176552 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4da78d1b-59f1-4c37-b94f-73129070f8a8-util\") pod \"4da78d1b-59f1-4c37-b94f-73129070f8a8\" (UID: \"4da78d1b-59f1-4c37-b94f-73129070f8a8\") " Jul 02 14:09:20.177292 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:20.177260 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4da78d1b-59f1-4c37-b94f-73129070f8a8-bundle" (OuterVolumeSpecName: "bundle") pod "4da78d1b-59f1-4c37-b94f-73129070f8a8" (UID: "4da78d1b-59f1-4c37-b94f-73129070f8a8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 14:09:20.178625 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:20.178595 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4da78d1b-59f1-4c37-b94f-73129070f8a8-kube-api-access-8vsjm" (OuterVolumeSpecName: "kube-api-access-8vsjm") pod "4da78d1b-59f1-4c37-b94f-73129070f8a8" (UID: "4da78d1b-59f1-4c37-b94f-73129070f8a8"). InnerVolumeSpecName "kube-api-access-8vsjm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 14:09:20.181588 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:20.181562 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4da78d1b-59f1-4c37-b94f-73129070f8a8-util" (OuterVolumeSpecName: "util") pod "4da78d1b-59f1-4c37-b94f-73129070f8a8" (UID: "4da78d1b-59f1-4c37-b94f-73129070f8a8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 14:09:20.277626 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:20.277598 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8vsjm\" (UniqueName: \"kubernetes.io/projected/4da78d1b-59f1-4c37-b94f-73129070f8a8-kube-api-access-8vsjm\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:09:20.277626 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:20.277624 2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4da78d1b-59f1-4c37-b94f-73129070f8a8-bundle\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:09:20.277803 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:20.277635 2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4da78d1b-59f1-4c37-b94f-73129070f8a8-util\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:09:20.817572 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:20.817539 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:09:20.881963 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:20.881937 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affg24q" Jul 02 14:09:20.882396 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:20.881965 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affg24q" event={"ID":"4da78d1b-59f1-4c37-b94f-73129070f8a8","Type":"ContainerDied","Data":"273f65f8a3b9039bf81c408fd5eb9c3fe9e7012e55fe1cfa07e50fb4dac7be34"} Jul 02 14:09:20.882396 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:20.882039 2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="273f65f8a3b9039bf81c408fd5eb9c3fe9e7012e55fe1cfa07e50fb4dac7be34" Jul 02 14:09:23.866333 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:23.866287 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:09:23.976471 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:23.976434 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-54667967db-6j5mb"] Jul 02 14:09:23.976858 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:23.976838 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4da78d1b-59f1-4c37-b94f-73129070f8a8" containerName="extract" Jul 02 14:09:23.976951 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:23.976861 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="4da78d1b-59f1-4c37-b94f-73129070f8a8" containerName="extract" Jul 02 14:09:23.976951 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:23.976890 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4da78d1b-59f1-4c37-b94f-73129070f8a8" containerName="util" Jul 02 14:09:23.976951 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:23.976900 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="4da78d1b-59f1-4c37-b94f-73129070f8a8" containerName="util" Jul 02 14:09:23.976951 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:23.976909 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4da78d1b-59f1-4c37-b94f-73129070f8a8" containerName="pull" Jul 02 14:09:23.976951 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:23.976918 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="4da78d1b-59f1-4c37-b94f-73129070f8a8" containerName="pull" Jul 02 14:09:23.977136 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:23.977014 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="4da78d1b-59f1-4c37-b94f-73129070f8a8" containerName="extract" Jul 02 14:09:23.978929 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:23.978908 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-54667967db-6j5mb" Jul 02 14:09:23.984660 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:23.984645 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-65bwp\"" Jul 02 14:09:23.984785 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:23.984757 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 02 14:09:23.984900 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:23.984844 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 02 14:09:23.985524 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:23.985274 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 02 14:09:23.995754 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:23.995733 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-54667967db-6j5mb"] Jul 02 14:09:24.001402 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:24.001377 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb8eb52b-116c-44d9-83ec-797e7a67edc6-cert\") pod \"lws-controller-manager-54667967db-6j5mb\" (UID: \"eb8eb52b-116c-44d9-83ec-797e7a67edc6\") " pod="openshift-lws-operator/lws-controller-manager-54667967db-6j5mb" Jul 02 14:09:24.001499 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:24.001407 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/eb8eb52b-116c-44d9-83ec-797e7a67edc6-manager-config\") pod \"lws-controller-manager-54667967db-6j5mb\" (UID: \"eb8eb52b-116c-44d9-83ec-797e7a67edc6\") " pod="openshift-lws-operator/lws-controller-manager-54667967db-6j5mb" Jul 02 14:09:24.001499 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:24.001436 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/eb8eb52b-116c-44d9-83ec-797e7a67edc6-metrics-cert\") pod \"lws-controller-manager-54667967db-6j5mb\" (UID: \"eb8eb52b-116c-44d9-83ec-797e7a67edc6\") " pod="openshift-lws-operator/lws-controller-manager-54667967db-6j5mb" Jul 02 14:09:24.001630 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:24.001524 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgzmz\" (UniqueName: \"kubernetes.io/projected/eb8eb52b-116c-44d9-83ec-797e7a67edc6-kube-api-access-fgzmz\") pod \"lws-controller-manager-54667967db-6j5mb\" (UID: \"eb8eb52b-116c-44d9-83ec-797e7a67edc6\") " pod="openshift-lws-operator/lws-controller-manager-54667967db-6j5mb" Jul 02 14:09:24.002390 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:24.002368 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:09:24.102343 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:24.102308 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb8eb52b-116c-44d9-83ec-797e7a67edc6-cert\") pod \"lws-controller-manager-54667967db-6j5mb\" (UID: \"eb8eb52b-116c-44d9-83ec-797e7a67edc6\") " pod="openshift-lws-operator/lws-controller-manager-54667967db-6j5mb" Jul 02 14:09:24.102343 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:24.102343 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/eb8eb52b-116c-44d9-83ec-797e7a67edc6-manager-config\") pod \"lws-controller-manager-54667967db-6j5mb\" (UID: \"eb8eb52b-116c-44d9-83ec-797e7a67edc6\") " pod="openshift-lws-operator/lws-controller-manager-54667967db-6j5mb" Jul 02 14:09:24.102554 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:24.102381 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/eb8eb52b-116c-44d9-83ec-797e7a67edc6-metrics-cert\") pod \"lws-controller-manager-54667967db-6j5mb\" (UID: \"eb8eb52b-116c-44d9-83ec-797e7a67edc6\") " pod="openshift-lws-operator/lws-controller-manager-54667967db-6j5mb" Jul 02 14:09:24.102554 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:24.102416 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgzmz\" (UniqueName: \"kubernetes.io/projected/eb8eb52b-116c-44d9-83ec-797e7a67edc6-kube-api-access-fgzmz\") pod \"lws-controller-manager-54667967db-6j5mb\" (UID: \"eb8eb52b-116c-44d9-83ec-797e7a67edc6\") " pod="openshift-lws-operator/lws-controller-manager-54667967db-6j5mb" Jul 02 14:09:24.103114 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:24.103081 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/eb8eb52b-116c-44d9-83ec-797e7a67edc6-manager-config\") pod \"lws-controller-manager-54667967db-6j5mb\" (UID: \"eb8eb52b-116c-44d9-83ec-797e7a67edc6\") " pod="openshift-lws-operator/lws-controller-manager-54667967db-6j5mb" Jul 02 14:09:24.104861 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:24.104841 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/eb8eb52b-116c-44d9-83ec-797e7a67edc6-metrics-cert\") pod \"lws-controller-manager-54667967db-6j5mb\" (UID: \"eb8eb52b-116c-44d9-83ec-797e7a67edc6\") " pod="openshift-lws-operator/lws-controller-manager-54667967db-6j5mb" Jul 02 14:09:24.104949 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:24.104898 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb8eb52b-116c-44d9-83ec-797e7a67edc6-cert\") pod \"lws-controller-manager-54667967db-6j5mb\" (UID: \"eb8eb52b-116c-44d9-83ec-797e7a67edc6\") " pod="openshift-lws-operator/lws-controller-manager-54667967db-6j5mb" Jul 02 14:09:24.130836 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:24.130777 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgzmz\" (UniqueName: \"kubernetes.io/projected/eb8eb52b-116c-44d9-83ec-797e7a67edc6-kube-api-access-fgzmz\") pod \"lws-controller-manager-54667967db-6j5mb\" (UID: \"eb8eb52b-116c-44d9-83ec-797e7a67edc6\") " pod="openshift-lws-operator/lws-controller-manager-54667967db-6j5mb" Jul 02 14:09:24.288422 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:24.288387 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-54667967db-6j5mb" Jul 02 14:09:24.422635 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:24.422559 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-54667967db-6j5mb"] Jul 02 14:09:24.426312 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:09:24.426283 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb8eb52b_116c_44d9_83ec_797e7a67edc6.slice/crio-48d7389d037b5ccad57207234973b60d5dde6d202a4f4b5d0c7603935c39ac62 WatchSource:0}: Error finding container 48d7389d037b5ccad57207234973b60d5dde6d202a4f4b5d0c7603935c39ac62: Status 404 returned error can't find the container with id 48d7389d037b5ccad57207234973b60d5dde6d202a4f4b5d0c7603935c39ac62 Jul 02 14:09:24.899864 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:24.899826 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-54667967db-6j5mb" event={"ID":"eb8eb52b-116c-44d9-83ec-797e7a67edc6","Type":"ContainerStarted","Data":"48d7389d037b5ccad57207234973b60d5dde6d202a4f4b5d0c7603935c39ac62"} Jul 02 14:09:26.910623 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:26.910592 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-54667967db-6j5mb" event={"ID":"eb8eb52b-116c-44d9-83ec-797e7a67edc6","Type":"ContainerStarted","Data":"977fe243d28941147f440f3eb977edc403b00de5ec287cf8b31427e9fcd79c46"} Jul 02 14:09:26.911011 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:26.910701 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-54667967db-6j5mb" Jul 02 14:09:26.943335 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:26.943289 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-54667967db-6j5mb" podStartSLOduration=1.518194903 podStartE2EDuration="3.943273287s" totalImagesPullingTime="2.425078384s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:09:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:09:26.94224642 +0000 UTC m=+498.150489203" watchObservedRunningTime="2026-07-02 14:09:26.943273287 +0000 UTC m=+498.151516069" Jul 02 14:09:32.212855 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:32.212825 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:09:32.482900 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:32.482814 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:09:32.774361 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:32.774274 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:09:35.034492 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:35.034455 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:09:35.212945 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:35.212909 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:09:35.332785 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:35.332707 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-dbb7d6f6b-xjbwb"] Jul 02 14:09:35.335105 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:35.335088 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-dbb7d6f6b-xjbwb" Jul 02 14:09:35.343156 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:35.343134 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 02 14:09:35.343285 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:35.343193 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-95wkf\"" Jul 02 14:09:35.343285 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:35.343202 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 02 14:09:35.344163 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:35.344148 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 02 14:09:35.347346 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:35.347330 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 02 14:09:35.388787 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:35.388752 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/887bc5a0-35f9-4ebd-8a6a-c7b7132c8c58-manifests\") pod \"opendatahub-operator-controller-manager-dbb7d6f6b-xjbwb\" (UID: \"887bc5a0-35f9-4ebd-8a6a-c7b7132c8c58\") " pod="opendatahub/opendatahub-operator-controller-manager-dbb7d6f6b-xjbwb" Jul 02 14:09:35.388787 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:35.388788 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/887bc5a0-35f9-4ebd-8a6a-c7b7132c8c58-tmp\") pod \"opendatahub-operator-controller-manager-dbb7d6f6b-xjbwb\" (UID: \"887bc5a0-35f9-4ebd-8a6a-c7b7132c8c58\") " pod="opendatahub/opendatahub-operator-controller-manager-dbb7d6f6b-xjbwb" Jul 02 14:09:35.388956 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:35.388811 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9jb9\" (UniqueName: \"kubernetes.io/projected/887bc5a0-35f9-4ebd-8a6a-c7b7132c8c58-kube-api-access-m9jb9\") pod \"opendatahub-operator-controller-manager-dbb7d6f6b-xjbwb\" (UID: \"887bc5a0-35f9-4ebd-8a6a-c7b7132c8c58\") " pod="opendatahub/opendatahub-operator-controller-manager-dbb7d6f6b-xjbwb" Jul 02 14:09:35.388956 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:35.388910 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/887bc5a0-35f9-4ebd-8a6a-c7b7132c8c58-webhook-cert\") pod \"opendatahub-operator-controller-manager-dbb7d6f6b-xjbwb\" (UID: \"887bc5a0-35f9-4ebd-8a6a-c7b7132c8c58\") " pod="opendatahub/opendatahub-operator-controller-manager-dbb7d6f6b-xjbwb" Jul 02 14:09:35.388956 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:35.388943 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/887bc5a0-35f9-4ebd-8a6a-c7b7132c8c58-apiservice-cert\") pod \"opendatahub-operator-controller-manager-dbb7d6f6b-xjbwb\" (UID: \"887bc5a0-35f9-4ebd-8a6a-c7b7132c8c58\") " pod="opendatahub/opendatahub-operator-controller-manager-dbb7d6f6b-xjbwb" Jul 02 14:09:35.450670 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:35.450644 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-dbb7d6f6b-xjbwb"] Jul 02 14:09:35.490057 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:35.490028 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/887bc5a0-35f9-4ebd-8a6a-c7b7132c8c58-manifests\") pod \"opendatahub-operator-controller-manager-dbb7d6f6b-xjbwb\" (UID: \"887bc5a0-35f9-4ebd-8a6a-c7b7132c8c58\") " pod="opendatahub/opendatahub-operator-controller-manager-dbb7d6f6b-xjbwb" Jul 02 14:09:35.490176 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:35.490061 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/887bc5a0-35f9-4ebd-8a6a-c7b7132c8c58-tmp\") pod \"opendatahub-operator-controller-manager-dbb7d6f6b-xjbwb\" (UID: \"887bc5a0-35f9-4ebd-8a6a-c7b7132c8c58\") " pod="opendatahub/opendatahub-operator-controller-manager-dbb7d6f6b-xjbwb" Jul 02 14:09:35.490176 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:35.490079 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9jb9\" (UniqueName: \"kubernetes.io/projected/887bc5a0-35f9-4ebd-8a6a-c7b7132c8c58-kube-api-access-m9jb9\") pod \"opendatahub-operator-controller-manager-dbb7d6f6b-xjbwb\" (UID: \"887bc5a0-35f9-4ebd-8a6a-c7b7132c8c58\") " pod="opendatahub/opendatahub-operator-controller-manager-dbb7d6f6b-xjbwb" Jul 02 14:09:35.490259 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:35.490214 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/887bc5a0-35f9-4ebd-8a6a-c7b7132c8c58-webhook-cert\") pod \"opendatahub-operator-controller-manager-dbb7d6f6b-xjbwb\" (UID: \"887bc5a0-35f9-4ebd-8a6a-c7b7132c8c58\") " pod="opendatahub/opendatahub-operator-controller-manager-dbb7d6f6b-xjbwb" Jul 02 14:09:35.490310 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:35.490267 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/887bc5a0-35f9-4ebd-8a6a-c7b7132c8c58-apiservice-cert\") pod \"opendatahub-operator-controller-manager-dbb7d6f6b-xjbwb\" (UID: \"887bc5a0-35f9-4ebd-8a6a-c7b7132c8c58\") " pod="opendatahub/opendatahub-operator-controller-manager-dbb7d6f6b-xjbwb" Jul 02 14:09:35.490414 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:35.490394 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/887bc5a0-35f9-4ebd-8a6a-c7b7132c8c58-manifests\") pod \"opendatahub-operator-controller-manager-dbb7d6f6b-xjbwb\" (UID: \"887bc5a0-35f9-4ebd-8a6a-c7b7132c8c58\") " pod="opendatahub/opendatahub-operator-controller-manager-dbb7d6f6b-xjbwb" Jul 02 14:09:35.492332 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:35.492309 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/887bc5a0-35f9-4ebd-8a6a-c7b7132c8c58-tmp\") pod \"opendatahub-operator-controller-manager-dbb7d6f6b-xjbwb\" (UID: \"887bc5a0-35f9-4ebd-8a6a-c7b7132c8c58\") " pod="opendatahub/opendatahub-operator-controller-manager-dbb7d6f6b-xjbwb" Jul 02 14:09:35.492558 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:35.492542 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/887bc5a0-35f9-4ebd-8a6a-c7b7132c8c58-webhook-cert\") pod \"opendatahub-operator-controller-manager-dbb7d6f6b-xjbwb\" (UID: \"887bc5a0-35f9-4ebd-8a6a-c7b7132c8c58\") " pod="opendatahub/opendatahub-operator-controller-manager-dbb7d6f6b-xjbwb" Jul 02 14:09:35.492638 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:35.492624 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/887bc5a0-35f9-4ebd-8a6a-c7b7132c8c58-apiservice-cert\") pod \"opendatahub-operator-controller-manager-dbb7d6f6b-xjbwb\" (UID: \"887bc5a0-35f9-4ebd-8a6a-c7b7132c8c58\") " pod="opendatahub/opendatahub-operator-controller-manager-dbb7d6f6b-xjbwb" Jul 02 14:09:35.508017 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:35.507981 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9jb9\" (UniqueName: \"kubernetes.io/projected/887bc5a0-35f9-4ebd-8a6a-c7b7132c8c58-kube-api-access-m9jb9\") pod \"opendatahub-operator-controller-manager-dbb7d6f6b-xjbwb\" (UID: \"887bc5a0-35f9-4ebd-8a6a-c7b7132c8c58\") " pod="opendatahub/opendatahub-operator-controller-manager-dbb7d6f6b-xjbwb" Jul 02 14:09:35.645041 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:35.645015 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-dbb7d6f6b-xjbwb" Jul 02 14:09:35.782822 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:35.782788 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:09:35.795933 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:35.795913 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-dbb7d6f6b-xjbwb"] Jul 02 14:09:35.798173 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:09:35.798150 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod887bc5a0_35f9_4ebd_8a6a_c7b7132c8c58.slice/crio-5785b3580072d39db8eff782f2640c5f14b4cf8e1118e5016a343772757b8a82 WatchSource:0}: Error finding container 5785b3580072d39db8eff782f2640c5f14b4cf8e1118e5016a343772757b8a82: Status 404 returned error can't find the container with id 5785b3580072d39db8eff782f2640c5f14b4cf8e1118e5016a343772757b8a82 Jul 02 14:09:35.949447 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:35.949360 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-dbb7d6f6b-xjbwb" event={"ID":"887bc5a0-35f9-4ebd-8a6a-c7b7132c8c58","Type":"ContainerStarted","Data":"5785b3580072d39db8eff782f2640c5f14b4cf8e1118e5016a343772757b8a82"} Jul 02 14:09:35.976318 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:35.976287 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:09:36.128725 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:36.128693 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:09:36.288593 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:36.288508 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:09:36.572563 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:36.572469 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:09:37.917218 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:37.917192 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-54667967db-6j5mb" Jul 02 14:09:39.970204 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:39.970167 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-dbb7d6f6b-xjbwb" event={"ID":"887bc5a0-35f9-4ebd-8a6a-c7b7132c8c58","Type":"ContainerStarted","Data":"2c4ade01438c307f9c01b155ba43dd679167168c68f72fb2a7dcc50218309602"} Jul 02 14:09:41.979962 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:41.979929 2553 generic.go:356] "Generic (PLEG): container finished" podID="887bc5a0-35f9-4ebd-8a6a-c7b7132c8c58" containerID="2c4ade01438c307f9c01b155ba43dd679167168c68f72fb2a7dcc50218309602" exitCode=0 Jul 02 14:09:41.980331 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:41.980009 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-dbb7d6f6b-xjbwb" event={"ID":"887bc5a0-35f9-4ebd-8a6a-c7b7132c8c58","Type":"ContainerDied","Data":"2c4ade01438c307f9c01b155ba43dd679167168c68f72fb2a7dcc50218309602"} Jul 02 14:09:42.986562 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:42.986526 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-dbb7d6f6b-xjbwb" event={"ID":"887bc5a0-35f9-4ebd-8a6a-c7b7132c8c58","Type":"ContainerStarted","Data":"7f3f7cd09ceb28b04e5504fe1e9ef0928da28357d9c1f038bb2bc3f82dbadefb"} Jul 02 14:09:42.987058 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:42.986759 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-dbb7d6f6b-xjbwb" Jul 02 14:09:43.029700 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:43.029652 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-dbb7d6f6b-xjbwb" podStartSLOduration=2.448731094 podStartE2EDuration="8.029636618s" totalImagesPullingTime="4.528441124s" totalInitContainerRuntime="1.0524644s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:09:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:09:43.028176197 +0000 UTC m=+514.236419002" watchObservedRunningTime="2026-07-02 14:09:43.029636618 +0000 UTC m=+514.237879454" Jul 02 14:09:44.484239 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:44.484208 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:09:44.674008 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:44.673961 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:09:53.992288 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:53.992257 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-dbb7d6f6b-xjbwb" Jul 02 14:09:54.064772 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:54.064742 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:09:54.162969 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:54.162939 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:09:56.099202 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:56.099156 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:09:56.318219 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:56.318190 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:09:57.581955 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:57.581918 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:09:57.810312 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:57.810282 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:09:57.988578 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:57.988546 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:09:58.171800 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:58.171769 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:09:59.406938 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:59.406871 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:09:59.569187 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:09:59.569155 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:10:01.669279 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:10:01.669211 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:10:01.870036 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:10:01.870003 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:10:03.246822 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:10:03.246793 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:10:04.841361 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:10:04.841324 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:10:07.771360 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:10:07.771326 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s7xtg"] Jul 02 14:10:07.774588 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:10:07.774565 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s7xtg" Jul 02 14:10:07.782308 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:10:07.782290 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 02 14:10:07.782501 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:10:07.782486 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-vrkzr\"" Jul 02 14:10:07.782580 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:10:07.782520 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 02 14:10:07.782580 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:10:07.782549 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 02 14:10:07.782682 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:10:07.782632 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 02 14:10:07.802501 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:10:07.802480 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s7xtg"] Jul 02 14:10:07.852958 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:10:07.852935 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d6ba3255-759a-4898-856f-478c199f2e1f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-s7xtg\" (UID: \"d6ba3255-759a-4898-856f-478c199f2e1f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s7xtg" Jul 02 14:10:07.853091 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:10:07.852969 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d6ba3255-759a-4898-856f-478c199f2e1f-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-s7xtg\" (UID: \"d6ba3255-759a-4898-856f-478c199f2e1f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s7xtg" Jul 02 14:10:07.853091 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:10:07.853048 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d6ba3255-759a-4898-856f-478c199f2e1f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-s7xtg\" (UID: \"d6ba3255-759a-4898-856f-478c199f2e1f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s7xtg" Jul 02 14:10:07.853091 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:10:07.853064 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6ba3255-759a-4898-856f-478c199f2e1f-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-s7xtg\" (UID: \"d6ba3255-759a-4898-856f-478c199f2e1f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s7xtg" Jul 02 14:10:07.853091 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:10:07.853079 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hfgv\" (UniqueName: \"kubernetes.io/projected/d6ba3255-759a-4898-856f-478c199f2e1f-kube-api-access-6hfgv\") pod \"istiod-openshift-gateway-94bb8fbfd-s7xtg\" (UID: \"d6ba3255-759a-4898-856f-478c199f2e1f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s7xtg" Jul 02 14:10:07.853228 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:10:07.853115 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6ba3255-759a-4898-856f-478c199f2e1f-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-s7xtg\" (UID: \"d6ba3255-759a-4898-856f-478c199f2e1f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s7xtg" Jul 02 14:10:07.853228 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:10:07.853159 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d6ba3255-759a-4898-856f-478c199f2e1f-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-s7xtg\" (UID: \"d6ba3255-759a-4898-856f-478c199f2e1f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s7xtg" Jul 02 14:10:07.954121 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:10:07.954094 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d6ba3255-759a-4898-856f-478c199f2e1f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-s7xtg\" (UID: \"d6ba3255-759a-4898-856f-478c199f2e1f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s7xtg" Jul 02 14:10:07.954121 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:10:07.954126 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6ba3255-759a-4898-856f-478c199f2e1f-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-s7xtg\" (UID: \"d6ba3255-759a-4898-856f-478c199f2e1f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s7xtg" Jul 02 14:10:07.954328 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:10:07.954145 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hfgv\" (UniqueName: \"kubernetes.io/projected/d6ba3255-759a-4898-856f-478c199f2e1f-kube-api-access-6hfgv\") pod \"istiod-openshift-gateway-94bb8fbfd-s7xtg\" (UID: \"d6ba3255-759a-4898-856f-478c199f2e1f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s7xtg" Jul 02 14:10:07.954328 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:10:07.954163 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6ba3255-759a-4898-856f-478c199f2e1f-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-s7xtg\" (UID: \"d6ba3255-759a-4898-856f-478c199f2e1f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s7xtg" Jul 02 14:10:07.954328 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:10:07.954186 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d6ba3255-759a-4898-856f-478c199f2e1f-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-s7xtg\" (UID: \"d6ba3255-759a-4898-856f-478c199f2e1f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s7xtg" Jul 02 14:10:07.954328 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:10:07.954228 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d6ba3255-759a-4898-856f-478c199f2e1f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-s7xtg\" (UID: \"d6ba3255-759a-4898-856f-478c199f2e1f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s7xtg" Jul 02 14:10:07.954328 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:10:07.954252 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d6ba3255-759a-4898-856f-478c199f2e1f-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-s7xtg\" (UID: \"d6ba3255-759a-4898-856f-478c199f2e1f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s7xtg" Jul 02 14:10:07.954861 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:10:07.954839 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d6ba3255-759a-4898-856f-478c199f2e1f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-s7xtg\" (UID: \"d6ba3255-759a-4898-856f-478c199f2e1f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s7xtg" Jul 02 14:10:07.956588 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:10:07.956566 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d6ba3255-759a-4898-856f-478c199f2e1f-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-s7xtg\" (UID: \"d6ba3255-759a-4898-856f-478c199f2e1f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s7xtg" Jul 02 14:10:07.956711 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:10:07.956688 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d6ba3255-759a-4898-856f-478c199f2e1f-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-s7xtg\" (UID: \"d6ba3255-759a-4898-856f-478c199f2e1f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s7xtg" Jul 02 14:10:07.956869 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:10:07.956851 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6ba3255-759a-4898-856f-478c199f2e1f-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-s7xtg\" (UID: \"d6ba3255-759a-4898-856f-478c199f2e1f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s7xtg" Jul 02 14:10:07.956905 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:10:07.956864 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d6ba3255-759a-4898-856f-478c199f2e1f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-s7xtg\" (UID: \"d6ba3255-759a-4898-856f-478c199f2e1f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s7xtg" Jul 02 14:10:07.971156 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:10:07.971131 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hfgv\" (UniqueName: \"kubernetes.io/projected/d6ba3255-759a-4898-856f-478c199f2e1f-kube-api-access-6hfgv\") pod \"istiod-openshift-gateway-94bb8fbfd-s7xtg\" (UID: \"d6ba3255-759a-4898-856f-478c199f2e1f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s7xtg" Jul 02 14:10:07.987635 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:10:07.987608 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6ba3255-759a-4898-856f-478c199f2e1f-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-s7xtg\" (UID: \"d6ba3255-759a-4898-856f-478c199f2e1f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s7xtg" Jul 02 14:10:08.083761 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:10:08.083688 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s7xtg" Jul 02 14:10:08.239482 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:10:08.239450 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s7xtg"] Jul 02 14:10:08.242553 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:10:08.242527 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6ba3255_759a_4898_856f_478c199f2e1f.slice/crio-45ab7a4c4c3e1aca01f1d0c64818005e0ef3535069bae7b0b39114a2ea6512dd WatchSource:0}: Error finding container 45ab7a4c4c3e1aca01f1d0c64818005e0ef3535069bae7b0b39114a2ea6512dd: Status 404 returned error can't find the container with id 45ab7a4c4c3e1aca01f1d0c64818005e0ef3535069bae7b0b39114a2ea6512dd Jul 02 14:10:08.562239 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:10:08.562207 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:10:08.730065 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:10:08.730032 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:10:09.098216 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:10:09.098180 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s7xtg" event={"ID":"d6ba3255-759a-4898-856f-478c199f2e1f","Type":"ContainerStarted","Data":"45ab7a4c4c3e1aca01f1d0c64818005e0ef3535069bae7b0b39114a2ea6512dd"} Jul 02 14:10:09.944930 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:10:09.944866 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:10:10.185408 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:10:10.185366 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:10:10.384459 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:10:10.384430 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:10:10.550087 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:10:10.550053 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:10:10.856296 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:10:10.856218 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:10:10.989902 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:10:10.989871 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:10:11.399580 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:10:11.399551 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:10:11.478647 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:10:11.478609 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 14:10:11.478782 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:10:11.478692 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 14:10:11.620269 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:10:11.620238 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:10:12.114563 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:10:12.114526 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s7xtg" event={"ID":"d6ba3255-759a-4898-856f-478c199f2e1f","Type":"ContainerStarted","Data":"0da98376bad47e14ce7c73dc379ef5bb428caa9085c143df0eda9877d6a210df"} Jul 02 14:10:12.114736 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:10:12.114703 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s7xtg" Jul 02 14:10:12.116375 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:10:12.116344 2553 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-s7xtg container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 02 14:10:12.116478 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:10:12.116397 2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s7xtg" podUID="d6ba3255-759a-4898-856f-478c199f2e1f" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 14:10:12.159396 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:10:12.159348 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s7xtg" podStartSLOduration=1.9254354299999998 podStartE2EDuration="5.159333619s" totalImagesPullingTime="3.233898189s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:10:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:10:12.158318517 +0000 UTC m=+543.366561301" watchObservedRunningTime="2026-07-02 14:10:12.159333619 +0000 UTC m=+543.367576401" Jul 02 14:10:13.119006 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:10:13.118957 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s7xtg" Jul 02 14:10:37.898913 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:10:37.898877 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:10:39.649509 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:10:39.649453 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:10:39.748900 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:10:39.748862 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:10:57.832692 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:10:57.832659 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:10:57.942449 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:10:57.942397 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:10:58.066946 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:10:58.066887 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:10:58.731501 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:10:58.731430 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:10:58.952854 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:10:58.952821 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:11:09.173565 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:09.173535 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-7gq54_4ff6194a-8b82-4387-a950-0ee9961b6012/console-operator/1.log" Jul 02 14:11:09.175142 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:09.175123 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-7gq54_4ff6194a-8b82-4387-a950-0ee9961b6012/console-operator/1.log" Jul 02 14:11:09.180401 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:09.180382 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7r445_ca0f7ed3-f75b-4edb-86c2-afa842962cf5/ovn-acl-logging/0.log" Jul 02 14:11:09.182102 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:09.182085 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7r445_ca0f7ed3-f75b-4edb-86c2-afa842962cf5/ovn-acl-logging/0.log" Jul 02 14:11:13.955517 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:13.955481 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cc2cw"] Jul 02 14:11:13.958730 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:13.958714 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cc2cw" Jul 02 14:11:13.961869 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:13.961849 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 02 14:11:13.962507 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:13.962490 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-9h5fg\"" Jul 02 14:11:13.962798 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:13.962782 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 02 14:11:13.969347 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:13.969323 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cc2cw"] Jul 02 14:11:14.112902 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:14.112869 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a539291f-1e17-4614-93d3-ebce9a49ffdc-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cc2cw\" (UID: \"a539291f-1e17-4614-93d3-ebce9a49ffdc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cc2cw" Jul 02 14:11:14.113112 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:14.112911 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gk4z9\" (UniqueName: \"kubernetes.io/projected/a539291f-1e17-4614-93d3-ebce9a49ffdc-kube-api-access-gk4z9\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cc2cw\" (UID: \"a539291f-1e17-4614-93d3-ebce9a49ffdc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cc2cw" Jul 02 14:11:14.113112 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:14.112945 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a539291f-1e17-4614-93d3-ebce9a49ffdc-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cc2cw\" (UID: \"a539291f-1e17-4614-93d3-ebce9a49ffdc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cc2cw" Jul 02 14:11:14.213482 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:14.213389 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a539291f-1e17-4614-93d3-ebce9a49ffdc-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cc2cw\" (UID: \"a539291f-1e17-4614-93d3-ebce9a49ffdc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cc2cw" Jul 02 14:11:14.213482 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:14.213437 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gk4z9\" (UniqueName: \"kubernetes.io/projected/a539291f-1e17-4614-93d3-ebce9a49ffdc-kube-api-access-gk4z9\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cc2cw\" (UID: \"a539291f-1e17-4614-93d3-ebce9a49ffdc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cc2cw" Jul 02 14:11:14.213482 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:14.213473 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a539291f-1e17-4614-93d3-ebce9a49ffdc-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cc2cw\" (UID: \"a539291f-1e17-4614-93d3-ebce9a49ffdc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cc2cw" Jul 02 14:11:14.213907 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:14.213884 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a539291f-1e17-4614-93d3-ebce9a49ffdc-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cc2cw\" (UID: \"a539291f-1e17-4614-93d3-ebce9a49ffdc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cc2cw" Jul 02 14:11:14.214009 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:14.213894 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a539291f-1e17-4614-93d3-ebce9a49ffdc-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cc2cw\" (UID: \"a539291f-1e17-4614-93d3-ebce9a49ffdc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cc2cw" Jul 02 14:11:14.222463 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:14.222439 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gk4z9\" (UniqueName: \"kubernetes.io/projected/a539291f-1e17-4614-93d3-ebce9a49ffdc-kube-api-access-gk4z9\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cc2cw\" (UID: \"a539291f-1e17-4614-93d3-ebce9a49ffdc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cc2cw" Jul 02 14:11:14.267810 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:14.267778 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cc2cw" Jul 02 14:11:14.398043 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:14.398019 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cc2cw"] Jul 02 14:11:14.399977 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:11:14.399954 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda539291f_1e17_4614_93d3_ebce9a49ffdc.slice/crio-34094f14f2e46e40cefd6d2ac27af81317423de653b2ef0b1c72adb11a4be38e WatchSource:0}: Error finding container 34094f14f2e46e40cefd6d2ac27af81317423de653b2ef0b1c72adb11a4be38e: Status 404 returned error can't find the container with id 34094f14f2e46e40cefd6d2ac27af81317423de653b2ef0b1c72adb11a4be38e Jul 02 14:11:14.756914 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:14.756835 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lm829"] Jul 02 14:11:14.760074 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:14.760055 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lm829" Jul 02 14:11:14.770979 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:14.770958 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lm829"] Jul 02 14:11:14.920049 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:14.920011 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/75a732ff-889d-4ae7-8330-17cf2b6ae7c8-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lm829\" (UID: \"75a732ff-889d-4ae7-8330-17cf2b6ae7c8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lm829" Jul 02 14:11:14.920049 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:14.920047 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9lzh\" (UniqueName: \"kubernetes.io/projected/75a732ff-889d-4ae7-8330-17cf2b6ae7c8-kube-api-access-l9lzh\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lm829\" (UID: \"75a732ff-889d-4ae7-8330-17cf2b6ae7c8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lm829" Jul 02 14:11:14.920270 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:14.920112 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/75a732ff-889d-4ae7-8330-17cf2b6ae7c8-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lm829\" (UID: \"75a732ff-889d-4ae7-8330-17cf2b6ae7c8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lm829" Jul 02 14:11:15.021322 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:15.021230 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/75a732ff-889d-4ae7-8330-17cf2b6ae7c8-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lm829\" (UID: \"75a732ff-889d-4ae7-8330-17cf2b6ae7c8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lm829" Jul 02 14:11:15.021322 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:15.021270 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9lzh\" (UniqueName: \"kubernetes.io/projected/75a732ff-889d-4ae7-8330-17cf2b6ae7c8-kube-api-access-l9lzh\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lm829\" (UID: \"75a732ff-889d-4ae7-8330-17cf2b6ae7c8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lm829" Jul 02 14:11:15.021322 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:15.021317 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/75a732ff-889d-4ae7-8330-17cf2b6ae7c8-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lm829\" (UID: \"75a732ff-889d-4ae7-8330-17cf2b6ae7c8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lm829" Jul 02 14:11:15.021864 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:15.021588 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/75a732ff-889d-4ae7-8330-17cf2b6ae7c8-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lm829\" (UID: \"75a732ff-889d-4ae7-8330-17cf2b6ae7c8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lm829" Jul 02 14:11:15.021864 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:15.021660 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/75a732ff-889d-4ae7-8330-17cf2b6ae7c8-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lm829\" (UID: \"75a732ff-889d-4ae7-8330-17cf2b6ae7c8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lm829" Jul 02 14:11:15.029671 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:15.029649 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9lzh\" (UniqueName: \"kubernetes.io/projected/75a732ff-889d-4ae7-8330-17cf2b6ae7c8-kube-api-access-l9lzh\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lm829\" (UID: \"75a732ff-889d-4ae7-8330-17cf2b6ae7c8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lm829" Jul 02 14:11:15.069027 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:15.068979 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lm829" Jul 02 14:11:15.199776 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:15.199747 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lm829"] Jul 02 14:11:15.201404 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:11:15.201370 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75a732ff_889d_4ae7_8330_17cf2b6ae7c8.slice/crio-9776b90c138b4496d967446ecfc5b474dc43147143743c41f30da0766c800f7c WatchSource:0}: Error finding container 9776b90c138b4496d967446ecfc5b474dc43147143743c41f30da0766c800f7c: Status 404 returned error can't find the container with id 9776b90c138b4496d967446ecfc5b474dc43147143743c41f30da0766c800f7c Jul 02 14:11:15.360084 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:15.360053 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73428mf"] Jul 02 14:11:15.363379 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:15.363362 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73428mf" Jul 02 14:11:15.374673 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:15.374654 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73428mf"] Jul 02 14:11:15.395315 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:15.395283 2553 generic.go:356] "Generic (PLEG): container finished" podID="a539291f-1e17-4614-93d3-ebce9a49ffdc" containerID="01e3b9a9277b2862386256047c6932e3b3f53e46bd26d2bd5ea0c9633c1ad286" exitCode=0 Jul 02 14:11:15.395458 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:15.395368 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cc2cw" event={"ID":"a539291f-1e17-4614-93d3-ebce9a49ffdc","Type":"ContainerDied","Data":"01e3b9a9277b2862386256047c6932e3b3f53e46bd26d2bd5ea0c9633c1ad286"} Jul 02 14:11:15.395458 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:15.395420 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cc2cw" event={"ID":"a539291f-1e17-4614-93d3-ebce9a49ffdc","Type":"ContainerStarted","Data":"34094f14f2e46e40cefd6d2ac27af81317423de653b2ef0b1c72adb11a4be38e"} Jul 02 14:11:15.395907 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:15.395877 2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 14:11:15.396932 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:15.396911 2553 generic.go:356] "Generic (PLEG): container finished" podID="75a732ff-889d-4ae7-8330-17cf2b6ae7c8" containerID="cec4552c05ac53f597996f187b8a94deaac3e448f9075654e324a2fdb32eb962" exitCode=0 Jul 02 14:11:15.397034 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:15.397010 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lm829" event={"ID":"75a732ff-889d-4ae7-8330-17cf2b6ae7c8","Type":"ContainerDied","Data":"cec4552c05ac53f597996f187b8a94deaac3e448f9075654e324a2fdb32eb962"} Jul 02 14:11:15.397092 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:15.397048 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lm829" event={"ID":"75a732ff-889d-4ae7-8330-17cf2b6ae7c8","Type":"ContainerStarted","Data":"9776b90c138b4496d967446ecfc5b474dc43147143743c41f30da0766c800f7c"} Jul 02 14:11:15.526735 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:15.526693 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gc6sd\" (UniqueName: \"kubernetes.io/projected/f08bb41e-4eae-46af-a548-1170b6547df3-kube-api-access-gc6sd\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73428mf\" (UID: \"f08bb41e-4eae-46af-a548-1170b6547df3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73428mf" Jul 02 14:11:15.526899 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:15.526802 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f08bb41e-4eae-46af-a548-1170b6547df3-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73428mf\" (UID: \"f08bb41e-4eae-46af-a548-1170b6547df3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73428mf" Jul 02 14:11:15.526899 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:15.526850 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f08bb41e-4eae-46af-a548-1170b6547df3-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73428mf\" (UID: \"f08bb41e-4eae-46af-a548-1170b6547df3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73428mf" Jul 02 14:11:15.627442 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:15.627414 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gc6sd\" (UniqueName: \"kubernetes.io/projected/f08bb41e-4eae-46af-a548-1170b6547df3-kube-api-access-gc6sd\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73428mf\" (UID: \"f08bb41e-4eae-46af-a548-1170b6547df3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73428mf" Jul 02 14:11:15.627553 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:15.627461 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f08bb41e-4eae-46af-a548-1170b6547df3-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73428mf\" (UID: \"f08bb41e-4eae-46af-a548-1170b6547df3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73428mf" Jul 02 14:11:15.627553 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:15.627498 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f08bb41e-4eae-46af-a548-1170b6547df3-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73428mf\" (UID: \"f08bb41e-4eae-46af-a548-1170b6547df3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73428mf" Jul 02 14:11:15.627931 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:15.627911 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f08bb41e-4eae-46af-a548-1170b6547df3-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73428mf\" (UID: \"f08bb41e-4eae-46af-a548-1170b6547df3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73428mf" Jul 02 14:11:15.627931 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:15.627925 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f08bb41e-4eae-46af-a548-1170b6547df3-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73428mf\" (UID: \"f08bb41e-4eae-46af-a548-1170b6547df3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73428mf" Jul 02 14:11:15.636534 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:15.636505 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gc6sd\" (UniqueName: \"kubernetes.io/projected/f08bb41e-4eae-46af-a548-1170b6547df3-kube-api-access-gc6sd\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73428mf\" (UID: \"f08bb41e-4eae-46af-a548-1170b6547df3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73428mf" Jul 02 14:11:15.677003 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:15.676951 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73428mf" Jul 02 14:11:15.811973 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:15.811951 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73428mf"] Jul 02 14:11:15.814291 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:11:15.814262 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf08bb41e_4eae_46af_a548_1170b6547df3.slice/crio-6ed5a217222e9d6a47669615c5dd3134d0287a710ea5966162efb27ce168cf3c WatchSource:0}: Error finding container 6ed5a217222e9d6a47669615c5dd3134d0287a710ea5966162efb27ce168cf3c: Status 404 returned error can't find the container with id 6ed5a217222e9d6a47669615c5dd3134d0287a710ea5966162efb27ce168cf3c Jul 02 14:11:15.818575 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:15.818553 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltxmd"] Jul 02 14:11:15.821748 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:15.821733 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltxmd" Jul 02 14:11:15.833096 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:15.833072 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltxmd"] Jul 02 14:11:15.930098 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:15.930061 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96925341-68cb-4d2f-8ba2-37f22d9a1c91-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltxmd\" (UID: \"96925341-68cb-4d2f-8ba2-37f22d9a1c91\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltxmd" Jul 02 14:11:15.930265 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:15.930133 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96925341-68cb-4d2f-8ba2-37f22d9a1c91-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltxmd\" (UID: \"96925341-68cb-4d2f-8ba2-37f22d9a1c91\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltxmd" Jul 02 14:11:15.930265 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:15.930211 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkqjc\" (UniqueName: \"kubernetes.io/projected/96925341-68cb-4d2f-8ba2-37f22d9a1c91-kube-api-access-pkqjc\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltxmd\" (UID: \"96925341-68cb-4d2f-8ba2-37f22d9a1c91\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltxmd" Jul 02 14:11:16.031232 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:16.031198 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96925341-68cb-4d2f-8ba2-37f22d9a1c91-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltxmd\" (UID: \"96925341-68cb-4d2f-8ba2-37f22d9a1c91\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltxmd" Jul 02 14:11:16.031633 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:16.031240 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96925341-68cb-4d2f-8ba2-37f22d9a1c91-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltxmd\" (UID: \"96925341-68cb-4d2f-8ba2-37f22d9a1c91\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltxmd" Jul 02 14:11:16.031633 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:16.031272 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkqjc\" (UniqueName: \"kubernetes.io/projected/96925341-68cb-4d2f-8ba2-37f22d9a1c91-kube-api-access-pkqjc\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltxmd\" (UID: \"96925341-68cb-4d2f-8ba2-37f22d9a1c91\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltxmd" Jul 02 14:11:16.031633 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:16.031567 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96925341-68cb-4d2f-8ba2-37f22d9a1c91-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltxmd\" (UID: \"96925341-68cb-4d2f-8ba2-37f22d9a1c91\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltxmd" Jul 02 14:11:16.031633 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:16.031600 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96925341-68cb-4d2f-8ba2-37f22d9a1c91-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltxmd\" (UID: \"96925341-68cb-4d2f-8ba2-37f22d9a1c91\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltxmd" Jul 02 14:11:16.039767 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:16.039746 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkqjc\" (UniqueName: \"kubernetes.io/projected/96925341-68cb-4d2f-8ba2-37f22d9a1c91-kube-api-access-pkqjc\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltxmd\" (UID: \"96925341-68cb-4d2f-8ba2-37f22d9a1c91\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltxmd" Jul 02 14:11:16.131208 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:16.131178 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltxmd" Jul 02 14:11:16.390094 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:16.390071 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltxmd"] Jul 02 14:11:16.402890 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:16.402864 2553 generic.go:356] "Generic (PLEG): container finished" podID="a539291f-1e17-4614-93d3-ebce9a49ffdc" containerID="d61aafd9c43139fb6b0b7427f9591d6dd9bf79969a2a8144d79e90eb2e714f15" exitCode=0 Jul 02 14:11:16.403033 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:16.402951 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cc2cw" event={"ID":"a539291f-1e17-4614-93d3-ebce9a49ffdc","Type":"ContainerDied","Data":"d61aafd9c43139fb6b0b7427f9591d6dd9bf79969a2a8144d79e90eb2e714f15"} Jul 02 14:11:16.404769 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:16.404740 2553 generic.go:356] "Generic (PLEG): container finished" podID="75a732ff-889d-4ae7-8330-17cf2b6ae7c8" containerID="16045857488e92550230f906a0415e4d1badf60c016580ecefa925fe56fdb812" exitCode=0 Jul 02 14:11:16.404933 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:16.404767 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lm829" event={"ID":"75a732ff-889d-4ae7-8330-17cf2b6ae7c8","Type":"ContainerDied","Data":"16045857488e92550230f906a0415e4d1badf60c016580ecefa925fe56fdb812"} Jul 02 14:11:16.406517 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:16.406493 2553 generic.go:356] "Generic (PLEG): container finished" podID="f08bb41e-4eae-46af-a548-1170b6547df3" containerID="404620270fc7bf6f635da7fbc56fffdefd9672468ca9a17b2dd7af463f763227" exitCode=0 Jul 02 14:11:16.406609 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:16.406591 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73428mf" event={"ID":"f08bb41e-4eae-46af-a548-1170b6547df3","Type":"ContainerDied","Data":"404620270fc7bf6f635da7fbc56fffdefd9672468ca9a17b2dd7af463f763227"} Jul 02 14:11:16.406694 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:16.406626 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73428mf" event={"ID":"f08bb41e-4eae-46af-a548-1170b6547df3","Type":"ContainerStarted","Data":"6ed5a217222e9d6a47669615c5dd3134d0287a710ea5966162efb27ce168cf3c"} Jul 02 14:11:16.436894 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:11:16.436873 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96925341_68cb_4d2f_8ba2_37f22d9a1c91.slice/crio-e8cc55e882bcf39fd5d945e5226a4fbf7e33b89f46e8ef0e78b05c605a5d5f35 WatchSource:0}: Error finding container e8cc55e882bcf39fd5d945e5226a4fbf7e33b89f46e8ef0e78b05c605a5d5f35: Status 404 returned error can't find the container with id e8cc55e882bcf39fd5d945e5226a4fbf7e33b89f46e8ef0e78b05c605a5d5f35 Jul 02 14:11:17.413635 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:17.413600 2553 generic.go:356] "Generic (PLEG): container finished" podID="a539291f-1e17-4614-93d3-ebce9a49ffdc" containerID="001bcac5248521c155c2f06f65deb3cedd356de879418529dd8ba0882760484a" exitCode=0 Jul 02 14:11:17.414066 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:17.413684 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cc2cw" event={"ID":"a539291f-1e17-4614-93d3-ebce9a49ffdc","Type":"ContainerDied","Data":"001bcac5248521c155c2f06f65deb3cedd356de879418529dd8ba0882760484a"} Jul 02 14:11:17.415673 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:17.415652 2553 generic.go:356] "Generic (PLEG): container finished" podID="75a732ff-889d-4ae7-8330-17cf2b6ae7c8" containerID="34f363f2cd62597358b263e01b41f82c9e46639096bbbd2d9e9e5ef7671fc0c4" exitCode=0 Jul 02 14:11:17.415782 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:17.415694 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lm829" event={"ID":"75a732ff-889d-4ae7-8330-17cf2b6ae7c8","Type":"ContainerDied","Data":"34f363f2cd62597358b263e01b41f82c9e46639096bbbd2d9e9e5ef7671fc0c4"} Jul 02 14:11:17.416935 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:17.416917 2553 generic.go:356] "Generic (PLEG): container finished" podID="96925341-68cb-4d2f-8ba2-37f22d9a1c91" containerID="0173142a14846c15b28ffa096a1337a47366dfc123ab0bbb272d41aa6d1614ac" exitCode=0 Jul 02 14:11:17.417037 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:17.416967 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltxmd" event={"ID":"96925341-68cb-4d2f-8ba2-37f22d9a1c91","Type":"ContainerDied","Data":"0173142a14846c15b28ffa096a1337a47366dfc123ab0bbb272d41aa6d1614ac"} Jul 02 14:11:17.417037 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:17.417008 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltxmd" event={"ID":"96925341-68cb-4d2f-8ba2-37f22d9a1c91","Type":"ContainerStarted","Data":"e8cc55e882bcf39fd5d945e5226a4fbf7e33b89f46e8ef0e78b05c605a5d5f35"} Jul 02 14:11:18.424706 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:18.424668 2553 generic.go:356] "Generic (PLEG): container finished" podID="f08bb41e-4eae-46af-a548-1170b6547df3" containerID="e4e361b1730658fae4a30961f7157e8ef9f77e1539becc8be6f64003f969a2c4" exitCode=0 Jul 02 14:11:18.425197 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:18.424748 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73428mf" event={"ID":"f08bb41e-4eae-46af-a548-1170b6547df3","Type":"ContainerDied","Data":"e4e361b1730658fae4a30961f7157e8ef9f77e1539becc8be6f64003f969a2c4"} Jul 02 14:11:18.584673 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:18.584647 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cc2cw" Jul 02 14:11:18.588207 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:18.588186 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lm829" Jul 02 14:11:18.654413 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:18.654378 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gk4z9\" (UniqueName: \"kubernetes.io/projected/a539291f-1e17-4614-93d3-ebce9a49ffdc-kube-api-access-gk4z9\") pod \"a539291f-1e17-4614-93d3-ebce9a49ffdc\" (UID: \"a539291f-1e17-4614-93d3-ebce9a49ffdc\") " Jul 02 14:11:18.654603 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:18.654434 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a539291f-1e17-4614-93d3-ebce9a49ffdc-bundle\") pod \"a539291f-1e17-4614-93d3-ebce9a49ffdc\" (UID: \"a539291f-1e17-4614-93d3-ebce9a49ffdc\") " Jul 02 14:11:18.654603 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:18.654552 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a539291f-1e17-4614-93d3-ebce9a49ffdc-util\") pod \"a539291f-1e17-4614-93d3-ebce9a49ffdc\" (UID: \"a539291f-1e17-4614-93d3-ebce9a49ffdc\") " Jul 02 14:11:18.654603 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:18.654595 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/75a732ff-889d-4ae7-8330-17cf2b6ae7c8-bundle\") pod \"75a732ff-889d-4ae7-8330-17cf2b6ae7c8\" (UID: \"75a732ff-889d-4ae7-8330-17cf2b6ae7c8\") " Jul 02 14:11:18.654773 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:18.654627 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l9lzh\" (UniqueName: \"kubernetes.io/projected/75a732ff-889d-4ae7-8330-17cf2b6ae7c8-kube-api-access-l9lzh\") pod \"75a732ff-889d-4ae7-8330-17cf2b6ae7c8\" (UID: \"75a732ff-889d-4ae7-8330-17cf2b6ae7c8\") " Jul 02 14:11:18.654773 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:18.654645 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/75a732ff-889d-4ae7-8330-17cf2b6ae7c8-util\") pod \"75a732ff-889d-4ae7-8330-17cf2b6ae7c8\" (UID: \"75a732ff-889d-4ae7-8330-17cf2b6ae7c8\") " Jul 02 14:11:18.655260 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:18.655183 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a539291f-1e17-4614-93d3-ebce9a49ffdc-bundle" (OuterVolumeSpecName: "bundle") pod "a539291f-1e17-4614-93d3-ebce9a49ffdc" (UID: "a539291f-1e17-4614-93d3-ebce9a49ffdc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 14:11:18.655775 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:18.655740 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75a732ff-889d-4ae7-8330-17cf2b6ae7c8-bundle" (OuterVolumeSpecName: "bundle") pod "75a732ff-889d-4ae7-8330-17cf2b6ae7c8" (UID: "75a732ff-889d-4ae7-8330-17cf2b6ae7c8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 14:11:18.657581 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:18.657556 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a539291f-1e17-4614-93d3-ebce9a49ffdc-kube-api-access-gk4z9" (OuterVolumeSpecName: "kube-api-access-gk4z9") pod "a539291f-1e17-4614-93d3-ebce9a49ffdc" (UID: "a539291f-1e17-4614-93d3-ebce9a49ffdc"). InnerVolumeSpecName "kube-api-access-gk4z9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 14:11:18.657688 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:18.657661 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75a732ff-889d-4ae7-8330-17cf2b6ae7c8-kube-api-access-l9lzh" (OuterVolumeSpecName: "kube-api-access-l9lzh") pod "75a732ff-889d-4ae7-8330-17cf2b6ae7c8" (UID: "75a732ff-889d-4ae7-8330-17cf2b6ae7c8"). InnerVolumeSpecName "kube-api-access-l9lzh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 14:11:18.660719 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:18.660697 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a539291f-1e17-4614-93d3-ebce9a49ffdc-util" (OuterVolumeSpecName: "util") pod "a539291f-1e17-4614-93d3-ebce9a49ffdc" (UID: "a539291f-1e17-4614-93d3-ebce9a49ffdc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 14:11:18.661087 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:18.661067 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75a732ff-889d-4ae7-8330-17cf2b6ae7c8-util" (OuterVolumeSpecName: "util") pod "75a732ff-889d-4ae7-8330-17cf2b6ae7c8" (UID: "75a732ff-889d-4ae7-8330-17cf2b6ae7c8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 14:11:18.756245 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:18.756223 2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a539291f-1e17-4614-93d3-ebce9a49ffdc-bundle\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:11:18.756352 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:18.756247 2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a539291f-1e17-4614-93d3-ebce9a49ffdc-util\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:11:18.756352 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:18.756261 2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/75a732ff-889d-4ae7-8330-17cf2b6ae7c8-bundle\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:11:18.756352 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:18.756272 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l9lzh\" (UniqueName: \"kubernetes.io/projected/75a732ff-889d-4ae7-8330-17cf2b6ae7c8-kube-api-access-l9lzh\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:11:18.756352 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:18.756287 2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/75a732ff-889d-4ae7-8330-17cf2b6ae7c8-util\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:11:18.756352 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:18.756299 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gk4z9\" (UniqueName: \"kubernetes.io/projected/a539291f-1e17-4614-93d3-ebce9a49ffdc-kube-api-access-gk4z9\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:11:19.435858 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:19.435821 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cc2cw" event={"ID":"a539291f-1e17-4614-93d3-ebce9a49ffdc","Type":"ContainerDied","Data":"34094f14f2e46e40cefd6d2ac27af81317423de653b2ef0b1c72adb11a4be38e"} Jul 02 14:11:19.436311 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:19.435901 2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="34094f14f2e46e40cefd6d2ac27af81317423de653b2ef0b1c72adb11a4be38e" Jul 02 14:11:19.436311 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:19.435831 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cc2cw" Jul 02 14:11:19.437758 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:19.437715 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lm829" Jul 02 14:11:19.437878 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:19.437712 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lm829" event={"ID":"75a732ff-889d-4ae7-8330-17cf2b6ae7c8","Type":"ContainerDied","Data":"9776b90c138b4496d967446ecfc5b474dc43147143743c41f30da0766c800f7c"} Jul 02 14:11:19.437878 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:19.437866 2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9776b90c138b4496d967446ecfc5b474dc43147143743c41f30da0766c800f7c" Jul 02 14:11:19.440161 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:19.440140 2553 generic.go:356] "Generic (PLEG): container finished" podID="f08bb41e-4eae-46af-a548-1170b6547df3" containerID="6bae928e008178688b9a17fef6d0832167906bfa5a05cc0da5773730d8d1e708" exitCode=0 Jul 02 14:11:19.440284 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:19.440204 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73428mf" event={"ID":"f08bb41e-4eae-46af-a548-1170b6547df3","Type":"ContainerDied","Data":"6bae928e008178688b9a17fef6d0832167906bfa5a05cc0da5773730d8d1e708"} Jul 02 14:11:19.441888 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:19.441871 2553 generic.go:356] "Generic (PLEG): container finished" podID="96925341-68cb-4d2f-8ba2-37f22d9a1c91" containerID="0aea06ebe22315a72ef2eab1b12269aba4380c6636e2f476c55fc76bbceee7d3" exitCode=0 Jul 02 14:11:19.441957 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:19.441942 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltxmd" event={"ID":"96925341-68cb-4d2f-8ba2-37f22d9a1c91","Type":"ContainerDied","Data":"0aea06ebe22315a72ef2eab1b12269aba4380c6636e2f476c55fc76bbceee7d3"} Jul 02 14:11:20.448964 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:20.448934 2553 generic.go:356] "Generic (PLEG): container finished" podID="96925341-68cb-4d2f-8ba2-37f22d9a1c91" containerID="e6756ad981bc1eb111c332336dd9bafcf1806d56a703b2b37e6fa71a6b03517e" exitCode=0 Jul 02 14:11:20.449415 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:20.449030 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltxmd" event={"ID":"96925341-68cb-4d2f-8ba2-37f22d9a1c91","Type":"ContainerDied","Data":"e6756ad981bc1eb111c332336dd9bafcf1806d56a703b2b37e6fa71a6b03517e"} Jul 02 14:11:20.572477 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:20.572454 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73428mf" Jul 02 14:11:20.669438 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:20.669392 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f08bb41e-4eae-46af-a548-1170b6547df3-bundle\") pod \"f08bb41e-4eae-46af-a548-1170b6547df3\" (UID: \"f08bb41e-4eae-46af-a548-1170b6547df3\") " Jul 02 14:11:20.669624 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:20.669457 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gc6sd\" (UniqueName: \"kubernetes.io/projected/f08bb41e-4eae-46af-a548-1170b6547df3-kube-api-access-gc6sd\") pod \"f08bb41e-4eae-46af-a548-1170b6547df3\" (UID: \"f08bb41e-4eae-46af-a548-1170b6547df3\") " Jul 02 14:11:20.669624 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:20.669496 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f08bb41e-4eae-46af-a548-1170b6547df3-util\") pod \"f08bb41e-4eae-46af-a548-1170b6547df3\" (UID: \"f08bb41e-4eae-46af-a548-1170b6547df3\") " Jul 02 14:11:20.670008 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:20.669967 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f08bb41e-4eae-46af-a548-1170b6547df3-bundle" (OuterVolumeSpecName: "bundle") pod "f08bb41e-4eae-46af-a548-1170b6547df3" (UID: "f08bb41e-4eae-46af-a548-1170b6547df3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 14:11:20.671559 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:20.671534 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f08bb41e-4eae-46af-a548-1170b6547df3-kube-api-access-gc6sd" (OuterVolumeSpecName: "kube-api-access-gc6sd") pod "f08bb41e-4eae-46af-a548-1170b6547df3" (UID: "f08bb41e-4eae-46af-a548-1170b6547df3"). InnerVolumeSpecName "kube-api-access-gc6sd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 14:11:20.674881 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:20.674851 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f08bb41e-4eae-46af-a548-1170b6547df3-util" (OuterVolumeSpecName: "util") pod "f08bb41e-4eae-46af-a548-1170b6547df3" (UID: "f08bb41e-4eae-46af-a548-1170b6547df3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 14:11:20.771067 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:20.770970 2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f08bb41e-4eae-46af-a548-1170b6547df3-bundle\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:11:20.771067 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:20.771017 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gc6sd\" (UniqueName: \"kubernetes.io/projected/f08bb41e-4eae-46af-a548-1170b6547df3-kube-api-access-gc6sd\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:11:20.771067 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:20.771039 2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f08bb41e-4eae-46af-a548-1170b6547df3-util\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:11:21.455376 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:21.455345 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73428mf" Jul 02 14:11:21.455376 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:21.455355 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73428mf" event={"ID":"f08bb41e-4eae-46af-a548-1170b6547df3","Type":"ContainerDied","Data":"6ed5a217222e9d6a47669615c5dd3134d0287a710ea5966162efb27ce168cf3c"} Jul 02 14:11:21.455766 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:21.455396 2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6ed5a217222e9d6a47669615c5dd3134d0287a710ea5966162efb27ce168cf3c" Jul 02 14:11:21.580208 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:21.580182 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltxmd" Jul 02 14:11:21.677918 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:21.677894 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96925341-68cb-4d2f-8ba2-37f22d9a1c91-util\") pod \"96925341-68cb-4d2f-8ba2-37f22d9a1c91\" (UID: \"96925341-68cb-4d2f-8ba2-37f22d9a1c91\") " Jul 02 14:11:21.678109 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:21.677928 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pkqjc\" (UniqueName: \"kubernetes.io/projected/96925341-68cb-4d2f-8ba2-37f22d9a1c91-kube-api-access-pkqjc\") pod \"96925341-68cb-4d2f-8ba2-37f22d9a1c91\" (UID: \"96925341-68cb-4d2f-8ba2-37f22d9a1c91\") " Jul 02 14:11:21.678109 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:21.678003 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96925341-68cb-4d2f-8ba2-37f22d9a1c91-bundle\") pod \"96925341-68cb-4d2f-8ba2-37f22d9a1c91\" (UID: \"96925341-68cb-4d2f-8ba2-37f22d9a1c91\") " Jul 02 14:11:21.678551 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:21.678525 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96925341-68cb-4d2f-8ba2-37f22d9a1c91-bundle" (OuterVolumeSpecName: "bundle") pod "96925341-68cb-4d2f-8ba2-37f22d9a1c91" (UID: "96925341-68cb-4d2f-8ba2-37f22d9a1c91"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 14:11:21.680022 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:21.679997 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96925341-68cb-4d2f-8ba2-37f22d9a1c91-kube-api-access-pkqjc" (OuterVolumeSpecName: "kube-api-access-pkqjc") pod "96925341-68cb-4d2f-8ba2-37f22d9a1c91" (UID: "96925341-68cb-4d2f-8ba2-37f22d9a1c91"). InnerVolumeSpecName "kube-api-access-pkqjc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 14:11:21.683447 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:21.683426 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96925341-68cb-4d2f-8ba2-37f22d9a1c91-util" (OuterVolumeSpecName: "util") pod "96925341-68cb-4d2f-8ba2-37f22d9a1c91" (UID: "96925341-68cb-4d2f-8ba2-37f22d9a1c91"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 14:11:21.779497 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:21.779424 2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96925341-68cb-4d2f-8ba2-37f22d9a1c91-util\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:11:21.779497 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:21.779453 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pkqjc\" (UniqueName: \"kubernetes.io/projected/96925341-68cb-4d2f-8ba2-37f22d9a1c91-kube-api-access-pkqjc\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:11:21.779497 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:21.779464 2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96925341-68cb-4d2f-8ba2-37f22d9a1c91-bundle\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:11:22.462603 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:22.462565 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltxmd" event={"ID":"96925341-68cb-4d2f-8ba2-37f22d9a1c91","Type":"ContainerDied","Data":"e8cc55e882bcf39fd5d945e5226a4fbf7e33b89f46e8ef0e78b05c605a5d5f35"} Jul 02 14:11:22.462603 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:22.462600 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltxmd" Jul 02 14:11:22.462603 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:22.462613 2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e8cc55e882bcf39fd5d945e5226a4fbf7e33b89f46e8ef0e78b05c605a5d5f35" Jul 02 14:11:27.932837 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:27.932803 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:11:29.510095 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:29.510063 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:11:30.269928 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:30.269894 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-54bf74458b-h2fdl"] Jul 02 14:11:30.270306 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:30.270287 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f08bb41e-4eae-46af-a548-1170b6547df3" containerName="extract" Jul 02 14:11:30.270405 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:30.270309 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="f08bb41e-4eae-46af-a548-1170b6547df3" containerName="extract" Jul 02 14:11:30.270405 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:30.270324 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96925341-68cb-4d2f-8ba2-37f22d9a1c91" containerName="pull" Jul 02 14:11:30.270405 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:30.270332 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="96925341-68cb-4d2f-8ba2-37f22d9a1c91" containerName="pull" Jul 02 14:11:30.270405 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:30.270346 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75a732ff-889d-4ae7-8330-17cf2b6ae7c8" containerName="pull" Jul 02 14:11:30.270405 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:30.270354 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="75a732ff-889d-4ae7-8330-17cf2b6ae7c8" containerName="pull" Jul 02 14:11:30.270405 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:30.270369 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75a732ff-889d-4ae7-8330-17cf2b6ae7c8" containerName="util" Jul 02 14:11:30.270405 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:30.270377 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="75a732ff-889d-4ae7-8330-17cf2b6ae7c8" containerName="util" Jul 02 14:11:30.270405 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:30.270386 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f08bb41e-4eae-46af-a548-1170b6547df3" containerName="util" Jul 02 14:11:30.270405 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:30.270396 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="f08bb41e-4eae-46af-a548-1170b6547df3" containerName="util" Jul 02 14:11:30.270405 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:30.270405 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96925341-68cb-4d2f-8ba2-37f22d9a1c91" containerName="extract" Jul 02 14:11:30.271005 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:30.270413 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="96925341-68cb-4d2f-8ba2-37f22d9a1c91" containerName="extract" Jul 02 14:11:30.271005 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:30.270428 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f08bb41e-4eae-46af-a548-1170b6547df3" containerName="pull" Jul 02 14:11:30.271005 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:30.270436 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="f08bb41e-4eae-46af-a548-1170b6547df3" containerName="pull" Jul 02 14:11:30.271005 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:30.270454 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a539291f-1e17-4614-93d3-ebce9a49ffdc" containerName="extract" Jul 02 14:11:30.271005 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:30.270463 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="a539291f-1e17-4614-93d3-ebce9a49ffdc" containerName="extract" Jul 02 14:11:30.271005 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:30.270474 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a539291f-1e17-4614-93d3-ebce9a49ffdc" containerName="pull" Jul 02 14:11:30.271005 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:30.270482 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="a539291f-1e17-4614-93d3-ebce9a49ffdc" containerName="pull" Jul 02 14:11:30.271005 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:30.270491 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96925341-68cb-4d2f-8ba2-37f22d9a1c91" containerName="util" Jul 02 14:11:30.271005 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:30.270499 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="96925341-68cb-4d2f-8ba2-37f22d9a1c91" containerName="util" Jul 02 14:11:30.271005 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:30.270507 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75a732ff-889d-4ae7-8330-17cf2b6ae7c8" containerName="extract" Jul 02 14:11:30.271005 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:30.270514 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="75a732ff-889d-4ae7-8330-17cf2b6ae7c8" containerName="extract" Jul 02 14:11:30.271005 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:30.270527 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a539291f-1e17-4614-93d3-ebce9a49ffdc" containerName="util" Jul 02 14:11:30.271005 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:30.270535 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="a539291f-1e17-4614-93d3-ebce9a49ffdc" containerName="util" Jul 02 14:11:30.271005 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:30.270615 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="f08bb41e-4eae-46af-a548-1170b6547df3" containerName="extract" Jul 02 14:11:30.271005 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:30.270627 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="96925341-68cb-4d2f-8ba2-37f22d9a1c91" containerName="extract" Jul 02 14:11:30.271005 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:30.270636 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="a539291f-1e17-4614-93d3-ebce9a49ffdc" containerName="extract" Jul 02 14:11:30.271005 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:30.270648 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="75a732ff-889d-4ae7-8330-17cf2b6ae7c8" containerName="extract" Jul 02 14:11:30.273862 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:30.273842 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54bf74458b-h2fdl" Jul 02 14:11:30.299715 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:30.299684 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54bf74458b-h2fdl"] Jul 02 14:11:30.343091 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:30.343057 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:11:30.351299 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:30.351272 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd06cd9b-afa2-4715-a796-b19a7f530081-console-serving-cert\") pod \"console-54bf74458b-h2fdl\" (UID: \"bd06cd9b-afa2-4715-a796-b19a7f530081\") " pod="openshift-console/console-54bf74458b-h2fdl" Jul 02 14:11:30.351431 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:30.351317 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd06cd9b-afa2-4715-a796-b19a7f530081-trusted-ca-bundle\") pod \"console-54bf74458b-h2fdl\" (UID: \"bd06cd9b-afa2-4715-a796-b19a7f530081\") " pod="openshift-console/console-54bf74458b-h2fdl" Jul 02 14:11:30.351431 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:30.351343 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bd06cd9b-afa2-4715-a796-b19a7f530081-oauth-serving-cert\") pod \"console-54bf74458b-h2fdl\" (UID: \"bd06cd9b-afa2-4715-a796-b19a7f530081\") " pod="openshift-console/console-54bf74458b-h2fdl" Jul 02 14:11:30.351431 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:30.351378 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qs8d\" (UniqueName: \"kubernetes.io/projected/bd06cd9b-afa2-4715-a796-b19a7f530081-kube-api-access-6qs8d\") pod \"console-54bf74458b-h2fdl\" (UID: \"bd06cd9b-afa2-4715-a796-b19a7f530081\") " pod="openshift-console/console-54bf74458b-h2fdl" Jul 02 14:11:30.351431 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:30.351406 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bd06cd9b-afa2-4715-a796-b19a7f530081-console-oauth-config\") pod \"console-54bf74458b-h2fdl\" (UID: \"bd06cd9b-afa2-4715-a796-b19a7f530081\") " pod="openshift-console/console-54bf74458b-h2fdl" Jul 02 14:11:30.351573 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:30.351474 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bd06cd9b-afa2-4715-a796-b19a7f530081-console-config\") pod \"console-54bf74458b-h2fdl\" (UID: \"bd06cd9b-afa2-4715-a796-b19a7f530081\") " pod="openshift-console/console-54bf74458b-h2fdl" Jul 02 14:11:30.351573 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:30.351525 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bd06cd9b-afa2-4715-a796-b19a7f530081-service-ca\") pod \"console-54bf74458b-h2fdl\" (UID: \"bd06cd9b-afa2-4715-a796-b19a7f530081\") " pod="openshift-console/console-54bf74458b-h2fdl" Jul 02 14:11:30.426764 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:30.426728 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:11:30.452139 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:30.452098 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd06cd9b-afa2-4715-a796-b19a7f530081-console-serving-cert\") pod \"console-54bf74458b-h2fdl\" (UID: \"bd06cd9b-afa2-4715-a796-b19a7f530081\") " pod="openshift-console/console-54bf74458b-h2fdl" Jul 02 14:11:30.452324 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:30.452159 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd06cd9b-afa2-4715-a796-b19a7f530081-trusted-ca-bundle\") pod \"console-54bf74458b-h2fdl\" (UID: \"bd06cd9b-afa2-4715-a796-b19a7f530081\") " pod="openshift-console/console-54bf74458b-h2fdl" Jul 02 14:11:30.452324 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:30.452195 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bd06cd9b-afa2-4715-a796-b19a7f530081-oauth-serving-cert\") pod \"console-54bf74458b-h2fdl\" (UID: \"bd06cd9b-afa2-4715-a796-b19a7f530081\") " pod="openshift-console/console-54bf74458b-h2fdl" Jul 02 14:11:30.452324 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:30.452217 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qs8d\" (UniqueName: \"kubernetes.io/projected/bd06cd9b-afa2-4715-a796-b19a7f530081-kube-api-access-6qs8d\") pod \"console-54bf74458b-h2fdl\" (UID: \"bd06cd9b-afa2-4715-a796-b19a7f530081\") " pod="openshift-console/console-54bf74458b-h2fdl" Jul 02 14:11:30.452324 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:30.452240 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bd06cd9b-afa2-4715-a796-b19a7f530081-console-oauth-config\") pod \"console-54bf74458b-h2fdl\" (UID: \"bd06cd9b-afa2-4715-a796-b19a7f530081\") " pod="openshift-console/console-54bf74458b-h2fdl" Jul 02 14:11:30.452324 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:30.452294 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bd06cd9b-afa2-4715-a796-b19a7f530081-console-config\") pod \"console-54bf74458b-h2fdl\" (UID: \"bd06cd9b-afa2-4715-a796-b19a7f530081\") " pod="openshift-console/console-54bf74458b-h2fdl" Jul 02 14:11:30.452558 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:30.452476 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bd06cd9b-afa2-4715-a796-b19a7f530081-service-ca\") pod \"console-54bf74458b-h2fdl\" (UID: \"bd06cd9b-afa2-4715-a796-b19a7f530081\") " pod="openshift-console/console-54bf74458b-h2fdl" Jul 02 14:11:30.453154 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:30.453126 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bd06cd9b-afa2-4715-a796-b19a7f530081-oauth-serving-cert\") pod \"console-54bf74458b-h2fdl\" (UID: \"bd06cd9b-afa2-4715-a796-b19a7f530081\") " pod="openshift-console/console-54bf74458b-h2fdl" Jul 02 14:11:30.453277 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:30.453136 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd06cd9b-afa2-4715-a796-b19a7f530081-trusted-ca-bundle\") pod \"console-54bf74458b-h2fdl\" (UID: \"bd06cd9b-afa2-4715-a796-b19a7f530081\") " pod="openshift-console/console-54bf74458b-h2fdl" Jul 02 14:11:30.453277 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:30.453192 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bd06cd9b-afa2-4715-a796-b19a7f530081-console-config\") pod \"console-54bf74458b-h2fdl\" (UID: \"bd06cd9b-afa2-4715-a796-b19a7f530081\") " pod="openshift-console/console-54bf74458b-h2fdl" Jul 02 14:11:30.453277 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:30.453218 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bd06cd9b-afa2-4715-a796-b19a7f530081-service-ca\") pod \"console-54bf74458b-h2fdl\" (UID: \"bd06cd9b-afa2-4715-a796-b19a7f530081\") " pod="openshift-console/console-54bf74458b-h2fdl" Jul 02 14:11:30.454739 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:30.454710 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd06cd9b-afa2-4715-a796-b19a7f530081-console-serving-cert\") pod \"console-54bf74458b-h2fdl\" (UID: \"bd06cd9b-afa2-4715-a796-b19a7f530081\") " pod="openshift-console/console-54bf74458b-h2fdl" Jul 02 14:11:30.454830 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:30.454742 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bd06cd9b-afa2-4715-a796-b19a7f530081-console-oauth-config\") pod \"console-54bf74458b-h2fdl\" (UID: \"bd06cd9b-afa2-4715-a796-b19a7f530081\") " pod="openshift-console/console-54bf74458b-h2fdl" Jul 02 14:11:30.465156 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:30.465128 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qs8d\" (UniqueName: \"kubernetes.io/projected/bd06cd9b-afa2-4715-a796-b19a7f530081-kube-api-access-6qs8d\") pod \"console-54bf74458b-h2fdl\" (UID: \"bd06cd9b-afa2-4715-a796-b19a7f530081\") " pod="openshift-console/console-54bf74458b-h2fdl" Jul 02 14:11:30.583692 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:30.583572 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54bf74458b-h2fdl" Jul 02 14:11:30.733821 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:30.733795 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54bf74458b-h2fdl"] Jul 02 14:11:30.736540 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:11:30.736512 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd06cd9b_afa2_4715_a796_b19a7f530081.slice/crio-7d97ea83c4810ab52606ebfaa85f6148e1b14968e1cc0c80a40975b65e4744c9 WatchSource:0}: Error finding container 7d97ea83c4810ab52606ebfaa85f6148e1b14968e1cc0c80a40975b65e4744c9: Status 404 returned error can't find the container with id 7d97ea83c4810ab52606ebfaa85f6148e1b14968e1cc0c80a40975b65e4744c9 Jul 02 14:11:31.512427 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:31.512389 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54bf74458b-h2fdl" event={"ID":"bd06cd9b-afa2-4715-a796-b19a7f530081","Type":"ContainerStarted","Data":"cd9680d9259b59bc2fa6cfe25e850efebc2f2e447cb09285a6c061613097f635"} Jul 02 14:11:31.512427 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:31.512444 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54bf74458b-h2fdl" event={"ID":"bd06cd9b-afa2-4715-a796-b19a7f530081","Type":"ContainerStarted","Data":"7d97ea83c4810ab52606ebfaa85f6148e1b14968e1cc0c80a40975b65e4744c9"} Jul 02 14:11:31.537400 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:31.537306 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-54bf74458b-h2fdl" podStartSLOduration=1.5372881409999999 podStartE2EDuration="1.537288141s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:11:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:11:31.536241819 +0000 UTC m=+622.744484603" watchObservedRunningTime="2026-07-02 14:11:31.537288141 +0000 UTC m=+622.745530939" Jul 02 14:11:32.986115 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:32.986075 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:11:33.093561 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:33.093522 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:11:33.197489 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:33.197456 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:11:34.410854 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:34.410824 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:11:37.014399 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:37.014316 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:11:38.373878 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:38.373845 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:11:40.422125 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:40.422088 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:11:40.534359 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:40.534312 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:11:40.584085 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:40.584052 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54bf74458b-h2fdl" Jul 02 14:11:40.584255 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:40.584101 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-54bf74458b-h2fdl" Jul 02 14:11:40.589018 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:40.588973 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-54bf74458b-h2fdl" Jul 02 14:11:41.570148 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:41.570113 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-54bf74458b-h2fdl" Jul 02 14:11:41.649297 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:41.649263 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57d644bdc9-fhdk7"] Jul 02 14:11:41.811828 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:41.811792 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:11:41.910872 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:41.910830 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:11:42.021284 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:42.021249 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:11:42.119461 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:42.119422 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:11:42.819794 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:42.819754 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:11:44.345122 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:44.345074 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:11:44.442509 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:44.442471 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:11:44.755218 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:44.755175 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:11:44.855923 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:44.855886 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:11:48.959016 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:48.958959 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:11:49.131410 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:49.131370 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:11:49.950324 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:49.950284 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:11:50.208245 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:50.208152 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:11:53.779813 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:53.779745 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:11:53.879314 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:53.879276 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:11:56.684535 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:56.684500 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:11:56.793499 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:11:56.793465 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:12:01.503226 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:01.503192 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:12:01.640512 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:01.640455 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:12:05.386385 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:05.386350 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:12:05.486676 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:05.486644 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:12:06.402197 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:06.402162 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:12:06.499675 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:06.499622 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:12:06.671921 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:06.671826 2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-57d644bdc9-fhdk7" podUID="03df0d30-b56c-49e8-99d6-ff0128814f4b" containerName="console" containerID="cri-o://4c328b5e15ed5c1249144f4a43b8cf97a94501bd4a11ba7241551d514ea8a088" gracePeriod=15 Jul 02 14:12:06.920106 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:06.920081 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57d644bdc9-fhdk7" Jul 02 14:12:07.078399 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:07.078318 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03df0d30-b56c-49e8-99d6-ff0128814f4b-trusted-ca-bundle\") pod \"03df0d30-b56c-49e8-99d6-ff0128814f4b\" (UID: \"03df0d30-b56c-49e8-99d6-ff0128814f4b\") " Jul 02 14:12:07.078399 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:07.078362 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03df0d30-b56c-49e8-99d6-ff0128814f4b-oauth-serving-cert\") pod \"03df0d30-b56c-49e8-99d6-ff0128814f4b\" (UID: \"03df0d30-b56c-49e8-99d6-ff0128814f4b\") " Jul 02 14:12:07.078399 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:07.078380 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03df0d30-b56c-49e8-99d6-ff0128814f4b-console-oauth-config\") pod \"03df0d30-b56c-49e8-99d6-ff0128814f4b\" (UID: \"03df0d30-b56c-49e8-99d6-ff0128814f4b\") " Jul 02 14:12:07.078687 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:07.078411 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2d2hm\" (UniqueName: \"kubernetes.io/projected/03df0d30-b56c-49e8-99d6-ff0128814f4b-kube-api-access-2d2hm\") pod \"03df0d30-b56c-49e8-99d6-ff0128814f4b\" (UID: \"03df0d30-b56c-49e8-99d6-ff0128814f4b\") " Jul 02 14:12:07.078687 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:07.078452 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03df0d30-b56c-49e8-99d6-ff0128814f4b-console-config\") pod \"03df0d30-b56c-49e8-99d6-ff0128814f4b\" (UID: \"03df0d30-b56c-49e8-99d6-ff0128814f4b\") " Jul 02 14:12:07.078687 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:07.078496 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03df0d30-b56c-49e8-99d6-ff0128814f4b-console-serving-cert\") pod \"03df0d30-b56c-49e8-99d6-ff0128814f4b\" (UID: \"03df0d30-b56c-49e8-99d6-ff0128814f4b\") " Jul 02 14:12:07.078687 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:07.078522 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03df0d30-b56c-49e8-99d6-ff0128814f4b-service-ca\") pod \"03df0d30-b56c-49e8-99d6-ff0128814f4b\" (UID: \"03df0d30-b56c-49e8-99d6-ff0128814f4b\") " Jul 02 14:12:07.078893 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:07.078772 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03df0d30-b56c-49e8-99d6-ff0128814f4b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "03df0d30-b56c-49e8-99d6-ff0128814f4b" (UID: "03df0d30-b56c-49e8-99d6-ff0128814f4b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 14:12:07.079046 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:07.078921 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03df0d30-b56c-49e8-99d6-ff0128814f4b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "03df0d30-b56c-49e8-99d6-ff0128814f4b" (UID: "03df0d30-b56c-49e8-99d6-ff0128814f4b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 14:12:07.079046 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:07.078945 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03df0d30-b56c-49e8-99d6-ff0128814f4b-service-ca" (OuterVolumeSpecName: "service-ca") pod "03df0d30-b56c-49e8-99d6-ff0128814f4b" (UID: "03df0d30-b56c-49e8-99d6-ff0128814f4b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 14:12:07.079150 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:07.079057 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03df0d30-b56c-49e8-99d6-ff0128814f4b-console-config" (OuterVolumeSpecName: "console-config") pod "03df0d30-b56c-49e8-99d6-ff0128814f4b" (UID: "03df0d30-b56c-49e8-99d6-ff0128814f4b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 14:12:07.080687 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:07.080661 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03df0d30-b56c-49e8-99d6-ff0128814f4b-kube-api-access-2d2hm" (OuterVolumeSpecName: "kube-api-access-2d2hm") pod "03df0d30-b56c-49e8-99d6-ff0128814f4b" (UID: "03df0d30-b56c-49e8-99d6-ff0128814f4b"). InnerVolumeSpecName "kube-api-access-2d2hm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 14:12:07.081131 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:07.081111 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03df0d30-b56c-49e8-99d6-ff0128814f4b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "03df0d30-b56c-49e8-99d6-ff0128814f4b" (UID: "03df0d30-b56c-49e8-99d6-ff0128814f4b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 14:12:07.081210 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:07.081141 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03df0d30-b56c-49e8-99d6-ff0128814f4b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "03df0d30-b56c-49e8-99d6-ff0128814f4b" (UID: "03df0d30-b56c-49e8-99d6-ff0128814f4b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 14:12:07.180204 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:07.180164 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2d2hm\" (UniqueName: \"kubernetes.io/projected/03df0d30-b56c-49e8-99d6-ff0128814f4b-kube-api-access-2d2hm\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:12:07.180204 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:07.180199 2553 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03df0d30-b56c-49e8-99d6-ff0128814f4b-console-config\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:12:07.180204 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:07.180210 2553 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03df0d30-b56c-49e8-99d6-ff0128814f4b-console-serving-cert\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:12:07.180457 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:07.180219 2553 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03df0d30-b56c-49e8-99d6-ff0128814f4b-service-ca\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:12:07.180457 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:07.180230 2553 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03df0d30-b56c-49e8-99d6-ff0128814f4b-trusted-ca-bundle\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:12:07.180457 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:07.180239 2553 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03df0d30-b56c-49e8-99d6-ff0128814f4b-oauth-serving-cert\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:12:07.180457 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:07.180247 2553 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03df0d30-b56c-49e8-99d6-ff0128814f4b-console-oauth-config\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:12:07.691434 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:07.691392 2553 generic.go:356] "Generic (PLEG): container finished" podID="03df0d30-b56c-49e8-99d6-ff0128814f4b" containerID="4c328b5e15ed5c1249144f4a43b8cf97a94501bd4a11ba7241551d514ea8a088" exitCode=0 Jul 02 14:12:07.691863 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:07.691457 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57d644bdc9-fhdk7" Jul 02 14:12:07.691863 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:07.691476 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57d644bdc9-fhdk7" event={"ID":"03df0d30-b56c-49e8-99d6-ff0128814f4b","Type":"ContainerDied","Data":"4c328b5e15ed5c1249144f4a43b8cf97a94501bd4a11ba7241551d514ea8a088"} Jul 02 14:12:07.691863 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:07.691533 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57d644bdc9-fhdk7" event={"ID":"03df0d30-b56c-49e8-99d6-ff0128814f4b","Type":"ContainerDied","Data":"a7b81ae9bc405a2bdb279fa1a7949a0028ac65636bb38ecf008c0e234f0dfec2"} Jul 02 14:12:07.691863 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:07.691555 2553 scope.go:117] "RemoveContainer" containerID="4c328b5e15ed5c1249144f4a43b8cf97a94501bd4a11ba7241551d514ea8a088" Jul 02 14:12:07.700371 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:07.700354 2553 scope.go:117] "RemoveContainer" containerID="4c328b5e15ed5c1249144f4a43b8cf97a94501bd4a11ba7241551d514ea8a088" Jul 02 14:12:07.700660 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:12:07.700641 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c328b5e15ed5c1249144f4a43b8cf97a94501bd4a11ba7241551d514ea8a088\": container with ID starting with 4c328b5e15ed5c1249144f4a43b8cf97a94501bd4a11ba7241551d514ea8a088 not found: ID does not exist" containerID="4c328b5e15ed5c1249144f4a43b8cf97a94501bd4a11ba7241551d514ea8a088" Jul 02 14:12:07.700727 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:07.700669 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c328b5e15ed5c1249144f4a43b8cf97a94501bd4a11ba7241551d514ea8a088"} err="failed to get container status \"4c328b5e15ed5c1249144f4a43b8cf97a94501bd4a11ba7241551d514ea8a088\": rpc error: code = NotFound desc = could not find container \"4c328b5e15ed5c1249144f4a43b8cf97a94501bd4a11ba7241551d514ea8a088\": container with ID starting with 4c328b5e15ed5c1249144f4a43b8cf97a94501bd4a11ba7241551d514ea8a088 not found: ID does not exist" Jul 02 14:12:07.713826 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:07.713793 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57d644bdc9-fhdk7"] Jul 02 14:12:07.722908 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:07.722879 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-57d644bdc9-fhdk7"] Jul 02 14:12:09.206827 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:09.206802 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03df0d30-b56c-49e8-99d6-ff0128814f4b" path="/var/lib/kubelet/pods/03df0d30-b56c-49e8-99d6-ff0128814f4b/volumes" Jul 02 14:12:09.560901 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:09.560813 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:12:09.669713 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:09.669678 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:12:15.645966 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:15.645929 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:12:15.749910 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:15.749869 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:12:20.429091 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:20.429056 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:12:20.534770 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:20.534734 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:12:24.811151 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:24.811101 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:12:34.942108 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:34.942073 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:12:46.454552 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:46.454514 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:12:46.714341 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:46.714256 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wqhxx"] Jul 02 14:12:46.714567 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:46.714555 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03df0d30-b56c-49e8-99d6-ff0128814f4b" containerName="console" Jul 02 14:12:46.714611 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:46.714568 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="03df0d30-b56c-49e8-99d6-ff0128814f4b" containerName="console" Jul 02 14:12:46.714650 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:46.714627 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="03df0d30-b56c-49e8-99d6-ff0128814f4b" containerName="console" Jul 02 14:12:46.717676 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:46.717659 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wqhxx" Jul 02 14:12:46.720686 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:46.720664 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 02 14:12:46.720835 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:46.720815 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gb8hw\"" Jul 02 14:12:46.720914 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:46.720895 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 02 14:12:46.730399 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:46.730374 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wqhxx"] Jul 02 14:12:46.824554 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:46.824516 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17e71f5d-42e5-4df7-aea7-5a141e486e12-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wqhxx\" (UID: \"17e71f5d-42e5-4df7-aea7-5a141e486e12\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wqhxx" Jul 02 14:12:46.824748 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:46.824572 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qght\" (UniqueName: \"kubernetes.io/projected/17e71f5d-42e5-4df7-aea7-5a141e486e12-kube-api-access-6qght\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wqhxx\" (UID: \"17e71f5d-42e5-4df7-aea7-5a141e486e12\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wqhxx" Jul 02 14:12:46.824748 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:46.824600 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17e71f5d-42e5-4df7-aea7-5a141e486e12-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wqhxx\" (UID: \"17e71f5d-42e5-4df7-aea7-5a141e486e12\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wqhxx" Jul 02 14:12:46.925872 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:46.925837 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qght\" (UniqueName: \"kubernetes.io/projected/17e71f5d-42e5-4df7-aea7-5a141e486e12-kube-api-access-6qght\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wqhxx\" (UID: \"17e71f5d-42e5-4df7-aea7-5a141e486e12\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wqhxx" Jul 02 14:12:46.926082 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:46.925883 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17e71f5d-42e5-4df7-aea7-5a141e486e12-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wqhxx\" (UID: \"17e71f5d-42e5-4df7-aea7-5a141e486e12\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wqhxx" Jul 02 14:12:46.926082 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:46.925935 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17e71f5d-42e5-4df7-aea7-5a141e486e12-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wqhxx\" (UID: \"17e71f5d-42e5-4df7-aea7-5a141e486e12\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wqhxx" Jul 02 14:12:46.926309 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:46.926290 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17e71f5d-42e5-4df7-aea7-5a141e486e12-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wqhxx\" (UID: \"17e71f5d-42e5-4df7-aea7-5a141e486e12\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wqhxx" Jul 02 14:12:46.926353 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:46.926317 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17e71f5d-42e5-4df7-aea7-5a141e486e12-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wqhxx\" (UID: \"17e71f5d-42e5-4df7-aea7-5a141e486e12\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wqhxx" Jul 02 14:12:46.934786 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:46.934759 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qght\" (UniqueName: \"kubernetes.io/projected/17e71f5d-42e5-4df7-aea7-5a141e486e12-kube-api-access-6qght\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wqhxx\" (UID: \"17e71f5d-42e5-4df7-aea7-5a141e486e12\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wqhxx" Jul 02 14:12:47.026979 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:47.026879 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wqhxx" Jul 02 14:12:47.178529 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:47.178502 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wqhxx"] Jul 02 14:12:47.180125 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:12:47.180097 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17e71f5d_42e5_4df7_aea7_5a141e486e12.slice/crio-0ad12a2b710a4060a74f6a8a595f27ce571186d10c11bbd5e8044fb0675d7ed4 WatchSource:0}: Error finding container 0ad12a2b710a4060a74f6a8a595f27ce571186d10c11bbd5e8044fb0675d7ed4: Status 404 returned error can't find the container with id 0ad12a2b710a4060a74f6a8a595f27ce571186d10c11bbd5e8044fb0675d7ed4 Jul 02 14:12:47.886454 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:47.886419 2553 generic.go:356] "Generic (PLEG): container finished" podID="17e71f5d-42e5-4df7-aea7-5a141e486e12" containerID="ab74ce4861b37a9797c546a19dc7a7f823793728370c5d07e9ea27ceae7e723a" exitCode=0 Jul 02 14:12:47.886947 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:47.886481 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wqhxx" event={"ID":"17e71f5d-42e5-4df7-aea7-5a141e486e12","Type":"ContainerDied","Data":"ab74ce4861b37a9797c546a19dc7a7f823793728370c5d07e9ea27ceae7e723a"} Jul 02 14:12:47.886947 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:47.886533 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wqhxx" event={"ID":"17e71f5d-42e5-4df7-aea7-5a141e486e12","Type":"ContainerStarted","Data":"0ad12a2b710a4060a74f6a8a595f27ce571186d10c11bbd5e8044fb0675d7ed4"} Jul 02 14:12:50.554623 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:50.554535 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:12:50.908975 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:50.908934 2553 generic.go:356] "Generic (PLEG): container finished" podID="17e71f5d-42e5-4df7-aea7-5a141e486e12" containerID="27b8f7c9433e2ce497dbe644d7e0daefbb516cc005e1c19f6519c4215e6911dd" exitCode=0 Jul 02 14:12:50.909172 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:50.909025 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wqhxx" event={"ID":"17e71f5d-42e5-4df7-aea7-5a141e486e12","Type":"ContainerDied","Data":"27b8f7c9433e2ce497dbe644d7e0daefbb516cc005e1c19f6519c4215e6911dd"} Jul 02 14:12:50.955976 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:50.955946 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:12:51.916535 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:51.916503 2553 generic.go:356] "Generic (PLEG): container finished" podID="17e71f5d-42e5-4df7-aea7-5a141e486e12" containerID="31de51e11297ec867b817ea50676fcdcb1a13a442639efc4642eeed1d6f59f12" exitCode=0 Jul 02 14:12:51.916935 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:51.916587 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wqhxx" event={"ID":"17e71f5d-42e5-4df7-aea7-5a141e486e12","Type":"ContainerDied","Data":"31de51e11297ec867b817ea50676fcdcb1a13a442639efc4642eeed1d6f59f12"} Jul 02 14:12:53.050630 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:53.050603 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wqhxx" Jul 02 14:12:53.178049 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:53.177925 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6qght\" (UniqueName: \"kubernetes.io/projected/17e71f5d-42e5-4df7-aea7-5a141e486e12-kube-api-access-6qght\") pod \"17e71f5d-42e5-4df7-aea7-5a141e486e12\" (UID: \"17e71f5d-42e5-4df7-aea7-5a141e486e12\") " Jul 02 14:12:53.178049 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:53.177965 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17e71f5d-42e5-4df7-aea7-5a141e486e12-util\") pod \"17e71f5d-42e5-4df7-aea7-5a141e486e12\" (UID: \"17e71f5d-42e5-4df7-aea7-5a141e486e12\") " Jul 02 14:12:53.178049 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:53.178029 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17e71f5d-42e5-4df7-aea7-5a141e486e12-bundle\") pod \"17e71f5d-42e5-4df7-aea7-5a141e486e12\" (UID: \"17e71f5d-42e5-4df7-aea7-5a141e486e12\") " Jul 02 14:12:53.178892 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:53.178861 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17e71f5d-42e5-4df7-aea7-5a141e486e12-bundle" (OuterVolumeSpecName: "bundle") pod "17e71f5d-42e5-4df7-aea7-5a141e486e12" (UID: "17e71f5d-42e5-4df7-aea7-5a141e486e12"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 14:12:53.180119 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:53.180095 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17e71f5d-42e5-4df7-aea7-5a141e486e12-kube-api-access-6qght" (OuterVolumeSpecName: "kube-api-access-6qght") pod "17e71f5d-42e5-4df7-aea7-5a141e486e12" (UID: "17e71f5d-42e5-4df7-aea7-5a141e486e12"). InnerVolumeSpecName "kube-api-access-6qght". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 14:12:53.183299 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:53.183275 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17e71f5d-42e5-4df7-aea7-5a141e486e12-util" (OuterVolumeSpecName: "util") pod "17e71f5d-42e5-4df7-aea7-5a141e486e12" (UID: "17e71f5d-42e5-4df7-aea7-5a141e486e12"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 14:12:53.279190 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:53.279150 2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17e71f5d-42e5-4df7-aea7-5a141e486e12-bundle\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:12:53.279190 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:53.279184 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6qght\" (UniqueName: \"kubernetes.io/projected/17e71f5d-42e5-4df7-aea7-5a141e486e12-kube-api-access-6qght\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:12:53.279190 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:53.279193 2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17e71f5d-42e5-4df7-aea7-5a141e486e12-util\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:12:53.413075 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:53.413040 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:12:53.416580 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:53.416550 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-97mds"] Jul 02 14:12:53.416916 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:53.416899 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17e71f5d-42e5-4df7-aea7-5a141e486e12" containerName="extract" Jul 02 14:12:53.417008 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:53.416918 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="17e71f5d-42e5-4df7-aea7-5a141e486e12" containerName="extract" Jul 02 14:12:53.417008 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:53.416931 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17e71f5d-42e5-4df7-aea7-5a141e486e12" containerName="pull" Jul 02 14:12:53.417008 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:53.416939 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="17e71f5d-42e5-4df7-aea7-5a141e486e12" containerName="pull" Jul 02 14:12:53.417008 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:53.416957 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17e71f5d-42e5-4df7-aea7-5a141e486e12" containerName="util" Jul 02 14:12:53.417008 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:53.416965 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="17e71f5d-42e5-4df7-aea7-5a141e486e12" containerName="util" Jul 02 14:12:53.417265 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:53.417060 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="17e71f5d-42e5-4df7-aea7-5a141e486e12" containerName="extract" Jul 02 14:12:53.420931 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:53.420911 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-97mds" Jul 02 14:12:53.423501 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:53.423475 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 02 14:12:53.423501 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:53.423493 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 02 14:12:53.423705 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:53.423527 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-9h5fg\"" Jul 02 14:12:53.423705 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:53.423478 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 02 14:12:53.429419 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:53.429397 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-97mds"] Jul 02 14:12:53.517463 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:53.517429 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-97mds"] Jul 02 14:12:53.524502 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:53.524475 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:12:53.581570 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:53.581532 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4h9w4\" (UniqueName: \"kubernetes.io/projected/23932512-d4cf-4ca7-bb00-77964177cc43-kube-api-access-4h9w4\") pod \"limitador-limitador-64c94fd64f-97mds\" (UID: \"23932512-d4cf-4ca7-bb00-77964177cc43\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-97mds" Jul 02 14:12:53.581749 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:53.581649 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/23932512-d4cf-4ca7-bb00-77964177cc43-config-file\") pod \"limitador-limitador-64c94fd64f-97mds\" (UID: \"23932512-d4cf-4ca7-bb00-77964177cc43\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-97mds" Jul 02 14:12:53.582756 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:53.582727 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:12:53.683572 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:53.682646 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/23932512-d4cf-4ca7-bb00-77964177cc43-config-file\") pod \"limitador-limitador-64c94fd64f-97mds\" (UID: \"23932512-d4cf-4ca7-bb00-77964177cc43\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-97mds" Jul 02 14:12:53.683866 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:53.683498 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/23932512-d4cf-4ca7-bb00-77964177cc43-config-file\") pod \"limitador-limitador-64c94fd64f-97mds\" (UID: \"23932512-d4cf-4ca7-bb00-77964177cc43\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-97mds" Jul 02 14:12:53.684049 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:53.683979 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4h9w4\" (UniqueName: \"kubernetes.io/projected/23932512-d4cf-4ca7-bb00-77964177cc43-kube-api-access-4h9w4\") pod \"limitador-limitador-64c94fd64f-97mds\" (UID: \"23932512-d4cf-4ca7-bb00-77964177cc43\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-97mds" Jul 02 14:12:53.692506 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:53.692479 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4h9w4\" (UniqueName: \"kubernetes.io/projected/23932512-d4cf-4ca7-bb00-77964177cc43-kube-api-access-4h9w4\") pod \"limitador-limitador-64c94fd64f-97mds\" (UID: \"23932512-d4cf-4ca7-bb00-77964177cc43\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-97mds" Jul 02 14:12:53.732199 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:53.732168 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-97mds" Jul 02 14:12:53.874135 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:53.874110 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-97mds"] Jul 02 14:12:53.876101 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:12:53.876067 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23932512_d4cf_4ca7_bb00_77964177cc43.slice/crio-89a01405e7cfb93968008a2e75484ef8ff2aeb39a57daf9b757d87e2eaaec453 WatchSource:0}: Error finding container 89a01405e7cfb93968008a2e75484ef8ff2aeb39a57daf9b757d87e2eaaec453: Status 404 returned error can't find the container with id 89a01405e7cfb93968008a2e75484ef8ff2aeb39a57daf9b757d87e2eaaec453 Jul 02 14:12:53.927951 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:53.927914 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wqhxx" event={"ID":"17e71f5d-42e5-4df7-aea7-5a141e486e12","Type":"ContainerDied","Data":"0ad12a2b710a4060a74f6a8a595f27ce571186d10c11bbd5e8044fb0675d7ed4"} Jul 02 14:12:53.927951 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:53.927931 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wqhxx" Jul 02 14:12:53.928173 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:53.927966 2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0ad12a2b710a4060a74f6a8a595f27ce571186d10c11bbd5e8044fb0675d7ed4" Jul 02 14:12:53.929285 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:53.929260 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-97mds" event={"ID":"23932512-d4cf-4ca7-bb00-77964177cc43","Type":"ContainerStarted","Data":"89a01405e7cfb93968008a2e75484ef8ff2aeb39a57daf9b757d87e2eaaec453"} Jul 02 14:12:54.259512 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:54.259477 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:12:54.359858 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:54.359818 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:12:56.949102 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:56.949060 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-97mds" event={"ID":"23932512-d4cf-4ca7-bb00-77964177cc43","Type":"ContainerStarted","Data":"aeaa639a6c59b26394dfe0a21a8be1c4b45b2d10fef90cef96d29b79e4c8faa7"} Jul 02 14:12:56.949487 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:56.949187 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-97mds" Jul 02 14:12:56.966441 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:56.966395 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-97mds" podStartSLOduration=0.992408248 podStartE2EDuration="3.966380998s" totalImagesPullingTime="2.97397275s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:12:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:12:56.965072171 +0000 UTC m=+708.173314954" watchObservedRunningTime="2026-07-02 14:12:56.966380998 +0000 UTC m=+708.174623824" Jul 02 14:12:58.491785 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:58.491738 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:12:58.708806 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:12:58.708774 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:13:04.859169 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:04.859065 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:13:04.953507 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:04.953468 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:13:06.404725 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:06.404687 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-crbdm"] Jul 02 14:13:06.405216 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:06.404933 2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-crbdm" podUID="754d81ad-3b07-4848-b4af-42c3718816d0" containerName="cert-manager-operator" containerID="cri-o://46ec34c439984e492a71dca53a9b943cd3d5d3ababbc6c212c3875a430bb2a30" gracePeriod=10 Jul 02 14:13:06.659258 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:06.659201 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-crbdm" Jul 02 14:13:06.685744 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:06.685718 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jstgj\" (UniqueName: \"kubernetes.io/projected/754d81ad-3b07-4848-b4af-42c3718816d0-kube-api-access-jstgj\") pod \"754d81ad-3b07-4848-b4af-42c3718816d0\" (UID: \"754d81ad-3b07-4848-b4af-42c3718816d0\") " Jul 02 14:13:06.685889 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:06.685755 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/754d81ad-3b07-4848-b4af-42c3718816d0-tmp\") pod \"754d81ad-3b07-4848-b4af-42c3718816d0\" (UID: \"754d81ad-3b07-4848-b4af-42c3718816d0\") " Jul 02 14:13:06.686191 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:06.686171 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/754d81ad-3b07-4848-b4af-42c3718816d0-tmp" (OuterVolumeSpecName: "tmp") pod "754d81ad-3b07-4848-b4af-42c3718816d0" (UID: "754d81ad-3b07-4848-b4af-42c3718816d0"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 14:13:06.687943 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:06.687922 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/754d81ad-3b07-4848-b4af-42c3718816d0-kube-api-access-jstgj" (OuterVolumeSpecName: "kube-api-access-jstgj") pod "754d81ad-3b07-4848-b4af-42c3718816d0" (UID: "754d81ad-3b07-4848-b4af-42c3718816d0"). InnerVolumeSpecName "kube-api-access-jstgj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 14:13:06.787005 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:06.786952 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jstgj\" (UniqueName: \"kubernetes.io/projected/754d81ad-3b07-4848-b4af-42c3718816d0-kube-api-access-jstgj\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:13:06.787005 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:06.787005 2553 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/754d81ad-3b07-4848-b4af-42c3718816d0-tmp\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:13:06.998827 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:06.998732 2553 generic.go:356] "Generic (PLEG): container finished" podID="754d81ad-3b07-4848-b4af-42c3718816d0" containerID="46ec34c439984e492a71dca53a9b943cd3d5d3ababbc6c212c3875a430bb2a30" exitCode=0 Jul 02 14:13:06.998827 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:06.998773 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-crbdm" Jul 02 14:13:06.998827 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:06.998815 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-crbdm" event={"ID":"754d81ad-3b07-4848-b4af-42c3718816d0","Type":"ContainerDied","Data":"46ec34c439984e492a71dca53a9b943cd3d5d3ababbc6c212c3875a430bb2a30"} Jul 02 14:13:06.999129 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:06.998854 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-crbdm" event={"ID":"754d81ad-3b07-4848-b4af-42c3718816d0","Type":"ContainerDied","Data":"632e69830ebf69bab18b903e6053dd7f425632f0f23ee6609edb32817880b5ba"} Jul 02 14:13:06.999129 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:06.998874 2553 scope.go:117] "RemoveContainer" containerID="46ec34c439984e492a71dca53a9b943cd3d5d3ababbc6c212c3875a430bb2a30" Jul 02 14:13:07.007903 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:07.007882 2553 scope.go:117] "RemoveContainer" containerID="46ec34c439984e492a71dca53a9b943cd3d5d3ababbc6c212c3875a430bb2a30" Jul 02 14:13:07.008190 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:13:07.008168 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46ec34c439984e492a71dca53a9b943cd3d5d3ababbc6c212c3875a430bb2a30\": container with ID starting with 46ec34c439984e492a71dca53a9b943cd3d5d3ababbc6c212c3875a430bb2a30 not found: ID does not exist" containerID="46ec34c439984e492a71dca53a9b943cd3d5d3ababbc6c212c3875a430bb2a30" Jul 02 14:13:07.008248 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:07.008200 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46ec34c439984e492a71dca53a9b943cd3d5d3ababbc6c212c3875a430bb2a30"} err="failed to get container status \"46ec34c439984e492a71dca53a9b943cd3d5d3ababbc6c212c3875a430bb2a30\": rpc error: code = NotFound desc = could not find container \"46ec34c439984e492a71dca53a9b943cd3d5d3ababbc6c212c3875a430bb2a30\": container with ID starting with 46ec34c439984e492a71dca53a9b943cd3d5d3ababbc6c212c3875a430bb2a30 not found: ID does not exist" Jul 02 14:13:07.027803 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:07.027777 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-crbdm"] Jul 02 14:13:07.034803 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:07.034776 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-crbdm"] Jul 02 14:13:07.206165 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:07.206132 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="754d81ad-3b07-4848-b4af-42c3718816d0" path="/var/lib/kubelet/pods/754d81ad-3b07-4848-b4af-42c3718816d0/volumes" Jul 02 14:13:07.955380 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:07.955351 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-97mds" Jul 02 14:13:10.275957 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:10.275920 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-97mds"] Jul 02 14:13:10.276417 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:10.276154 2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-97mds" podUID="23932512-d4cf-4ca7-bb00-77964177cc43" containerName="limitador" containerID="cri-o://aeaa639a6c59b26394dfe0a21a8be1c4b45b2d10fef90cef96d29b79e4c8faa7" gracePeriod=30 Jul 02 14:13:10.827889 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:10.827862 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-97mds" Jul 02 14:13:10.917918 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:10.917887 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4h9w4\" (UniqueName: \"kubernetes.io/projected/23932512-d4cf-4ca7-bb00-77964177cc43-kube-api-access-4h9w4\") pod \"23932512-d4cf-4ca7-bb00-77964177cc43\" (UID: \"23932512-d4cf-4ca7-bb00-77964177cc43\") " Jul 02 14:13:10.918144 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:10.917982 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/23932512-d4cf-4ca7-bb00-77964177cc43-config-file\") pod \"23932512-d4cf-4ca7-bb00-77964177cc43\" (UID: \"23932512-d4cf-4ca7-bb00-77964177cc43\") " Jul 02 14:13:10.918335 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:10.918306 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23932512-d4cf-4ca7-bb00-77964177cc43-config-file" (OuterVolumeSpecName: "config-file") pod "23932512-d4cf-4ca7-bb00-77964177cc43" (UID: "23932512-d4cf-4ca7-bb00-77964177cc43"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 14:13:10.920033 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:10.920010 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23932512-d4cf-4ca7-bb00-77964177cc43-kube-api-access-4h9w4" (OuterVolumeSpecName: "kube-api-access-4h9w4") pod "23932512-d4cf-4ca7-bb00-77964177cc43" (UID: "23932512-d4cf-4ca7-bb00-77964177cc43"). InnerVolumeSpecName "kube-api-access-4h9w4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 14:13:11.018712 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:11.018664 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4h9w4\" (UniqueName: \"kubernetes.io/projected/23932512-d4cf-4ca7-bb00-77964177cc43-kube-api-access-4h9w4\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:13:11.018712 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:11.018708 2553 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/23932512-d4cf-4ca7-bb00-77964177cc43-config-file\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:13:11.030194 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:11.030161 2553 generic.go:356] "Generic (PLEG): container finished" podID="23932512-d4cf-4ca7-bb00-77964177cc43" containerID="aeaa639a6c59b26394dfe0a21a8be1c4b45b2d10fef90cef96d29b79e4c8faa7" exitCode=0 Jul 02 14:13:11.030353 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:11.030208 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-97mds" Jul 02 14:13:11.030353 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:11.030248 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-97mds" event={"ID":"23932512-d4cf-4ca7-bb00-77964177cc43","Type":"ContainerDied","Data":"aeaa639a6c59b26394dfe0a21a8be1c4b45b2d10fef90cef96d29b79e4c8faa7"} Jul 02 14:13:11.030353 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:11.030303 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-97mds" event={"ID":"23932512-d4cf-4ca7-bb00-77964177cc43","Type":"ContainerDied","Data":"89a01405e7cfb93968008a2e75484ef8ff2aeb39a57daf9b757d87e2eaaec453"} Jul 02 14:13:11.030353 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:11.030331 2553 scope.go:117] "RemoveContainer" containerID="aeaa639a6c59b26394dfe0a21a8be1c4b45b2d10fef90cef96d29b79e4c8faa7" Jul 02 14:13:11.039054 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:11.039033 2553 scope.go:117] "RemoveContainer" containerID="aeaa639a6c59b26394dfe0a21a8be1c4b45b2d10fef90cef96d29b79e4c8faa7" Jul 02 14:13:11.039323 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:13:11.039303 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aeaa639a6c59b26394dfe0a21a8be1c4b45b2d10fef90cef96d29b79e4c8faa7\": container with ID starting with aeaa639a6c59b26394dfe0a21a8be1c4b45b2d10fef90cef96d29b79e4c8faa7 not found: ID does not exist" containerID="aeaa639a6c59b26394dfe0a21a8be1c4b45b2d10fef90cef96d29b79e4c8faa7" Jul 02 14:13:11.039372 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:11.039334 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aeaa639a6c59b26394dfe0a21a8be1c4b45b2d10fef90cef96d29b79e4c8faa7"} err="failed to get container status \"aeaa639a6c59b26394dfe0a21a8be1c4b45b2d10fef90cef96d29b79e4c8faa7\": rpc error: code = NotFound desc = could not find container \"aeaa639a6c59b26394dfe0a21a8be1c4b45b2d10fef90cef96d29b79e4c8faa7\": container with ID starting with aeaa639a6c59b26394dfe0a21a8be1c4b45b2d10fef90cef96d29b79e4c8faa7 not found: ID does not exist" Jul 02 14:13:11.053622 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:11.053595 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-97mds"] Jul 02 14:13:11.057176 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:11.057155 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-97mds"] Jul 02 14:13:11.207004 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:11.206889 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23932512-d4cf-4ca7-bb00-77964177cc43" path="/var/lib/kubelet/pods/23932512-d4cf-4ca7-bb00-77964177cc43/volumes" Jul 02 14:13:11.443586 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:11.443551 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:13:12.020624 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:12.020591 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:13:13.847727 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:13.847695 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-rqxfg"] Jul 02 14:13:13.848141 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:13.848004 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="754d81ad-3b07-4848-b4af-42c3718816d0" containerName="cert-manager-operator" Jul 02 14:13:13.848141 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:13.848019 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="754d81ad-3b07-4848-b4af-42c3718816d0" containerName="cert-manager-operator" Jul 02 14:13:13.848141 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:13.848033 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23932512-d4cf-4ca7-bb00-77964177cc43" containerName="limitador" Jul 02 14:13:13.848141 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:13.848040 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="23932512-d4cf-4ca7-bb00-77964177cc43" containerName="limitador" Jul 02 14:13:13.848141 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:13.848099 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="23932512-d4cf-4ca7-bb00-77964177cc43" containerName="limitador" Jul 02 14:13:13.848141 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:13.848107 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="754d81ad-3b07-4848-b4af-42c3718816d0" containerName="cert-manager-operator" Jul 02 14:13:13.852596 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:13.852572 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-rqxfg" Jul 02 14:13:13.855033 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:13.855010 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-89dcp\"" Jul 02 14:13:13.855172 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:13.855015 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jul 02 14:13:13.859408 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:13.859385 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-rqxfg"] Jul 02 14:13:13.880703 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:13.880676 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:13:13.944160 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:13.944129 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7fgc\" (UniqueName: \"kubernetes.io/projected/98f06008-77a6-4c8e-8499-83965334ae3a-kube-api-access-q7fgc\") pod \"postgres-69fb4594cf-rqxfg\" (UID: \"98f06008-77a6-4c8e-8499-83965334ae3a\") " pod="opendatahub/postgres-69fb4594cf-rqxfg" Jul 02 14:13:13.944314 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:13.944179 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/98f06008-77a6-4c8e-8499-83965334ae3a-data\") pod \"postgres-69fb4594cf-rqxfg\" (UID: \"98f06008-77a6-4c8e-8499-83965334ae3a\") " pod="opendatahub/postgres-69fb4594cf-rqxfg" Jul 02 14:13:14.044866 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:14.044829 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7fgc\" (UniqueName: \"kubernetes.io/projected/98f06008-77a6-4c8e-8499-83965334ae3a-kube-api-access-q7fgc\") pod \"postgres-69fb4594cf-rqxfg\" (UID: \"98f06008-77a6-4c8e-8499-83965334ae3a\") " pod="opendatahub/postgres-69fb4594cf-rqxfg" Jul 02 14:13:14.045098 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:14.044875 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/98f06008-77a6-4c8e-8499-83965334ae3a-data\") pod \"postgres-69fb4594cf-rqxfg\" (UID: \"98f06008-77a6-4c8e-8499-83965334ae3a\") " pod="opendatahub/postgres-69fb4594cf-rqxfg" Jul 02 14:13:14.045235 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:14.045217 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/98f06008-77a6-4c8e-8499-83965334ae3a-data\") pod \"postgres-69fb4594cf-rqxfg\" (UID: \"98f06008-77a6-4c8e-8499-83965334ae3a\") " pod="opendatahub/postgres-69fb4594cf-rqxfg" Jul 02 14:13:14.053466 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:14.053438 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7fgc\" (UniqueName: \"kubernetes.io/projected/98f06008-77a6-4c8e-8499-83965334ae3a-kube-api-access-q7fgc\") pod \"postgres-69fb4594cf-rqxfg\" (UID: \"98f06008-77a6-4c8e-8499-83965334ae3a\") " pod="opendatahub/postgres-69fb4594cf-rqxfg" Jul 02 14:13:14.163908 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:14.163879 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-rqxfg" Jul 02 14:13:14.297921 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:14.297895 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-rqxfg"] Jul 02 14:13:14.300055 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:13:14.300022 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98f06008_77a6_4c8e_8499_83965334ae3a.slice/crio-8bfa71ddbab7e4df92967c9212fd35c9b711051f9e62fa0aa12e6568af5c27c0 WatchSource:0}: Error finding container 8bfa71ddbab7e4df92967c9212fd35c9b711051f9e62fa0aa12e6568af5c27c0: Status 404 returned error can't find the container with id 8bfa71ddbab7e4df92967c9212fd35c9b711051f9e62fa0aa12e6568af5c27c0 Jul 02 14:13:15.057793 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:15.057757 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-rqxfg" event={"ID":"98f06008-77a6-4c8e-8499-83965334ae3a","Type":"ContainerStarted","Data":"8bfa71ddbab7e4df92967c9212fd35c9b711051f9e62fa0aa12e6568af5c27c0"} Jul 02 14:13:21.092070 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:21.092030 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-rqxfg" event={"ID":"98f06008-77a6-4c8e-8499-83965334ae3a","Type":"ContainerStarted","Data":"23e900b7432a1cd1bd92836502a56f3a6cd0a6d640dd777a469c4e1750c409cf"} Jul 02 14:13:21.092493 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:21.092212 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-rqxfg" Jul 02 14:13:21.110051 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:21.109975 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-rqxfg" podStartSLOduration=2.3347256659999998 podStartE2EDuration="8.109959897s" totalImagesPullingTime="5.775234231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:13:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:13:21.108035506 +0000 UTC m=+732.316278290" watchObservedRunningTime="2026-07-02 14:13:21.109959897 +0000 UTC m=+732.318202680" Jul 02 14:13:27.127591 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:27.127554 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-rqxfg" Jul 02 14:13:27.544137 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:27.544050 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:13:27.644125 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:27.644068 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:13:27.748530 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:27.748469 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:13:28.773312 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:28.773274 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c895dvb"] Jul 02 14:13:28.934257 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:28.934221 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c895dvb"] Jul 02 14:13:28.934410 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:28.934339 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c895dvb" Jul 02 14:13:28.937232 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:28.937211 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gb8hw\"" Jul 02 14:13:28.937232 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:28.937216 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 02 14:13:28.938082 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:28.938054 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 02 14:13:28.974852 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:28.974817 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cfc87750-a826-4521-ade9-f515b9927503-bundle\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c895dvb\" (UID: \"cfc87750-a826-4521-ade9-f515b9927503\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c895dvb" Jul 02 14:13:28.975056 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:28.974901 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cfc87750-a826-4521-ade9-f515b9927503-util\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c895dvb\" (UID: \"cfc87750-a826-4521-ade9-f515b9927503\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c895dvb" Jul 02 14:13:28.975056 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:28.974925 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxnsd\" (UniqueName: \"kubernetes.io/projected/cfc87750-a826-4521-ade9-f515b9927503-kube-api-access-vxnsd\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c895dvb\" (UID: \"cfc87750-a826-4521-ade9-f515b9927503\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c895dvb" Jul 02 14:13:29.076259 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:29.076177 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cfc87750-a826-4521-ade9-f515b9927503-util\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c895dvb\" (UID: \"cfc87750-a826-4521-ade9-f515b9927503\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c895dvb" Jul 02 14:13:29.076259 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:29.076217 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxnsd\" (UniqueName: \"kubernetes.io/projected/cfc87750-a826-4521-ade9-f515b9927503-kube-api-access-vxnsd\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c895dvb\" (UID: \"cfc87750-a826-4521-ade9-f515b9927503\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c895dvb" Jul 02 14:13:29.076259 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:29.076247 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cfc87750-a826-4521-ade9-f515b9927503-bundle\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c895dvb\" (UID: \"cfc87750-a826-4521-ade9-f515b9927503\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c895dvb" Jul 02 14:13:29.076570 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:29.076549 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cfc87750-a826-4521-ade9-f515b9927503-util\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c895dvb\" (UID: \"cfc87750-a826-4521-ade9-f515b9927503\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c895dvb" Jul 02 14:13:29.076631 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:29.076608 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cfc87750-a826-4521-ade9-f515b9927503-bundle\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c895dvb\" (UID: \"cfc87750-a826-4521-ade9-f515b9927503\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c895dvb" Jul 02 14:13:29.090531 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:29.090507 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxnsd\" (UniqueName: \"kubernetes.io/projected/cfc87750-a826-4521-ade9-f515b9927503-kube-api-access-vxnsd\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c895dvb\" (UID: \"cfc87750-a826-4521-ade9-f515b9927503\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c895dvb" Jul 02 14:13:29.243465 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:29.243430 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c895dvb" Jul 02 14:13:29.446743 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:29.446712 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c895dvb"] Jul 02 14:13:29.449117 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:13:29.449086 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfc87750_a826_4521_ade9_f515b9927503.slice/crio-620c2c7579de15cfc6cbb50db5212cda55fb4a0c1fc0e3c64027dbf5eef0d136 WatchSource:0}: Error finding container 620c2c7579de15cfc6cbb50db5212cda55fb4a0c1fc0e3c64027dbf5eef0d136: Status 404 returned error can't find the container with id 620c2c7579de15cfc6cbb50db5212cda55fb4a0c1fc0e3c64027dbf5eef0d136 Jul 02 14:13:30.136234 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:30.136194 2553 generic.go:356] "Generic (PLEG): container finished" podID="cfc87750-a826-4521-ade9-f515b9927503" containerID="518aad94648674ec0ad307430479f7f81c440da0c62dfdc8c5ef0922ca191e6b" exitCode=0 Jul 02 14:13:30.136631 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:30.136285 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c895dvb" event={"ID":"cfc87750-a826-4521-ade9-f515b9927503","Type":"ContainerDied","Data":"518aad94648674ec0ad307430479f7f81c440da0c62dfdc8c5ef0922ca191e6b"} Jul 02 14:13:30.136631 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:30.136346 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c895dvb" event={"ID":"cfc87750-a826-4521-ade9-f515b9927503","Type":"ContainerStarted","Data":"620c2c7579de15cfc6cbb50db5212cda55fb4a0c1fc0e3c64027dbf5eef0d136"} Jul 02 14:13:31.143075 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:31.143038 2553 generic.go:356] "Generic (PLEG): container finished" podID="cfc87750-a826-4521-ade9-f515b9927503" containerID="4a00a83020c15cecb492f11691d3c4bd9decd706a82ed07429612577f8117803" exitCode=0 Jul 02 14:13:31.143488 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:31.143116 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c895dvb" event={"ID":"cfc87750-a826-4521-ade9-f515b9927503","Type":"ContainerDied","Data":"4a00a83020c15cecb492f11691d3c4bd9decd706a82ed07429612577f8117803"} Jul 02 14:13:32.149913 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:32.149879 2553 generic.go:356] "Generic (PLEG): container finished" podID="cfc87750-a826-4521-ade9-f515b9927503" containerID="0fed91eb197e30faf73215de156e892a52449cacccab386e27dfb1e623c14492" exitCode=0 Jul 02 14:13:32.150369 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:32.149932 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c895dvb" event={"ID":"cfc87750-a826-4521-ade9-f515b9927503","Type":"ContainerDied","Data":"0fed91eb197e30faf73215de156e892a52449cacccab386e27dfb1e623c14492"} Jul 02 14:13:33.282754 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:33.282734 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c895dvb" Jul 02 14:13:33.410582 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:33.410495 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vxnsd\" (UniqueName: \"kubernetes.io/projected/cfc87750-a826-4521-ade9-f515b9927503-kube-api-access-vxnsd\") pod \"cfc87750-a826-4521-ade9-f515b9927503\" (UID: \"cfc87750-a826-4521-ade9-f515b9927503\") " Jul 02 14:13:33.410749 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:33.410586 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cfc87750-a826-4521-ade9-f515b9927503-bundle\") pod \"cfc87750-a826-4521-ade9-f515b9927503\" (UID: \"cfc87750-a826-4521-ade9-f515b9927503\") " Jul 02 14:13:33.410749 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:33.410706 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cfc87750-a826-4521-ade9-f515b9927503-util\") pod \"cfc87750-a826-4521-ade9-f515b9927503\" (UID: \"cfc87750-a826-4521-ade9-f515b9927503\") " Jul 02 14:13:33.411126 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:33.411101 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfc87750-a826-4521-ade9-f515b9927503-bundle" (OuterVolumeSpecName: "bundle") pod "cfc87750-a826-4521-ade9-f515b9927503" (UID: "cfc87750-a826-4521-ade9-f515b9927503"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 14:13:33.412610 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:33.412578 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfc87750-a826-4521-ade9-f515b9927503-kube-api-access-vxnsd" (OuterVolumeSpecName: "kube-api-access-vxnsd") pod "cfc87750-a826-4521-ade9-f515b9927503" (UID: "cfc87750-a826-4521-ade9-f515b9927503"). InnerVolumeSpecName "kube-api-access-vxnsd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 14:13:33.416190 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:33.416170 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfc87750-a826-4521-ade9-f515b9927503-util" (OuterVolumeSpecName: "util") pod "cfc87750-a826-4521-ade9-f515b9927503" (UID: "cfc87750-a826-4521-ade9-f515b9927503"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 14:13:33.511712 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:33.511659 2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cfc87750-a826-4521-ade9-f515b9927503-bundle\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:13:33.511712 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:33.511704 2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cfc87750-a826-4521-ade9-f515b9927503-util\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:13:33.511712 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:33.511714 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vxnsd\" (UniqueName: \"kubernetes.io/projected/cfc87750-a826-4521-ade9-f515b9927503-kube-api-access-vxnsd\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:13:34.161918 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:34.161886 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c895dvb" Jul 02 14:13:34.161918 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:34.161904 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c895dvb" event={"ID":"cfc87750-a826-4521-ade9-f515b9927503","Type":"ContainerDied","Data":"620c2c7579de15cfc6cbb50db5212cda55fb4a0c1fc0e3c64027dbf5eef0d136"} Jul 02 14:13:34.162152 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:34.161974 2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="620c2c7579de15cfc6cbb50db5212cda55fb4a0c1fc0e3c64027dbf5eef0d136" Jul 02 14:13:36.617364 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:36.617328 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d8b9d7b4d-mw9bg"] Jul 02 14:13:36.617744 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:36.617619 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfc87750-a826-4521-ade9-f515b9927503" containerName="pull" Jul 02 14:13:36.617744 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:36.617630 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfc87750-a826-4521-ade9-f515b9927503" containerName="pull" Jul 02 14:13:36.617744 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:36.617650 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfc87750-a826-4521-ade9-f515b9927503" containerName="extract" Jul 02 14:13:36.617744 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:36.617656 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfc87750-a826-4521-ade9-f515b9927503" containerName="extract" Jul 02 14:13:36.617744 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:36.617666 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfc87750-a826-4521-ade9-f515b9927503" containerName="util" Jul 02 14:13:36.617744 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:36.617671 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfc87750-a826-4521-ade9-f515b9927503" containerName="util" Jul 02 14:13:36.617744 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:36.617726 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfc87750-a826-4521-ade9-f515b9927503" containerName="extract" Jul 02 14:13:36.619642 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:36.619627 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d8b9d7b4d-mw9bg" Jul 02 14:13:36.622105 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:36.622078 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jul 02 14:13:36.622105 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:36.622080 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-phqhj\"" Jul 02 14:13:36.622997 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:36.622970 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jul 02 14:13:36.629309 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:36.629288 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d8b9d7b4d-mw9bg"] Jul 02 14:13:36.741515 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:36.741473 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2s9qp\" (UniqueName: \"kubernetes.io/projected/54297815-83cf-4005-9b89-9599ebed2c6c-kube-api-access-2s9qp\") pod \"keycloak-operator-d8b9d7b4d-mw9bg\" (UID: \"54297815-83cf-4005-9b89-9599ebed2c6c\") " pod="keycloak-system/keycloak-operator-d8b9d7b4d-mw9bg" Jul 02 14:13:36.842949 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:36.842897 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2s9qp\" (UniqueName: \"kubernetes.io/projected/54297815-83cf-4005-9b89-9599ebed2c6c-kube-api-access-2s9qp\") pod \"keycloak-operator-d8b9d7b4d-mw9bg\" (UID: \"54297815-83cf-4005-9b89-9599ebed2c6c\") " pod="keycloak-system/keycloak-operator-d8b9d7b4d-mw9bg" Jul 02 14:13:36.851197 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:36.851174 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2s9qp\" (UniqueName: \"kubernetes.io/projected/54297815-83cf-4005-9b89-9599ebed2c6c-kube-api-access-2s9qp\") pod \"keycloak-operator-d8b9d7b4d-mw9bg\" (UID: \"54297815-83cf-4005-9b89-9599ebed2c6c\") " pod="keycloak-system/keycloak-operator-d8b9d7b4d-mw9bg" Jul 02 14:13:36.930751 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:36.930650 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d8b9d7b4d-mw9bg" Jul 02 14:13:37.063397 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:37.063369 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d8b9d7b4d-mw9bg"] Jul 02 14:13:37.065246 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:13:37.065222 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54297815_83cf_4005_9b89_9599ebed2c6c.slice/crio-860e17835f1cd79e705bdd3607cf8b3e50d006712f3d2e7848bac9a4db34ce85 WatchSource:0}: Error finding container 860e17835f1cd79e705bdd3607cf8b3e50d006712f3d2e7848bac9a4db34ce85: Status 404 returned error can't find the container with id 860e17835f1cd79e705bdd3607cf8b3e50d006712f3d2e7848bac9a4db34ce85 Jul 02 14:13:37.178003 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:37.177964 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d8b9d7b4d-mw9bg" event={"ID":"54297815-83cf-4005-9b89-9599ebed2c6c","Type":"ContainerStarted","Data":"860e17835f1cd79e705bdd3607cf8b3e50d006712f3d2e7848bac9a4db34ce85"} Jul 02 14:13:44.220492 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:44.220453 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d8b9d7b4d-mw9bg" event={"ID":"54297815-83cf-4005-9b89-9599ebed2c6c","Type":"ContainerStarted","Data":"ab96a053544e71fa9782de88d2aa4ce7d3866f0ccf178a27392e130ebf262139"} Jul 02 14:13:44.237285 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:44.237235 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d8b9d7b4d-mw9bg" podStartSLOduration=2.112876056 podStartE2EDuration="8.237219434s" totalImagesPullingTime="6.124343378s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:13:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:13:44.235595621 +0000 UTC m=+755.443838407" watchObservedRunningTime="2026-07-02 14:13:44.237219434 +0000 UTC m=+755.445462216" Jul 02 14:13:45.340731 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:45.340685 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:13:45.419347 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:45.419313 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:13:46.725170 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:46.725105 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:13:47.908391 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:47.908355 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:13:49.612145 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:49.612108 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["cert-manager/cert-manager-59c77684cc-2kckz"] Jul 02 14:13:49.612551 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:49.612285 2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="cert-manager/cert-manager-59c77684cc-2kckz" podUID="8a05ab47-4939-4adc-85e0-2ec03b7fe16c" containerName="cert-manager-controller" containerID="cri-o://15b54f709822cdecc469c6c6440fb44df44dd660392176aa1322d600b202866a" gracePeriod=30 Jul 02 14:13:49.865563 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:49.865534 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-2kckz" Jul 02 14:13:49.960823 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:49.960786 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9kb8v\" (UniqueName: \"kubernetes.io/projected/8a05ab47-4939-4adc-85e0-2ec03b7fe16c-kube-api-access-9kb8v\") pod \"8a05ab47-4939-4adc-85e0-2ec03b7fe16c\" (UID: \"8a05ab47-4939-4adc-85e0-2ec03b7fe16c\") " Jul 02 14:13:49.961062 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:49.960896 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8a05ab47-4939-4adc-85e0-2ec03b7fe16c-bound-sa-token\") pod \"8a05ab47-4939-4adc-85e0-2ec03b7fe16c\" (UID: \"8a05ab47-4939-4adc-85e0-2ec03b7fe16c\") " Jul 02 14:13:49.963118 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:49.963091 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a05ab47-4939-4adc-85e0-2ec03b7fe16c-kube-api-access-9kb8v" (OuterVolumeSpecName: "kube-api-access-9kb8v") pod "8a05ab47-4939-4adc-85e0-2ec03b7fe16c" (UID: "8a05ab47-4939-4adc-85e0-2ec03b7fe16c"). InnerVolumeSpecName "kube-api-access-9kb8v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 14:13:49.963118 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:49.963105 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a05ab47-4939-4adc-85e0-2ec03b7fe16c-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "8a05ab47-4939-4adc-85e0-2ec03b7fe16c" (UID: "8a05ab47-4939-4adc-85e0-2ec03b7fe16c"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 14:13:50.061826 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:50.061790 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9kb8v\" (UniqueName: \"kubernetes.io/projected/8a05ab47-4939-4adc-85e0-2ec03b7fe16c-kube-api-access-9kb8v\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:13:50.061826 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:50.061820 2553 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8a05ab47-4939-4adc-85e0-2ec03b7fe16c-bound-sa-token\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:13:50.249843 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:50.249743 2553 generic.go:356] "Generic (PLEG): container finished" podID="8a05ab47-4939-4adc-85e0-2ec03b7fe16c" containerID="15b54f709822cdecc469c6c6440fb44df44dd660392176aa1322d600b202866a" exitCode=0 Jul 02 14:13:50.249843 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:50.249792 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-2kckz" Jul 02 14:13:50.249843 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:50.249835 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-2kckz" event={"ID":"8a05ab47-4939-4adc-85e0-2ec03b7fe16c","Type":"ContainerDied","Data":"15b54f709822cdecc469c6c6440fb44df44dd660392176aa1322d600b202866a"} Jul 02 14:13:50.250138 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:50.249880 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-2kckz" event={"ID":"8a05ab47-4939-4adc-85e0-2ec03b7fe16c","Type":"ContainerDied","Data":"b80372f6f2e06aa55a949d6e60b9e1781a7234f0ece57f49625519495fbd64e3"} Jul 02 14:13:50.250138 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:50.249900 2553 scope.go:117] "RemoveContainer" containerID="15b54f709822cdecc469c6c6440fb44df44dd660392176aa1322d600b202866a" Jul 02 14:13:50.265338 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:50.265318 2553 scope.go:117] "RemoveContainer" containerID="15b54f709822cdecc469c6c6440fb44df44dd660392176aa1322d600b202866a" Jul 02 14:13:50.265652 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:13:50.265624 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15b54f709822cdecc469c6c6440fb44df44dd660392176aa1322d600b202866a\": container with ID starting with 15b54f709822cdecc469c6c6440fb44df44dd660392176aa1322d600b202866a not found: ID does not exist" containerID="15b54f709822cdecc469c6c6440fb44df44dd660392176aa1322d600b202866a" Jul 02 14:13:50.265713 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:50.265665 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15b54f709822cdecc469c6c6440fb44df44dd660392176aa1322d600b202866a"} err="failed to get container status \"15b54f709822cdecc469c6c6440fb44df44dd660392176aa1322d600b202866a\": rpc error: code = NotFound desc = could not find container \"15b54f709822cdecc469c6c6440fb44df44dd660392176aa1322d600b202866a\": container with ID starting with 15b54f709822cdecc469c6c6440fb44df44dd660392176aa1322d600b202866a not found: ID does not exist" Jul 02 14:13:50.279001 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:50.278961 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["cert-manager/cert-manager-59c77684cc-2kckz"] Jul 02 14:13:50.284126 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:50.284093 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["cert-manager/cert-manager-59c77684cc-2kckz"] Jul 02 14:13:51.207042 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:51.207011 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a05ab47-4939-4adc-85e0-2ec03b7fe16c" path="/var/lib/kubelet/pods/8a05ab47-4939-4adc-85e0-2ec03b7fe16c/volumes" Jul 02 14:13:52.433329 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:52.433274 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:13:52.533809 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:52.533776 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:13:56.334288 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:13:56.334254 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:14:23.930098 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:14:23.930062 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:14:25.201878 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:14:25.201838 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:14:30.480922 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:14:30.480887 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:14:30.493606 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:14:30.493570 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6d8588479b-kbnpv"] Jul 02 14:14:30.493896 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:14:30.493883 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a05ab47-4939-4adc-85e0-2ec03b7fe16c" containerName="cert-manager-controller" Jul 02 14:14:30.493947 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:14:30.493897 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a05ab47-4939-4adc-85e0-2ec03b7fe16c" containerName="cert-manager-controller" Jul 02 14:14:30.493997 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:14:30.493953 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a05ab47-4939-4adc-85e0-2ec03b7fe16c" containerName="cert-manager-controller" Jul 02 14:14:30.501791 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:14:30.501765 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d8588479b-kbnpv" Jul 02 14:14:30.510748 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:14:30.510720 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 02 14:14:30.513011 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:14:30.512978 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-kkg5v\"" Jul 02 14:14:30.513091 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:14:30.512978 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 02 14:14:30.522016 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:14:30.521971 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6d8588479b-kbnpv"] Jul 02 14:14:30.612532 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:14:30.612450 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:14:30.612705 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:14:30.612650 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2cn9\" (UniqueName: \"kubernetes.io/projected/5efb8abc-ca9a-4e6c-ab33-e1f6ede1e44c-kube-api-access-z2cn9\") pod \"maas-controller-6d8588479b-kbnpv\" (UID: \"5efb8abc-ca9a-4e6c-ab33-e1f6ede1e44c\") " pod="opendatahub/maas-controller-6d8588479b-kbnpv" Jul 02 14:14:30.612753 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:14:30.612707 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5efb8abc-ca9a-4e6c-ab33-e1f6ede1e44c-webhook-cert\") pod \"maas-controller-6d8588479b-kbnpv\" (UID: \"5efb8abc-ca9a-4e6c-ab33-e1f6ede1e44c\") " pod="opendatahub/maas-controller-6d8588479b-kbnpv" Jul 02 14:14:30.713450 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:14:30.713407 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2cn9\" (UniqueName: \"kubernetes.io/projected/5efb8abc-ca9a-4e6c-ab33-e1f6ede1e44c-kube-api-access-z2cn9\") pod \"maas-controller-6d8588479b-kbnpv\" (UID: \"5efb8abc-ca9a-4e6c-ab33-e1f6ede1e44c\") " pod="opendatahub/maas-controller-6d8588479b-kbnpv" Jul 02 14:14:30.713450 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:14:30.713456 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5efb8abc-ca9a-4e6c-ab33-e1f6ede1e44c-webhook-cert\") pod \"maas-controller-6d8588479b-kbnpv\" (UID: \"5efb8abc-ca9a-4e6c-ab33-e1f6ede1e44c\") " pod="opendatahub/maas-controller-6d8588479b-kbnpv" Jul 02 14:14:30.713672 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:14:30.713593 2553 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 02 14:14:30.713672 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:14:30.713657 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5efb8abc-ca9a-4e6c-ab33-e1f6ede1e44c-webhook-cert podName:5efb8abc-ca9a-4e6c-ab33-e1f6ede1e44c nodeName:}" failed. No retries permitted until 2026-07-02 14:14:31.213640209 +0000 UTC m=+802.421882970 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/5efb8abc-ca9a-4e6c-ab33-e1f6ede1e44c-webhook-cert") pod "maas-controller-6d8588479b-kbnpv" (UID: "5efb8abc-ca9a-4e6c-ab33-e1f6ede1e44c") : secret "maas-controller-webhook-cert" not found Jul 02 14:14:30.759483 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:14:30.759395 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2cn9\" (UniqueName: \"kubernetes.io/projected/5efb8abc-ca9a-4e6c-ab33-e1f6ede1e44c-kube-api-access-z2cn9\") pod \"maas-controller-6d8588479b-kbnpv\" (UID: \"5efb8abc-ca9a-4e6c-ab33-e1f6ede1e44c\") " pod="opendatahub/maas-controller-6d8588479b-kbnpv" Jul 02 14:14:30.806937 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:14:30.806900 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:14:31.045214 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:14:31.045126 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:14:31.218295 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:14:31.218265 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5efb8abc-ca9a-4e6c-ab33-e1f6ede1e44c-webhook-cert\") pod \"maas-controller-6d8588479b-kbnpv\" (UID: \"5efb8abc-ca9a-4e6c-ab33-e1f6ede1e44c\") " pod="opendatahub/maas-controller-6d8588479b-kbnpv" Jul 02 14:14:31.220628 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:14:31.220606 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5efb8abc-ca9a-4e6c-ab33-e1f6ede1e44c-webhook-cert\") pod \"maas-controller-6d8588479b-kbnpv\" (UID: \"5efb8abc-ca9a-4e6c-ab33-e1f6ede1e44c\") " pod="opendatahub/maas-controller-6d8588479b-kbnpv" Jul 02 14:14:31.411954 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:14:31.411919 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d8588479b-kbnpv" Jul 02 14:14:31.558836 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:14:31.558767 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6d8588479b-kbnpv"] Jul 02 14:14:31.561572 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:14:31.561541 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5efb8abc_ca9a_4e6c_ab33_e1f6ede1e44c.slice/crio-581c63d9e7b3b0b89aeef4c00bac3910fb52a72759c1e2e3572c4ec42364ce77 WatchSource:0}: Error finding container 581c63d9e7b3b0b89aeef4c00bac3910fb52a72759c1e2e3572c4ec42364ce77: Status 404 returned error can't find the container with id 581c63d9e7b3b0b89aeef4c00bac3910fb52a72759c1e2e3572c4ec42364ce77 Jul 02 14:14:32.466016 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:14:32.465881 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d8588479b-kbnpv" event={"ID":"5efb8abc-ca9a-4e6c-ab33-e1f6ede1e44c","Type":"ContainerStarted","Data":"581c63d9e7b3b0b89aeef4c00bac3910fb52a72759c1e2e3572c4ec42364ce77"} Jul 02 14:14:34.084220 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:14:34.084127 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:14:34.382836 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:14:34.382803 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:14:34.477415 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:14:34.477378 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d8588479b-kbnpv" event={"ID":"5efb8abc-ca9a-4e6c-ab33-e1f6ede1e44c","Type":"ContainerStarted","Data":"ddfb17f76391a3ad645b3aa20f9f0258052ef6c3ec1fae1ab3e2c047b2d77e88"} Jul 02 14:14:34.477599 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:14:34.477483 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6d8588479b-kbnpv" Jul 02 14:14:34.522520 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:14:34.522465 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6d8588479b-kbnpv" podStartSLOduration=2.252045528 podStartE2EDuration="4.522451138s" totalImagesPullingTime="2.27040561s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:14:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:14:34.520717239 +0000 UTC m=+805.728960024" watchObservedRunningTime="2026-07-02 14:14:34.522451138 +0000 UTC m=+805.730693948" Jul 02 14:14:45.488501 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:14:45.488467 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6d8588479b-kbnpv" Jul 02 14:14:45.923370 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:14:45.923329 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6d8588479b-kbnpv"] Jul 02 14:14:45.923616 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:14:45.923589 2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-6d8588479b-kbnpv" podUID="5efb8abc-ca9a-4e6c-ab33-e1f6ede1e44c" containerName="manager" containerID="cri-o://ddfb17f76391a3ad645b3aa20f9f0258052ef6c3ec1fae1ab3e2c047b2d77e88" gracePeriod=30 Jul 02 14:14:46.167572 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:14:46.167542 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d8588479b-kbnpv" Jul 02 14:14:46.353418 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:14:46.353319 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z2cn9\" (UniqueName: \"kubernetes.io/projected/5efb8abc-ca9a-4e6c-ab33-e1f6ede1e44c-kube-api-access-z2cn9\") pod \"5efb8abc-ca9a-4e6c-ab33-e1f6ede1e44c\" (UID: \"5efb8abc-ca9a-4e6c-ab33-e1f6ede1e44c\") " Jul 02 14:14:46.353601 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:14:46.353452 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5efb8abc-ca9a-4e6c-ab33-e1f6ede1e44c-webhook-cert\") pod \"5efb8abc-ca9a-4e6c-ab33-e1f6ede1e44c\" (UID: \"5efb8abc-ca9a-4e6c-ab33-e1f6ede1e44c\") " Jul 02 14:14:46.355663 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:14:46.355641 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5efb8abc-ca9a-4e6c-ab33-e1f6ede1e44c-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "5efb8abc-ca9a-4e6c-ab33-e1f6ede1e44c" (UID: "5efb8abc-ca9a-4e6c-ab33-e1f6ede1e44c"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 14:14:46.355732 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:14:46.355714 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5efb8abc-ca9a-4e6c-ab33-e1f6ede1e44c-kube-api-access-z2cn9" (OuterVolumeSpecName: "kube-api-access-z2cn9") pod "5efb8abc-ca9a-4e6c-ab33-e1f6ede1e44c" (UID: "5efb8abc-ca9a-4e6c-ab33-e1f6ede1e44c"). InnerVolumeSpecName "kube-api-access-z2cn9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 14:14:46.454326 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:14:46.454288 2553 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5efb8abc-ca9a-4e6c-ab33-e1f6ede1e44c-webhook-cert\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:14:46.454326 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:14:46.454319 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z2cn9\" (UniqueName: \"kubernetes.io/projected/5efb8abc-ca9a-4e6c-ab33-e1f6ede1e44c-kube-api-access-z2cn9\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\"" Jul 02 14:14:46.534582 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:14:46.534548 2553 generic.go:356] "Generic (PLEG): container finished" podID="5efb8abc-ca9a-4e6c-ab33-e1f6ede1e44c" containerID="ddfb17f76391a3ad645b3aa20f9f0258052ef6c3ec1fae1ab3e2c047b2d77e88" exitCode=0 Jul 02 14:14:46.534974 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:14:46.534606 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d8588479b-kbnpv" Jul 02 14:14:46.534974 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:14:46.534613 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d8588479b-kbnpv" event={"ID":"5efb8abc-ca9a-4e6c-ab33-e1f6ede1e44c","Type":"ContainerDied","Data":"ddfb17f76391a3ad645b3aa20f9f0258052ef6c3ec1fae1ab3e2c047b2d77e88"} Jul 02 14:14:46.534974 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:14:46.534657 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d8588479b-kbnpv" event={"ID":"5efb8abc-ca9a-4e6c-ab33-e1f6ede1e44c","Type":"ContainerDied","Data":"581c63d9e7b3b0b89aeef4c00bac3910fb52a72759c1e2e3572c4ec42364ce77"} Jul 02 14:14:46.534974 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:14:46.534679 2553 scope.go:117] "RemoveContainer" containerID="ddfb17f76391a3ad645b3aa20f9f0258052ef6c3ec1fae1ab3e2c047b2d77e88" Jul 02 14:14:46.543584 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:14:46.543565 2553 scope.go:117] "RemoveContainer" containerID="ddfb17f76391a3ad645b3aa20f9f0258052ef6c3ec1fae1ab3e2c047b2d77e88" Jul 02 14:14:46.543831 ip-10-0-133-57 kubenswrapper[2553]: E0702 14:14:46.543812 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ddfb17f76391a3ad645b3aa20f9f0258052ef6c3ec1fae1ab3e2c047b2d77e88\": container with ID starting with ddfb17f76391a3ad645b3aa20f9f0258052ef6c3ec1fae1ab3e2c047b2d77e88 not found: ID does not exist" containerID="ddfb17f76391a3ad645b3aa20f9f0258052ef6c3ec1fae1ab3e2c047b2d77e88" Jul 02 14:14:46.543869 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:14:46.543842 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddfb17f76391a3ad645b3aa20f9f0258052ef6c3ec1fae1ab3e2c047b2d77e88"} err="failed to get container status \"ddfb17f76391a3ad645b3aa20f9f0258052ef6c3ec1fae1ab3e2c047b2d77e88\": rpc error: code = NotFound desc = could not find container \"ddfb17f76391a3ad645b3aa20f9f0258052ef6c3ec1fae1ab3e2c047b2d77e88\": container with ID starting with ddfb17f76391a3ad645b3aa20f9f0258052ef6c3ec1fae1ab3e2c047b2d77e88 not found: ID does not exist" Jul 02 14:14:46.559962 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:14:46.559933 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6d8588479b-kbnpv"] Jul 02 14:14:46.568156 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:14:46.568133 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6d8588479b-kbnpv"] Jul 02 14:14:47.206635 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:14:47.206603 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5efb8abc-ca9a-4e6c-ab33-e1f6ede1e44c" path="/var/lib/kubelet/pods/5efb8abc-ca9a-4e6c-ab33-e1f6ede1e44c/volumes" Jul 02 14:15:05.482605 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:15:05.482567 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:15:05.957232 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:15:05.957178 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:15:06.042807 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:15:06.042766 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-67b8d69c9f-47wlt"] Jul 02 14:15:06.043099 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:15:06.043086 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5efb8abc-ca9a-4e6c-ab33-e1f6ede1e44c" containerName="manager" Jul 02 14:15:06.043172 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:15:06.043102 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="5efb8abc-ca9a-4e6c-ab33-e1f6ede1e44c" containerName="manager" Jul 02 14:15:06.043218 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:15:06.043175 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="5efb8abc-ca9a-4e6c-ab33-e1f6ede1e44c" containerName="manager" Jul 02 14:15:06.047269 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:15:06.047249 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-67b8d69c9f-47wlt" Jul 02 14:15:06.050574 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:15:06.050555 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jul 02 14:15:06.051112 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:15:06.051095 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-zs26d\"" Jul 02 14:15:06.061202 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:15:06.061169 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-67b8d69c9f-47wlt"] Jul 02 14:15:06.109331 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:15:06.109287 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5755a14-9a6e-4a59-b546-83d6c7c729c0-maas-api-tls\") pod \"maas-api-67b8d69c9f-47wlt\" (UID: \"d5755a14-9a6e-4a59-b546-83d6c7c729c0\") " pod="opendatahub/maas-api-67b8d69c9f-47wlt" Jul 02 14:15:06.109331 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:15:06.109332 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5755a14-9a6e-4a59-b546-83d6c7c729c0-openshift-service-ca\") pod \"maas-api-67b8d69c9f-47wlt\" (UID: \"d5755a14-9a6e-4a59-b546-83d6c7c729c0\") " pod="opendatahub/maas-api-67b8d69c9f-47wlt" Jul 02 14:15:06.109551 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:15:06.109351 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mp4s5\" (UniqueName: \"kubernetes.io/projected/d5755a14-9a6e-4a59-b546-83d6c7c729c0-kube-api-access-mp4s5\") pod \"maas-api-67b8d69c9f-47wlt\" (UID: \"d5755a14-9a6e-4a59-b546-83d6c7c729c0\") " pod="opendatahub/maas-api-67b8d69c9f-47wlt" Jul 02 14:15:06.180421 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:15:06.180384 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:15:06.210551 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:15:06.210472 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5755a14-9a6e-4a59-b546-83d6c7c729c0-maas-api-tls\") pod \"maas-api-67b8d69c9f-47wlt\" (UID: \"d5755a14-9a6e-4a59-b546-83d6c7c729c0\") " pod="opendatahub/maas-api-67b8d69c9f-47wlt" Jul 02 14:15:06.210551 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:15:06.210512 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5755a14-9a6e-4a59-b546-83d6c7c729c0-openshift-service-ca\") pod \"maas-api-67b8d69c9f-47wlt\" (UID: \"d5755a14-9a6e-4a59-b546-83d6c7c729c0\") " pod="opendatahub/maas-api-67b8d69c9f-47wlt" Jul 02 14:15:06.210551 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:15:06.210530 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp4s5\" (UniqueName: \"kubernetes.io/projected/d5755a14-9a6e-4a59-b546-83d6c7c729c0-kube-api-access-mp4s5\") pod \"maas-api-67b8d69c9f-47wlt\" (UID: \"d5755a14-9a6e-4a59-b546-83d6c7c729c0\") " pod="opendatahub/maas-api-67b8d69c9f-47wlt" Jul 02 14:15:06.211190 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:15:06.211163 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5755a14-9a6e-4a59-b546-83d6c7c729c0-openshift-service-ca\") pod \"maas-api-67b8d69c9f-47wlt\" (UID: \"d5755a14-9a6e-4a59-b546-83d6c7c729c0\") " pod="opendatahub/maas-api-67b8d69c9f-47wlt" Jul 02 14:15:06.212933 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:15:06.212905 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5755a14-9a6e-4a59-b546-83d6c7c729c0-maas-api-tls\") pod \"maas-api-67b8d69c9f-47wlt\" (UID: \"d5755a14-9a6e-4a59-b546-83d6c7c729c0\") " pod="opendatahub/maas-api-67b8d69c9f-47wlt" Jul 02 14:15:06.221688 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:15:06.221660 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mp4s5\" (UniqueName: \"kubernetes.io/projected/d5755a14-9a6e-4a59-b546-83d6c7c729c0-kube-api-access-mp4s5\") pod \"maas-api-67b8d69c9f-47wlt\" (UID: \"d5755a14-9a6e-4a59-b546-83d6c7c729c0\") " pod="opendatahub/maas-api-67b8d69c9f-47wlt" Jul 02 14:15:06.367473 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:15:06.367441 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-67b8d69c9f-47wlt" Jul 02 14:15:06.458351 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:15:06.457958 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:15:06.516123 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:15:06.516093 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-67b8d69c9f-47wlt"] Jul 02 14:15:06.516563 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:15:06.516481 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5755a14_9a6e_4a59_b546_83d6c7c729c0.slice/crio-49b95a67a264d09256bf51817bedf77ec7af359d99650fa9f1e53b32b7a6d7d1 WatchSource:0}: Error finding container 49b95a67a264d09256bf51817bedf77ec7af359d99650fa9f1e53b32b7a6d7d1: Status 404 returned error can't find the container with id 49b95a67a264d09256bf51817bedf77ec7af359d99650fa9f1e53b32b7a6d7d1 Jul 02 14:15:06.549875 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:15:06.549842 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:15:06.635039 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:15:06.635000 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-67b8d69c9f-47wlt" event={"ID":"d5755a14-9a6e-4a59-b546-83d6c7c729c0","Type":"ContainerStarted","Data":"49b95a67a264d09256bf51817bedf77ec7af359d99650fa9f1e53b32b7a6d7d1"} Jul 02 14:15:06.635324 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:15:06.635303 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59f49fd4f6-c9cxs"] Jul 02 14:15:06.641210 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:15:06.641193 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-c9cxs" Jul 02 14:15:06.645035 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:15:06.645012 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 02 14:15:06.647191 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:15:06.647167 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-7skh5\"" Jul 02 14:15:06.652759 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:15:06.652736 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59f49fd4f6-c9cxs"] Jul 02 14:15:06.714532 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:15:06.714498 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brl79\" (UniqueName: \"kubernetes.io/projected/a9f23b9d-dfb4-414b-832d-32fffd5d594f-kube-api-access-brl79\") pod \"payload-pre-processing-59f49fd4f6-c9cxs\" (UID: \"a9f23b9d-dfb4-414b-832d-32fffd5d594f\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-c9cxs" Jul 02 14:15:06.714700 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:15:06.714545 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a9f23b9d-dfb4-414b-832d-32fffd5d594f-plugins-config-volume\") pod \"payload-pre-processing-59f49fd4f6-c9cxs\" (UID: \"a9f23b9d-dfb4-414b-832d-32fffd5d594f\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-c9cxs" Jul 02 14:15:06.815850 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:15:06.815753 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brl79\" (UniqueName: \"kubernetes.io/projected/a9f23b9d-dfb4-414b-832d-32fffd5d594f-kube-api-access-brl79\") pod \"payload-pre-processing-59f49fd4f6-c9cxs\" (UID: \"a9f23b9d-dfb4-414b-832d-32fffd5d594f\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-c9cxs" Jul 02 14:15:06.815850 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:15:06.815812 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a9f23b9d-dfb4-414b-832d-32fffd5d594f-plugins-config-volume\") pod \"payload-pre-processing-59f49fd4f6-c9cxs\" (UID: \"a9f23b9d-dfb4-414b-832d-32fffd5d594f\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-c9cxs" Jul 02 14:15:06.816549 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:15:06.816530 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a9f23b9d-dfb4-414b-832d-32fffd5d594f-plugins-config-volume\") pod \"payload-pre-processing-59f49fd4f6-c9cxs\" (UID: \"a9f23b9d-dfb4-414b-832d-32fffd5d594f\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-c9cxs" Jul 02 14:15:06.827152 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:15:06.827119 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brl79\" (UniqueName: \"kubernetes.io/projected/a9f23b9d-dfb4-414b-832d-32fffd5d594f-kube-api-access-brl79\") pod \"payload-pre-processing-59f49fd4f6-c9cxs\" (UID: \"a9f23b9d-dfb4-414b-832d-32fffd5d594f\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-c9cxs" Jul 02 14:15:06.952420 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:15:06.952379 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-c9cxs" Jul 02 14:15:07.087677 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:15:07.087646 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59f49fd4f6-c9cxs"] Jul 02 14:15:07.089665 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:15:07.089638 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9f23b9d_dfb4_414b_832d_32fffd5d594f.slice/crio-ff04d4c09fe876198988247c1c1b5903d6b8ffb538262d33fbbaaaf9091fc408 WatchSource:0}: Error finding container ff04d4c09fe876198988247c1c1b5903d6b8ffb538262d33fbbaaaf9091fc408: Status 404 returned error can't find the container with id ff04d4c09fe876198988247c1c1b5903d6b8ffb538262d33fbbaaaf9091fc408 Jul 02 14:15:07.642340 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:15:07.642303 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-c9cxs" event={"ID":"a9f23b9d-dfb4-414b-832d-32fffd5d594f","Type":"ContainerStarted","Data":"ff04d4c09fe876198988247c1c1b5903d6b8ffb538262d33fbbaaaf9091fc408"} Jul 02 14:15:10.665875 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:15:10.665828 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-67b8d69c9f-47wlt" event={"ID":"d5755a14-9a6e-4a59-b546-83d6c7c729c0","Type":"ContainerStarted","Data":"f8e900c3b3bebf356267b4ac9c48f30a03cd01c34f655f29ce1c94e0a24d8a70"} Jul 02 14:15:10.666399 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:15:10.665939 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-67b8d69c9f-47wlt" Jul 02 14:15:10.667442 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:15:10.667418 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-c9cxs" event={"ID":"a9f23b9d-dfb4-414b-832d-32fffd5d594f","Type":"ContainerStarted","Data":"804e4bbc8b735454b780215edbbb2014ce8f136fc1c8a17186dca362ef2a2418"} Jul 02 14:15:10.667560 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:15:10.667503 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-c9cxs" Jul 02 14:15:10.709110 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:15:10.709063 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-67b8d69c9f-47wlt" podStartSLOduration=1.579957219 podStartE2EDuration="4.709048781s" totalImagesPullingTime="3.129091562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:15:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:15:10.706566461 +0000 UTC m=+841.914809258" watchObservedRunningTime="2026-07-02 14:15:10.709048781 +0000 UTC m=+841.917291564" Jul 02 14:15:10.737503 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:15:10.737456 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-c9cxs" podStartSLOduration=2.134673679 podStartE2EDuration="4.737441811s" totalImagesPullingTime="2.602768132s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:15:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:15:10.734287697 +0000 UTC m=+841.942530502" watchObservedRunningTime="2026-07-02 14:15:10.737441811 +0000 UTC m=+841.945684594" Jul 02 14:15:16.679194 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:15:16.679161 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-67b8d69c9f-47wlt" Jul 02 14:15:21.675893 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:15:21.675863 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-c9cxs" Jul 02 14:15:43.299221 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:15:43.299180 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:15:43.398607 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:15:43.398576 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:15:58.774802 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:15:58.774761 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:15:58.889957 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:15:58.889916 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:16:03.530358 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:03.530273 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:16:09.205922 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:09.205888 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-7gq54_4ff6194a-8b82-4387-a950-0ee9961b6012/console-operator/1.log" Jul 02 14:16:09.209398 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:09.209375 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-7gq54_4ff6194a-8b82-4387-a950-0ee9961b6012/console-operator/1.log" Jul 02 14:16:09.213317 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:09.213282 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7r445_ca0f7ed3-f75b-4edb-86c2-afa842962cf5/ovn-acl-logging/0.log" Jul 02 14:16:09.216552 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:09.216532 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7r445_ca0f7ed3-f75b-4edb-86c2-afa842962cf5/ovn-acl-logging/0.log" Jul 02 14:16:21.362452 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:21.362412 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:16:21.430966 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:21.430931 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:16:27.500651 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:27.500612 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:16:36.979679 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:36.979596 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:16:37.007849 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:37.007814 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-2kx9v"] Jul 02 14:16:37.010548 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:37.010523 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2kx9v" Jul 02 14:16:37.016711 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:37.016681 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-9mc7s\"" Jul 02 14:16:37.016711 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:37.016680 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 02 14:16:37.017188 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:37.017166 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 02 14:16:37.017312 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:37.017290 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 02 14:16:37.025877 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:37.025850 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-2kx9v"] Jul 02 14:16:37.104855 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:37.104821 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgr26\" (UniqueName: \"kubernetes.io/projected/1d7592b0-ad3e-41de-8921-d52f57964bac-kube-api-access-mgr26\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2kx9v\" (UID: \"1d7592b0-ad3e-41de-8921-d52f57964bac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2kx9v" Jul 02 14:16:37.105069 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:37.104899 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d7592b0-ad3e-41de-8921-d52f57964bac-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2kx9v\" (UID: \"1d7592b0-ad3e-41de-8921-d52f57964bac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2kx9v" Jul 02 14:16:37.105069 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:37.104924 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d7592b0-ad3e-41de-8921-d52f57964bac-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2kx9v\" (UID: \"1d7592b0-ad3e-41de-8921-d52f57964bac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2kx9v" Jul 02 14:16:37.105069 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:37.104939 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d7592b0-ad3e-41de-8921-d52f57964bac-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2kx9v\" (UID: \"1d7592b0-ad3e-41de-8921-d52f57964bac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2kx9v" Jul 02 14:16:37.105069 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:37.105056 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d7592b0-ad3e-41de-8921-d52f57964bac-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2kx9v\" (UID: \"1d7592b0-ad3e-41de-8921-d52f57964bac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2kx9v" Jul 02 14:16:37.105228 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:37.105084 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d7592b0-ad3e-41de-8921-d52f57964bac-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2kx9v\" (UID: \"1d7592b0-ad3e-41de-8921-d52f57964bac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2kx9v" Jul 02 14:16:37.205815 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:37.205780 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d7592b0-ad3e-41de-8921-d52f57964bac-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2kx9v\" (UID: \"1d7592b0-ad3e-41de-8921-d52f57964bac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2kx9v" Jul 02 14:16:37.206033 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:37.205828 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d7592b0-ad3e-41de-8921-d52f57964bac-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2kx9v\" (UID: \"1d7592b0-ad3e-41de-8921-d52f57964bac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2kx9v" Jul 02 14:16:37.206033 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:37.205864 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgr26\" (UniqueName: \"kubernetes.io/projected/1d7592b0-ad3e-41de-8921-d52f57964bac-kube-api-access-mgr26\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2kx9v\" (UID: \"1d7592b0-ad3e-41de-8921-d52f57964bac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2kx9v" Jul 02 14:16:37.206033 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:37.205914 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d7592b0-ad3e-41de-8921-d52f57964bac-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2kx9v\" (UID: \"1d7592b0-ad3e-41de-8921-d52f57964bac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2kx9v" Jul 02 14:16:37.206033 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:37.205940 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d7592b0-ad3e-41de-8921-d52f57964bac-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2kx9v\" (UID: \"1d7592b0-ad3e-41de-8921-d52f57964bac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2kx9v" Jul 02 14:16:37.206033 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:37.205962 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d7592b0-ad3e-41de-8921-d52f57964bac-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2kx9v\" (UID: \"1d7592b0-ad3e-41de-8921-d52f57964bac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2kx9v" Jul 02 14:16:37.206341 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:37.206227 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d7592b0-ad3e-41de-8921-d52f57964bac-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2kx9v\" (UID: \"1d7592b0-ad3e-41de-8921-d52f57964bac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2kx9v" Jul 02 14:16:37.206401 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:37.206362 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d7592b0-ad3e-41de-8921-d52f57964bac-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2kx9v\" (UID: \"1d7592b0-ad3e-41de-8921-d52f57964bac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2kx9v" Jul 02 14:16:37.206443 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:37.206395 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d7592b0-ad3e-41de-8921-d52f57964bac-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2kx9v\" (UID: \"1d7592b0-ad3e-41de-8921-d52f57964bac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2kx9v" Jul 02 14:16:37.208208 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:37.208188 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d7592b0-ad3e-41de-8921-d52f57964bac-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2kx9v\" (UID: \"1d7592b0-ad3e-41de-8921-d52f57964bac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2kx9v" Jul 02 14:16:37.208458 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:37.208442 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d7592b0-ad3e-41de-8921-d52f57964bac-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2kx9v\" (UID: \"1d7592b0-ad3e-41de-8921-d52f57964bac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2kx9v" Jul 02 14:16:37.216564 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:37.216539 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgr26\" (UniqueName: \"kubernetes.io/projected/1d7592b0-ad3e-41de-8921-d52f57964bac-kube-api-access-mgr26\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2kx9v\" (UID: \"1d7592b0-ad3e-41de-8921-d52f57964bac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2kx9v" Jul 02 14:16:37.321411 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:37.321310 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2kx9v" Jul 02 14:16:37.464163 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:37.464135 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-2kx9v"] Jul 02 14:16:37.465604 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:16:37.465574 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d7592b0_ad3e_41de_8921_d52f57964bac.slice/crio-bec05247613e260a3da52a27692461eaca69debc7ddd39988a9e4175767250f1 WatchSource:0}: Error finding container bec05247613e260a3da52a27692461eaca69debc7ddd39988a9e4175767250f1: Status 404 returned error can't find the container with id bec05247613e260a3da52a27692461eaca69debc7ddd39988a9e4175767250f1 Jul 02 14:16:37.467010 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:37.466978 2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 14:16:38.121045 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:38.121000 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2kx9v" event={"ID":"1d7592b0-ad3e-41de-8921-d52f57964bac","Type":"ContainerStarted","Data":"bec05247613e260a3da52a27692461eaca69debc7ddd39988a9e4175767250f1"} Jul 02 14:16:39.127704 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:39.127666 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2kx9v" event={"ID":"1d7592b0-ad3e-41de-8921-d52f57964bac","Type":"ContainerStarted","Data":"2f10e87c285cb66f83acd1995bedfc5399a5007bb0f9a2dd0d4911a6ed00d109"} Jul 02 14:16:39.145600 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:39.145535 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2kx9v" podStartSLOduration=1.6995389589999998 podStartE2EDuration="3.145513412s" totalImagesPullingTime="1.445974453s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:16:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:16:39.143460863 +0000 UTC m=+930.351703650" watchObservedRunningTime="2026-07-02 14:16:39.145513412 +0000 UTC m=+930.353756194" Jul 02 14:16:40.061749 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:40.061711 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:16:43.503684 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:43.503649 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfxsqq"] Jul 02 14:16:43.507040 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:43.507023 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfxsqq" Jul 02 14:16:43.510258 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:43.510235 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 02 14:16:43.525434 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:43.525404 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfxsqq"] Jul 02 14:16:43.667201 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:43.667167 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/09b84148-91ee-4825-85af-580368b09fd3-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfxsqq\" (UID: \"09b84148-91ee-4825-85af-580368b09fd3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfxsqq" Jul 02 14:16:43.667201 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:43.667204 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/09b84148-91ee-4825-85af-580368b09fd3-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfxsqq\" (UID: \"09b84148-91ee-4825-85af-580368b09fd3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfxsqq" Jul 02 14:16:43.667426 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:43.667226 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/09b84148-91ee-4825-85af-580368b09fd3-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfxsqq\" (UID: \"09b84148-91ee-4825-85af-580368b09fd3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfxsqq" Jul 02 14:16:43.667426 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:43.667319 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09b84148-91ee-4825-85af-580368b09fd3-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfxsqq\" (UID: \"09b84148-91ee-4825-85af-580368b09fd3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfxsqq" Jul 02 14:16:43.667426 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:43.667387 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nht66\" (UniqueName: \"kubernetes.io/projected/09b84148-91ee-4825-85af-580368b09fd3-kube-api-access-nht66\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfxsqq\" (UID: \"09b84148-91ee-4825-85af-580368b09fd3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfxsqq" Jul 02 14:16:43.667426 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:43.667424 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09b84148-91ee-4825-85af-580368b09fd3-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfxsqq\" (UID: \"09b84148-91ee-4825-85af-580368b09fd3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfxsqq" Jul 02 14:16:43.768894 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:43.768809 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/09b84148-91ee-4825-85af-580368b09fd3-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfxsqq\" (UID: \"09b84148-91ee-4825-85af-580368b09fd3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfxsqq" Jul 02 14:16:43.768894 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:43.768856 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/09b84148-91ee-4825-85af-580368b09fd3-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfxsqq\" (UID: \"09b84148-91ee-4825-85af-580368b09fd3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfxsqq" Jul 02 14:16:43.768894 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:43.768885 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/09b84148-91ee-4825-85af-580368b09fd3-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfxsqq\" (UID: \"09b84148-91ee-4825-85af-580368b09fd3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfxsqq" Jul 02 14:16:43.769195 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:43.768930 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09b84148-91ee-4825-85af-580368b09fd3-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfxsqq\" (UID: \"09b84148-91ee-4825-85af-580368b09fd3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfxsqq" Jul 02 14:16:43.769195 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:43.769010 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nht66\" (UniqueName: \"kubernetes.io/projected/09b84148-91ee-4825-85af-580368b09fd3-kube-api-access-nht66\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfxsqq\" (UID: \"09b84148-91ee-4825-85af-580368b09fd3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfxsqq" Jul 02 14:16:43.769195 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:43.769056 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09b84148-91ee-4825-85af-580368b09fd3-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfxsqq\" (UID: \"09b84148-91ee-4825-85af-580368b09fd3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfxsqq" Jul 02 14:16:43.769356 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:43.769306 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/09b84148-91ee-4825-85af-580368b09fd3-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfxsqq\" (UID: \"09b84148-91ee-4825-85af-580368b09fd3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfxsqq" Jul 02 14:16:43.769414 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:43.769364 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/09b84148-91ee-4825-85af-580368b09fd3-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfxsqq\" (UID: \"09b84148-91ee-4825-85af-580368b09fd3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfxsqq" Jul 02 14:16:43.769467 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:43.769418 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09b84148-91ee-4825-85af-580368b09fd3-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfxsqq\" (UID: \"09b84148-91ee-4825-85af-580368b09fd3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfxsqq" Jul 02 14:16:43.771248 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:43.771221 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/09b84148-91ee-4825-85af-580368b09fd3-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfxsqq\" (UID: \"09b84148-91ee-4825-85af-580368b09fd3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfxsqq" Jul 02 14:16:43.771485 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:43.771469 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09b84148-91ee-4825-85af-580368b09fd3-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfxsqq\" (UID: \"09b84148-91ee-4825-85af-580368b09fd3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfxsqq" Jul 02 14:16:43.779526 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:43.779504 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nht66\" (UniqueName: \"kubernetes.io/projected/09b84148-91ee-4825-85af-580368b09fd3-kube-api-access-nht66\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfxsqq\" (UID: \"09b84148-91ee-4825-85af-580368b09fd3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfxsqq" Jul 02 14:16:43.793456 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:43.793431 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:16:43.817546 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:43.817495 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfxsqq" Jul 02 14:16:43.963497 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:43.963470 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfxsqq"] Jul 02 14:16:43.965500 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:16:43.965472 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09b84148_91ee_4825_85af_580368b09fd3.slice/crio-2cdbc450abd4fe2881d9643b436dde81a0680f44ad063a395af7df5fac070283 WatchSource:0}: Error finding container 2cdbc450abd4fe2881d9643b436dde81a0680f44ad063a395af7df5fac070283: Status 404 returned error can't find the container with id 2cdbc450abd4fe2881d9643b436dde81a0680f44ad063a395af7df5fac070283 Jul 02 14:16:44.154798 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:44.154762 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfxsqq" event={"ID":"09b84148-91ee-4825-85af-580368b09fd3","Type":"ContainerStarted","Data":"2cdbc450abd4fe2881d9643b436dde81a0680f44ad063a395af7df5fac070283"} Jul 02 14:16:45.162416 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:45.162375 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfxsqq" event={"ID":"09b84148-91ee-4825-85af-580368b09fd3","Type":"ContainerStarted","Data":"0c92d81d781d786ef328daa60bfa1b31d9107f14c015cdd938c01f9410c10883"} Jul 02 14:16:45.182856 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:45.182792 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfxsqq" podStartSLOduration=1.936004627 podStartE2EDuration="2.18277227s" totalImagesPullingTime="246.767643ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:16:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:16:45.181466438 +0000 UTC m=+936.389709222" watchObservedRunningTime="2026-07-02 14:16:45.18277227 +0000 UTC m=+936.391015056" Jul 02 14:16:47.322239 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:47.322200 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2kx9v" Jul 02 14:16:47.322656 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:47.322292 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2kx9v" Jul 02 14:16:47.334957 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:47.334932 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2kx9v" Jul 02 14:16:48.189278 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:48.189247 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2kx9v" Jul 02 14:16:53.818732 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:53.818691 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfxsqq" Jul 02 14:16:53.819287 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:53.818778 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfxsqq" Jul 02 14:16:53.830954 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:53.830930 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfxsqq" Jul 02 14:16:54.209550 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:54.209514 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:16:54.220595 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:54.220573 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfxsqq" Jul 02 14:16:54.581384 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:16:54.581298 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:17:09.195998 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:17:09.195945 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:17:56.746600 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:17:56.746561 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:17:56.843692 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:17:56.843656 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:17:57.917847 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:17:57.917810 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:17:58.030272 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:17:58.030236 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:18:41.008698 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:18:41.008647 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-67b8d69c9f-47wlt_d5755a14-9a6e-4a59-b546-83d6c7c729c0/maas-api/0.log" Jul 02 14:18:41.719053 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:18:41.719017 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-dbb7d6f6b-xjbwb_887bc5a0-35f9-4ebd-8a6a-c7b7132c8c58/copy-manifests/0.log" Jul 02 14:18:41.725910 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:18:41.725886 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-dbb7d6f6b-xjbwb_887bc5a0-35f9-4ebd-8a6a-c7b7132c8c58/manager/0.log" Jul 02 14:18:41.838890 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:18:41.838857 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-rqxfg_98f06008-77a6-4c8e-8499-83965334ae3a/postgres/0.log" Jul 02 14:18:42.630800 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:18:42.630765 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lm829_75a732ff-889d-4ae7-8330-17cf2b6ae7c8/util/0.log" Jul 02 14:18:42.659308 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:18:42.659276 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lm829_75a732ff-889d-4ae7-8330-17cf2b6ae7c8/pull/0.log" Jul 02 14:18:42.688357 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:18:42.688328 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lm829_75a732ff-889d-4ae7-8330-17cf2b6ae7c8/extract/0.log" Jul 02 14:18:42.803705 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:18:42.803674 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cc2cw_a539291f-1e17-4614-93d3-ebce9a49ffdc/util/0.log" Jul 02 14:18:42.812466 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:18:42.812437 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cc2cw_a539291f-1e17-4614-93d3-ebce9a49ffdc/pull/0.log" Jul 02 14:18:42.820065 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:18:42.820044 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cc2cw_a539291f-1e17-4614-93d3-ebce9a49ffdc/extract/0.log" Jul 02 14:18:42.932872 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:18:42.932802 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73428mf_f08bb41e-4eae-46af-a548-1170b6547df3/util/0.log" Jul 02 14:18:42.939962 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:18:42.939937 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73428mf_f08bb41e-4eae-46af-a548-1170b6547df3/pull/0.log" Jul 02 14:18:42.946468 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:18:42.946446 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73428mf_f08bb41e-4eae-46af-a548-1170b6547df3/extract/0.log" Jul 02 14:18:43.057890 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:18:43.057861 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltxmd_96925341-68cb-4d2f-8ba2-37f22d9a1c91/util/0.log" Jul 02 14:18:43.067291 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:18:43.067267 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltxmd_96925341-68cb-4d2f-8ba2-37f22d9a1c91/pull/0.log" Jul 02 14:18:43.079071 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:18:43.079047 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltxmd_96925341-68cb-4d2f-8ba2-37f22d9a1c91/extract/0.log" Jul 02 14:18:44.480513 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:18:44.480479 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-s7xtg_d6ba3255-759a-4898-856f-478c199f2e1f/discovery/0.log" Jul 02 14:18:44.933197 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:18:44.933169 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-c9cxs_a9f23b9d-dfb4-414b-832d-32fffd5d594f/payload-pre-processing/0.log" Jul 02 14:18:45.161338 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:18:45.161313 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-684cbf6d5c-l2rsv_d45432e4-b5f5-429c-bc73-8b2518047065/router/0.log" Jul 02 14:18:45.717872 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:18:45.717805 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-2kx9v_1d7592b0-ad3e-41de-8921-d52f57964bac/main/0.log" Jul 02 14:18:45.828263 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:18:45.828229 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfxsqq_09b84148-91ee-4825-85af-580368b09fd3/main/0.log" Jul 02 14:18:47.319425 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:18:47.319387 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:18:50.473427 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:18:50.473395 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:18:50.568381 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:18:50.568346 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:18:53.354022 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:18:53.353981 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xvgpg_e558c7dc-3cca-412b-b6a2-cd48bd9b430f/global-pull-secret-syncer/0.log" Jul 02 14:18:53.405201 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:18:53.405164 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" Jul 02 14:18:53.510081 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:18:53.510051 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-57.ec2.internal_c582d8238a6f3daead6044036f2a5eeb/haproxy/0.log" Jul 02 14:18:53.888901 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:18:53.888870 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:18:53.948268 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:18:53.948235 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:18:58.303868 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:18:58.303819 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lm829_75a732ff-889d-4ae7-8330-17cf2b6ae7c8/extract/0.log" Jul 02 14:18:58.333158 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:18:58.333124 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lm829_75a732ff-889d-4ae7-8330-17cf2b6ae7c8/util/0.log" Jul 02 14:18:58.358588 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:18:58.358569 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lm829_75a732ff-889d-4ae7-8330-17cf2b6ae7c8/pull/0.log" Jul 02 14:18:58.385860 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:18:58.385836 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cc2cw_a539291f-1e17-4614-93d3-ebce9a49ffdc/extract/0.log" Jul 02 14:18:58.418726 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:18:58.418690 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cc2cw_a539291f-1e17-4614-93d3-ebce9a49ffdc/util/0.log" Jul 02 14:18:58.442672 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:18:58.442640 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cc2cw_a539291f-1e17-4614-93d3-ebce9a49ffdc/pull/0.log" Jul 02 14:18:58.476182 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:18:58.476146 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73428mf_f08bb41e-4eae-46af-a548-1170b6547df3/extract/0.log" Jul 02 14:18:58.508328 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:18:58.508285 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73428mf_f08bb41e-4eae-46af-a548-1170b6547df3/util/0.log" Jul 02 14:18:58.531850 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:18:58.531815 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73428mf_f08bb41e-4eae-46af-a548-1170b6547df3/pull/0.log" Jul 02 14:18:58.574109 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:18:58.574027 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltxmd_96925341-68cb-4d2f-8ba2-37f22d9a1c91/extract/0.log" Jul 02 14:18:58.602890 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:18:58.602857 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltxmd_96925341-68cb-4d2f-8ba2-37f22d9a1c91/util/0.log" Jul 02 14:18:58.624680 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:18:58.624644 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltxmd_96925341-68cb-4d2f-8ba2-37f22d9a1c91/pull/0.log" Jul 02 14:19:00.773127 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:00.773100 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-54cb84584-g7qmz_cd3f94a9-f70e-497f-9b2e-4c7c3a0bd79e/cluster-monitoring-operator/0.log" Jul 02 14:19:01.051617 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:01.051535 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8vzlm_9793b3be-8c64-46f7-a09f-99cdca3b0ffa/node-exporter/0.log" Jul 02 14:19:01.075716 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:01.075692 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8vzlm_9793b3be-8c64-46f7-a09f-99cdca3b0ffa/kube-rbac-proxy/0.log" Jul 02 14:19:01.099329 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:01.099294 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7nn4r_ef367a3a-b360-4b9a-b66c-c4b8b128d70f/konnectivity-agent/0.log" limit=1024 Jul 02 14:19:01.102445 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:01.102423 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8vzlm_9793b3be-8c64-46f7-a09f-99cdca3b0ffa/init-textfile/0.log" Jul 02 14:19:01.228010 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:01.227961 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-vllp7_07691aba-8df2-4270-ba7e-04cd91be1b0a/kube-rbac-proxy-main/0.log" Jul 02 14:19:01.264695 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:01.264661 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-vllp7_07691aba-8df2-4270-ba7e-04cd91be1b0a/kube-rbac-proxy-self/0.log" Jul 02 14:19:01.295322 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:01.295293 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-vllp7_07691aba-8df2-4270-ba7e-04cd91be1b0a/openshift-state-metrics/0.log" Jul 02 14:19:01.535456 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:01.535426 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7b7d896497-wd6xh_628da1c5-41dc-47fa-be44-35389a1f6bd4/prometheus-operator/0.log" Jul 02 14:19:01.560630 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:01.560593 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7b7d896497-wd6xh_628da1c5-41dc-47fa-be44-35389a1f6bd4/kube-rbac-proxy/0.log" Jul 02 14:19:01.594223 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:01.594196 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7ddc8784d4-zgm8b_52d9c9f7-ba13-4b8f-923e-f04137c174e3/prometheus-operator-admission-webhook/0.log" Jul 02 14:19:03.239696 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:03.239662 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-n4dpz/perf-node-gather-daemonset-f4985"] Jul 02 14:19:03.243230 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:03.243210 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n4dpz/perf-node-gather-daemonset-f4985" Jul 02 14:19:03.247223 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:03.247206 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n4dpz\"/\"kube-root-ca.crt\"" Jul 02 14:19:03.248086 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:03.248070 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-n4dpz\"/\"default-dockercfg-qzzxb\"" Jul 02 14:19:03.248146 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:03.248130 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n4dpz\"/\"openshift-service-ca.crt\"" Jul 02 14:19:03.283304 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:03.283270 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n4dpz/perf-node-gather-daemonset-f4985"] Jul 02 14:19:03.390467 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:03.390433 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2b07c712-26ce-4cc5-9ad6-0bc035e022b4-proc\") pod \"perf-node-gather-daemonset-f4985\" (UID: \"2b07c712-26ce-4cc5-9ad6-0bc035e022b4\") " pod="openshift-must-gather-n4dpz/perf-node-gather-daemonset-f4985" Jul 02 14:19:03.390660 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:03.390485 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2b07c712-26ce-4cc5-9ad6-0bc035e022b4-sys\") pod \"perf-node-gather-daemonset-f4985\" (UID: \"2b07c712-26ce-4cc5-9ad6-0bc035e022b4\") " pod="openshift-must-gather-n4dpz/perf-node-gather-daemonset-f4985" Jul 02 14:19:03.390660 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:03.390508 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wgw4\" (UniqueName: \"kubernetes.io/projected/2b07c712-26ce-4cc5-9ad6-0bc035e022b4-kube-api-access-8wgw4\") pod \"perf-node-gather-daemonset-f4985\" (UID: \"2b07c712-26ce-4cc5-9ad6-0bc035e022b4\") " pod="openshift-must-gather-n4dpz/perf-node-gather-daemonset-f4985" Jul 02 14:19:03.390660 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:03.390608 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2b07c712-26ce-4cc5-9ad6-0bc035e022b4-podres\") pod \"perf-node-gather-daemonset-f4985\" (UID: \"2b07c712-26ce-4cc5-9ad6-0bc035e022b4\") " pod="openshift-must-gather-n4dpz/perf-node-gather-daemonset-f4985" Jul 02 14:19:03.390660 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:03.390654 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2b07c712-26ce-4cc5-9ad6-0bc035e022b4-lib-modules\") pod \"perf-node-gather-daemonset-f4985\" (UID: \"2b07c712-26ce-4cc5-9ad6-0bc035e022b4\") " pod="openshift-must-gather-n4dpz/perf-node-gather-daemonset-f4985" Jul 02 14:19:03.491878 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:03.491778 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2b07c712-26ce-4cc5-9ad6-0bc035e022b4-lib-modules\") pod \"perf-node-gather-daemonset-f4985\" (UID: \"2b07c712-26ce-4cc5-9ad6-0bc035e022b4\") " pod="openshift-must-gather-n4dpz/perf-node-gather-daemonset-f4985" Jul 02 14:19:03.491878 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:03.491840 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2b07c712-26ce-4cc5-9ad6-0bc035e022b4-proc\") pod \"perf-node-gather-daemonset-f4985\" (UID: \"2b07c712-26ce-4cc5-9ad6-0bc035e022b4\") " pod="openshift-must-gather-n4dpz/perf-node-gather-daemonset-f4985" Jul 02 14:19:03.492141 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:03.491898 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2b07c712-26ce-4cc5-9ad6-0bc035e022b4-sys\") pod \"perf-node-gather-daemonset-f4985\" (UID: \"2b07c712-26ce-4cc5-9ad6-0bc035e022b4\") " pod="openshift-must-gather-n4dpz/perf-node-gather-daemonset-f4985" Jul 02 14:19:03.492141 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:03.491924 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wgw4\" (UniqueName: \"kubernetes.io/projected/2b07c712-26ce-4cc5-9ad6-0bc035e022b4-kube-api-access-8wgw4\") pod \"perf-node-gather-daemonset-f4985\" (UID: \"2b07c712-26ce-4cc5-9ad6-0bc035e022b4\") " pod="openshift-must-gather-n4dpz/perf-node-gather-daemonset-f4985" Jul 02 14:19:03.492141 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:03.491960 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2b07c712-26ce-4cc5-9ad6-0bc035e022b4-lib-modules\") pod \"perf-node-gather-daemonset-f4985\" (UID: \"2b07c712-26ce-4cc5-9ad6-0bc035e022b4\") " pod="openshift-must-gather-n4dpz/perf-node-gather-daemonset-f4985" Jul 02 14:19:03.492141 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:03.491982 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2b07c712-26ce-4cc5-9ad6-0bc035e022b4-proc\") pod \"perf-node-gather-daemonset-f4985\" (UID: \"2b07c712-26ce-4cc5-9ad6-0bc035e022b4\") " pod="openshift-must-gather-n4dpz/perf-node-gather-daemonset-f4985" Jul 02 14:19:03.492141 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:03.491968 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2b07c712-26ce-4cc5-9ad6-0bc035e022b4-podres\") pod \"perf-node-gather-daemonset-f4985\" (UID: \"2b07c712-26ce-4cc5-9ad6-0bc035e022b4\") " pod="openshift-must-gather-n4dpz/perf-node-gather-daemonset-f4985" Jul 02 14:19:03.492141 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:03.491982 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2b07c712-26ce-4cc5-9ad6-0bc035e022b4-sys\") pod \"perf-node-gather-daemonset-f4985\" (UID: \"2b07c712-26ce-4cc5-9ad6-0bc035e022b4\") " pod="openshift-must-gather-n4dpz/perf-node-gather-daemonset-f4985" Jul 02 14:19:03.492141 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:03.492088 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2b07c712-26ce-4cc5-9ad6-0bc035e022b4-podres\") pod \"perf-node-gather-daemonset-f4985\" (UID: \"2b07c712-26ce-4cc5-9ad6-0bc035e022b4\") " pod="openshift-must-gather-n4dpz/perf-node-gather-daemonset-f4985" Jul 02 14:19:03.501096 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:03.501060 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wgw4\" (UniqueName: \"kubernetes.io/projected/2b07c712-26ce-4cc5-9ad6-0bc035e022b4-kube-api-access-8wgw4\") pod \"perf-node-gather-daemonset-f4985\" (UID: \"2b07c712-26ce-4cc5-9ad6-0bc035e022b4\") " pod="openshift-must-gather-n4dpz/perf-node-gather-daemonset-f4985" Jul 02 14:19:03.553874 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:03.553837 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n4dpz/perf-node-gather-daemonset-f4985" Jul 02 14:19:03.687687 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:03.687654 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n4dpz/perf-node-gather-daemonset-f4985"] Jul 02 14:19:03.688881 ip-10-0-133-57 kubenswrapper[2553]: W0702 14:19:03.688854 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2b07c712_26ce_4cc5_9ad6_0bc035e022b4.slice/crio-a5da9ce0137f0c8cdaacdffc78b8e2f672cec5bfa9167729894137b2bdad903d WatchSource:0}: Error finding container a5da9ce0137f0c8cdaacdffc78b8e2f672cec5bfa9167729894137b2bdad903d: Status 404 returned error can't find the container with id a5da9ce0137f0c8cdaacdffc78b8e2f672cec5bfa9167729894137b2bdad903d Jul 02 14:19:03.876912 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:03.876865 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n4dpz/perf-node-gather-daemonset-f4985" event={"ID":"2b07c712-26ce-4cc5-9ad6-0bc035e022b4","Type":"ContainerStarted","Data":"74bb61bd3d49313522f62423f475a97ea14f9967fc45cf1043e6617075a004b0"} Jul 02 14:19:03.877105 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:03.876931 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-n4dpz/perf-node-gather-daemonset-f4985" Jul 02 14:19:03.877105 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:03.876953 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n4dpz/perf-node-gather-daemonset-f4985" event={"ID":"2b07c712-26ce-4cc5-9ad6-0bc035e022b4","Type":"ContainerStarted","Data":"a5da9ce0137f0c8cdaacdffc78b8e2f672cec5bfa9167729894137b2bdad903d"} Jul 02 14:19:03.896241 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:03.896212 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-7gq54_4ff6194a-8b82-4387-a950-0ee9961b6012/console-operator/1.log" Jul 02 14:19:03.900625 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:03.900604 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-7gq54_4ff6194a-8b82-4387-a950-0ee9961b6012/console-operator/2.log" Jul 02 14:19:04.390042 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:04.390013 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-54bf74458b-h2fdl_bd06cd9b-afa2-4715-a796-b19a7f530081/console/0.log" Jul 02 14:19:06.069943 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:06.069912 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2f9dr_5a21a391-4a45-4143-a680-df9abc1cee3b/dns/0.log" Jul 02 14:19:06.090796 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:06.090769 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2f9dr_5a21a391-4a45-4143-a680-df9abc1cee3b/kube-rbac-proxy/0.log" Jul 02 14:19:06.230194 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:06.230157 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lg74z_070f7754-21fb-458f-b47c-a5d2820ad39d/dns-node-resolver/0.log" Jul 02 14:19:06.850894 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:06.850858 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zbkhx_253a79fe-da31-4f39-8017-9b6528e9e4df/node-ca/0.log" Jul 02 14:19:07.847717 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:07.847677 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-s7xtg_d6ba3255-759a-4898-856f-478c199f2e1f/discovery/0.log" Jul 02 14:19:07.968203 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:07.968175 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-c9cxs_a9f23b9d-dfb4-414b-832d-32fffd5d594f/payload-pre-processing/0.log" Jul 02 14:19:08.045065 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:08.045040 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-684cbf6d5c-l2rsv_d45432e4-b5f5-429c-bc73-8b2518047065/router/0.log" Jul 02 14:19:08.662109 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:08.662075 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6m2l6_f157d300-722a-4edc-84a9-cda9534aafd5/serve-healthcheck-canary/0.log" Jul 02 14:19:09.457082 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:09.457046 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cn8gp_73f73c80-abc8-4c51-b3f3-82971c4aaaf1/kube-rbac-proxy/0.log" Jul 02 14:19:09.478959 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:09.478929 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cn8gp_73f73c80-abc8-4c51-b3f3-82971c4aaaf1/exporter/0.log" Jul 02 14:19:09.502043 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:09.502018 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cn8gp_73f73c80-abc8-4c51-b3f3-82971c4aaaf1/extractor/0.log" Jul 02 14:19:09.892683 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:09.892654 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-n4dpz/perf-node-gather-daemonset-f4985" Jul 02 14:19:09.910369 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:09.910315 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-n4dpz/perf-node-gather-daemonset-f4985" podStartSLOduration=6.910298788 podStartE2EDuration="6.910298788s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:19:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:19:03.89261636 +0000 UTC m=+1075.100859145" watchObservedRunningTime="2026-07-02 14:19:09.910298788 +0000 UTC m=+1081.118541570" Jul 02 14:19:11.865282 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:11.865251 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-67b8d69c9f-47wlt_d5755a14-9a6e-4a59-b546-83d6c7c729c0/maas-api/0.log" Jul 02 14:19:12.173940 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:12.173908 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-dbb7d6f6b-xjbwb_887bc5a0-35f9-4ebd-8a6a-c7b7132c8c58/manager/0.log" Jul 02 14:19:12.195521 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:12.195490 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-dbb7d6f6b-xjbwb_887bc5a0-35f9-4ebd-8a6a-c7b7132c8c58/copy-manifests/0.log" Jul 02 14:19:12.221148 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:12.221118 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-rqxfg_98f06008-77a6-4c8e-8499-83965334ae3a/postgres/0.log" Jul 02 14:19:13.582715 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:13.582677 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-s7xtg_d6ba3255-759a-4898-856f-478c199f2e1f/discovery/0.log" Jul 02 14:19:13.727616 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:13.727582 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-c9cxs_a9f23b9d-dfb4-414b-832d-32fffd5d594f/payload-pre-processing/0.log" Jul 02 14:19:13.755948 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:13.755922 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-54667967db-6j5mb_eb8eb52b-116c-44d9-83ec-797e7a67edc6/manager/0.log" Jul 02 14:19:13.790190 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:13.790163 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-684cbf6d5c-l2rsv_d45432e4-b5f5-429c-bc73-8b2518047065/router/0.log" Jul 02 14:19:13.858440 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:13.858372 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-9786s_b481a8f4-61d5-4fac-a2dc-4b0b6e47281a/openshift-lws-operator/0.log" Jul 02 14:19:14.907082 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:14.906993 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-s7xtg_d6ba3255-759a-4898-856f-478c199f2e1f/discovery/0.log" Jul 02 14:19:14.990304 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:14.990269 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-c9cxs_a9f23b9d-dfb4-414b-832d-32fffd5d594f/payload-pre-processing/0.log" Jul 02 14:19:15.030586 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:15.030533 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-684cbf6d5c-l2rsv_d45432e4-b5f5-429c-bc73-8b2518047065/router/0.log" Jul 02 14:19:20.224825 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:20.224783 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-8l6bt_cfbb6333-3d89-4a46-9c46-cd02efede2e8/kube-multus/0.log" Jul 02 14:19:20.248934 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:20.248906 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-68vbd_b9aba121-950c-4aab-bc81-d6efedf5bfbd/kube-multus-additional-cni-plugins/0.log" Jul 02 14:19:20.274152 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:20.274119 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-68vbd_b9aba121-950c-4aab-bc81-d6efedf5bfbd/egress-router-binary-copy/0.log" Jul 02 14:19:20.301911 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:20.301884 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-68vbd_b9aba121-950c-4aab-bc81-d6efedf5bfbd/cni-plugins/0.log" Jul 02 14:19:20.332205 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:20.332182 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-68vbd_b9aba121-950c-4aab-bc81-d6efedf5bfbd/bond-cni-plugin/0.log" Jul 02 14:19:20.359317 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:20.359293 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-68vbd_b9aba121-950c-4aab-bc81-d6efedf5bfbd/routeoverride-cni/0.log" Jul 02 14:19:20.391275 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:20.391249 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-68vbd_b9aba121-950c-4aab-bc81-d6efedf5bfbd/whereabouts-cni-bincopy/0.log" Jul 02 14:19:20.426040 ip-10-0-133-57 kubenswrapper[2553]: I0702 14:19:20.426010 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-68vbd_b9aba121-950c-4aab-bc81-d6efedf5bfbd/whereabouts-cni/0.log"