Jul 24 14:34:44.658205 ip-10-0-129-87 systemd[1]: Starting Kubernetes Kubelet... Jul 24 14:34:44.973820 ip-10-0-129-87 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 24 14:34:44.973820 ip-10-0-129-87 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 24 14:34:44.973820 ip-10-0-129-87 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 24 14:34:44.973820 ip-10-0-129-87 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 24 14:34:44.973820 ip-10-0-129-87 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 24 14:34:44.975409 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.975323 2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 24 14:34:44.979733 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.979709 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 14:34:44.979733 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.979727 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 14:34:44.979733 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.979733 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 14:34:44.979733 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.979738 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 14:34:44.979998 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.979743 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 14:34:44.979998 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.979747 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 14:34:44.979998 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.979751 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 14:34:44.979998 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.979755 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 14:34:44.979998 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.979768 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 14:34:44.979998 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.979772 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 14:34:44.979998 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.979776 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 14:34:44.979998 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.979780 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 14:34:44.979998 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.979784 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 14:34:44.979998 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.979788 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 14:34:44.979998 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.979792 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 14:34:44.979998 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.979796 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 14:34:44.979998 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.979800 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 14:34:44.979998 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.979804 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 14:34:44.979998 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.979808 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 14:34:44.979998 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.979812 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 14:34:44.979998 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.979816 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 14:34:44.979998 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.979820 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 14:34:44.979998 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.979824 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 14:34:44.979998 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.979827 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 14:34:44.980810 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.979832 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 14:34:44.980810 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.979836 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 14:34:44.980810 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.979840 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 14:34:44.980810 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.979844 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 14:34:44.980810 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.979849 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 14:34:44.980810 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.979853 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 14:34:44.980810 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.979861 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 14:34:44.980810 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.979868 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 14:34:44.980810 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.979873 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 14:34:44.980810 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.979878 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 14:34:44.980810 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.979883 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 14:34:44.980810 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.979889 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 14:34:44.980810 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.979893 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 14:34:44.980810 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.979898 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 14:34:44.980810 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.979903 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 14:34:44.980810 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.979926 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 14:34:44.980810 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.979933 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 14:34:44.980810 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.979937 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 14:34:44.980810 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.979942 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 14:34:44.981610 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.979947 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 14:34:44.981610 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.979951 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 14:34:44.981610 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.979956 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 14:34:44.981610 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.979960 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 14:34:44.981610 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.979965 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 14:34:44.981610 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.979970 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 14:34:44.981610 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.979974 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 14:34:44.981610 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.979979 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 14:34:44.981610 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.979984 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 14:34:44.981610 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.979990 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 14:34:44.981610 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.979994 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 14:34:44.981610 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.979998 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 14:34:44.981610 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.980002 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 14:34:44.981610 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.980014 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 14:34:44.981610 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.980019 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 24 14:34:44.981610 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.980023 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 14:34:44.981610 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.980027 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 14:34:44.981610 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.980032 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 14:34:44.981610 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.980038 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 14:34:44.981610 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.980042 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 14:34:44.982487 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.980046 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 14:34:44.982487 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.980052 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 14:34:44.982487 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.980056 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 14:34:44.982487 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.980061 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 14:34:44.982487 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.980066 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 14:34:44.982487 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.980070 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 14:34:44.982487 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.980075 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 14:34:44.982487 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.980081 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 14:34:44.982487 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.980085 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 14:34:44.982487 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.980090 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 14:34:44.982487 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.980094 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 14:34:44.982487 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.980098 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 14:34:44.982487 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.980102 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 14:34:44.982487 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.980106 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 14:34:44.982487 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.980110 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 14:34:44.982487 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.980115 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 14:34:44.982487 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.980119 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 14:34:44.982487 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.980123 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 14:34:44.982487 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.980128 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 14:34:44.982487 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.980132 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 14:34:44.983345 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.980137 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 14:34:44.983345 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.980142 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 14:34:44.983345 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.980146 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 14:34:44.983345 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.980150 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 14:34:44.983345 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.980155 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 14:34:44.983345 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.980159 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 14:34:44.983345 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.980164 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 14:34:44.983345 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.980170 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 14:34:44.983345 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.980176 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 14:34:44.983345 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.980180 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 14:34:44.983345 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.980185 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 14:34:44.983345 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.980190 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 14:34:44.983345 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.980194 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 14:34:44.983345 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.980198 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 14:34:44.983345 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.980202 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 14:34:44.983345 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.980207 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 14:34:44.983345 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981377 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 14:34:44.983345 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981388 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 14:34:44.983345 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981393 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 14:34:44.983345 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981398 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 14:34:44.984186 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981402 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 14:34:44.984186 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981406 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 14:34:44.984186 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981411 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 14:34:44.984186 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981416 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 14:34:44.984186 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981420 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 14:34:44.984186 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981425 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 14:34:44.984186 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981429 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 14:34:44.984186 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981434 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 14:34:44.984186 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981439 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 14:34:44.984186 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981443 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 14:34:44.984186 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981447 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 14:34:44.984186 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981451 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 14:34:44.984186 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981456 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 14:34:44.984186 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981462 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 14:34:44.984186 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981470 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 14:34:44.984186 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981476 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 14:34:44.984186 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981481 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 14:34:44.984186 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981485 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 14:34:44.984186 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981491 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 14:34:44.984806 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981498 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 14:34:44.984806 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981503 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 14:34:44.984806 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981508 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 14:34:44.984806 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981513 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 14:34:44.984806 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981517 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 14:34:44.984806 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981522 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 14:34:44.984806 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981526 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 14:34:44.984806 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981531 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 14:34:44.984806 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981535 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 14:34:44.984806 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981539 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 14:34:44.984806 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981544 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 14:34:44.984806 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981548 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 14:34:44.984806 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981552 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 14:34:44.984806 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981557 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 14:34:44.984806 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981561 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 14:34:44.984806 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981565 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 14:34:44.984806 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981569 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 14:34:44.984806 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981573 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 14:34:44.984806 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981577 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 24 14:34:44.984806 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981582 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 14:34:44.985404 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981586 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 14:34:44.985404 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981592 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 14:34:44.985404 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981596 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 14:34:44.985404 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981601 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 14:34:44.985404 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981605 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 14:34:44.985404 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981608 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 14:34:44.985404 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981613 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 14:34:44.985404 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981618 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 14:34:44.985404 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981621 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 14:34:44.985404 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981625 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 14:34:44.985404 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981629 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 14:34:44.985404 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981633 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 14:34:44.985404 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981637 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 14:34:44.985404 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981641 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 14:34:44.985404 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981646 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 14:34:44.985404 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981651 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 14:34:44.985404 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981655 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 14:34:44.985404 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981660 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 14:34:44.985404 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981665 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 14:34:44.985404 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981669 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 14:34:44.986061 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981673 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 14:34:44.986061 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981677 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 14:34:44.986061 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981681 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 14:34:44.986061 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981686 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 14:34:44.986061 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981690 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 14:34:44.986061 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981694 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 14:34:44.986061 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981698 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 14:34:44.986061 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981702 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 14:34:44.986061 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981707 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 14:34:44.986061 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981711 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 14:34:44.986061 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981716 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 14:34:44.986061 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981720 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 14:34:44.986061 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981724 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 14:34:44.986061 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981728 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 14:34:44.986061 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981732 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 14:34:44.986061 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981736 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 14:34:44.986061 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981740 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 14:34:44.986061 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981745 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 14:34:44.986061 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981749 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 14:34:44.986061 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981760 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 14:34:44.986650 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981766 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 14:34:44.986650 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981770 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 14:34:44.986650 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981774 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 14:34:44.986650 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981778 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 14:34:44.986650 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981782 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 14:34:44.986650 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981787 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 14:34:44.986650 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981791 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 14:34:44.986650 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981796 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 14:34:44.986650 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981800 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 14:34:44.986650 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981805 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 14:34:44.986650 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981811 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 14:34:44.986650 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981818 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 14:34:44.986650 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981824 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 14:34:44.986650 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981829 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 14:34:44.986650 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981834 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 14:34:44.986650 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.981839 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 14:34:44.986650 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982436 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 14:34:44.986650 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982444 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 14:34:44.986650 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982448 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 14:34:44.986650 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982454 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 14:34:44.987202 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982458 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 14:34:44.987202 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982462 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 14:34:44.987202 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982467 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 14:34:44.987202 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982471 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 14:34:44.987202 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982475 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 14:34:44.987202 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982480 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 14:34:44.987202 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982484 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 14:34:44.987202 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982488 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 14:34:44.987202 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982492 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 14:34:44.987202 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982495 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 14:34:44.987202 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982500 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 14:34:44.987202 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982504 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 14:34:44.987202 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982509 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 14:34:44.987202 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982513 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 14:34:44.987202 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982518 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 14:34:44.987202 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982522 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 14:34:44.987202 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982526 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 14:34:44.987202 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982530 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 14:34:44.987202 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982534 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 14:34:44.987202 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982539 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 14:34:44.987743 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982544 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 14:34:44.987743 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982551 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 14:34:44.987743 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982555 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 14:34:44.987743 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982559 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 14:34:44.987743 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982564 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 14:34:44.987743 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982568 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 14:34:44.987743 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982572 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 14:34:44.987743 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982576 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 14:34:44.987743 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982580 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 14:34:44.987743 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982585 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 14:34:44.987743 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982589 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 14:34:44.987743 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982593 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 14:34:44.987743 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982601 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 14:34:44.987743 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982606 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 14:34:44.987743 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982612 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 14:34:44.987743 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982617 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 14:34:44.987743 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982621 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 14:34:44.987743 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982625 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 14:34:44.987743 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982629 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 14:34:44.987743 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982634 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 14:34:44.988261 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982638 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 14:34:44.988261 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982643 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 14:34:44.988261 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982647 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 14:34:44.988261 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982651 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 14:34:44.988261 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982655 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 14:34:44.988261 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982660 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 14:34:44.988261 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982665 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 14:34:44.988261 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982669 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 14:34:44.988261 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982673 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 14:34:44.988261 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982677 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 14:34:44.988261 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982681 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 14:34:44.988261 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982686 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 14:34:44.988261 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982690 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 14:34:44.988261 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982696 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 14:34:44.988261 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982700 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 14:34:44.988261 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982707 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 14:34:44.988261 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982713 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 14:34:44.988261 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982717 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 14:34:44.988261 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982721 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 14:34:44.988261 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982725 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 14:34:44.988792 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982729 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 14:34:44.988792 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982734 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 14:34:44.988792 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982739 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 14:34:44.988792 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982743 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 14:34:44.988792 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982747 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 14:34:44.988792 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982751 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 14:34:44.988792 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982756 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 14:34:44.988792 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982760 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 14:34:44.988792 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982764 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 14:34:44.988792 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982768 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 14:34:44.988792 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982772 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 14:34:44.988792 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982776 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 14:34:44.988792 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982781 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 14:34:44.988792 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982785 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 14:34:44.988792 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982789 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 14:34:44.988792 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982793 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 24 14:34:44.988792 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982799 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 14:34:44.988792 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982804 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 14:34:44.988792 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982808 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 14:34:44.988792 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982813 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 14:34:44.989292 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982819 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 14:34:44.989292 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982824 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 14:34:44.989292 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982829 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 14:34:44.989292 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982834 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 14:34:44.989292 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982838 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 14:34:44.989292 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982845 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 14:34:44.989292 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982849 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 14:34:44.989292 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982853 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 14:34:44.989292 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982857 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 14:34:44.989292 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982862 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 14:34:44.989292 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982866 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 14:34:44.989292 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982870 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 14:34:44.989292 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982874 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 14:34:44.989292 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982879 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 14:34:44.989292 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.982883 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 14:34:44.989292 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.982998 2565 flags.go:64] FLAG: --address="0.0.0.0" Jul 24 14:34:44.989292 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983009 2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 24 14:34:44.989292 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983018 2565 flags.go:64] FLAG: --anonymous-auth="true" Jul 24 14:34:44.989292 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983026 2565 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 24 14:34:44.989292 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983032 2565 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 24 14:34:44.989777 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983037 2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 24 14:34:44.989777 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983044 2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 24 14:34:44.989777 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983051 2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 24 14:34:44.989777 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983056 2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 24 14:34:44.989777 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983061 2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 24 14:34:44.989777 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983067 2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 24 14:34:44.989777 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983072 2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 24 14:34:44.989777 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983078 2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 24 14:34:44.989777 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983083 2565 flags.go:64] FLAG: --cgroup-root="" Jul 24 14:34:44.989777 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983087 2565 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 24 14:34:44.989777 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983092 2565 flags.go:64] FLAG: --client-ca-file="" Jul 24 14:34:44.989777 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983097 2565 flags.go:64] FLAG: --cloud-provider="external" Jul 24 14:34:44.989777 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983102 2565 flags.go:64] FLAG: --cluster-dns="[]" Jul 24 14:34:44.989777 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983110 2565 flags.go:64] FLAG: --cluster-domain="" Jul 24 14:34:44.989777 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983117 2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 24 14:34:44.989777 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983122 2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 24 14:34:44.989777 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983127 2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 24 14:34:44.989777 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983134 2565 flags.go:64] FLAG: --container-log-max-files="5" Jul 24 14:34:44.989777 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983141 2565 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 24 14:34:44.989777 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983146 2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 24 14:34:44.989777 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983152 2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 24 14:34:44.989777 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983157 2565 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 24 14:34:44.989777 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983162 2565 flags.go:64] FLAG: --contention-profiling="false" Jul 24 14:34:44.989777 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983167 2565 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 24 14:34:44.990498 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983172 2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 24 14:34:44.990498 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983177 2565 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 24 14:34:44.990498 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983181 2565 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 24 14:34:44.990498 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983188 2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 24 14:34:44.990498 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983193 2565 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 24 14:34:44.990498 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983198 2565 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 24 14:34:44.990498 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983203 2565 flags.go:64] FLAG: --enable-load-reader="false" Jul 24 14:34:44.990498 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983208 2565 flags.go:64] FLAG: --enable-server="true" Jul 24 14:34:44.990498 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983212 2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 24 14:34:44.990498 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983219 2565 flags.go:64] FLAG: --event-burst="100" Jul 24 14:34:44.990498 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983224 2565 flags.go:64] FLAG: --event-qps="50" Jul 24 14:34:44.990498 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983228 2565 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 24 14:34:44.990498 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983233 2565 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 24 14:34:44.990498 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983238 2565 flags.go:64] FLAG: --eviction-hard="" Jul 24 14:34:44.990498 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983244 2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 24 14:34:44.990498 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983249 2565 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 24 14:34:44.990498 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983253 2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 24 14:34:44.990498 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983258 2565 flags.go:64] FLAG: --eviction-soft="" Jul 24 14:34:44.990498 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983263 2565 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 24 14:34:44.990498 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983267 2565 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 24 14:34:44.990498 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983273 2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 24 14:34:44.990498 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983278 2565 flags.go:64] FLAG: --experimental-mounter-path="" Jul 24 14:34:44.990498 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983285 2565 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 24 14:34:44.990498 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983289 2565 flags.go:64] FLAG: --fail-swap-on="true" Jul 24 14:34:44.990498 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983294 2565 flags.go:64] FLAG: --feature-gates="" Jul 24 14:34:44.991135 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983301 2565 flags.go:64] FLAG: --file-check-frequency="20s" Jul 24 14:34:44.991135 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983307 2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 24 14:34:44.991135 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983311 2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 24 14:34:44.991135 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983317 2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 24 14:34:44.991135 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983322 2565 flags.go:64] FLAG: --healthz-port="10248" Jul 24 14:34:44.991135 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983327 2565 flags.go:64] FLAG: --help="false" Jul 24 14:34:44.991135 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983331 2565 flags.go:64] FLAG: --hostname-override="ip-10-0-129-87.ec2.internal" Jul 24 14:34:44.991135 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983337 2565 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 24 14:34:44.991135 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983342 2565 flags.go:64] FLAG: --http-check-frequency="20s" Jul 24 14:34:44.991135 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983346 2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 24 14:34:44.991135 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983351 2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 24 14:34:44.991135 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983357 2565 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 24 14:34:44.991135 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983361 2565 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 24 14:34:44.991135 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983366 2565 flags.go:64] FLAG: --image-service-endpoint="" Jul 24 14:34:44.991135 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983370 2565 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 24 14:34:44.991135 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983375 2565 flags.go:64] FLAG: --kube-api-burst="100" Jul 24 14:34:44.991135 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983380 2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 24 14:34:44.991135 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983386 2565 flags.go:64] FLAG: --kube-api-qps="50" Jul 24 14:34:44.991135 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983390 2565 flags.go:64] FLAG: --kube-reserved="" Jul 24 14:34:44.991135 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983395 2565 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 24 14:34:44.991135 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983400 2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 24 14:34:44.991135 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983405 2565 flags.go:64] FLAG: --kubelet-cgroups="" Jul 24 14:34:44.991135 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983410 2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 24 14:34:44.991135 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983414 2565 flags.go:64] FLAG: --lock-file="" Jul 24 14:34:44.991724 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983419 2565 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 24 14:34:44.991724 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983424 2565 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 24 14:34:44.991724 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983428 2565 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 24 14:34:44.991724 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983437 2565 flags.go:64] FLAG: --log-json-split-stream="false" Jul 24 14:34:44.991724 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983443 2565 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 24 14:34:44.991724 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983449 2565 flags.go:64] FLAG: --log-text-split-stream="false" Jul 24 14:34:44.991724 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983454 2565 flags.go:64] FLAG: --logging-format="text" Jul 24 14:34:44.991724 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983458 2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 24 14:34:44.991724 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983466 2565 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 24 14:34:44.991724 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983471 2565 flags.go:64] FLAG: --manifest-url="" Jul 24 14:34:44.991724 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983475 2565 flags.go:64] FLAG: --manifest-url-header="" Jul 24 14:34:44.991724 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983482 2565 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 24 14:34:44.991724 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983487 2565 flags.go:64] FLAG: --max-open-files="1000000" Jul 24 14:34:44.991724 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983493 2565 flags.go:64] FLAG: --max-pods="110" Jul 24 14:34:44.991724 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983497 2565 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 24 14:34:44.991724 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983503 2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 24 14:34:44.991724 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983507 2565 flags.go:64] FLAG: --memory-manager-policy="None" Jul 24 14:34:44.991724 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983512 2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 24 14:34:44.991724 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983517 2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 24 14:34:44.991724 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983522 2565 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 24 14:34:44.991724 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983527 2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 24 14:34:44.991724 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983538 2565 flags.go:64] FLAG: --node-status-max-images="50" Jul 24 14:34:44.991724 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983542 2565 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 24 14:34:44.991724 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983547 2565 flags.go:64] FLAG: --oom-score-adj="-999" Jul 24 14:34:44.991724 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983553 2565 flags.go:64] FLAG: --pod-cidr="" Jul 24 14:34:44.992352 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983557 2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 24 14:34:44.992352 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983566 2565 flags.go:64] FLAG: --pod-manifest-path="" Jul 24 14:34:44.992352 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983570 2565 flags.go:64] FLAG: --pod-max-pids="-1" Jul 24 14:34:44.992352 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983575 2565 flags.go:64] FLAG: --pods-per-core="0" Jul 24 14:34:44.992352 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983580 2565 flags.go:64] FLAG: --port="10250" Jul 24 14:34:44.992352 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983585 2565 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 24 14:34:44.992352 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983589 2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0cf3ed778bc1d7397" Jul 24 14:34:44.992352 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983595 2565 flags.go:64] FLAG: --qos-reserved="" Jul 24 14:34:44.992352 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983600 2565 flags.go:64] FLAG: --read-only-port="10255" Jul 24 14:34:44.992352 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983605 2565 flags.go:64] FLAG: --register-node="true" Jul 24 14:34:44.992352 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983610 2565 flags.go:64] FLAG: --register-with-taints="" Jul 24 14:34:44.992352 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983615 2565 flags.go:64] FLAG: --registry-burst="10" Jul 24 14:34:44.992352 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983624 2565 flags.go:64] FLAG: --registry-qps="5" Jul 24 14:34:44.992352 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983629 2565 flags.go:64] FLAG: --reserved-cpus="" Jul 24 14:34:44.992352 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983633 2565 flags.go:64] FLAG: --reserved-memory="" Jul 24 14:34:44.992352 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983640 2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 24 14:34:44.992352 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983646 2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 24 14:34:44.992352 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983651 2565 flags.go:64] FLAG: --rotate-certificates="false" Jul 24 14:34:44.992352 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983656 2565 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 24 14:34:44.992352 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983661 2565 flags.go:64] FLAG: --runonce="false" Jul 24 14:34:44.992352 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983666 2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 24 14:34:44.992352 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983671 2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 24 14:34:44.992352 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983676 2565 flags.go:64] FLAG: --seccomp-default="false" Jul 24 14:34:44.992352 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983681 2565 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 24 14:34:44.992352 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983685 2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 24 14:34:44.992984 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983690 2565 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 24 14:34:44.992984 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983695 2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 24 14:34:44.992984 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983700 2565 flags.go:64] FLAG: --storage-driver-password="root" Jul 24 14:34:44.992984 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983705 2565 flags.go:64] FLAG: --storage-driver-secure="false" Jul 24 14:34:44.992984 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983710 2565 flags.go:64] FLAG: --storage-driver-table="stats" Jul 24 14:34:44.992984 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983715 2565 flags.go:64] FLAG: --storage-driver-user="root" Jul 24 14:34:44.992984 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983719 2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 24 14:34:44.992984 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983724 2565 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 24 14:34:44.992984 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983729 2565 flags.go:64] FLAG: --system-cgroups="" Jul 24 14:34:44.992984 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983734 2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 24 14:34:44.992984 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983742 2565 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 24 14:34:44.992984 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983747 2565 flags.go:64] FLAG: --tls-cert-file="" Jul 24 14:34:44.992984 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983752 2565 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 24 14:34:44.992984 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983759 2565 flags.go:64] FLAG: --tls-min-version="" Jul 24 14:34:44.992984 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983764 2565 flags.go:64] FLAG: --tls-private-key-file="" Jul 24 14:34:44.992984 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983768 2565 flags.go:64] FLAG: --topology-manager-policy="none" Jul 24 14:34:44.992984 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983773 2565 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 24 14:34:44.992984 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983777 2565 flags.go:64] FLAG: --topology-manager-scope="container" Jul 24 14:34:44.992984 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983783 2565 flags.go:64] FLAG: --v="2" Jul 24 14:34:44.992984 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983791 2565 flags.go:64] FLAG: --version="false" Jul 24 14:34:44.992984 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983798 2565 flags.go:64] FLAG: --vmodule="" Jul 24 14:34:44.992984 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983804 2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 24 14:34:44.992984 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.983810 2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 24 14:34:44.992984 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984006 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 14:34:44.992984 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984013 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 14:34:44.993619 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984018 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 14:34:44.993619 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984023 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 14:34:44.993619 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984027 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 14:34:44.993619 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984032 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 14:34:44.993619 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984036 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 14:34:44.993619 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984040 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 14:34:44.993619 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984044 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 14:34:44.993619 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984049 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 14:34:44.993619 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984053 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 14:34:44.993619 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984058 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 14:34:44.993619 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984062 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 14:34:44.993619 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984066 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 14:34:44.993619 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984070 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 14:34:44.993619 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984075 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 14:34:44.993619 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984079 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 14:34:44.993619 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984083 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 14:34:44.993619 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984087 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 14:34:44.993619 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984092 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 14:34:44.993619 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984096 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 14:34:44.993619 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984100 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 14:34:44.994184 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984107 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 14:34:44.994184 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984113 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 14:34:44.994184 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984118 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 14:34:44.994184 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984123 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 14:34:44.994184 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984127 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 14:34:44.994184 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984132 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 14:34:44.994184 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984139 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 14:34:44.994184 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984144 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 14:34:44.994184 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984153 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 14:34:44.994184 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984159 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 14:34:44.994184 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984166 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 14:34:44.994184 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984171 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 14:34:44.994184 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984176 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 14:34:44.994184 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984180 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 14:34:44.994184 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984185 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 14:34:44.994184 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984189 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 14:34:44.994184 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984193 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 14:34:44.994184 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984197 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 14:34:44.994623 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984202 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 14:34:44.994623 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984206 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 14:34:44.994623 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984211 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 14:34:44.994623 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984216 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 14:34:44.994623 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984221 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 14:34:44.994623 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984225 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 14:34:44.994623 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984230 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 14:34:44.994623 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984235 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 14:34:44.994623 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984240 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 14:34:44.994623 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984244 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 14:34:44.994623 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984248 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 14:34:44.994623 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984253 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 14:34:44.994623 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984257 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 14:34:44.994623 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984261 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 14:34:44.994623 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984266 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 14:34:44.994623 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984271 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 14:34:44.994623 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984275 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 24 14:34:44.994623 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984279 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 14:34:44.994623 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984283 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 14:34:44.995106 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984288 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 14:34:44.995106 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984293 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 14:34:44.995106 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984298 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 14:34:44.995106 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984302 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 14:34:44.995106 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984307 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 14:34:44.995106 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984313 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 14:34:44.995106 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984317 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 14:34:44.995106 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984322 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 14:34:44.995106 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984326 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 14:34:44.995106 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984330 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 14:34:44.995106 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984334 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 14:34:44.995106 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984339 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 14:34:44.995106 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984343 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 14:34:44.995106 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984347 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 14:34:44.995106 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984351 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 14:34:44.995106 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984355 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 14:34:44.995106 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984360 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 14:34:44.995106 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984364 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 14:34:44.995106 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984368 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 14:34:44.995106 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984372 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 14:34:44.995591 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984376 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 14:34:44.995591 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984380 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 14:34:44.995591 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984384 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 14:34:44.995591 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984388 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 14:34:44.995591 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984393 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 14:34:44.995591 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984397 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 14:34:44.995591 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984401 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 14:34:44.995591 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984405 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 14:34:44.995591 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984410 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 14:34:44.995591 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984414 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 14:34:44.995591 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984418 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 14:34:44.995591 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984422 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 14:34:44.995591 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984426 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 14:34:44.995591 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984432 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 14:34:44.995591 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984436 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 14:34:44.995591 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984440 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 14:34:44.995591 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984447 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 14:34:44.995591 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984457 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 14:34:44.995591 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984461 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 14:34:44.995591 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.984466 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 14:34:44.996087 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.985188 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 24 14:34:44.996087 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.991696 2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 24 14:34:44.996087 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.991712 2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 24 14:34:44.996087 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.992358 2565 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 24 14:34:44.996087 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.992366 2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 24 14:34:44.996087 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992426 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 14:34:44.996087 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992431 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 14:34:44.996087 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992434 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 14:34:44.996087 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992439 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 14:34:44.996087 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992443 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 14:34:44.996087 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992446 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 14:34:44.996087 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992450 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 14:34:44.996087 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992452 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 14:34:44.996087 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992455 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 14:34:44.996431 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992458 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 14:34:44.996431 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992460 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 14:34:44.996431 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992463 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 14:34:44.996431 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992466 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 14:34:44.996431 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992468 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 14:34:44.996431 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992471 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 14:34:44.996431 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992474 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 14:34:44.996431 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992477 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 14:34:44.996431 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992481 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 14:34:44.996431 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992485 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 14:34:44.996431 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992488 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 14:34:44.996431 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992490 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 14:34:44.996431 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992493 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 14:34:44.996431 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992496 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 14:34:44.996431 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992499 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 14:34:44.996431 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992502 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 14:34:44.996431 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992504 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 14:34:44.996431 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992507 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 14:34:44.996431 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992510 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 14:34:44.996431 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992512 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 14:34:44.996940 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992517 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 14:34:44.996940 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992520 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 14:34:44.996940 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992523 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 14:34:44.996940 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992525 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 14:34:44.996940 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992528 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 14:34:44.996940 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992531 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 14:34:44.996940 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992534 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 14:34:44.996940 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992536 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 14:34:44.996940 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992539 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 14:34:44.996940 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992541 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 14:34:44.996940 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992544 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 14:34:44.996940 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992547 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 14:34:44.996940 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992549 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 14:34:44.996940 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992552 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 14:34:44.996940 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992554 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 14:34:44.996940 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992557 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 14:34:44.996940 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992560 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 14:34:44.996940 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992562 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 14:34:44.996940 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992565 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 14:34:44.996940 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992567 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 14:34:44.997397 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992570 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 14:34:44.997397 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992572 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 14:34:44.997397 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992575 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 14:34:44.997397 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992577 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 14:34:44.997397 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992580 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 14:34:44.997397 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992583 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 14:34:44.997397 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992585 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 14:34:44.997397 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992588 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 14:34:44.997397 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992590 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 14:34:44.997397 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992593 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 14:34:44.997397 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992596 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 14:34:44.997397 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992598 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 14:34:44.997397 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992601 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 14:34:44.997397 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992604 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 14:34:44.997397 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992607 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 14:34:44.997397 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992610 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 14:34:44.997397 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992612 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 14:34:44.997397 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992615 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 14:34:44.997397 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992617 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 14:34:44.997397 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992620 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 14:34:44.997908 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992622 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 14:34:44.997908 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992625 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 14:34:44.997908 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992627 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 14:34:44.997908 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992630 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 14:34:44.997908 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992632 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 14:34:44.997908 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992635 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 24 14:34:44.997908 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992637 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 14:34:44.997908 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992640 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 14:34:44.997908 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992642 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 14:34:44.997908 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992645 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 14:34:44.997908 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992647 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 14:34:44.997908 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992650 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 14:34:44.997908 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992653 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 14:34:44.997908 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992655 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 14:34:44.997908 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992658 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 14:34:44.997908 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992662 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 14:34:44.997908 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992665 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 14:34:44.997908 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992668 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 14:34:44.997908 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992671 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 14:34:44.997908 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992674 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 14:34:44.998415 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992677 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 14:34:44.998415 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992680 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 14:34:44.998415 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992683 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 14:34:44.998415 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992685 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 14:34:44.998415 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992688 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 14:34:44.998415 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992691 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 14:34:44.998415 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992709 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 14:34:44.998415 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992712 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 14:34:44.998415 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992715 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 14:34:44.998415 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992718 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 14:34:44.998415 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.992723 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 24 14:34:44.998415 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992859 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 14:34:44.998415 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992863 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 14:34:44.998415 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992866 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 14:34:44.998754 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992869 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 14:34:44.998754 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992872 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 14:34:44.998754 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992875 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 14:34:44.998754 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992878 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 14:34:44.998754 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992881 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 14:34:44.998754 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992883 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 14:34:44.998754 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992886 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 14:34:44.998754 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992889 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 14:34:44.998754 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992891 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 14:34:44.998754 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992894 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 14:34:44.998754 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992896 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 14:34:44.998754 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992899 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 14:34:44.998754 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992902 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 14:34:44.998754 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992904 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 14:34:44.998754 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992907 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 14:34:44.998754 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992924 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 14:34:44.998754 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992926 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 14:34:44.998754 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992930 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 14:34:44.998754 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992932 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 14:34:44.998754 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992935 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 14:34:44.999254 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992938 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 14:34:44.999254 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992940 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 14:34:44.999254 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992943 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 14:34:44.999254 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992946 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 14:34:44.999254 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992948 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 14:34:44.999254 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992957 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 14:34:44.999254 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992959 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 14:34:44.999254 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992962 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 14:34:44.999254 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992965 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 14:34:44.999254 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992967 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 14:34:44.999254 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992970 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 14:34:44.999254 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992972 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 14:34:44.999254 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992975 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 14:34:44.999254 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992977 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 14:34:44.999254 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992980 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 14:34:44.999254 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992983 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 14:34:44.999254 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992985 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 14:34:44.999254 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992988 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 14:34:44.999254 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992991 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 14:34:44.999254 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992994 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 14:34:44.999718 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.992996 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 14:34:44.999718 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.993000 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 14:34:44.999718 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.993004 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 14:34:44.999718 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.993007 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 14:34:44.999718 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.993009 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 14:34:44.999718 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.993018 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 14:34:44.999718 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.993021 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 14:34:44.999718 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.993024 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 14:34:44.999718 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.993026 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 14:34:44.999718 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.993029 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 14:34:44.999718 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.993032 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 14:34:44.999718 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.993034 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 14:34:44.999718 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.993037 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 14:34:44.999718 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.993039 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 14:34:44.999718 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.993042 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 14:34:44.999718 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.993045 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 14:34:44.999718 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.993047 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 14:34:44.999718 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.993050 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 14:34:44.999718 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.993060 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 14:34:45.000197 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.993063 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 14:34:45.000197 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.993065 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 14:34:45.000197 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.993068 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 14:34:45.000197 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.993070 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 14:34:45.000197 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.993073 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 14:34:45.000197 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.993075 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 14:34:45.000197 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.993078 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 14:34:45.000197 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.993080 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 14:34:45.000197 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.993083 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 14:34:45.000197 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.993085 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 14:34:45.000197 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.993088 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 14:34:45.000197 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.993090 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 14:34:45.000197 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.993093 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 14:34:45.000197 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.993095 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 14:34:45.000197 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.993097 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 14:34:45.000197 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.993100 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 14:34:45.000197 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.993103 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 24 14:34:45.000197 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.993105 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 14:34:45.000197 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.993108 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 14:34:45.000197 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.993110 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 14:34:45.000683 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.993113 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 14:34:45.000683 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.993115 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 14:34:45.000683 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.993121 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 14:34:45.000683 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.993124 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 14:34:45.000683 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.993127 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 14:34:45.000683 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.993130 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 14:34:45.000683 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.993133 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 14:34:45.000683 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.993136 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 14:34:45.000683 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.993138 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 14:34:45.000683 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.993141 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 14:34:45.000683 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.993144 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 14:34:45.000683 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.993147 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 14:34:45.000683 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.993155 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 14:34:45.000683 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.993158 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 14:34:45.000683 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.993161 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 14:34:45.000683 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.993164 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 14:34:45.000683 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:44.993166 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 14:34:45.001122 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.993171 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 24 14:34:45.001122 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.993286 2565 server.go:962] "Client rotation is on, will bootstrap in background" Jul 24 14:34:45.001122 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.995872 2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 24 14:34:45.001122 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.997039 2565 server.go:1019] "Starting client certificate rotation" Jul 24 14:34:45.001122 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.997145 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 24 14:34:45.001122 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.997658 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 24 14:34:45.001122 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:44.999838 2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 24 14:34:45.001885 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.001871 2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 24 14:34:45.011962 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.011939 2565 log.go:25] "Validated CRI v1 runtime API" Jul 24 14:34:45.014037 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.014021 2565 log.go:25] "Validated CRI v1 image API" Jul 24 14:34:45.014818 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.014793 2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 24 14:34:45.016802 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.016781 2565 fs.go:135] Filesystem UUIDs: map[46531cea-b081-42e7-a67c-791d87690a93:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 8dfbd616-9b84-4a8e-a26e-796b0fdb0746:/dev/nvme0n1p4] Jul 24 14:34:45.016858 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.016803 2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 24 14:34:45.022695 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.022581 2565 manager.go:216] Machine: {Timestamp:2026-07-24 14:34:45.020683201 +0000 UTC m=+0.267629503 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3109355 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25b2e9bc9e01ccd90522b6dc18c974 SystemUUID:ec25b2e9-bc9e-01cc-d905-22b6dc18c974 BootID:eef13f9b-1f9c-4d80-8142-e60b31413567 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:81:51:3d:ca:39 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:81:51:3d:ca:39 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:96:07:40:5c:75:95 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 24 14:34:45.022695 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.022691 2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 24 14:34:45.022794 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.022772 2565 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 24 14:34:45.025286 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.025262 2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 24 14:34:45.025448 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.025289 2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-87.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 24 14:34:45.026435 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.026424 2565 topology_manager.go:138] "Creating topology manager with none policy" Jul 24 14:34:45.026473 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.026438 2565 container_manager_linux.go:309] "Creating device plugin manager" Jul 24 14:34:45.026473 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.026446 2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 24 14:34:45.026991 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.026980 2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 24 14:34:45.028111 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.028096 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 24 14:34:45.028245 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.028236 2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 24 14:34:45.031816 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.031804 2565 state_mem.go:36] "Initialized new in-memory state store" Jul 24 14:34:45.031937 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.031927 2565 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 24 14:34:45.031968 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.031957 2565 kubelet.go:486] "Attempting to sync node with API server" Jul 24 14:34:45.031968 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.031966 2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 24 14:34:45.032029 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.031980 2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 24 14:34:45.032029 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.031989 2565 kubelet.go:398] "Adding apiserver pod source" Jul 24 14:34:45.032029 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.031998 2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 24 14:34:45.032445 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.032433 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 24 14:34:45.032488 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.032452 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 24 14:34:45.034283 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.034265 2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 24 14:34:45.036206 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.036193 2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 24 14:34:45.036263 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.036223 2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 24 14:34:45.037691 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.037680 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 24 14:34:45.037725 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.037696 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 24 14:34:45.037725 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.037703 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 24 14:34:45.037725 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.037709 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 24 14:34:45.037725 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.037718 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 24 14:34:45.037725 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.037723 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 24 14:34:45.037892 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.037732 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 24 14:34:45.037892 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.037738 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 24 14:34:45.037892 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.037744 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 24 14:34:45.037892 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.037749 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 24 14:34:45.037892 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.037764 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 24 14:34:45.037892 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.037769 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 24 14:34:45.038975 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.038962 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 24 14:34:45.039009 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.038981 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 24 14:34:45.042580 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.042566 2565 server.go:1268] "Started kubelet" Jul 24 14:34:45.042724 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.042658 2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 24 14:34:45.042791 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.042661 2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 24 14:34:45.042888 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.042868 2565 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 24 14:34:45.043385 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:45.043359 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 24 14:34:45.043503 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:45.043479 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-87.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 24 14:34:45.043503 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.043496 2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-87.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 24 14:34:45.043550 ip-10-0-129-87 systemd[1]: Started Kubernetes Kubelet. Jul 24 14:34:45.044589 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.044183 2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 24 14:34:45.045558 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.045545 2565 server.go:310] "Adding debug handlers to kubelet server" Jul 24 14:34:45.048552 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:45.048529 2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 24 14:34:45.054345 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:45.053515 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-87.ec2.internal.18c54071d93ed711 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-87.ec2.internal,UID:ip-10-0-129-87.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-87.ec2.internal,},FirstTimestamp:2026-07-24 14:34:45.042525969 +0000 UTC m=+0.289472272,LastTimestamp:2026-07-24 14:34:45.042525969 +0000 UTC m=+0.289472272,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-87.ec2.internal,}" Jul 24 14:34:45.054532 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.054513 2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 24 14:34:45.054532 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.054523 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 24 14:34:45.054677 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:45.054586 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-87.ec2.internal\" not found" Jul 24 14:34:45.055123 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.055011 2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 24 14:34:45.055123 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.055015 2565 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 24 14:34:45.055123 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.055035 2565 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 24 14:34:45.055319 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.055167 2565 reconstruct.go:97] "Volume reconstruction finished" Jul 24 14:34:45.055319 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.055177 2565 reconciler.go:29] "Reconciler: start to sync state" Jul 24 14:34:45.055748 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.055666 2565 factory.go:153] Registering CRI-O factory Jul 24 14:34:45.055748 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.055702 2565 factory.go:223] Registration of the crio container factory successfully Jul 24 14:34:45.055845 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.055752 2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 24 14:34:45.055845 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.055761 2565 factory.go:55] Registering systemd factory Jul 24 14:34:45.055845 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.055767 2565 factory.go:223] Registration of the systemd container factory successfully Jul 24 14:34:45.055845 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.055800 2565 factory.go:103] Registering Raw factory Jul 24 14:34:45.055845 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.055813 2565 manager.go:1196] Started watching for new ooms in manager Jul 24 14:34:45.056298 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.056281 2565 manager.go:349] Starting recovery of all containers Jul 24 14:34:45.056727 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:45.056702 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 24 14:34:45.057165 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:45.057115 2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-87.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 24 14:34:45.058837 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.058812 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9b24t" Jul 24 14:34:45.067990 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.067956 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9b24t" Jul 24 14:34:45.070107 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.070091 2565 manager.go:354] Recovery completed Jul 24 14:34:45.074088 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.074074 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 14:34:45.076051 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.076035 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-87.ec2.internal" event="NodeHasSufficientMemory" Jul 24 14:34:45.076136 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.076068 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-87.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 14:34:45.076136 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.076101 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-87.ec2.internal" event="NodeHasSufficientPID" Jul 24 14:34:45.076808 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.076791 2565 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 24 14:34:45.076808 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.076807 2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 24 14:34:45.076939 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.076831 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 14:34:45.076939 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.076885 2565 state_mem.go:36] "Initialized new in-memory state store" Jul 24 14:34:45.077670 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.077631 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-87.ec2.internal" event="NodeHasSufficientMemory" Jul 24 14:34:45.077747 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.077682 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-87.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 14:34:45.077747 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.077693 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-87.ec2.internal" event="NodeHasSufficientPID" Jul 24 14:34:45.079419 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.079405 2565 policy_none.go:49] "None policy: Start" Jul 24 14:34:45.079419 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.079420 2565 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 24 14:34:45.079510 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.079430 2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 24 14:34:45.081388 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.081377 2565 policy_none.go:47] "Start" Jul 24 14:34:45.125499 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.125482 2565 manager.go:337] "Starting Device Plugin manager" Jul 24 14:34:45.139080 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:45.125515 2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 24 14:34:45.139080 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.125525 2565 server.go:87] "Starting device plugin registration server" Jul 24 14:34:45.139080 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.125826 2565 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 24 14:34:45.139080 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.125839 2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 24 14:34:45.139080 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.125968 2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 24 14:34:45.139080 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.126049 2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 24 14:34:45.139080 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.126059 2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 24 14:34:45.139080 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:45.126636 2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 24 14:34:45.139080 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:45.126686 2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-87.ec2.internal\" not found" Jul 24 14:34:45.197331 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.197289 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 24 14:34:45.198561 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.198541 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 24 14:34:45.198675 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.198579 2565 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 24 14:34:45.198675 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.198607 2565 kubelet.go:2448] "Starting kubelet main sync loop" Jul 24 14:34:45.198675 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:45.198648 2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 24 14:34:45.201061 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.201037 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 14:34:45.226192 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.226137 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 14:34:45.227150 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.227123 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-87.ec2.internal" event="NodeHasSufficientMemory" Jul 24 14:34:45.227246 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.227164 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-87.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 14:34:45.227246 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.227180 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-87.ec2.internal" event="NodeHasSufficientPID" Jul 24 14:34:45.227246 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.227204 2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-87.ec2.internal" Jul 24 14:34:45.235574 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.235554 2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-87.ec2.internal" Jul 24 14:34:45.235651 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:45.235583 2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-87.ec2.internal\": node \"ip-10-0-129-87.ec2.internal\" not found" Jul 24 14:34:45.249454 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:45.249432 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-87.ec2.internal\" not found" Jul 24 14:34:45.299355 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.299324 2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-87.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-87.ec2.internal"] Jul 24 14:34:45.299431 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.299402 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 14:34:45.300311 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.300296 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-87.ec2.internal" event="NodeHasSufficientMemory" Jul 24 14:34:45.300391 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.300324 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-87.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 14:34:45.300391 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.300333 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-87.ec2.internal" event="NodeHasSufficientPID" Jul 24 14:34:45.302634 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.302621 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 14:34:45.302751 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.302734 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-87.ec2.internal" Jul 24 14:34:45.302820 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.302768 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 14:34:45.303343 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.303327 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-87.ec2.internal" event="NodeHasSufficientMemory" Jul 24 14:34:45.303343 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.303339 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-87.ec2.internal" event="NodeHasSufficientMemory" Jul 24 14:34:45.303487 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.303354 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-87.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 14:34:45.303487 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.303362 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-87.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 14:34:45.303487 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.303368 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-87.ec2.internal" event="NodeHasSufficientPID" Jul 24 14:34:45.303487 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.303377 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-87.ec2.internal" event="NodeHasSufficientPID" Jul 24 14:34:45.305629 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.305615 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-87.ec2.internal" Jul 24 14:34:45.305696 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.305641 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 14:34:45.306353 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.306339 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-87.ec2.internal" event="NodeHasSufficientMemory" Jul 24 14:34:45.306428 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.306364 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-87.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 14:34:45.306428 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.306374 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-87.ec2.internal" event="NodeHasSufficientPID" Jul 24 14:34:45.319455 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:45.319438 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-87.ec2.internal\" not found" node="ip-10-0-129-87.ec2.internal" Jul 24 14:34:45.322755 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:45.322742 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-87.ec2.internal\" not found" node="ip-10-0-129-87.ec2.internal" Jul 24 14:34:45.349811 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:45.349790 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-87.ec2.internal\" not found" Jul 24 14:34:45.357645 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.357619 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2f7e8cdd0c9e683123e995ae57bab829-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-87.ec2.internal\" (UID: \"2f7e8cdd0c9e683123e995ae57bab829\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-87.ec2.internal" Jul 24 14:34:45.357732 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.357649 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f7e8cdd0c9e683123e995ae57bab829-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-87.ec2.internal\" (UID: \"2f7e8cdd0c9e683123e995ae57bab829\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-87.ec2.internal" Jul 24 14:34:45.357732 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.357667 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a4818398c4598e46d283eeb2e2a1a7ab-config\") pod \"kube-apiserver-proxy-ip-10-0-129-87.ec2.internal\" (UID: \"a4818398c4598e46d283eeb2e2a1a7ab\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-87.ec2.internal" Jul 24 14:34:45.450090 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:45.450060 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-87.ec2.internal\" not found" Jul 24 14:34:45.458672 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.458649 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a4818398c4598e46d283eeb2e2a1a7ab-config\") pod \"kube-apiserver-proxy-ip-10-0-129-87.ec2.internal\" (UID: \"a4818398c4598e46d283eeb2e2a1a7ab\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-87.ec2.internal" Jul 24 14:34:45.458784 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.458681 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2f7e8cdd0c9e683123e995ae57bab829-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-87.ec2.internal\" (UID: \"2f7e8cdd0c9e683123e995ae57bab829\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-87.ec2.internal" Jul 24 14:34:45.458784 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.458703 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f7e8cdd0c9e683123e995ae57bab829-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-87.ec2.internal\" (UID: \"2f7e8cdd0c9e683123e995ae57bab829\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-87.ec2.internal" Jul 24 14:34:45.458784 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.458773 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a4818398c4598e46d283eeb2e2a1a7ab-config\") pod \"kube-apiserver-proxy-ip-10-0-129-87.ec2.internal\" (UID: \"a4818398c4598e46d283eeb2e2a1a7ab\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-87.ec2.internal" Jul 24 14:34:45.458903 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.458823 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f7e8cdd0c9e683123e995ae57bab829-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-87.ec2.internal\" (UID: \"2f7e8cdd0c9e683123e995ae57bab829\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-87.ec2.internal" Jul 24 14:34:45.458903 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.458867 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2f7e8cdd0c9e683123e995ae57bab829-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-87.ec2.internal\" (UID: \"2f7e8cdd0c9e683123e995ae57bab829\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-87.ec2.internal" Jul 24 14:34:45.551176 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:45.551117 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-87.ec2.internal\" not found" Jul 24 14:34:45.621595 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.621560 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-87.ec2.internal" Jul 24 14:34:45.627091 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.626606 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-87.ec2.internal" Jul 24 14:34:45.651582 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:45.651556 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-87.ec2.internal\" not found" Jul 24 14:34:45.752103 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:45.752066 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-87.ec2.internal\" not found" Jul 24 14:34:45.852635 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:45.852545 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-87.ec2.internal\" not found" Jul 24 14:34:45.947209 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.947178 2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 14:34:45.953158 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:45.953137 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-87.ec2.internal\" not found" Jul 24 14:34:45.996585 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.996560 2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 24 14:34:45.997029 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.996692 2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 24 14:34:45.997029 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:45.996735 2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 24 14:34:46.053642 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:46.053607 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-87.ec2.internal\" not found" Jul 24 14:34:46.074656 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:46.074623 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-23 14:29:47 +0000 UTC" deadline="2028-03-06 20:29:10.132970913 +0000 UTC" Jul 24 14:34:46.074656 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:46.074651 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14189h54m24.058322744s" Jul 24 14:34:46.154018 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:46.153954 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-87.ec2.internal\" not found" Jul 24 14:34:48.186761 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:48.186723 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4818398c4598e46d283eeb2e2a1a7ab.slice/crio-208e555239a108c2b15724e13e275c6fba9e9e968b87ac34eb41cced2fdab5a5 WatchSource:0}: Error finding container 208e555239a108c2b15724e13e275c6fba9e9e968b87ac34eb41cced2fdab5a5: Status 404 returned error can't find the container with id 208e555239a108c2b15724e13e275c6fba9e9e968b87ac34eb41cced2fdab5a5 Jul 24 14:34:48.187128 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:48.187108 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f7e8cdd0c9e683123e995ae57bab829.slice/crio-fff4660b1df8ea6856ef7d9202625b7050c3d7ca7f32f60774de8b50ed309f6f WatchSource:0}: Error finding container fff4660b1df8ea6856ef7d9202625b7050c3d7ca7f32f60774de8b50ed309f6f: Status 404 returned error can't find the container with id fff4660b1df8ea6856ef7d9202625b7050c3d7ca7f32f60774de8b50ed309f6f Jul 24 14:34:48.192087 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:48.192070 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 24 14:34:48.220219 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:48.220190 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-87.ec2.internal\" not found" Jul 24 14:34:48.279258 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:48.279228 2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 14:34:48.321115 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:48.321075 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-87.ec2.internal\" not found" Jul 24 14:34:48.421513 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:48.421426 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-87.ec2.internal\" not found" Jul 24 14:34:48.522173 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:48.522143 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-87.ec2.internal\" not found" Jul 24 14:34:48.583285 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:48.583252 2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 14:34:48.620423 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:48.620385 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-87.ec2.internal" Jul 24 14:34:48.630649 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:48.630630 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 24 14:34:48.631495 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:48.631481 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-87.ec2.internal" Jul 24 14:34:48.637920 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:48.637907 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 24 14:34:48.956731 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:48.956687 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 14:34:48.998894 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:48.998862 2565 apiserver.go:52] "Watching apiserver" Jul 24 14:34:49.007156 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.007124 2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 24 14:34:49.007599 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.007570 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-v7jqr","kube-system/konnectivity-agent-q5258","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vc5z","openshift-cluster-node-tuning-operator/tuned-pc4m9","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-87.ec2.internal","openshift-multus/multus-additional-cni-plugins-vvk6x","openshift-multus/multus-g6tbw","openshift-multus/network-metrics-daemon-2jd76","kube-system/kube-apiserver-proxy-ip-10-0-129-87.ec2.internal","openshift-dns/node-resolver-2w5hp","openshift-image-registry/node-ca-kt54d","openshift-network-diagnostics/network-check-target-cjzwq","openshift-network-operator/iptables-alerter-mkh45","openshift-ovn-kubernetes/ovnkube-node-n8n54"] Jul 24 14:34:49.010107 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.010080 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-g6tbw" Jul 24 14:34:49.012425 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.012402 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kt54d" Jul 24 14:34:49.013724 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.013635 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-lfchs\"" Jul 24 14:34:49.013868 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.013850 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 24 14:34:49.015011 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.013994 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 24 14:34:49.015011 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.014023 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 24 14:34:49.015011 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.014290 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 24 14:34:49.015291 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.015272 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 24 14:34:49.016688 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.016665 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 24 14:34:49.016884 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.016867 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 24 14:34:49.017094 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.017075 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hrlxc\"" Jul 24 14:34:49.017238 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.017168 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vc5z" Jul 24 14:34:49.019136 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.019106 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pc4m9" Jul 24 14:34:49.019535 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.019518 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 24 14:34:49.019840 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.019822 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-r94wk\"" Jul 24 14:34:49.019925 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.019874 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 24 14:34:49.019925 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.019889 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 24 14:34:49.020296 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.020280 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 24 14:34:49.021793 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.021776 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 24 14:34:49.022021 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.022002 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 24 14:34:49.022102 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.022086 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-pthrv\"" Jul 24 14:34:49.022313 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.022293 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:34:49.024780 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.024463 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vvk6x" Jul 24 14:34:49.024780 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.024596 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 24 14:34:49.025193 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.025175 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 24 14:34:49.025295 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.025279 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 24 14:34:49.025352 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.025292 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 24 14:34:49.025352 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.025338 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-b2n6h\"" Jul 24 14:34:49.025455 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.025393 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 24 14:34:49.025455 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.025438 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 24 14:34:49.026977 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.026957 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7tpql\"" Jul 24 14:34:49.027294 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.027259 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 24 14:34:49.027390 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.027337 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 24 14:34:49.027915 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.027901 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jd76" Jul 24 14:34:49.027999 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:49.027975 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jd76" podUID="208712d7-ea7e-430c-b730-e6bf290b2fcd" Jul 24 14:34:49.030272 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.030253 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mkh45" Jul 24 14:34:49.033328 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.032822 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-q5258" Jul 24 14:34:49.033328 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.032958 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c7619283-a7ed-4678-a867-2d22252a0e29-host-run-multus-certs\") pod \"multus-g6tbw\" (UID: \"c7619283-a7ed-4678-a867-2d22252a0e29\") " pod="openshift-multus/multus-g6tbw" Jul 24 14:34:49.033328 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.032996 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tzcg\" (UniqueName: \"kubernetes.io/projected/4a748576-5432-4fcf-b10f-5c488963ba3d-kube-api-access-7tzcg\") pod \"node-ca-kt54d\" (UID: \"4a748576-5432-4fcf-b10f-5c488963ba3d\") " pod="openshift-image-registry/node-ca-kt54d" Jul 24 14:34:49.033328 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.033023 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a-run\") pod \"tuned-pc4m9\" (UID: \"9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a\") " pod="openshift-cluster-node-tuning-operator/tuned-pc4m9" Jul 24 14:34:49.033328 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.033046 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a-sys\") pod \"tuned-pc4m9\" (UID: \"9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a\") " pod="openshift-cluster-node-tuning-operator/tuned-pc4m9" Jul 24 14:34:49.033328 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.033084 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4ec9750f-187d-4f04-89e3-d915de6e9778-ovn-node-metrics-cert\") pod \"ovnkube-node-n8n54\" (UID: \"4ec9750f-187d-4f04-89e3-d915de6e9778\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:34:49.033328 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.033142 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c7619283-a7ed-4678-a867-2d22252a0e29-multus-socket-dir-parent\") pod \"multus-g6tbw\" (UID: \"c7619283-a7ed-4678-a867-2d22252a0e29\") " pod="openshift-multus/multus-g6tbw" Jul 24 14:34:49.033328 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.033172 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 24 14:34:49.033328 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.033173 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c7619283-a7ed-4678-a867-2d22252a0e29-host-var-lib-kubelet\") pod \"multus-g6tbw\" (UID: \"c7619283-a7ed-4678-a867-2d22252a0e29\") " pod="openshift-multus/multus-g6tbw" Jul 24 14:34:49.033328 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.033225 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a10fad6d-bf8a-4154-8a15-3028177e8226-etc-selinux\") pod \"aws-ebs-csi-driver-node-4vc5z\" (UID: \"a10fad6d-bf8a-4154-8a15-3028177e8226\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vc5z" Jul 24 14:34:49.033328 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.033253 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4ec9750f-187d-4f04-89e3-d915de6e9778-run-systemd\") pod \"ovnkube-node-n8n54\" (UID: \"4ec9750f-187d-4f04-89e3-d915de6e9778\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:34:49.033328 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.033292 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4ec9750f-187d-4f04-89e3-d915de6e9778-etc-openvswitch\") pod \"ovnkube-node-n8n54\" (UID: \"4ec9750f-187d-4f04-89e3-d915de6e9778\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:34:49.033328 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.033330 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4ec9750f-187d-4f04-89e3-d915de6e9778-host-run-ovn-kubernetes\") pod \"ovnkube-node-n8n54\" (UID: \"4ec9750f-187d-4f04-89e3-d915de6e9778\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:34:49.034074 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.033359 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4ec9750f-187d-4f04-89e3-d915de6e9778-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n8n54\" (UID: \"4ec9750f-187d-4f04-89e3-d915de6e9778\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:34:49.034074 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.033388 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c7619283-a7ed-4678-a867-2d22252a0e29-multus-daemon-config\") pod \"multus-g6tbw\" (UID: \"c7619283-a7ed-4678-a867-2d22252a0e29\") " pod="openshift-multus/multus-g6tbw" Jul 24 14:34:49.034074 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.033428 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ec9750f-187d-4f04-89e3-d915de6e9778-host-kubelet\") pod \"ovnkube-node-n8n54\" (UID: \"4ec9750f-187d-4f04-89e3-d915de6e9778\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:34:49.034074 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.033442 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 24 14:34:49.034074 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.033458 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a10fad6d-bf8a-4154-8a15-3028177e8226-device-dir\") pod \"aws-ebs-csi-driver-node-4vc5z\" (UID: \"a10fad6d-bf8a-4154-8a15-3028177e8226\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vc5z" Jul 24 14:34:49.034074 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.033504 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a-lib-modules\") pod \"tuned-pc4m9\" (UID: \"9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a\") " pod="openshift-cluster-node-tuning-operator/tuned-pc4m9" Jul 24 14:34:49.034074 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.033513 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-9p6tx\"" Jul 24 14:34:49.034074 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.033555 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a-etc-tuned\") pod \"tuned-pc4m9\" (UID: \"9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a\") " pod="openshift-cluster-node-tuning-operator/tuned-pc4m9" Jul 24 14:34:49.034074 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.033589 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c7619283-a7ed-4678-a867-2d22252a0e29-cni-binary-copy\") pod \"multus-g6tbw\" (UID: \"c7619283-a7ed-4678-a867-2d22252a0e29\") " pod="openshift-multus/multus-g6tbw" Jul 24 14:34:49.034074 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.033625 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c7619283-a7ed-4678-a867-2d22252a0e29-host-run-k8s-cni-cncf-io\") pod \"multus-g6tbw\" (UID: \"c7619283-a7ed-4678-a867-2d22252a0e29\") " pod="openshift-multus/multus-g6tbw" Jul 24 14:34:49.034074 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.033650 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c7619283-a7ed-4678-a867-2d22252a0e29-host-var-lib-cni-bin\") pod \"multus-g6tbw\" (UID: \"c7619283-a7ed-4678-a867-2d22252a0e29\") " pod="openshift-multus/multus-g6tbw" Jul 24 14:34:49.034074 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.033674 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4a748576-5432-4fcf-b10f-5c488963ba3d-host\") pod \"node-ca-kt54d\" (UID: \"4a748576-5432-4fcf-b10f-5c488963ba3d\") " pod="openshift-image-registry/node-ca-kt54d" Jul 24 14:34:49.034074 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.033706 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a-etc-sysconfig\") pod \"tuned-pc4m9\" (UID: \"9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a\") " pod="openshift-cluster-node-tuning-operator/tuned-pc4m9" Jul 24 14:34:49.034074 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.033728 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a-etc-kubernetes\") pod \"tuned-pc4m9\" (UID: \"9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a\") " pod="openshift-cluster-node-tuning-operator/tuned-pc4m9" Jul 24 14:34:49.034074 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.033755 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a-tmp\") pod \"tuned-pc4m9\" (UID: \"9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a\") " pod="openshift-cluster-node-tuning-operator/tuned-pc4m9" Jul 24 14:34:49.034074 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.033793 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-484z5\" (UniqueName: \"kubernetes.io/projected/9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a-kube-api-access-484z5\") pod \"tuned-pc4m9\" (UID: \"9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a\") " pod="openshift-cluster-node-tuning-operator/tuned-pc4m9" Jul 24 14:34:49.034074 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.033822 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c7619283-a7ed-4678-a867-2d22252a0e29-etc-kubernetes\") pod \"multus-g6tbw\" (UID: \"c7619283-a7ed-4678-a867-2d22252a0e29\") " pod="openshift-multus/multus-g6tbw" Jul 24 14:34:49.034074 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.033842 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 24 14:34:49.035073 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.033855 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmmbg\" (UniqueName: \"kubernetes.io/projected/a10fad6d-bf8a-4154-8a15-3028177e8226-kube-api-access-qmmbg\") pod \"aws-ebs-csi-driver-node-4vc5z\" (UID: \"a10fad6d-bf8a-4154-8a15-3028177e8226\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vc5z" Jul 24 14:34:49.035073 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.033882 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a-etc-modprobe-d\") pod \"tuned-pc4m9\" (UID: \"9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a\") " pod="openshift-cluster-node-tuning-operator/tuned-pc4m9" Jul 24 14:34:49.035073 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.033948 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4ec9750f-187d-4f04-89e3-d915de6e9778-host-slash\") pod \"ovnkube-node-n8n54\" (UID: \"4ec9750f-187d-4f04-89e3-d915de6e9778\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:34:49.035073 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.033983 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knwd6\" (UniqueName: \"kubernetes.io/projected/c7619283-a7ed-4678-a867-2d22252a0e29-kube-api-access-knwd6\") pod \"multus-g6tbw\" (UID: \"c7619283-a7ed-4678-a867-2d22252a0e29\") " pod="openshift-multus/multus-g6tbw" Jul 24 14:34:49.035073 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.034030 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a-host\") pod \"tuned-pc4m9\" (UID: \"9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a\") " pod="openshift-cluster-node-tuning-operator/tuned-pc4m9" Jul 24 14:34:49.035073 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.034053 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4ec9750f-187d-4f04-89e3-d915de6e9778-systemd-units\") pod \"ovnkube-node-n8n54\" (UID: \"4ec9750f-187d-4f04-89e3-d915de6e9778\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:34:49.035073 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.034094 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c7619283-a7ed-4678-a867-2d22252a0e29-hostroot\") pod \"multus-g6tbw\" (UID: \"c7619283-a7ed-4678-a867-2d22252a0e29\") " pod="openshift-multus/multus-g6tbw" Jul 24 14:34:49.035073 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.034115 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a10fad6d-bf8a-4154-8a15-3028177e8226-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4vc5z\" (UID: \"a10fad6d-bf8a-4154-8a15-3028177e8226\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vc5z" Jul 24 14:34:49.035073 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.034132 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a10fad6d-bf8a-4154-8a15-3028177e8226-socket-dir\") pod \"aws-ebs-csi-driver-node-4vc5z\" (UID: \"a10fad6d-bf8a-4154-8a15-3028177e8226\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vc5z" Jul 24 14:34:49.035073 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.034155 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4ec9750f-187d-4f04-89e3-d915de6e9778-host-run-netns\") pod \"ovnkube-node-n8n54\" (UID: \"4ec9750f-187d-4f04-89e3-d915de6e9778\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:34:49.035073 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.034183 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4ec9750f-187d-4f04-89e3-d915de6e9778-node-log\") pod \"ovnkube-node-n8n54\" (UID: \"4ec9750f-187d-4f04-89e3-d915de6e9778\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:34:49.035073 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.034209 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a-etc-sysctl-conf\") pod \"tuned-pc4m9\" (UID: \"9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a\") " pod="openshift-cluster-node-tuning-operator/tuned-pc4m9" Jul 24 14:34:49.035073 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.034258 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4ec9750f-187d-4f04-89e3-d915de6e9778-host-cni-netd\") pod \"ovnkube-node-n8n54\" (UID: \"4ec9750f-187d-4f04-89e3-d915de6e9778\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:34:49.035073 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.034283 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4ec9750f-187d-4f04-89e3-d915de6e9778-run-ovn\") pod \"ovnkube-node-n8n54\" (UID: \"4ec9750f-187d-4f04-89e3-d915de6e9778\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:34:49.035073 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.034388 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4ec9750f-187d-4f04-89e3-d915de6e9778-log-socket\") pod \"ovnkube-node-n8n54\" (UID: \"4ec9750f-187d-4f04-89e3-d915de6e9778\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:34:49.035073 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.034414 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4ec9750f-187d-4f04-89e3-d915de6e9778-ovnkube-config\") pod \"ovnkube-node-n8n54\" (UID: \"4ec9750f-187d-4f04-89e3-d915de6e9778\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:34:49.035928 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.034436 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4ec9750f-187d-4f04-89e3-d915de6e9778-env-overrides\") pod \"ovnkube-node-n8n54\" (UID: \"4ec9750f-187d-4f04-89e3-d915de6e9778\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:34:49.035928 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.034461 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4ec9750f-187d-4f04-89e3-d915de6e9778-ovnkube-script-lib\") pod \"ovnkube-node-n8n54\" (UID: \"4ec9750f-187d-4f04-89e3-d915de6e9778\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:34:49.035928 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.034502 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c7619283-a7ed-4678-a867-2d22252a0e29-os-release\") pod \"multus-g6tbw\" (UID: \"c7619283-a7ed-4678-a867-2d22252a0e29\") " pod="openshift-multus/multus-g6tbw" Jul 24 14:34:49.035928 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.034524 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4ec9750f-187d-4f04-89e3-d915de6e9778-run-openvswitch\") pod \"ovnkube-node-n8n54\" (UID: \"4ec9750f-187d-4f04-89e3-d915de6e9778\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:34:49.035928 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.034583 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c7619283-a7ed-4678-a867-2d22252a0e29-system-cni-dir\") pod \"multus-g6tbw\" (UID: \"c7619283-a7ed-4678-a867-2d22252a0e29\") " pod="openshift-multus/multus-g6tbw" Jul 24 14:34:49.035928 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.034613 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a10fad6d-bf8a-4154-8a15-3028177e8226-sys-fs\") pod \"aws-ebs-csi-driver-node-4vc5z\" (UID: \"a10fad6d-bf8a-4154-8a15-3028177e8226\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vc5z" Jul 24 14:34:49.035928 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.034641 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkt42\" (UniqueName: \"kubernetes.io/projected/4ec9750f-187d-4f04-89e3-d915de6e9778-kube-api-access-fkt42\") pod \"ovnkube-node-n8n54\" (UID: \"4ec9750f-187d-4f04-89e3-d915de6e9778\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:34:49.035928 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.034664 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c7619283-a7ed-4678-a867-2d22252a0e29-host-var-lib-cni-multus\") pod \"multus-g6tbw\" (UID: \"c7619283-a7ed-4678-a867-2d22252a0e29\") " pod="openshift-multus/multus-g6tbw" Jul 24 14:34:49.035928 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.034685 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c7619283-a7ed-4678-a867-2d22252a0e29-multus-conf-dir\") pod \"multus-g6tbw\" (UID: \"c7619283-a7ed-4678-a867-2d22252a0e29\") " pod="openshift-multus/multus-g6tbw" Jul 24 14:34:49.035928 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.034718 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4a748576-5432-4fcf-b10f-5c488963ba3d-serviceca\") pod \"node-ca-kt54d\" (UID: \"4a748576-5432-4fcf-b10f-5c488963ba3d\") " pod="openshift-image-registry/node-ca-kt54d" Jul 24 14:34:49.035928 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.034752 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a-etc-systemd\") pod \"tuned-pc4m9\" (UID: \"9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a\") " pod="openshift-cluster-node-tuning-operator/tuned-pc4m9" Jul 24 14:34:49.035928 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.034792 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c7619283-a7ed-4678-a867-2d22252a0e29-multus-cni-dir\") pod \"multus-g6tbw\" (UID: \"c7619283-a7ed-4678-a867-2d22252a0e29\") " pod="openshift-multus/multus-g6tbw" Jul 24 14:34:49.035928 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.034829 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a10fad6d-bf8a-4154-8a15-3028177e8226-registration-dir\") pod \"aws-ebs-csi-driver-node-4vc5z\" (UID: \"a10fad6d-bf8a-4154-8a15-3028177e8226\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vc5z" Jul 24 14:34:49.035928 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.034866 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a-etc-sysctl-d\") pod \"tuned-pc4m9\" (UID: \"9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a\") " pod="openshift-cluster-node-tuning-operator/tuned-pc4m9" Jul 24 14:34:49.035928 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.034889 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a-var-lib-kubelet\") pod \"tuned-pc4m9\" (UID: \"9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a\") " pod="openshift-cluster-node-tuning-operator/tuned-pc4m9" Jul 24 14:34:49.035928 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.034911 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4ec9750f-187d-4f04-89e3-d915de6e9778-var-lib-openvswitch\") pod \"ovnkube-node-n8n54\" (UID: \"4ec9750f-187d-4f04-89e3-d915de6e9778\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:34:49.035928 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.034950 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4ec9750f-187d-4f04-89e3-d915de6e9778-host-cni-bin\") pod \"ovnkube-node-n8n54\" (UID: \"4ec9750f-187d-4f04-89e3-d915de6e9778\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:34:49.036596 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.034983 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c7619283-a7ed-4678-a867-2d22252a0e29-cnibin\") pod \"multus-g6tbw\" (UID: \"c7619283-a7ed-4678-a867-2d22252a0e29\") " pod="openshift-multus/multus-g6tbw" Jul 24 14:34:49.036596 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.035013 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c7619283-a7ed-4678-a867-2d22252a0e29-host-run-netns\") pod \"multus-g6tbw\" (UID: \"c7619283-a7ed-4678-a867-2d22252a0e29\") " pod="openshift-multus/multus-g6tbw" Jul 24 14:34:49.036596 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.035266 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2w5hp" Jul 24 14:34:49.036596 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.035430 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-2v586\"" Jul 24 14:34:49.036596 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.035745 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 24 14:34:49.036596 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.036074 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 24 14:34:49.036596 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.036190 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 24 14:34:49.037618 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.037602 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 24 14:34:49.037696 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.037637 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-nj8l9\"" Jul 24 14:34:49.037853 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.037833 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7jqr" Jul 24 14:34:49.038063 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.038046 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 24 14:34:49.038134 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:49.038073 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7jqr" podUID="f269d799-9553-4954-8bdf-4a76fafcdc06" Jul 24 14:34:49.041299 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.041283 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjzwq" Jul 24 14:34:49.041380 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:49.041345 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjzwq" podUID="9e71e9e2-8727-4639-a971-7d92acd69928" Jul 24 14:34:49.058130 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.058104 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-kwhbf" Jul 24 14:34:49.068040 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.068018 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-kwhbf" Jul 24 14:34:49.122485 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.122444 2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 24 14:34:49.135611 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.135582 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knwd6\" (UniqueName: \"kubernetes.io/projected/c7619283-a7ed-4678-a867-2d22252a0e29-kube-api-access-knwd6\") pod \"multus-g6tbw\" (UID: \"c7619283-a7ed-4678-a867-2d22252a0e29\") " pod="openshift-multus/multus-g6tbw" Jul 24 14:34:49.135783 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.135619 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a-host\") pod \"tuned-pc4m9\" (UID: \"9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a\") " pod="openshift-cluster-node-tuning-operator/tuned-pc4m9" Jul 24 14:34:49.135783 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.135644 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4ec9750f-187d-4f04-89e3-d915de6e9778-systemd-units\") pod \"ovnkube-node-n8n54\" (UID: \"4ec9750f-187d-4f04-89e3-d915de6e9778\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:34:49.135783 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.135671 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4562x\" (UniqueName: \"kubernetes.io/projected/52fee0af-d9bb-4fb2-8ab4-20431332262f-kube-api-access-4562x\") pod \"iptables-alerter-mkh45\" (UID: \"52fee0af-d9bb-4fb2-8ab4-20431332262f\") " pod="openshift-network-operator/iptables-alerter-mkh45" Jul 24 14:34:49.135783 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.135694 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c7619283-a7ed-4678-a867-2d22252a0e29-hostroot\") pod \"multus-g6tbw\" (UID: \"c7619283-a7ed-4678-a867-2d22252a0e29\") " pod="openshift-multus/multus-g6tbw" Jul 24 14:34:49.135783 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.135715 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a10fad6d-bf8a-4154-8a15-3028177e8226-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4vc5z\" (UID: \"a10fad6d-bf8a-4154-8a15-3028177e8226\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vc5z" Jul 24 14:34:49.135783 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.135736 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a10fad6d-bf8a-4154-8a15-3028177e8226-socket-dir\") pod \"aws-ebs-csi-driver-node-4vc5z\" (UID: \"a10fad6d-bf8a-4154-8a15-3028177e8226\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vc5z" Jul 24 14:34:49.135783 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.135737 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a-host\") pod \"tuned-pc4m9\" (UID: \"9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a\") " pod="openshift-cluster-node-tuning-operator/tuned-pc4m9" Jul 24 14:34:49.135783 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.135757 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/208712d7-ea7e-430c-b730-e6bf290b2fcd-metrics-certs\") pod \"network-metrics-daemon-2jd76\" (UID: \"208712d7-ea7e-430c-b730-e6bf290b2fcd\") " pod="openshift-multus/network-metrics-daemon-2jd76" Jul 24 14:34:49.135783 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.135784 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c7619283-a7ed-4678-a867-2d22252a0e29-hostroot\") pod \"multus-g6tbw\" (UID: \"c7619283-a7ed-4678-a867-2d22252a0e29\") " pod="openshift-multus/multus-g6tbw" Jul 24 14:34:49.136192 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.135781 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f269d799-9553-4954-8bdf-4a76fafcdc06-dbus\") pod \"global-pull-secret-syncer-v7jqr\" (UID: \"f269d799-9553-4954-8bdf-4a76fafcdc06\") " pod="kube-system/global-pull-secret-syncer-v7jqr" Jul 24 14:34:49.136192 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.135822 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4ec9750f-187d-4f04-89e3-d915de6e9778-systemd-units\") pod \"ovnkube-node-n8n54\" (UID: \"4ec9750f-187d-4f04-89e3-d915de6e9778\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:34:49.136192 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.135826 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b8ade508-14e0-4f5b-b508-0a542b29d1c3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vvk6x\" (UID: \"b8ade508-14e0-4f5b-b508-0a542b29d1c3\") " pod="openshift-multus/multus-additional-cni-plugins-vvk6x" Jul 24 14:34:49.136192 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.135853 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4ec9750f-187d-4f04-89e3-d915de6e9778-host-run-netns\") pod \"ovnkube-node-n8n54\" (UID: \"4ec9750f-187d-4f04-89e3-d915de6e9778\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:34:49.136192 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.135878 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4ec9750f-187d-4f04-89e3-d915de6e9778-node-log\") pod \"ovnkube-node-n8n54\" (UID: \"4ec9750f-187d-4f04-89e3-d915de6e9778\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:34:49.136192 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.135903 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q49q6\" (UniqueName: \"kubernetes.io/projected/b8ade508-14e0-4f5b-b508-0a542b29d1c3-kube-api-access-q49q6\") pod \"multus-additional-cni-plugins-vvk6x\" (UID: \"b8ade508-14e0-4f5b-b508-0a542b29d1c3\") " pod="openshift-multus/multus-additional-cni-plugins-vvk6x" Jul 24 14:34:49.136192 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.135906 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a10fad6d-bf8a-4154-8a15-3028177e8226-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4vc5z\" (UID: \"a10fad6d-bf8a-4154-8a15-3028177e8226\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vc5z" Jul 24 14:34:49.136192 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.135930 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a-etc-sysctl-conf\") pod \"tuned-pc4m9\" (UID: \"9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a\") " pod="openshift-cluster-node-tuning-operator/tuned-pc4m9" Jul 24 14:34:49.136192 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.135955 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4ec9750f-187d-4f04-89e3-d915de6e9778-host-cni-netd\") pod \"ovnkube-node-n8n54\" (UID: \"4ec9750f-187d-4f04-89e3-d915de6e9778\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:34:49.136192 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.135975 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4ec9750f-187d-4f04-89e3-d915de6e9778-node-log\") pod \"ovnkube-node-n8n54\" (UID: \"4ec9750f-187d-4f04-89e3-d915de6e9778\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:34:49.136192 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.135982 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c5686d40-c284-4232-acfe-b583a06627d6-konnectivity-ca\") pod \"konnectivity-agent-q5258\" (UID: \"c5686d40-c284-4232-acfe-b583a06627d6\") " pod="kube-system/konnectivity-agent-q5258" Jul 24 14:34:49.136192 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.136031 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4ec9750f-187d-4f04-89e3-d915de6e9778-host-run-netns\") pod \"ovnkube-node-n8n54\" (UID: \"4ec9750f-187d-4f04-89e3-d915de6e9778\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:34:49.136192 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.136040 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a10fad6d-bf8a-4154-8a15-3028177e8226-socket-dir\") pod \"aws-ebs-csi-driver-node-4vc5z\" (UID: \"a10fad6d-bf8a-4154-8a15-3028177e8226\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vc5z" Jul 24 14:34:49.136192 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.136084 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4ec9750f-187d-4f04-89e3-d915de6e9778-host-cni-netd\") pod \"ovnkube-node-n8n54\" (UID: \"4ec9750f-187d-4f04-89e3-d915de6e9778\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:34:49.136192 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.136140 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b8ade508-14e0-4f5b-b508-0a542b29d1c3-system-cni-dir\") pod \"multus-additional-cni-plugins-vvk6x\" (UID: \"b8ade508-14e0-4f5b-b508-0a542b29d1c3\") " pod="openshift-multus/multus-additional-cni-plugins-vvk6x" Jul 24 14:34:49.136192 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.136165 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a-etc-sysctl-conf\") pod \"tuned-pc4m9\" (UID: \"9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a\") " pod="openshift-cluster-node-tuning-operator/tuned-pc4m9" Jul 24 14:34:49.136192 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.136188 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4ec9750f-187d-4f04-89e3-d915de6e9778-run-ovn\") pod \"ovnkube-node-n8n54\" (UID: \"4ec9750f-187d-4f04-89e3-d915de6e9778\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:34:49.136930 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.136212 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4ec9750f-187d-4f04-89e3-d915de6e9778-log-socket\") pod \"ovnkube-node-n8n54\" (UID: \"4ec9750f-187d-4f04-89e3-d915de6e9778\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:34:49.136930 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.136219 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4ec9750f-187d-4f04-89e3-d915de6e9778-run-ovn\") pod \"ovnkube-node-n8n54\" (UID: \"4ec9750f-187d-4f04-89e3-d915de6e9778\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:34:49.136930 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.136235 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4ec9750f-187d-4f04-89e3-d915de6e9778-ovnkube-config\") pod \"ovnkube-node-n8n54\" (UID: \"4ec9750f-187d-4f04-89e3-d915de6e9778\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:34:49.136930 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.136253 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4ec9750f-187d-4f04-89e3-d915de6e9778-log-socket\") pod \"ovnkube-node-n8n54\" (UID: \"4ec9750f-187d-4f04-89e3-d915de6e9778\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:34:49.136930 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.136259 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4ec9750f-187d-4f04-89e3-d915de6e9778-env-overrides\") pod \"ovnkube-node-n8n54\" (UID: \"4ec9750f-187d-4f04-89e3-d915de6e9778\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:34:49.136930 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.136298 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4ec9750f-187d-4f04-89e3-d915de6e9778-ovnkube-script-lib\") pod \"ovnkube-node-n8n54\" (UID: \"4ec9750f-187d-4f04-89e3-d915de6e9778\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:34:49.136930 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.136333 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcp4v\" (UniqueName: \"kubernetes.io/projected/208712d7-ea7e-430c-b730-e6bf290b2fcd-kube-api-access-mcp4v\") pod \"network-metrics-daemon-2jd76\" (UID: \"208712d7-ea7e-430c-b730-e6bf290b2fcd\") " pod="openshift-multus/network-metrics-daemon-2jd76" Jul 24 14:34:49.136930 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.136361 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/52fee0af-d9bb-4fb2-8ab4-20431332262f-host-slash\") pod \"iptables-alerter-mkh45\" (UID: \"52fee0af-d9bb-4fb2-8ab4-20431332262f\") " pod="openshift-network-operator/iptables-alerter-mkh45" Jul 24 14:34:49.136930 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.136441 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f269d799-9553-4954-8bdf-4a76fafcdc06-original-pull-secret\") pod \"global-pull-secret-syncer-v7jqr\" (UID: \"f269d799-9553-4954-8bdf-4a76fafcdc06\") " pod="kube-system/global-pull-secret-syncer-v7jqr" Jul 24 14:34:49.136930 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.136499 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c7619283-a7ed-4678-a867-2d22252a0e29-os-release\") pod \"multus-g6tbw\" (UID: \"c7619283-a7ed-4678-a867-2d22252a0e29\") " pod="openshift-multus/multus-g6tbw" Jul 24 14:34:49.136930 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.136525 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4ec9750f-187d-4f04-89e3-d915de6e9778-run-openvswitch\") pod \"ovnkube-node-n8n54\" (UID: \"4ec9750f-187d-4f04-89e3-d915de6e9778\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:34:49.136930 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.136554 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/09a04909-4f60-48c8-8077-06b6dccf3df8-hosts-file\") pod \"node-resolver-2w5hp\" (UID: \"09a04909-4f60-48c8-8077-06b6dccf3df8\") " pod="openshift-dns/node-resolver-2w5hp" Jul 24 14:34:49.136930 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.136578 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c7619283-a7ed-4678-a867-2d22252a0e29-system-cni-dir\") pod \"multus-g6tbw\" (UID: \"c7619283-a7ed-4678-a867-2d22252a0e29\") " pod="openshift-multus/multus-g6tbw" Jul 24 14:34:49.136930 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.136613 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c7619283-a7ed-4678-a867-2d22252a0e29-os-release\") pod \"multus-g6tbw\" (UID: \"c7619283-a7ed-4678-a867-2d22252a0e29\") " pod="openshift-multus/multus-g6tbw" Jul 24 14:34:49.136930 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.136610 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4ec9750f-187d-4f04-89e3-d915de6e9778-run-openvswitch\") pod \"ovnkube-node-n8n54\" (UID: \"4ec9750f-187d-4f04-89e3-d915de6e9778\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:34:49.136930 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.136641 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a10fad6d-bf8a-4154-8a15-3028177e8226-sys-fs\") pod \"aws-ebs-csi-driver-node-4vc5z\" (UID: \"a10fad6d-bf8a-4154-8a15-3028177e8226\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vc5z" Jul 24 14:34:49.136930 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.136658 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c7619283-a7ed-4678-a867-2d22252a0e29-system-cni-dir\") pod \"multus-g6tbw\" (UID: \"c7619283-a7ed-4678-a867-2d22252a0e29\") " pod="openshift-multus/multus-g6tbw" Jul 24 14:34:49.137672 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.136715 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkt42\" (UniqueName: \"kubernetes.io/projected/4ec9750f-187d-4f04-89e3-d915de6e9778-kube-api-access-fkt42\") pod \"ovnkube-node-n8n54\" (UID: \"4ec9750f-187d-4f04-89e3-d915de6e9778\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:34:49.137672 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.136750 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c5686d40-c284-4232-acfe-b583a06627d6-agent-certs\") pod \"konnectivity-agent-q5258\" (UID: \"c5686d40-c284-4232-acfe-b583a06627d6\") " pod="kube-system/konnectivity-agent-q5258" Jul 24 14:34:49.137672 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.136746 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a10fad6d-bf8a-4154-8a15-3028177e8226-sys-fs\") pod \"aws-ebs-csi-driver-node-4vc5z\" (UID: \"a10fad6d-bf8a-4154-8a15-3028177e8226\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vc5z" Jul 24 14:34:49.137672 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.136776 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4ec9750f-187d-4f04-89e3-d915de6e9778-env-overrides\") pod \"ovnkube-node-n8n54\" (UID: \"4ec9750f-187d-4f04-89e3-d915de6e9778\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:34:49.137672 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.136786 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b8ade508-14e0-4f5b-b508-0a542b29d1c3-cnibin\") pod \"multus-additional-cni-plugins-vvk6x\" (UID: \"b8ade508-14e0-4f5b-b508-0a542b29d1c3\") " pod="openshift-multus/multus-additional-cni-plugins-vvk6x" Jul 24 14:34:49.137672 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.136813 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b8ade508-14e0-4f5b-b508-0a542b29d1c3-os-release\") pod \"multus-additional-cni-plugins-vvk6x\" (UID: \"b8ade508-14e0-4f5b-b508-0a542b29d1c3\") " pod="openshift-multus/multus-additional-cni-plugins-vvk6x" Jul 24 14:34:49.137672 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.136837 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b8ade508-14e0-4f5b-b508-0a542b29d1c3-cni-binary-copy\") pod \"multus-additional-cni-plugins-vvk6x\" (UID: \"b8ade508-14e0-4f5b-b508-0a542b29d1c3\") " pod="openshift-multus/multus-additional-cni-plugins-vvk6x" Jul 24 14:34:49.137672 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.136872 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4ec9750f-187d-4f04-89e3-d915de6e9778-ovnkube-config\") pod \"ovnkube-node-n8n54\" (UID: \"4ec9750f-187d-4f04-89e3-d915de6e9778\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:34:49.137672 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.136887 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c7619283-a7ed-4678-a867-2d22252a0e29-host-var-lib-cni-multus\") pod \"multus-g6tbw\" (UID: \"c7619283-a7ed-4678-a867-2d22252a0e29\") " pod="openshift-multus/multus-g6tbw" Jul 24 14:34:49.137672 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.136940 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c7619283-a7ed-4678-a867-2d22252a0e29-multus-conf-dir\") pod \"multus-g6tbw\" (UID: \"c7619283-a7ed-4678-a867-2d22252a0e29\") " pod="openshift-multus/multus-g6tbw" Jul 24 14:34:49.137672 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.136985 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4a748576-5432-4fcf-b10f-5c488963ba3d-serviceca\") pod \"node-ca-kt54d\" (UID: \"4a748576-5432-4fcf-b10f-5c488963ba3d\") " pod="openshift-image-registry/node-ca-kt54d" Jul 24 14:34:49.137672 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.136996 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c7619283-a7ed-4678-a867-2d22252a0e29-host-var-lib-cni-multus\") pod \"multus-g6tbw\" (UID: \"c7619283-a7ed-4678-a867-2d22252a0e29\") " pod="openshift-multus/multus-g6tbw" Jul 24 14:34:49.137672 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.137002 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4ec9750f-187d-4f04-89e3-d915de6e9778-ovnkube-script-lib\") pod \"ovnkube-node-n8n54\" (UID: \"4ec9750f-187d-4f04-89e3-d915de6e9778\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:34:49.137672 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.137009 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a-etc-systemd\") pod \"tuned-pc4m9\" (UID: \"9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a\") " pod="openshift-cluster-node-tuning-operator/tuned-pc4m9" Jul 24 14:34:49.137672 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.137060 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6j4wf\" (UniqueName: \"kubernetes.io/projected/09a04909-4f60-48c8-8077-06b6dccf3df8-kube-api-access-6j4wf\") pod \"node-resolver-2w5hp\" (UID: \"09a04909-4f60-48c8-8077-06b6dccf3df8\") " pod="openshift-dns/node-resolver-2w5hp" Jul 24 14:34:49.137672 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.137091 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c7619283-a7ed-4678-a867-2d22252a0e29-multus-cni-dir\") pod \"multus-g6tbw\" (UID: \"c7619283-a7ed-4678-a867-2d22252a0e29\") " pod="openshift-multus/multus-g6tbw" Jul 24 14:34:49.137672 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.137138 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c7619283-a7ed-4678-a867-2d22252a0e29-multus-conf-dir\") pod \"multus-g6tbw\" (UID: \"c7619283-a7ed-4678-a867-2d22252a0e29\") " pod="openshift-multus/multus-g6tbw" Jul 24 14:34:49.138441 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.137170 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a10fad6d-bf8a-4154-8a15-3028177e8226-registration-dir\") pod \"aws-ebs-csi-driver-node-4vc5z\" (UID: \"a10fad6d-bf8a-4154-8a15-3028177e8226\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vc5z" Jul 24 14:34:49.138441 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.137197 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a-etc-sysctl-d\") pod \"tuned-pc4m9\" (UID: \"9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a\") " pod="openshift-cluster-node-tuning-operator/tuned-pc4m9" Jul 24 14:34:49.138441 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.137213 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a-etc-systemd\") pod \"tuned-pc4m9\" (UID: \"9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a\") " pod="openshift-cluster-node-tuning-operator/tuned-pc4m9" Jul 24 14:34:49.138441 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.137220 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a-var-lib-kubelet\") pod \"tuned-pc4m9\" (UID: \"9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a\") " pod="openshift-cluster-node-tuning-operator/tuned-pc4m9" Jul 24 14:34:49.138441 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.137252 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4ec9750f-187d-4f04-89e3-d915de6e9778-var-lib-openvswitch\") pod \"ovnkube-node-n8n54\" (UID: \"4ec9750f-187d-4f04-89e3-d915de6e9778\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:34:49.138441 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.137269 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a-var-lib-kubelet\") pod \"tuned-pc4m9\" (UID: \"9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a\") " pod="openshift-cluster-node-tuning-operator/tuned-pc4m9" Jul 24 14:34:49.138441 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.137278 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4ec9750f-187d-4f04-89e3-d915de6e9778-host-cni-bin\") pod \"ovnkube-node-n8n54\" (UID: \"4ec9750f-187d-4f04-89e3-d915de6e9778\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:34:49.138441 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.137296 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c7619283-a7ed-4678-a867-2d22252a0e29-multus-cni-dir\") pod \"multus-g6tbw\" (UID: \"c7619283-a7ed-4678-a867-2d22252a0e29\") " pod="openshift-multus/multus-g6tbw" Jul 24 14:34:49.138441 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.137299 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a10fad6d-bf8a-4154-8a15-3028177e8226-registration-dir\") pod \"aws-ebs-csi-driver-node-4vc5z\" (UID: \"a10fad6d-bf8a-4154-8a15-3028177e8226\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vc5z" Jul 24 14:34:49.138441 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.137303 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09a04909-4f60-48c8-8077-06b6dccf3df8-tmp-dir\") pod \"node-resolver-2w5hp\" (UID: \"09a04909-4f60-48c8-8077-06b6dccf3df8\") " pod="openshift-dns/node-resolver-2w5hp" Jul 24 14:34:49.138441 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.137343 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c7619283-a7ed-4678-a867-2d22252a0e29-cnibin\") pod \"multus-g6tbw\" (UID: \"c7619283-a7ed-4678-a867-2d22252a0e29\") " pod="openshift-multus/multus-g6tbw" Jul 24 14:34:49.138441 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.137344 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4ec9750f-187d-4f04-89e3-d915de6e9778-var-lib-openvswitch\") pod \"ovnkube-node-n8n54\" (UID: \"4ec9750f-187d-4f04-89e3-d915de6e9778\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:34:49.138441 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.137343 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4a748576-5432-4fcf-b10f-5c488963ba3d-serviceca\") pod \"node-ca-kt54d\" (UID: \"4a748576-5432-4fcf-b10f-5c488963ba3d\") " pod="openshift-image-registry/node-ca-kt54d" Jul 24 14:34:49.138441 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.137366 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c7619283-a7ed-4678-a867-2d22252a0e29-host-run-netns\") pod \"multus-g6tbw\" (UID: \"c7619283-a7ed-4678-a867-2d22252a0e29\") " pod="openshift-multus/multus-g6tbw" Jul 24 14:34:49.138441 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.137375 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a-etc-sysctl-d\") pod \"tuned-pc4m9\" (UID: \"9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a\") " pod="openshift-cluster-node-tuning-operator/tuned-pc4m9" Jul 24 14:34:49.138441 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.137364 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4ec9750f-187d-4f04-89e3-d915de6e9778-host-cni-bin\") pod \"ovnkube-node-n8n54\" (UID: \"4ec9750f-187d-4f04-89e3-d915de6e9778\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:34:49.138441 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.137395 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c7619283-a7ed-4678-a867-2d22252a0e29-host-run-multus-certs\") pod \"multus-g6tbw\" (UID: \"c7619283-a7ed-4678-a867-2d22252a0e29\") " pod="openshift-multus/multus-g6tbw" Jul 24 14:34:49.138441 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.137412 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c7619283-a7ed-4678-a867-2d22252a0e29-host-run-netns\") pod \"multus-g6tbw\" (UID: \"c7619283-a7ed-4678-a867-2d22252a0e29\") " pod="openshift-multus/multus-g6tbw" Jul 24 14:34:49.139188 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.137421 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tzcg\" (UniqueName: \"kubernetes.io/projected/4a748576-5432-4fcf-b10f-5c488963ba3d-kube-api-access-7tzcg\") pod \"node-ca-kt54d\" (UID: \"4a748576-5432-4fcf-b10f-5c488963ba3d\") " pod="openshift-image-registry/node-ca-kt54d" Jul 24 14:34:49.139188 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.137439 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c7619283-a7ed-4678-a867-2d22252a0e29-host-run-multus-certs\") pod \"multus-g6tbw\" (UID: \"c7619283-a7ed-4678-a867-2d22252a0e29\") " pod="openshift-multus/multus-g6tbw" Jul 24 14:34:49.139188 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.137443 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a-run\") pod \"tuned-pc4m9\" (UID: \"9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a\") " pod="openshift-cluster-node-tuning-operator/tuned-pc4m9" Jul 24 14:34:49.139188 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.137398 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c7619283-a7ed-4678-a867-2d22252a0e29-cnibin\") pod \"multus-g6tbw\" (UID: \"c7619283-a7ed-4678-a867-2d22252a0e29\") " pod="openshift-multus/multus-g6tbw" Jul 24 14:34:49.139188 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.137501 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a-sys\") pod \"tuned-pc4m9\" (UID: \"9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a\") " pod="openshift-cluster-node-tuning-operator/tuned-pc4m9" Jul 24 14:34:49.139188 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.137520 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a-run\") pod \"tuned-pc4m9\" (UID: \"9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a\") " pod="openshift-cluster-node-tuning-operator/tuned-pc4m9" Jul 24 14:34:49.139188 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.137523 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4ec9750f-187d-4f04-89e3-d915de6e9778-ovn-node-metrics-cert\") pod \"ovnkube-node-n8n54\" (UID: \"4ec9750f-187d-4f04-89e3-d915de6e9778\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:34:49.139188 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.137564 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b8ade508-14e0-4f5b-b508-0a542b29d1c3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vvk6x\" (UID: \"b8ade508-14e0-4f5b-b508-0a542b29d1c3\") " pod="openshift-multus/multus-additional-cni-plugins-vvk6x" Jul 24 14:34:49.139188 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.137589 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7jxn\" (UniqueName: \"kubernetes.io/projected/9e71e9e2-8727-4639-a971-7d92acd69928-kube-api-access-g7jxn\") pod \"network-check-target-cjzwq\" (UID: \"9e71e9e2-8727-4639-a971-7d92acd69928\") " pod="openshift-network-diagnostics/network-check-target-cjzwq" Jul 24 14:34:49.139188 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.137605 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a-sys\") pod \"tuned-pc4m9\" (UID: \"9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a\") " pod="openshift-cluster-node-tuning-operator/tuned-pc4m9" Jul 24 14:34:49.139188 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.137615 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f269d799-9553-4954-8bdf-4a76fafcdc06-kubelet-config\") pod \"global-pull-secret-syncer-v7jqr\" (UID: \"f269d799-9553-4954-8bdf-4a76fafcdc06\") " pod="kube-system/global-pull-secret-syncer-v7jqr" Jul 24 14:34:49.139188 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.137665 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b8ade508-14e0-4f5b-b508-0a542b29d1c3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vvk6x\" (UID: \"b8ade508-14e0-4f5b-b508-0a542b29d1c3\") " pod="openshift-multus/multus-additional-cni-plugins-vvk6x" Jul 24 14:34:49.139188 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.137697 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c7619283-a7ed-4678-a867-2d22252a0e29-multus-socket-dir-parent\") pod \"multus-g6tbw\" (UID: \"c7619283-a7ed-4678-a867-2d22252a0e29\") " pod="openshift-multus/multus-g6tbw" Jul 24 14:34:49.139188 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.137723 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c7619283-a7ed-4678-a867-2d22252a0e29-host-var-lib-kubelet\") pod \"multus-g6tbw\" (UID: \"c7619283-a7ed-4678-a867-2d22252a0e29\") " pod="openshift-multus/multus-g6tbw" Jul 24 14:34:49.139188 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.137745 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a10fad6d-bf8a-4154-8a15-3028177e8226-etc-selinux\") pod \"aws-ebs-csi-driver-node-4vc5z\" (UID: \"a10fad6d-bf8a-4154-8a15-3028177e8226\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vc5z" Jul 24 14:34:49.139188 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.137763 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c7619283-a7ed-4678-a867-2d22252a0e29-multus-socket-dir-parent\") pod \"multus-g6tbw\" (UID: \"c7619283-a7ed-4678-a867-2d22252a0e29\") " pod="openshift-multus/multus-g6tbw" Jul 24 14:34:49.139188 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.137770 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4ec9750f-187d-4f04-89e3-d915de6e9778-run-systemd\") pod \"ovnkube-node-n8n54\" (UID: \"4ec9750f-187d-4f04-89e3-d915de6e9778\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:34:49.140079 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.137781 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c7619283-a7ed-4678-a867-2d22252a0e29-host-var-lib-kubelet\") pod \"multus-g6tbw\" (UID: \"c7619283-a7ed-4678-a867-2d22252a0e29\") " pod="openshift-multus/multus-g6tbw" Jul 24 14:34:49.140079 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.137793 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4ec9750f-187d-4f04-89e3-d915de6e9778-etc-openvswitch\") pod \"ovnkube-node-n8n54\" (UID: \"4ec9750f-187d-4f04-89e3-d915de6e9778\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:34:49.140079 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.137818 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4ec9750f-187d-4f04-89e3-d915de6e9778-host-run-ovn-kubernetes\") pod \"ovnkube-node-n8n54\" (UID: \"4ec9750f-187d-4f04-89e3-d915de6e9778\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:34:49.140079 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.137831 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4ec9750f-187d-4f04-89e3-d915de6e9778-run-systemd\") pod \"ovnkube-node-n8n54\" (UID: \"4ec9750f-187d-4f04-89e3-d915de6e9778\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:34:49.140079 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.137847 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a10fad6d-bf8a-4154-8a15-3028177e8226-etc-selinux\") pod \"aws-ebs-csi-driver-node-4vc5z\" (UID: \"a10fad6d-bf8a-4154-8a15-3028177e8226\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vc5z" Jul 24 14:34:49.140079 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.137864 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4ec9750f-187d-4f04-89e3-d915de6e9778-etc-openvswitch\") pod \"ovnkube-node-n8n54\" (UID: \"4ec9750f-187d-4f04-89e3-d915de6e9778\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:34:49.140079 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.137854 2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 24 14:34:49.140079 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.137845 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4ec9750f-187d-4f04-89e3-d915de6e9778-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n8n54\" (UID: \"4ec9750f-187d-4f04-89e3-d915de6e9778\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:34:49.140079 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.137898 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4ec9750f-187d-4f04-89e3-d915de6e9778-host-run-ovn-kubernetes\") pod \"ovnkube-node-n8n54\" (UID: \"4ec9750f-187d-4f04-89e3-d915de6e9778\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:34:49.140079 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.137913 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4ec9750f-187d-4f04-89e3-d915de6e9778-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n8n54\" (UID: \"4ec9750f-187d-4f04-89e3-d915de6e9778\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:34:49.140079 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.137915 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c7619283-a7ed-4678-a867-2d22252a0e29-multus-daemon-config\") pod \"multus-g6tbw\" (UID: \"c7619283-a7ed-4678-a867-2d22252a0e29\") " pod="openshift-multus/multus-g6tbw" Jul 24 14:34:49.140079 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.137950 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ec9750f-187d-4f04-89e3-d915de6e9778-host-kubelet\") pod \"ovnkube-node-n8n54\" (UID: \"4ec9750f-187d-4f04-89e3-d915de6e9778\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:34:49.140079 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.137974 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a10fad6d-bf8a-4154-8a15-3028177e8226-device-dir\") pod \"aws-ebs-csi-driver-node-4vc5z\" (UID: \"a10fad6d-bf8a-4154-8a15-3028177e8226\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vc5z" Jul 24 14:34:49.140079 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.137998 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a-lib-modules\") pod \"tuned-pc4m9\" (UID: \"9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a\") " pod="openshift-cluster-node-tuning-operator/tuned-pc4m9" Jul 24 14:34:49.140079 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.138019 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ec9750f-187d-4f04-89e3-d915de6e9778-host-kubelet\") pod \"ovnkube-node-n8n54\" (UID: \"4ec9750f-187d-4f04-89e3-d915de6e9778\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:34:49.140079 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.138037 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a-etc-tuned\") pod \"tuned-pc4m9\" (UID: \"9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a\") " pod="openshift-cluster-node-tuning-operator/tuned-pc4m9" Jul 24 14:34:49.140079 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.138056 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a10fad6d-bf8a-4154-8a15-3028177e8226-device-dir\") pod \"aws-ebs-csi-driver-node-4vc5z\" (UID: \"a10fad6d-bf8a-4154-8a15-3028177e8226\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vc5z" Jul 24 14:34:49.140869 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.138060 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c7619283-a7ed-4678-a867-2d22252a0e29-cni-binary-copy\") pod \"multus-g6tbw\" (UID: \"c7619283-a7ed-4678-a867-2d22252a0e29\") " pod="openshift-multus/multus-g6tbw" Jul 24 14:34:49.140869 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.138103 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c7619283-a7ed-4678-a867-2d22252a0e29-host-run-k8s-cni-cncf-io\") pod \"multus-g6tbw\" (UID: \"c7619283-a7ed-4678-a867-2d22252a0e29\") " pod="openshift-multus/multus-g6tbw" Jul 24 14:34:49.140869 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.138113 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a-lib-modules\") pod \"tuned-pc4m9\" (UID: \"9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a\") " pod="openshift-cluster-node-tuning-operator/tuned-pc4m9" Jul 24 14:34:49.140869 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.138130 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c7619283-a7ed-4678-a867-2d22252a0e29-host-var-lib-cni-bin\") pod \"multus-g6tbw\" (UID: \"c7619283-a7ed-4678-a867-2d22252a0e29\") " pod="openshift-multus/multus-g6tbw" Jul 24 14:34:49.140869 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.138154 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4a748576-5432-4fcf-b10f-5c488963ba3d-host\") pod \"node-ca-kt54d\" (UID: \"4a748576-5432-4fcf-b10f-5c488963ba3d\") " pod="openshift-image-registry/node-ca-kt54d" Jul 24 14:34:49.140869 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.138177 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a-etc-sysconfig\") pod \"tuned-pc4m9\" (UID: \"9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a\") " pod="openshift-cluster-node-tuning-operator/tuned-pc4m9" Jul 24 14:34:49.140869 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.138184 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c7619283-a7ed-4678-a867-2d22252a0e29-host-var-lib-cni-bin\") pod \"multus-g6tbw\" (UID: \"c7619283-a7ed-4678-a867-2d22252a0e29\") " pod="openshift-multus/multus-g6tbw" Jul 24 14:34:49.140869 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.138154 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c7619283-a7ed-4678-a867-2d22252a0e29-host-run-k8s-cni-cncf-io\") pod \"multus-g6tbw\" (UID: \"c7619283-a7ed-4678-a867-2d22252a0e29\") " pod="openshift-multus/multus-g6tbw" Jul 24 14:34:49.140869 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.138202 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a-etc-kubernetes\") pod \"tuned-pc4m9\" (UID: \"9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a\") " pod="openshift-cluster-node-tuning-operator/tuned-pc4m9" Jul 24 14:34:49.140869 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.138230 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a-etc-sysconfig\") pod \"tuned-pc4m9\" (UID: \"9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a\") " pod="openshift-cluster-node-tuning-operator/tuned-pc4m9" Jul 24 14:34:49.140869 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.138238 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a-tmp\") pod \"tuned-pc4m9\" (UID: \"9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a\") " pod="openshift-cluster-node-tuning-operator/tuned-pc4m9" Jul 24 14:34:49.140869 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.138242 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a-etc-kubernetes\") pod \"tuned-pc4m9\" (UID: \"9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a\") " pod="openshift-cluster-node-tuning-operator/tuned-pc4m9" Jul 24 14:34:49.140869 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.138269 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4a748576-5432-4fcf-b10f-5c488963ba3d-host\") pod \"node-ca-kt54d\" (UID: \"4a748576-5432-4fcf-b10f-5c488963ba3d\") " pod="openshift-image-registry/node-ca-kt54d" Jul 24 14:34:49.140869 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.138285 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-484z5\" (UniqueName: \"kubernetes.io/projected/9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a-kube-api-access-484z5\") pod \"tuned-pc4m9\" (UID: \"9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a\") " pod="openshift-cluster-node-tuning-operator/tuned-pc4m9" Jul 24 14:34:49.140869 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.138313 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c7619283-a7ed-4678-a867-2d22252a0e29-etc-kubernetes\") pod \"multus-g6tbw\" (UID: \"c7619283-a7ed-4678-a867-2d22252a0e29\") " pod="openshift-multus/multus-g6tbw" Jul 24 14:34:49.140869 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.138360 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c7619283-a7ed-4678-a867-2d22252a0e29-etc-kubernetes\") pod \"multus-g6tbw\" (UID: \"c7619283-a7ed-4678-a867-2d22252a0e29\") " pod="openshift-multus/multus-g6tbw" Jul 24 14:34:49.140869 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.138420 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c7619283-a7ed-4678-a867-2d22252a0e29-multus-daemon-config\") pod \"multus-g6tbw\" (UID: \"c7619283-a7ed-4678-a867-2d22252a0e29\") " pod="openshift-multus/multus-g6tbw" Jul 24 14:34:49.140869 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.138485 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmmbg\" (UniqueName: \"kubernetes.io/projected/a10fad6d-bf8a-4154-8a15-3028177e8226-kube-api-access-qmmbg\") pod \"aws-ebs-csi-driver-node-4vc5z\" (UID: \"a10fad6d-bf8a-4154-8a15-3028177e8226\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vc5z" Jul 24 14:34:49.141740 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.138521 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a-etc-modprobe-d\") pod \"tuned-pc4m9\" (UID: \"9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a\") " pod="openshift-cluster-node-tuning-operator/tuned-pc4m9" Jul 24 14:34:49.141740 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.138547 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4ec9750f-187d-4f04-89e3-d915de6e9778-host-slash\") pod \"ovnkube-node-n8n54\" (UID: \"4ec9750f-187d-4f04-89e3-d915de6e9778\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:34:49.141740 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.138574 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/52fee0af-d9bb-4fb2-8ab4-20431332262f-iptables-alerter-script\") pod \"iptables-alerter-mkh45\" (UID: \"52fee0af-d9bb-4fb2-8ab4-20431332262f\") " pod="openshift-network-operator/iptables-alerter-mkh45" Jul 24 14:34:49.141740 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.138700 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a-etc-modprobe-d\") pod \"tuned-pc4m9\" (UID: \"9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a\") " pod="openshift-cluster-node-tuning-operator/tuned-pc4m9" Jul 24 14:34:49.141740 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.138744 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4ec9750f-187d-4f04-89e3-d915de6e9778-host-slash\") pod \"ovnkube-node-n8n54\" (UID: \"4ec9750f-187d-4f04-89e3-d915de6e9778\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:34:49.141740 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.138780 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c7619283-a7ed-4678-a867-2d22252a0e29-cni-binary-copy\") pod \"multus-g6tbw\" (UID: \"c7619283-a7ed-4678-a867-2d22252a0e29\") " pod="openshift-multus/multus-g6tbw" Jul 24 14:34:49.141740 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.141694 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a-tmp\") pod \"tuned-pc4m9\" (UID: \"9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a\") " pod="openshift-cluster-node-tuning-operator/tuned-pc4m9" Jul 24 14:34:49.142032 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.141802 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a-etc-tuned\") pod \"tuned-pc4m9\" (UID: \"9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a\") " pod="openshift-cluster-node-tuning-operator/tuned-pc4m9" Jul 24 14:34:49.142032 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.141875 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4ec9750f-187d-4f04-89e3-d915de6e9778-ovn-node-metrics-cert\") pod \"ovnkube-node-n8n54\" (UID: \"4ec9750f-187d-4f04-89e3-d915de6e9778\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:34:49.145219 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.145182 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knwd6\" (UniqueName: \"kubernetes.io/projected/c7619283-a7ed-4678-a867-2d22252a0e29-kube-api-access-knwd6\") pod \"multus-g6tbw\" (UID: \"c7619283-a7ed-4678-a867-2d22252a0e29\") " pod="openshift-multus/multus-g6tbw" Jul 24 14:34:49.145523 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.145508 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkt42\" (UniqueName: \"kubernetes.io/projected/4ec9750f-187d-4f04-89e3-d915de6e9778-kube-api-access-fkt42\") pod \"ovnkube-node-n8n54\" (UID: \"4ec9750f-187d-4f04-89e3-d915de6e9778\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:34:49.145623 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.145601 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tzcg\" (UniqueName: \"kubernetes.io/projected/4a748576-5432-4fcf-b10f-5c488963ba3d-kube-api-access-7tzcg\") pod \"node-ca-kt54d\" (UID: \"4a748576-5432-4fcf-b10f-5c488963ba3d\") " pod="openshift-image-registry/node-ca-kt54d" Jul 24 14:34:49.146735 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.146696 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmmbg\" (UniqueName: \"kubernetes.io/projected/a10fad6d-bf8a-4154-8a15-3028177e8226-kube-api-access-qmmbg\") pod \"aws-ebs-csi-driver-node-4vc5z\" (UID: \"a10fad6d-bf8a-4154-8a15-3028177e8226\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vc5z" Jul 24 14:34:49.147352 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.147327 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-484z5\" (UniqueName: \"kubernetes.io/projected/9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a-kube-api-access-484z5\") pod \"tuned-pc4m9\" (UID: \"9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a\") " pod="openshift-cluster-node-tuning-operator/tuned-pc4m9" Jul 24 14:34:49.168813 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.168756 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-87.ec2.internal" event={"ID":"2f7e8cdd0c9e683123e995ae57bab829","Type":"ContainerStarted","Data":"fff4660b1df8ea6856ef7d9202625b7050c3d7ca7f32f60774de8b50ed309f6f"} Jul 24 14:34:49.169966 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.169934 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-87.ec2.internal" event={"ID":"a4818398c4598e46d283eeb2e2a1a7ab","Type":"ContainerStarted","Data":"208e555239a108c2b15724e13e275c6fba9e9e968b87ac34eb41cced2fdab5a5"} Jul 24 14:34:49.239121 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.239027 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q49q6\" (UniqueName: \"kubernetes.io/projected/b8ade508-14e0-4f5b-b508-0a542b29d1c3-kube-api-access-q49q6\") pod \"multus-additional-cni-plugins-vvk6x\" (UID: \"b8ade508-14e0-4f5b-b508-0a542b29d1c3\") " pod="openshift-multus/multus-additional-cni-plugins-vvk6x" Jul 24 14:34:49.239121 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.239071 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c5686d40-c284-4232-acfe-b583a06627d6-konnectivity-ca\") pod \"konnectivity-agent-q5258\" (UID: \"c5686d40-c284-4232-acfe-b583a06627d6\") " pod="kube-system/konnectivity-agent-q5258" Jul 24 14:34:49.239121 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.239094 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b8ade508-14e0-4f5b-b508-0a542b29d1c3-system-cni-dir\") pod \"multus-additional-cni-plugins-vvk6x\" (UID: \"b8ade508-14e0-4f5b-b508-0a542b29d1c3\") " pod="openshift-multus/multus-additional-cni-plugins-vvk6x" Jul 24 14:34:49.239121 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.239120 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcp4v\" (UniqueName: \"kubernetes.io/projected/208712d7-ea7e-430c-b730-e6bf290b2fcd-kube-api-access-mcp4v\") pod \"network-metrics-daemon-2jd76\" (UID: \"208712d7-ea7e-430c-b730-e6bf290b2fcd\") " pod="openshift-multus/network-metrics-daemon-2jd76" Jul 24 14:34:49.239430 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.239156 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/52fee0af-d9bb-4fb2-8ab4-20431332262f-host-slash\") pod \"iptables-alerter-mkh45\" (UID: \"52fee0af-d9bb-4fb2-8ab4-20431332262f\") " pod="openshift-network-operator/iptables-alerter-mkh45" Jul 24 14:34:49.239430 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.239177 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f269d799-9553-4954-8bdf-4a76fafcdc06-original-pull-secret\") pod \"global-pull-secret-syncer-v7jqr\" (UID: \"f269d799-9553-4954-8bdf-4a76fafcdc06\") " pod="kube-system/global-pull-secret-syncer-v7jqr" Jul 24 14:34:49.239430 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.239200 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/09a04909-4f60-48c8-8077-06b6dccf3df8-hosts-file\") pod \"node-resolver-2w5hp\" (UID: \"09a04909-4f60-48c8-8077-06b6dccf3df8\") " pod="openshift-dns/node-resolver-2w5hp" Jul 24 14:34:49.239430 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.239224 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c5686d40-c284-4232-acfe-b583a06627d6-agent-certs\") pod \"konnectivity-agent-q5258\" (UID: \"c5686d40-c284-4232-acfe-b583a06627d6\") " pod="kube-system/konnectivity-agent-q5258" Jul 24 14:34:49.239430 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.239244 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b8ade508-14e0-4f5b-b508-0a542b29d1c3-cnibin\") pod \"multus-additional-cni-plugins-vvk6x\" (UID: \"b8ade508-14e0-4f5b-b508-0a542b29d1c3\") " pod="openshift-multus/multus-additional-cni-plugins-vvk6x" Jul 24 14:34:49.239430 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.239265 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b8ade508-14e0-4f5b-b508-0a542b29d1c3-os-release\") pod \"multus-additional-cni-plugins-vvk6x\" (UID: \"b8ade508-14e0-4f5b-b508-0a542b29d1c3\") " pod="openshift-multus/multus-additional-cni-plugins-vvk6x" Jul 24 14:34:49.239430 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.239285 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b8ade508-14e0-4f5b-b508-0a542b29d1c3-cni-binary-copy\") pod \"multus-additional-cni-plugins-vvk6x\" (UID: \"b8ade508-14e0-4f5b-b508-0a542b29d1c3\") " pod="openshift-multus/multus-additional-cni-plugins-vvk6x" Jul 24 14:34:49.239430 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.239317 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6j4wf\" (UniqueName: \"kubernetes.io/projected/09a04909-4f60-48c8-8077-06b6dccf3df8-kube-api-access-6j4wf\") pod \"node-resolver-2w5hp\" (UID: \"09a04909-4f60-48c8-8077-06b6dccf3df8\") " pod="openshift-dns/node-resolver-2w5hp" Jul 24 14:34:49.239430 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.239348 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09a04909-4f60-48c8-8077-06b6dccf3df8-tmp-dir\") pod \"node-resolver-2w5hp\" (UID: \"09a04909-4f60-48c8-8077-06b6dccf3df8\") " pod="openshift-dns/node-resolver-2w5hp" Jul 24 14:34:49.239430 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.239382 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b8ade508-14e0-4f5b-b508-0a542b29d1c3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vvk6x\" (UID: \"b8ade508-14e0-4f5b-b508-0a542b29d1c3\") " pod="openshift-multus/multus-additional-cni-plugins-vvk6x" Jul 24 14:34:49.239430 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.239405 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7jxn\" (UniqueName: \"kubernetes.io/projected/9e71e9e2-8727-4639-a971-7d92acd69928-kube-api-access-g7jxn\") pod \"network-check-target-cjzwq\" (UID: \"9e71e9e2-8727-4639-a971-7d92acd69928\") " pod="openshift-network-diagnostics/network-check-target-cjzwq" Jul 24 14:34:49.239430 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.239430 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f269d799-9553-4954-8bdf-4a76fafcdc06-kubelet-config\") pod \"global-pull-secret-syncer-v7jqr\" (UID: \"f269d799-9553-4954-8bdf-4a76fafcdc06\") " pod="kube-system/global-pull-secret-syncer-v7jqr" Jul 24 14:34:49.240041 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.239457 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b8ade508-14e0-4f5b-b508-0a542b29d1c3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vvk6x\" (UID: \"b8ade508-14e0-4f5b-b508-0a542b29d1c3\") " pod="openshift-multus/multus-additional-cni-plugins-vvk6x" Jul 24 14:34:49.240041 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.239525 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/52fee0af-d9bb-4fb2-8ab4-20431332262f-iptables-alerter-script\") pod \"iptables-alerter-mkh45\" (UID: \"52fee0af-d9bb-4fb2-8ab4-20431332262f\") " pod="openshift-network-operator/iptables-alerter-mkh45" Jul 24 14:34:49.240041 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.239554 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4562x\" (UniqueName: \"kubernetes.io/projected/52fee0af-d9bb-4fb2-8ab4-20431332262f-kube-api-access-4562x\") pod \"iptables-alerter-mkh45\" (UID: \"52fee0af-d9bb-4fb2-8ab4-20431332262f\") " pod="openshift-network-operator/iptables-alerter-mkh45" Jul 24 14:34:49.240041 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.239582 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/208712d7-ea7e-430c-b730-e6bf290b2fcd-metrics-certs\") pod \"network-metrics-daemon-2jd76\" (UID: \"208712d7-ea7e-430c-b730-e6bf290b2fcd\") " pod="openshift-multus/network-metrics-daemon-2jd76" Jul 24 14:34:49.240041 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.239605 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f269d799-9553-4954-8bdf-4a76fafcdc06-dbus\") pod \"global-pull-secret-syncer-v7jqr\" (UID: \"f269d799-9553-4954-8bdf-4a76fafcdc06\") " pod="kube-system/global-pull-secret-syncer-v7jqr" Jul 24 14:34:49.240041 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.239630 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b8ade508-14e0-4f5b-b508-0a542b29d1c3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vvk6x\" (UID: \"b8ade508-14e0-4f5b-b508-0a542b29d1c3\") " pod="openshift-multus/multus-additional-cni-plugins-vvk6x" Jul 24 14:34:49.240041 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.239701 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c5686d40-c284-4232-acfe-b583a06627d6-konnectivity-ca\") pod \"konnectivity-agent-q5258\" (UID: \"c5686d40-c284-4232-acfe-b583a06627d6\") " pod="kube-system/konnectivity-agent-q5258" Jul 24 14:34:49.240041 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.239752 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/52fee0af-d9bb-4fb2-8ab4-20431332262f-host-slash\") pod \"iptables-alerter-mkh45\" (UID: \"52fee0af-d9bb-4fb2-8ab4-20431332262f\") " pod="openshift-network-operator/iptables-alerter-mkh45" Jul 24 14:34:49.240041 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.239800 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b8ade508-14e0-4f5b-b508-0a542b29d1c3-system-cni-dir\") pod \"multus-additional-cni-plugins-vvk6x\" (UID: \"b8ade508-14e0-4f5b-b508-0a542b29d1c3\") " pod="openshift-multus/multus-additional-cni-plugins-vvk6x" Jul 24 14:34:49.240456 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.240105 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b8ade508-14e0-4f5b-b508-0a542b29d1c3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vvk6x\" (UID: \"b8ade508-14e0-4f5b-b508-0a542b29d1c3\") " pod="openshift-multus/multus-additional-cni-plugins-vvk6x" Jul 24 14:34:49.240456 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.240156 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b8ade508-14e0-4f5b-b508-0a542b29d1c3-cnibin\") pod \"multus-additional-cni-plugins-vvk6x\" (UID: \"b8ade508-14e0-4f5b-b508-0a542b29d1c3\") " pod="openshift-multus/multus-additional-cni-plugins-vvk6x" Jul 24 14:34:49.240456 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.240183 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09a04909-4f60-48c8-8077-06b6dccf3df8-tmp-dir\") pod \"node-resolver-2w5hp\" (UID: \"09a04909-4f60-48c8-8077-06b6dccf3df8\") " pod="openshift-dns/node-resolver-2w5hp" Jul 24 14:34:49.240456 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.240231 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b8ade508-14e0-4f5b-b508-0a542b29d1c3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vvk6x\" (UID: \"b8ade508-14e0-4f5b-b508-0a542b29d1c3\") " pod="openshift-multus/multus-additional-cni-plugins-vvk6x" Jul 24 14:34:49.240456 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.240252 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b8ade508-14e0-4f5b-b508-0a542b29d1c3-cni-binary-copy\") pod \"multus-additional-cni-plugins-vvk6x\" (UID: \"b8ade508-14e0-4f5b-b508-0a542b29d1c3\") " pod="openshift-multus/multus-additional-cni-plugins-vvk6x" Jul 24 14:34:49.240456 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:49.240376 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 14:34:49.240747 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:49.240465 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/208712d7-ea7e-430c-b730-e6bf290b2fcd-metrics-certs podName:208712d7-ea7e-430c-b730-e6bf290b2fcd nodeName:}" failed. No retries permitted until 2026-07-24 14:34:49.740424626 +0000 UTC m=+3.021814186 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/208712d7-ea7e-430c-b730-e6bf290b2fcd-metrics-certs") pod "network-metrics-daemon-2jd76" (UID: "208712d7-ea7e-430c-b730-e6bf290b2fcd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 14:34:49.240747 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.240571 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b8ade508-14e0-4f5b-b508-0a542b29d1c3-os-release\") pod \"multus-additional-cni-plugins-vvk6x\" (UID: \"b8ade508-14e0-4f5b-b508-0a542b29d1c3\") " pod="openshift-multus/multus-additional-cni-plugins-vvk6x" Jul 24 14:34:49.240940 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.240556 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f269d799-9553-4954-8bdf-4a76fafcdc06-dbus\") pod \"global-pull-secret-syncer-v7jqr\" (UID: \"f269d799-9553-4954-8bdf-4a76fafcdc06\") " pod="kube-system/global-pull-secret-syncer-v7jqr" Jul 24 14:34:49.241531 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:49.241368 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 14:34:49.241531 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.241400 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/52fee0af-d9bb-4fb2-8ab4-20431332262f-iptables-alerter-script\") pod \"iptables-alerter-mkh45\" (UID: \"52fee0af-d9bb-4fb2-8ab4-20431332262f\") " pod="openshift-network-operator/iptables-alerter-mkh45" Jul 24 14:34:49.241531 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.241424 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/09a04909-4f60-48c8-8077-06b6dccf3df8-hosts-file\") pod \"node-resolver-2w5hp\" (UID: \"09a04909-4f60-48c8-8077-06b6dccf3df8\") " pod="openshift-dns/node-resolver-2w5hp" Jul 24 14:34:49.241531 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:49.241434 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f269d799-9553-4954-8bdf-4a76fafcdc06-original-pull-secret podName:f269d799-9553-4954-8bdf-4a76fafcdc06 nodeName:}" failed. No retries permitted until 2026-07-24 14:34:49.741411466 +0000 UTC m=+3.022801030 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f269d799-9553-4954-8bdf-4a76fafcdc06-original-pull-secret") pod "global-pull-secret-syncer-v7jqr" (UID: "f269d799-9553-4954-8bdf-4a76fafcdc06") : object "kube-system"/"original-pull-secret" not registered Jul 24 14:34:49.241531 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.241512 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f269d799-9553-4954-8bdf-4a76fafcdc06-kubelet-config\") pod \"global-pull-secret-syncer-v7jqr\" (UID: \"f269d799-9553-4954-8bdf-4a76fafcdc06\") " pod="kube-system/global-pull-secret-syncer-v7jqr" Jul 24 14:34:49.244491 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.241995 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b8ade508-14e0-4f5b-b508-0a542b29d1c3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vvk6x\" (UID: \"b8ade508-14e0-4f5b-b508-0a542b29d1c3\") " pod="openshift-multus/multus-additional-cni-plugins-vvk6x" Jul 24 14:34:49.244545 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.244495 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c5686d40-c284-4232-acfe-b583a06627d6-agent-certs\") pod \"konnectivity-agent-q5258\" (UID: \"c5686d40-c284-4232-acfe-b583a06627d6\") " pod="kube-system/konnectivity-agent-q5258" Jul 24 14:34:49.246010 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:49.245989 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 14:34:49.246149 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:49.246015 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 14:34:49.246149 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:49.246029 2565 projected.go:196] Error preparing data for projected volume kube-api-access-g7jxn for pod openshift-network-diagnostics/network-check-target-cjzwq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 14:34:49.246149 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:49.246079 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e71e9e2-8727-4639-a971-7d92acd69928-kube-api-access-g7jxn podName:9e71e9e2-8727-4639-a971-7d92acd69928 nodeName:}" failed. No retries permitted until 2026-07-24 14:34:49.746065087 +0000 UTC m=+3.027454661 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-g7jxn" (UniqueName: "kubernetes.io/projected/9e71e9e2-8727-4639-a971-7d92acd69928-kube-api-access-g7jxn") pod "network-check-target-cjzwq" (UID: "9e71e9e2-8727-4639-a971-7d92acd69928") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 14:34:49.248367 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.248317 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcp4v\" (UniqueName: \"kubernetes.io/projected/208712d7-ea7e-430c-b730-e6bf290b2fcd-kube-api-access-mcp4v\") pod \"network-metrics-daemon-2jd76\" (UID: \"208712d7-ea7e-430c-b730-e6bf290b2fcd\") " pod="openshift-multus/network-metrics-daemon-2jd76" Jul 24 14:34:49.248639 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.248614 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q49q6\" (UniqueName: \"kubernetes.io/projected/b8ade508-14e0-4f5b-b508-0a542b29d1c3-kube-api-access-q49q6\") pod \"multus-additional-cni-plugins-vvk6x\" (UID: \"b8ade508-14e0-4f5b-b508-0a542b29d1c3\") " pod="openshift-multus/multus-additional-cni-plugins-vvk6x" Jul 24 14:34:49.249927 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.249902 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4562x\" (UniqueName: \"kubernetes.io/projected/52fee0af-d9bb-4fb2-8ab4-20431332262f-kube-api-access-4562x\") pod \"iptables-alerter-mkh45\" (UID: \"52fee0af-d9bb-4fb2-8ab4-20431332262f\") " pod="openshift-network-operator/iptables-alerter-mkh45" Jul 24 14:34:49.250018 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.249928 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6j4wf\" (UniqueName: \"kubernetes.io/projected/09a04909-4f60-48c8-8077-06b6dccf3df8-kube-api-access-6j4wf\") pod \"node-resolver-2w5hp\" (UID: \"09a04909-4f60-48c8-8077-06b6dccf3df8\") " pod="openshift-dns/node-resolver-2w5hp" Jul 24 14:34:49.323302 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.323265 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-g6tbw" Jul 24 14:34:49.329838 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.329817 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kt54d" Jul 24 14:34:49.338456 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.338434 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vc5z" Jul 24 14:34:49.343183 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.343163 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pc4m9" Jul 24 14:34:49.348829 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.348806 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:34:49.358699 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.358678 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vvk6x" Jul 24 14:34:49.363389 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.363358 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mkh45" Jul 24 14:34:49.369055 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.369035 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-q5258" Jul 24 14:34:49.374633 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.374613 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2w5hp" Jul 24 14:34:49.586987 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.586908 2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 14:34:49.710191 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:49.710166 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ec9750f_187d_4f04_89e3_d915de6e9778.slice/crio-31c958079e46b716631bbe0c3d31849ef38335f15272e9aaceeacfc72fd3536e WatchSource:0}: Error finding container 31c958079e46b716631bbe0c3d31849ef38335f15272e9aaceeacfc72fd3536e: Status 404 returned error can't find the container with id 31c958079e46b716631bbe0c3d31849ef38335f15272e9aaceeacfc72fd3536e Jul 24 14:34:49.711535 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:49.711510 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5686d40_c284_4232_acfe_b583a06627d6.slice/crio-7026dad00040f0ab0bc9c03cbf125de7aa5eed18621ece43223ec7ed4bd792a5 WatchSource:0}: Error finding container 7026dad00040f0ab0bc9c03cbf125de7aa5eed18621ece43223ec7ed4bd792a5: Status 404 returned error can't find the container with id 7026dad00040f0ab0bc9c03cbf125de7aa5eed18621ece43223ec7ed4bd792a5 Jul 24 14:34:49.717893 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:49.717855 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ba901b4_5491_4f7f_ae71_94eb4c8a7e1a.slice/crio-485b75ce0308605f830915d2520a00f49b5d8bcc883421e140aa58f5a1f606e5 WatchSource:0}: Error finding container 485b75ce0308605f830915d2520a00f49b5d8bcc883421e140aa58f5a1f606e5: Status 404 returned error can't find the container with id 485b75ce0308605f830915d2520a00f49b5d8bcc883421e140aa58f5a1f606e5 Jul 24 14:34:49.737904 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:49.737875 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09a04909_4f60_48c8_8077_06b6dccf3df8.slice/crio-a7a2783c442ef70730a9b01f7601ef43f266355249d4ad55f7546630644039bf WatchSource:0}: Error finding container a7a2783c442ef70730a9b01f7601ef43f266355249d4ad55f7546630644039bf: Status 404 returned error can't find the container with id a7a2783c442ef70730a9b01f7601ef43f266355249d4ad55f7546630644039bf Jul 24 14:34:49.739100 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:49.739076 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7619283_a7ed_4678_a867_2d22252a0e29.slice/crio-69e7bdecfdac6cf226aa27e38866b8c5c80d2467caf003d9a90f0a5690213092 WatchSource:0}: Error finding container 69e7bdecfdac6cf226aa27e38866b8c5c80d2467caf003d9a90f0a5690213092: Status 404 returned error can't find the container with id 69e7bdecfdac6cf226aa27e38866b8c5c80d2467caf003d9a90f0a5690213092 Jul 24 14:34:49.740229 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:49.740087 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8ade508_14e0_4f5b_b508_0a542b29d1c3.slice/crio-d725b27a8766d84c288848b9ad95a9b5f8aee1caa39e5485d55f2bd0d0c8d3a7 WatchSource:0}: Error finding container d725b27a8766d84c288848b9ad95a9b5f8aee1caa39e5485d55f2bd0d0c8d3a7: Status 404 returned error can't find the container with id d725b27a8766d84c288848b9ad95a9b5f8aee1caa39e5485d55f2bd0d0c8d3a7 Jul 24 14:34:49.741269 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:49.741215 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52fee0af_d9bb_4fb2_8ab4_20431332262f.slice/crio-24e73a298c050b79ac8a128d6d70c4b8dc805bcc75fd591ebd758bf90a902e16 WatchSource:0}: Error finding container 24e73a298c050b79ac8a128d6d70c4b8dc805bcc75fd591ebd758bf90a902e16: Status 404 returned error can't find the container with id 24e73a298c050b79ac8a128d6d70c4b8dc805bcc75fd591ebd758bf90a902e16 Jul 24 14:34:49.742239 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:34:49.742198 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda10fad6d_bf8a_4154_8a15_3028177e8226.slice/crio-2137c92bd20d3a9ba0816e4b18b0861ebf158db2d23e3413be9dd895e08ea38d WatchSource:0}: Error finding container 2137c92bd20d3a9ba0816e4b18b0861ebf158db2d23e3413be9dd895e08ea38d: Status 404 returned error can't find the container with id 2137c92bd20d3a9ba0816e4b18b0861ebf158db2d23e3413be9dd895e08ea38d Jul 24 14:34:49.743597 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.743578 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/208712d7-ea7e-430c-b730-e6bf290b2fcd-metrics-certs\") pod \"network-metrics-daemon-2jd76\" (UID: \"208712d7-ea7e-430c-b730-e6bf290b2fcd\") " pod="openshift-multus/network-metrics-daemon-2jd76" Jul 24 14:34:49.743718 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.743611 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f269d799-9553-4954-8bdf-4a76fafcdc06-original-pull-secret\") pod \"global-pull-secret-syncer-v7jqr\" (UID: \"f269d799-9553-4954-8bdf-4a76fafcdc06\") " pod="kube-system/global-pull-secret-syncer-v7jqr" Jul 24 14:34:49.743763 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:49.743715 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 14:34:49.743795 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:49.743763 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/208712d7-ea7e-430c-b730-e6bf290b2fcd-metrics-certs podName:208712d7-ea7e-430c-b730-e6bf290b2fcd nodeName:}" failed. No retries permitted until 2026-07-24 14:34:50.743749189 +0000 UTC m=+4.025138748 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/208712d7-ea7e-430c-b730-e6bf290b2fcd-metrics-certs") pod "network-metrics-daemon-2jd76" (UID: "208712d7-ea7e-430c-b730-e6bf290b2fcd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 14:34:49.743795 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:49.743764 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 14:34:49.743870 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:49.743801 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f269d799-9553-4954-8bdf-4a76fafcdc06-original-pull-secret podName:f269d799-9553-4954-8bdf-4a76fafcdc06 nodeName:}" failed. No retries permitted until 2026-07-24 14:34:50.74379109 +0000 UTC m=+4.025180649 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f269d799-9553-4954-8bdf-4a76fafcdc06-original-pull-secret") pod "global-pull-secret-syncer-v7jqr" (UID: "f269d799-9553-4954-8bdf-4a76fafcdc06") : object "kube-system"/"original-pull-secret" not registered Jul 24 14:34:49.844654 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:49.844575 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7jxn\" (UniqueName: \"kubernetes.io/projected/9e71e9e2-8727-4639-a971-7d92acd69928-kube-api-access-g7jxn\") pod \"network-check-target-cjzwq\" (UID: \"9e71e9e2-8727-4639-a971-7d92acd69928\") " pod="openshift-network-diagnostics/network-check-target-cjzwq" Jul 24 14:34:49.844775 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:49.844690 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 14:34:49.844775 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:49.844703 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 14:34:49.844775 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:49.844712 2565 projected.go:196] Error preparing data for projected volume kube-api-access-g7jxn for pod openshift-network-diagnostics/network-check-target-cjzwq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 14:34:49.844775 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:49.844755 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e71e9e2-8727-4639-a971-7d92acd69928-kube-api-access-g7jxn podName:9e71e9e2-8727-4639-a971-7d92acd69928 nodeName:}" failed. No retries permitted until 2026-07-24 14:34:50.844743023 +0000 UTC m=+4.126132582 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-g7jxn" (UniqueName: "kubernetes.io/projected/9e71e9e2-8727-4639-a971-7d92acd69928-kube-api-access-g7jxn") pod "network-check-target-cjzwq" (UID: "9e71e9e2-8727-4639-a971-7d92acd69928") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 14:34:50.071323 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:50.071279 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 14:29:49 +0000 UTC" deadline="2027-12-30 22:49:17.856475063 +0000 UTC" Jul 24 14:34:50.071323 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:50.071317 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12584h14m27.78516284s" Jul 24 14:34:50.165134 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:50.165060 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7jqr" Jul 24 14:34:50.165290 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:50.165193 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7jqr" podUID="f269d799-9553-4954-8bdf-4a76fafcdc06" Jul 24 14:34:50.175521 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:50.175224 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-87.ec2.internal" event={"ID":"a4818398c4598e46d283eeb2e2a1a7ab","Type":"ContainerStarted","Data":"56bd924528e66cb9d877d960e17e43f355ce062089962013bd16094c25bc90b8"} Jul 24 14:34:50.177822 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:50.177767 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vvk6x" event={"ID":"b8ade508-14e0-4f5b-b508-0a542b29d1c3","Type":"ContainerStarted","Data":"d725b27a8766d84c288848b9ad95a9b5f8aee1caa39e5485d55f2bd0d0c8d3a7"} Jul 24 14:34:50.184802 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:50.184715 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mkh45" event={"ID":"52fee0af-d9bb-4fb2-8ab4-20431332262f","Type":"ContainerStarted","Data":"24e73a298c050b79ac8a128d6d70c4b8dc805bcc75fd591ebd758bf90a902e16"} Jul 24 14:34:50.187579 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:50.187497 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2w5hp" event={"ID":"09a04909-4f60-48c8-8077-06b6dccf3df8","Type":"ContainerStarted","Data":"a7a2783c442ef70730a9b01f7601ef43f266355249d4ad55f7546630644039bf"} Jul 24 14:34:50.192801 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:50.192597 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pc4m9" event={"ID":"9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a","Type":"ContainerStarted","Data":"485b75ce0308605f830915d2520a00f49b5d8bcc883421e140aa58f5a1f606e5"} Jul 24 14:34:50.196646 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:50.196620 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kt54d" event={"ID":"4a748576-5432-4fcf-b10f-5c488963ba3d","Type":"ContainerStarted","Data":"a6f65f6b3a266488027e2854a17f706badb49ba598e426da3a2b036aa30a45d8"} Jul 24 14:34:50.202023 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:50.201994 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-q5258" event={"ID":"c5686d40-c284-4232-acfe-b583a06627d6","Type":"ContainerStarted","Data":"7026dad00040f0ab0bc9c03cbf125de7aa5eed18621ece43223ec7ed4bd792a5"} Jul 24 14:34:50.204895 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:50.204867 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vc5z" event={"ID":"a10fad6d-bf8a-4154-8a15-3028177e8226","Type":"ContainerStarted","Data":"2137c92bd20d3a9ba0816e4b18b0861ebf158db2d23e3413be9dd895e08ea38d"} Jul 24 14:34:50.211302 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:50.211278 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-g6tbw" event={"ID":"c7619283-a7ed-4678-a867-2d22252a0e29","Type":"ContainerStarted","Data":"69e7bdecfdac6cf226aa27e38866b8c5c80d2467caf003d9a90f0a5690213092"} Jul 24 14:34:50.214065 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:50.214042 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" event={"ID":"4ec9750f-187d-4f04-89e3-d915de6e9778","Type":"ContainerStarted","Data":"31c958079e46b716631bbe0c3d31849ef38335f15272e9aaceeacfc72fd3536e"} Jul 24 14:34:50.753192 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:50.753153 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/208712d7-ea7e-430c-b730-e6bf290b2fcd-metrics-certs\") pod \"network-metrics-daemon-2jd76\" (UID: \"208712d7-ea7e-430c-b730-e6bf290b2fcd\") " pod="openshift-multus/network-metrics-daemon-2jd76" Jul 24 14:34:50.753398 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:50.753220 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f269d799-9553-4954-8bdf-4a76fafcdc06-original-pull-secret\") pod \"global-pull-secret-syncer-v7jqr\" (UID: \"f269d799-9553-4954-8bdf-4a76fafcdc06\") " pod="kube-system/global-pull-secret-syncer-v7jqr" Jul 24 14:34:50.753398 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:50.753354 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 14:34:50.753543 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:50.753414 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f269d799-9553-4954-8bdf-4a76fafcdc06-original-pull-secret podName:f269d799-9553-4954-8bdf-4a76fafcdc06 nodeName:}" failed. No retries permitted until 2026-07-24 14:34:52.753396121 +0000 UTC m=+6.034785683 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f269d799-9553-4954-8bdf-4a76fafcdc06-original-pull-secret") pod "global-pull-secret-syncer-v7jqr" (UID: "f269d799-9553-4954-8bdf-4a76fafcdc06") : object "kube-system"/"original-pull-secret" not registered Jul 24 14:34:50.753984 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:50.753820 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 14:34:50.753984 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:50.753875 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/208712d7-ea7e-430c-b730-e6bf290b2fcd-metrics-certs podName:208712d7-ea7e-430c-b730-e6bf290b2fcd nodeName:}" failed. No retries permitted until 2026-07-24 14:34:52.753861122 +0000 UTC m=+6.035250687 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/208712d7-ea7e-430c-b730-e6bf290b2fcd-metrics-certs") pod "network-metrics-daemon-2jd76" (UID: "208712d7-ea7e-430c-b730-e6bf290b2fcd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 14:34:50.853971 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:50.853923 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7jxn\" (UniqueName: \"kubernetes.io/projected/9e71e9e2-8727-4639-a971-7d92acd69928-kube-api-access-g7jxn\") pod \"network-check-target-cjzwq\" (UID: \"9e71e9e2-8727-4639-a971-7d92acd69928\") " pod="openshift-network-diagnostics/network-check-target-cjzwq" Jul 24 14:34:50.854146 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:50.854112 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 14:34:50.854146 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:50.854132 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 14:34:50.854146 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:50.854147 2565 projected.go:196] Error preparing data for projected volume kube-api-access-g7jxn for pod openshift-network-diagnostics/network-check-target-cjzwq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 14:34:50.854311 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:50.854205 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e71e9e2-8727-4639-a971-7d92acd69928-kube-api-access-g7jxn podName:9e71e9e2-8727-4639-a971-7d92acd69928 nodeName:}" failed. No retries permitted until 2026-07-24 14:34:52.854186993 +0000 UTC m=+6.135576556 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-g7jxn" (UniqueName: "kubernetes.io/projected/9e71e9e2-8727-4639-a971-7d92acd69928-kube-api-access-g7jxn") pod "network-check-target-cjzwq" (UID: "9e71e9e2-8727-4639-a971-7d92acd69928") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 14:34:51.072168 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:51.072032 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 14:29:49 +0000 UTC" deadline="2028-05-02 17:16:43.205662806 +0000 UTC" Jul 24 14:34:51.072168 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:51.072076 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15554h41m52.133591381s" Jul 24 14:34:51.167517 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:51.166866 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jd76" Jul 24 14:34:51.167517 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:51.167003 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jd76" podUID="208712d7-ea7e-430c-b730-e6bf290b2fcd" Jul 24 14:34:51.167517 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:51.167405 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjzwq" Jul 24 14:34:51.167517 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:51.167517 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjzwq" podUID="9e71e9e2-8727-4639-a971-7d92acd69928" Jul 24 14:34:52.167826 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:52.164764 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7jqr" Jul 24 14:34:52.167826 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:52.164896 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7jqr" podUID="f269d799-9553-4954-8bdf-4a76fafcdc06" Jul 24 14:34:52.770717 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:52.770676 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/208712d7-ea7e-430c-b730-e6bf290b2fcd-metrics-certs\") pod \"network-metrics-daemon-2jd76\" (UID: \"208712d7-ea7e-430c-b730-e6bf290b2fcd\") " pod="openshift-multus/network-metrics-daemon-2jd76" Jul 24 14:34:52.770941 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:52.770742 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f269d799-9553-4954-8bdf-4a76fafcdc06-original-pull-secret\") pod \"global-pull-secret-syncer-v7jqr\" (UID: \"f269d799-9553-4954-8bdf-4a76fafcdc06\") " pod="kube-system/global-pull-secret-syncer-v7jqr" Jul 24 14:34:52.770941 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:52.770912 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 14:34:52.771050 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:52.770974 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f269d799-9553-4954-8bdf-4a76fafcdc06-original-pull-secret podName:f269d799-9553-4954-8bdf-4a76fafcdc06 nodeName:}" failed. No retries permitted until 2026-07-24 14:34:56.770956667 +0000 UTC m=+10.052346245 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f269d799-9553-4954-8bdf-4a76fafcdc06-original-pull-secret") pod "global-pull-secret-syncer-v7jqr" (UID: "f269d799-9553-4954-8bdf-4a76fafcdc06") : object "kube-system"/"original-pull-secret" not registered Jul 24 14:34:52.771412 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:52.771391 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 14:34:52.771511 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:52.771453 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/208712d7-ea7e-430c-b730-e6bf290b2fcd-metrics-certs podName:208712d7-ea7e-430c-b730-e6bf290b2fcd nodeName:}" failed. No retries permitted until 2026-07-24 14:34:56.771436266 +0000 UTC m=+10.052825832 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/208712d7-ea7e-430c-b730-e6bf290b2fcd-metrics-certs") pod "network-metrics-daemon-2jd76" (UID: "208712d7-ea7e-430c-b730-e6bf290b2fcd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 14:34:52.871757 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:52.871713 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7jxn\" (UniqueName: \"kubernetes.io/projected/9e71e9e2-8727-4639-a971-7d92acd69928-kube-api-access-g7jxn\") pod \"network-check-target-cjzwq\" (UID: \"9e71e9e2-8727-4639-a971-7d92acd69928\") " pod="openshift-network-diagnostics/network-check-target-cjzwq" Jul 24 14:34:52.871947 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:52.871886 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 14:34:52.871947 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:52.871908 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 14:34:52.871947 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:52.871920 2565 projected.go:196] Error preparing data for projected volume kube-api-access-g7jxn for pod openshift-network-diagnostics/network-check-target-cjzwq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 14:34:52.872140 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:52.871977 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e71e9e2-8727-4639-a971-7d92acd69928-kube-api-access-g7jxn podName:9e71e9e2-8727-4639-a971-7d92acd69928 nodeName:}" failed. No retries permitted until 2026-07-24 14:34:56.871959739 +0000 UTC m=+10.153349301 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-g7jxn" (UniqueName: "kubernetes.io/projected/9e71e9e2-8727-4639-a971-7d92acd69928-kube-api-access-g7jxn") pod "network-check-target-cjzwq" (UID: "9e71e9e2-8727-4639-a971-7d92acd69928") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 14:34:53.164868 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:53.164714 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjzwq" Jul 24 14:34:53.164868 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:53.164849 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjzwq" podUID="9e71e9e2-8727-4639-a971-7d92acd69928" Jul 24 14:34:53.165355 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:53.164714 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jd76" Jul 24 14:34:53.165355 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:53.165283 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jd76" podUID="208712d7-ea7e-430c-b730-e6bf290b2fcd" Jul 24 14:34:54.164494 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:54.164344 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7jqr" Jul 24 14:34:54.165006 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:54.164496 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7jqr" podUID="f269d799-9553-4954-8bdf-4a76fafcdc06" Jul 24 14:34:55.164994 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:55.164935 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jd76" Jul 24 14:34:55.165362 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:55.165094 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jd76" podUID="208712d7-ea7e-430c-b730-e6bf290b2fcd" Jul 24 14:34:55.165362 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:55.165151 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjzwq" Jul 24 14:34:55.165362 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:55.165266 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjzwq" podUID="9e71e9e2-8727-4639-a971-7d92acd69928" Jul 24 14:34:56.164646 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:56.164370 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7jqr" Jul 24 14:34:56.164824 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:56.164778 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7jqr" podUID="f269d799-9553-4954-8bdf-4a76fafcdc06" Jul 24 14:34:56.810551 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:56.810490 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f269d799-9553-4954-8bdf-4a76fafcdc06-original-pull-secret\") pod \"global-pull-secret-syncer-v7jqr\" (UID: \"f269d799-9553-4954-8bdf-4a76fafcdc06\") " pod="kube-system/global-pull-secret-syncer-v7jqr" Jul 24 14:34:56.811000 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:56.810618 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/208712d7-ea7e-430c-b730-e6bf290b2fcd-metrics-certs\") pod \"network-metrics-daemon-2jd76\" (UID: \"208712d7-ea7e-430c-b730-e6bf290b2fcd\") " pod="openshift-multus/network-metrics-daemon-2jd76" Jul 24 14:34:56.811000 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:56.810743 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 14:34:56.811000 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:56.810805 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/208712d7-ea7e-430c-b730-e6bf290b2fcd-metrics-certs podName:208712d7-ea7e-430c-b730-e6bf290b2fcd nodeName:}" failed. No retries permitted until 2026-07-24 14:35:04.810784478 +0000 UTC m=+18.092174045 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/208712d7-ea7e-430c-b730-e6bf290b2fcd-metrics-certs") pod "network-metrics-daemon-2jd76" (UID: "208712d7-ea7e-430c-b730-e6bf290b2fcd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 14:34:56.811214 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:56.811195 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 14:34:56.811277 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:56.811253 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f269d799-9553-4954-8bdf-4a76fafcdc06-original-pull-secret podName:f269d799-9553-4954-8bdf-4a76fafcdc06 nodeName:}" failed. No retries permitted until 2026-07-24 14:35:04.811237071 +0000 UTC m=+18.092626643 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f269d799-9553-4954-8bdf-4a76fafcdc06-original-pull-secret") pod "global-pull-secret-syncer-v7jqr" (UID: "f269d799-9553-4954-8bdf-4a76fafcdc06") : object "kube-system"/"original-pull-secret" not registered Jul 24 14:34:56.911745 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:56.911682 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7jxn\" (UniqueName: \"kubernetes.io/projected/9e71e9e2-8727-4639-a971-7d92acd69928-kube-api-access-g7jxn\") pod \"network-check-target-cjzwq\" (UID: \"9e71e9e2-8727-4639-a971-7d92acd69928\") " pod="openshift-network-diagnostics/network-check-target-cjzwq" Jul 24 14:34:56.911922 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:56.911867 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 14:34:56.911922 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:56.911898 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 14:34:56.911922 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:56.911911 2565 projected.go:196] Error preparing data for projected volume kube-api-access-g7jxn for pod openshift-network-diagnostics/network-check-target-cjzwq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 14:34:56.912076 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:56.911969 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e71e9e2-8727-4639-a971-7d92acd69928-kube-api-access-g7jxn podName:9e71e9e2-8727-4639-a971-7d92acd69928 nodeName:}" failed. No retries permitted until 2026-07-24 14:35:04.911954786 +0000 UTC m=+18.193344345 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-g7jxn" (UniqueName: "kubernetes.io/projected/9e71e9e2-8727-4639-a971-7d92acd69928-kube-api-access-g7jxn") pod "network-check-target-cjzwq" (UID: "9e71e9e2-8727-4639-a971-7d92acd69928") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 14:34:57.166631 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:57.166004 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jd76" Jul 24 14:34:57.166631 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:57.166172 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jd76" podUID="208712d7-ea7e-430c-b730-e6bf290b2fcd" Jul 24 14:34:57.167153 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:57.167031 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjzwq" Jul 24 14:34:57.167252 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:57.167127 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjzwq" podUID="9e71e9e2-8727-4639-a971-7d92acd69928" Jul 24 14:34:58.165077 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:58.165030 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7jqr" Jul 24 14:34:58.165520 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:58.165156 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7jqr" podUID="f269d799-9553-4954-8bdf-4a76fafcdc06" Jul 24 14:34:59.164974 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:59.164795 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jd76" Jul 24 14:34:59.164974 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:59.164939 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jd76" podUID="208712d7-ea7e-430c-b730-e6bf290b2fcd" Jul 24 14:34:59.164974 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:34:59.164952 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjzwq" Jul 24 14:34:59.165607 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:34:59.165025 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjzwq" podUID="9e71e9e2-8727-4639-a971-7d92acd69928" Jul 24 14:35:00.165302 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:00.165276 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7jqr" Jul 24 14:35:00.165737 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:35:00.165383 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7jqr" podUID="f269d799-9553-4954-8bdf-4a76fafcdc06" Jul 24 14:35:01.164933 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:01.164894 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjzwq" Jul 24 14:35:01.165121 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:35:01.165023 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjzwq" podUID="9e71e9e2-8727-4639-a971-7d92acd69928" Jul 24 14:35:01.165121 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:01.164905 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jd76" Jul 24 14:35:01.165121 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:35:01.165100 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jd76" podUID="208712d7-ea7e-430c-b730-e6bf290b2fcd" Jul 24 14:35:02.164697 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:02.164659 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7jqr" Jul 24 14:35:02.165145 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:35:02.164799 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7jqr" podUID="f269d799-9553-4954-8bdf-4a76fafcdc06" Jul 24 14:35:03.165276 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:03.165037 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjzwq" Jul 24 14:35:03.165276 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:35:03.165169 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjzwq" podUID="9e71e9e2-8727-4639-a971-7d92acd69928" Jul 24 14:35:03.165276 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:03.165215 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jd76" Jul 24 14:35:03.165781 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:35:03.165331 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jd76" podUID="208712d7-ea7e-430c-b730-e6bf290b2fcd" Jul 24 14:35:04.164393 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:04.164356 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7jqr" Jul 24 14:35:04.164634 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:35:04.164494 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7jqr" podUID="f269d799-9553-4954-8bdf-4a76fafcdc06" Jul 24 14:35:04.872152 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:04.872094 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/208712d7-ea7e-430c-b730-e6bf290b2fcd-metrics-certs\") pod \"network-metrics-daemon-2jd76\" (UID: \"208712d7-ea7e-430c-b730-e6bf290b2fcd\") " pod="openshift-multus/network-metrics-daemon-2jd76" Jul 24 14:35:04.872687 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:04.872165 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f269d799-9553-4954-8bdf-4a76fafcdc06-original-pull-secret\") pod \"global-pull-secret-syncer-v7jqr\" (UID: \"f269d799-9553-4954-8bdf-4a76fafcdc06\") " pod="kube-system/global-pull-secret-syncer-v7jqr" Jul 24 14:35:04.872687 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:35:04.872319 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 14:35:04.872687 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:35:04.872331 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 14:35:04.872687 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:35:04.872435 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/208712d7-ea7e-430c-b730-e6bf290b2fcd-metrics-certs podName:208712d7-ea7e-430c-b730-e6bf290b2fcd nodeName:}" failed. No retries permitted until 2026-07-24 14:35:20.872410567 +0000 UTC m=+34.153800140 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/208712d7-ea7e-430c-b730-e6bf290b2fcd-metrics-certs") pod "network-metrics-daemon-2jd76" (UID: "208712d7-ea7e-430c-b730-e6bf290b2fcd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 14:35:04.872687 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:35:04.872573 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f269d799-9553-4954-8bdf-4a76fafcdc06-original-pull-secret podName:f269d799-9553-4954-8bdf-4a76fafcdc06 nodeName:}" failed. No retries permitted until 2026-07-24 14:35:20.872552808 +0000 UTC m=+34.153942370 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f269d799-9553-4954-8bdf-4a76fafcdc06-original-pull-secret") pod "global-pull-secret-syncer-v7jqr" (UID: "f269d799-9553-4954-8bdf-4a76fafcdc06") : object "kube-system"/"original-pull-secret" not registered Jul 24 14:35:04.973023 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:04.972983 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7jxn\" (UniqueName: \"kubernetes.io/projected/9e71e9e2-8727-4639-a971-7d92acd69928-kube-api-access-g7jxn\") pod \"network-check-target-cjzwq\" (UID: \"9e71e9e2-8727-4639-a971-7d92acd69928\") " pod="openshift-network-diagnostics/network-check-target-cjzwq" Jul 24 14:35:04.973188 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:35:04.973170 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 14:35:04.973259 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:35:04.973196 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 14:35:04.973259 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:35:04.973207 2565 projected.go:196] Error preparing data for projected volume kube-api-access-g7jxn for pod openshift-network-diagnostics/network-check-target-cjzwq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 14:35:04.973358 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:35:04.973262 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e71e9e2-8727-4639-a971-7d92acd69928-kube-api-access-g7jxn podName:9e71e9e2-8727-4639-a971-7d92acd69928 nodeName:}" failed. No retries permitted until 2026-07-24 14:35:20.973243781 +0000 UTC m=+34.254633340 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-g7jxn" (UniqueName: "kubernetes.io/projected/9e71e9e2-8727-4639-a971-7d92acd69928-kube-api-access-g7jxn") pod "network-check-target-cjzwq" (UID: "9e71e9e2-8727-4639-a971-7d92acd69928") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 14:35:05.165532 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:05.165433 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jd76" Jul 24 14:35:05.165681 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:05.165446 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjzwq" Jul 24 14:35:05.165681 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:35:05.165601 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jd76" podUID="208712d7-ea7e-430c-b730-e6bf290b2fcd" Jul 24 14:35:05.165681 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:35:05.165656 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjzwq" podUID="9e71e9e2-8727-4639-a971-7d92acd69928" Jul 24 14:35:06.164672 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:06.164637 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7jqr" Jul 24 14:35:06.165120 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:35:06.164760 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7jqr" podUID="f269d799-9553-4954-8bdf-4a76fafcdc06" Jul 24 14:35:07.165928 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:07.165892 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjzwq" Jul 24 14:35:07.166372 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:07.165932 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jd76" Jul 24 14:35:07.166372 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:35:07.166011 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjzwq" podUID="9e71e9e2-8727-4639-a971-7d92acd69928" Jul 24 14:35:07.166372 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:35:07.166125 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jd76" podUID="208712d7-ea7e-430c-b730-e6bf290b2fcd" Jul 24 14:35:08.165345 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:08.165309 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7jqr" Jul 24 14:35:08.165525 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:35:08.165439 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7jqr" podUID="f269d799-9553-4954-8bdf-4a76fafcdc06" Jul 24 14:35:09.166088 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:09.165317 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jd76" Jul 24 14:35:09.166088 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:35:09.165679 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jd76" podUID="208712d7-ea7e-430c-b730-e6bf290b2fcd" Jul 24 14:35:09.166088 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:09.165370 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjzwq" Jul 24 14:35:09.166088 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:35:09.165772 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjzwq" podUID="9e71e9e2-8727-4639-a971-7d92acd69928" Jul 24 14:35:09.261289 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:09.261262 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-q5258" event={"ID":"c5686d40-c284-4232-acfe-b583a06627d6","Type":"ContainerStarted","Data":"011623e6b801537ad362cfe3ca802a19977a484e6d768b52c3fa78b559831e15"} Jul 24 14:35:09.262510 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:09.262485 2565 generic.go:356] "Generic (PLEG): container finished" podID="2f7e8cdd0c9e683123e995ae57bab829" containerID="f59e0da576183a0c27c13b6d53ef07cd1b46e8c544075b20f7296314a64dcc9e" exitCode=0 Jul 24 14:35:09.262595 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:09.262524 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-87.ec2.internal" event={"ID":"2f7e8cdd0c9e683123e995ae57bab829","Type":"ContainerDied","Data":"f59e0da576183a0c27c13b6d53ef07cd1b46e8c544075b20f7296314a64dcc9e"} Jul 24 14:35:09.263921 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:09.263901 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vc5z" event={"ID":"a10fad6d-bf8a-4154-8a15-3028177e8226","Type":"ContainerStarted","Data":"6ba79867e8f936a1254f7c73bc1da7eca832981d8f9f7af19a3416ddce376f8a"} Jul 24 14:35:09.265285 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:09.265261 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-g6tbw" event={"ID":"c7619283-a7ed-4678-a867-2d22252a0e29","Type":"ContainerStarted","Data":"71cbdeba8fdbbbee56cd9596549223bb7e0de677e9b07b57b0e8a621c2149bfb"} Jul 24 14:35:09.267381 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:09.267355 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" event={"ID":"4ec9750f-187d-4f04-89e3-d915de6e9778","Type":"ContainerStarted","Data":"da4c1a604d7ae759247aaaa70fcda918631cc59adf29cc3955cc6e0aeb5fe935"} Jul 24 14:35:09.267463 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:09.267417 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" event={"ID":"4ec9750f-187d-4f04-89e3-d915de6e9778","Type":"ContainerStarted","Data":"4e0207e4cb2a49d5cc81eaae313b824d25acba497750dbae644c273469c13fcc"} Jul 24 14:35:09.267526 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:09.267464 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" event={"ID":"4ec9750f-187d-4f04-89e3-d915de6e9778","Type":"ContainerStarted","Data":"5142dbe4903b5c8f3e0dbf64421cc00336685394e4a009402ce2bd66d34cc090"} Jul 24 14:35:09.267573 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:09.267537 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" event={"ID":"4ec9750f-187d-4f04-89e3-d915de6e9778","Type":"ContainerStarted","Data":"87f75e8adb4f452906d08fe3d933b79936576110eca2342bde03ab404b160761"} Jul 24 14:35:09.268624 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:09.268600 2565 generic.go:356] "Generic (PLEG): container finished" podID="b8ade508-14e0-4f5b-b508-0a542b29d1c3" containerID="eddd84f661b41a3cf35d0cb2317405255535df038c2b15bf7d4ce54b3e38c946" exitCode=0 Jul 24 14:35:09.268727 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:09.268669 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vvk6x" event={"ID":"b8ade508-14e0-4f5b-b508-0a542b29d1c3","Type":"ContainerDied","Data":"eddd84f661b41a3cf35d0cb2317405255535df038c2b15bf7d4ce54b3e38c946"} Jul 24 14:35:09.270029 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:09.269979 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2w5hp" event={"ID":"09a04909-4f60-48c8-8077-06b6dccf3df8","Type":"ContainerStarted","Data":"8a73dec42374bd9a16ad5f921a63cf9919a8e9e1cb42d2bd30e293c9f1cf3f42"} Jul 24 14:35:09.271365 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:09.271343 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pc4m9" event={"ID":"9ba901b4-5491-4f7f-ae71-94eb4c8a7e1a","Type":"ContainerStarted","Data":"37219ab3f97d99dec0e85aeae071514ac63723b3d6eea6f5ee87e1fa948d37d7"} Jul 24 14:35:09.272809 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:09.272784 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kt54d" event={"ID":"4a748576-5432-4fcf-b10f-5c488963ba3d","Type":"ContainerStarted","Data":"8ec520019cc9a6d72b29f1fe2bd4b0be12bcdead555f10c901e66d8ba1ea7c73"} Jul 24 14:35:09.280172 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:09.280098 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-87.ec2.internal" podStartSLOduration=21.280082318 podStartE2EDuration="21.280082318s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:34:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:34:50.192760917 +0000 UTC m=+3.474150498" watchObservedRunningTime="2026-07-24 14:35:09.280082318 +0000 UTC m=+22.561471901" Jul 24 14:35:09.320273 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:09.320088 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-kt54d" podStartSLOduration=3.625006264 podStartE2EDuration="22.320071924s" totalImagesPullingTime="18.69506566s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:34:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:35:09.319576755 +0000 UTC m=+22.600966337" watchObservedRunningTime="2026-07-24 14:35:09.320071924 +0000 UTC m=+22.601461506" Jul 24 14:35:09.337951 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:09.337896 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-q5258" podStartSLOduration=11.595433938 podStartE2EDuration="22.33787411s" totalImagesPullingTime="10.742440172s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:34:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:35:09.337447634 +0000 UTC m=+22.618837206" watchObservedRunningTime="2026-07-24 14:35:09.33787411 +0000 UTC m=+22.619263682" Jul 24 14:35:09.352967 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:09.352926 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-2w5hp" podStartSLOduration=3.680717711 podStartE2EDuration="22.352911756s" totalImagesPullingTime="18.672194045s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:34:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:35:09.352768376 +0000 UTC m=+22.634157957" watchObservedRunningTime="2026-07-24 14:35:09.352911756 +0000 UTC m=+22.634301336" Jul 24 14:35:09.370708 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:09.370670 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-g6tbw" podStartSLOduration=3.490284288 podStartE2EDuration="22.370654597s" totalImagesPullingTime="18.880370309s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:34:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:35:09.370311498 +0000 UTC m=+22.651701080" watchObservedRunningTime="2026-07-24 14:35:09.370654597 +0000 UTC m=+22.652044177" Jul 24 14:35:09.389284 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:09.389232 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-pc4m9" podStartSLOduration=3.504730254 podStartE2EDuration="22.389216715s" totalImagesPullingTime="18.884486461s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:34:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:35:09.389049209 +0000 UTC m=+22.670438790" watchObservedRunningTime="2026-07-24 14:35:09.389216715 +0000 UTC m=+22.670606296" Jul 24 14:35:09.517414 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:09.517319 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:35:09.595282 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:09.595250 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:35:10.165136 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:10.165071 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7jqr" Jul 24 14:35:10.165326 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:35:10.165233 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7jqr" podUID="f269d799-9553-4954-8bdf-4a76fafcdc06" Jul 24 14:35:10.277373 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:10.277295 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-87.ec2.internal" event={"ID":"2f7e8cdd0c9e683123e995ae57bab829","Type":"ContainerStarted","Data":"254f9e4f613e3e42ea1097b659abb7a8b300084f6bb3f5fb4bb97e1627700ce3"} Jul 24 14:35:10.280431 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:10.280398 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" event={"ID":"4ec9750f-187d-4f04-89e3-d915de6e9778","Type":"ContainerStarted","Data":"ba8eaf9d4bb7565c4a410a40fa6884473b0811203a99449937320eb56471f373"} Jul 24 14:35:10.280572 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:10.280502 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" event={"ID":"4ec9750f-187d-4f04-89e3-d915de6e9778","Type":"ContainerStarted","Data":"36a18140e7a3687ec5e0f3f86c23929654956ceadce9e3c7db21ec048f03f61c"} Jul 24 14:35:10.281928 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:10.281867 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mkh45" event={"ID":"52fee0af-d9bb-4fb2-8ab4-20431332262f","Type":"ContainerStarted","Data":"8ba05b95e18ad1605dc481fdc2d683386d5d21072da0056213de756c0f72578e"} Jul 24 14:35:10.309091 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:10.309032 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-87.ec2.internal" podStartSLOduration=22.309012394 podStartE2EDuration="22.309012394s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:34:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:35:10.294908762 +0000 UTC m=+23.576298355" watchObservedRunningTime="2026-07-24 14:35:10.309012394 +0000 UTC m=+23.590401977" Jul 24 14:35:10.309552 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:10.309515 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-mkh45" podStartSLOduration=4.460056083 podStartE2EDuration="23.309504832s" totalImagesPullingTime="18.849448749s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:34:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:35:10.308855777 +0000 UTC m=+23.590245556" watchObservedRunningTime="2026-07-24 14:35:10.309504832 +0000 UTC m=+23.590894414" Jul 24 14:35:10.428983 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:10.428953 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:35:10.526409 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:10.526378 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:35:10.790026 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:10.789997 2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 24 14:35:11.036405 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:11.036318 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-q5258" Jul 24 14:35:11.036905 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:11.036886 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-q5258" Jul 24 14:35:11.104404 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:11.104296 2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-24T14:35:10.790022613Z","UUID":"26d887b8-c282-4623-a9f8-1a86d8c8954f","Handler":null,"Name":"","Endpoint":""} Jul 24 14:35:11.106416 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:11.106387 2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 24 14:35:11.106550 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:11.106436 2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 24 14:35:11.164648 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:11.164617 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jd76" Jul 24 14:35:11.164805 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:11.164624 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjzwq" Jul 24 14:35:11.164805 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:35:11.164725 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jd76" podUID="208712d7-ea7e-430c-b730-e6bf290b2fcd" Jul 24 14:35:11.164887 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:35:11.164805 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjzwq" podUID="9e71e9e2-8727-4639-a971-7d92acd69928" Jul 24 14:35:11.286613 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:11.286523 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vc5z" event={"ID":"a10fad6d-bf8a-4154-8a15-3028177e8226","Type":"ContainerStarted","Data":"6cb027e59bd6e5938bc8856a69fdb9ad9fb59c8a20cef8ea1f78ab21c478d2da"} Jul 24 14:35:11.287213 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:11.287191 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-q5258" Jul 24 14:35:11.287314 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:11.287306 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-q5258" Jul 24 14:35:11.360177 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:11.360127 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:35:12.165235 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:12.165212 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7jqr" Jul 24 14:35:12.165365 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:35:12.165322 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7jqr" podUID="f269d799-9553-4954-8bdf-4a76fafcdc06" Jul 24 14:35:12.290874 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:12.290831 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vc5z" event={"ID":"a10fad6d-bf8a-4154-8a15-3028177e8226","Type":"ContainerStarted","Data":"59e40f4e0e34f2a0015865fba5345065c9220295613692a6e1b1379eb3367c33"} Jul 24 14:35:12.294580 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:12.294542 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" event={"ID":"4ec9750f-187d-4f04-89e3-d915de6e9778","Type":"ContainerStarted","Data":"c46509c809fb906d412d91980d3d3515ed01787f078cd660b7b9bed60af2f32a"} Jul 24 14:35:12.311738 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:12.311700 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vc5z" podStartSLOduration=3.713373512 podStartE2EDuration="25.311685068s" totalImagesPullingTime="21.598311556s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:34:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:35:12.310248845 +0000 UTC m=+25.591638426" watchObservedRunningTime="2026-07-24 14:35:12.311685068 +0000 UTC m=+25.593074649" Jul 24 14:35:12.681205 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:12.681115 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:35:12.781677 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:12.781644 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:35:13.164652 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:13.164614 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jd76" Jul 24 14:35:13.164820 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:13.164613 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjzwq" Jul 24 14:35:13.164820 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:35:13.164755 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jd76" podUID="208712d7-ea7e-430c-b730-e6bf290b2fcd" Jul 24 14:35:13.164820 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:35:13.164794 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjzwq" podUID="9e71e9e2-8727-4639-a971-7d92acd69928" Jul 24 14:35:13.435556 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:13.435449 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:35:13.536592 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:13.536555 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:35:14.165591 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:14.165324 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7jqr" Jul 24 14:35:14.165814 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:35:14.165704 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7jqr" podUID="f269d799-9553-4954-8bdf-4a76fafcdc06" Jul 24 14:35:14.301651 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:14.301624 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" event={"ID":"4ec9750f-187d-4f04-89e3-d915de6e9778","Type":"ContainerStarted","Data":"2fdfb67e85718113f8ddc73b17421655e96eb930b925e8236a9cbc01c02cafb5"} Jul 24 14:35:14.306126 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:14.306100 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:35:14.306286 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:14.306178 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:35:14.323352 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:14.323271 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:35:14.324132 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:14.324110 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:35:14.335818 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:14.335757 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" podStartSLOduration=8.332782573 podStartE2EDuration="27.335742925s" totalImagesPullingTime="19.002960352s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:34:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:35:14.33519233 +0000 UTC m=+27.616581923" watchObservedRunningTime="2026-07-24 14:35:14.335742925 +0000 UTC m=+27.617132505" Jul 24 14:35:15.164899 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:15.164861 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjzwq" Jul 24 14:35:15.165778 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:15.164865 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jd76" Jul 24 14:35:15.165778 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:35:15.164994 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjzwq" podUID="9e71e9e2-8727-4639-a971-7d92acd69928" Jul 24 14:35:15.165778 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:35:15.165052 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jd76" podUID="208712d7-ea7e-430c-b730-e6bf290b2fcd" Jul 24 14:35:15.280999 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:15.280965 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:35:15.305801 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:15.305769 2565 generic.go:356] "Generic (PLEG): container finished" podID="b8ade508-14e0-4f5b-b508-0a542b29d1c3" containerID="4c6764936f48ea143b45aff6e6428f14e0e7fa1311e3ef464f4405a1f6cf3fe6" exitCode=0 Jul 24 14:35:15.306891 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:15.306858 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vvk6x" event={"ID":"b8ade508-14e0-4f5b-b508-0a542b29d1c3","Type":"ContainerDied","Data":"4c6764936f48ea143b45aff6e6428f14e0e7fa1311e3ef464f4405a1f6cf3fe6"} Jul 24 14:35:16.165153 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:16.164943 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7jqr" Jul 24 14:35:16.165464 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:35:16.165173 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7jqr" podUID="f269d799-9553-4954-8bdf-4a76fafcdc06" Jul 24 14:35:16.341060 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:16.341032 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-v7jqr"] Jul 24 14:35:16.341228 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:16.341118 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7jqr" Jul 24 14:35:16.341228 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:35:16.341194 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7jqr" podUID="f269d799-9553-4954-8bdf-4a76fafcdc06" Jul 24 14:35:16.342841 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:16.342815 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2jd76"] Jul 24 14:35:16.342961 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:16.342937 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jd76" Jul 24 14:35:16.343072 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:35:16.343050 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jd76" podUID="208712d7-ea7e-430c-b730-e6bf290b2fcd" Jul 24 14:35:16.355059 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:16.355032 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cjzwq"] Jul 24 14:35:16.355177 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:16.355144 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjzwq" Jul 24 14:35:16.355266 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:35:16.355235 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjzwq" podUID="9e71e9e2-8727-4639-a971-7d92acd69928" Jul 24 14:35:17.312295 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:17.312260 2565 generic.go:356] "Generic (PLEG): container finished" podID="b8ade508-14e0-4f5b-b508-0a542b29d1c3" containerID="4e38b1b79724f945294725ebb5e59dc1fad6013e1e778276910e8111da585839" exitCode=0 Jul 24 14:35:17.312792 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:17.312318 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vvk6x" event={"ID":"b8ade508-14e0-4f5b-b508-0a542b29d1c3","Type":"ContainerDied","Data":"4e38b1b79724f945294725ebb5e59dc1fad6013e1e778276910e8111da585839"} Jul 24 14:35:18.164504 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:18.164411 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7jqr" Jul 24 14:35:18.164504 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:18.164440 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjzwq" Jul 24 14:35:18.164695 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:18.164553 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jd76" Jul 24 14:35:18.164695 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:35:18.164551 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7jqr" podUID="f269d799-9553-4954-8bdf-4a76fafcdc06" Jul 24 14:35:18.164695 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:35:18.164666 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjzwq" podUID="9e71e9e2-8727-4639-a971-7d92acd69928" Jul 24 14:35:18.164862 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:35:18.164772 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jd76" podUID="208712d7-ea7e-430c-b730-e6bf290b2fcd" Jul 24 14:35:19.319751 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:19.319574 2565 generic.go:356] "Generic (PLEG): container finished" podID="b8ade508-14e0-4f5b-b508-0a542b29d1c3" containerID="ea5b6320513224af0ddc65ed0fada0b44a03bfc591784755a1ebd19c94d85bc9" exitCode=0 Jul 24 14:35:19.320107 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:19.319662 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vvk6x" event={"ID":"b8ade508-14e0-4f5b-b508-0a542b29d1c3","Type":"ContainerDied","Data":"ea5b6320513224af0ddc65ed0fada0b44a03bfc591784755a1ebd19c94d85bc9"} Jul 24 14:35:19.578764 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:19.578685 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:35:20.164617 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:20.164587 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jd76" Jul 24 14:35:20.164784 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:20.164587 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjzwq" Jul 24 14:35:20.164784 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:35:20.164731 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jd76" podUID="208712d7-ea7e-430c-b730-e6bf290b2fcd" Jul 24 14:35:20.164784 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:20.164587 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7jqr" Jul 24 14:35:20.164946 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:35:20.164790 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjzwq" podUID="9e71e9e2-8727-4639-a971-7d92acd69928" Jul 24 14:35:20.164946 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:35:20.164870 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7jqr" podUID="f269d799-9553-4954-8bdf-4a76fafcdc06" Jul 24 14:35:20.890555 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:20.890518 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/208712d7-ea7e-430c-b730-e6bf290b2fcd-metrics-certs\") pod \"network-metrics-daemon-2jd76\" (UID: \"208712d7-ea7e-430c-b730-e6bf290b2fcd\") " pod="openshift-multus/network-metrics-daemon-2jd76" Jul 24 14:35:20.890982 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:20.890566 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f269d799-9553-4954-8bdf-4a76fafcdc06-original-pull-secret\") pod \"global-pull-secret-syncer-v7jqr\" (UID: \"f269d799-9553-4954-8bdf-4a76fafcdc06\") " pod="kube-system/global-pull-secret-syncer-v7jqr" Jul 24 14:35:20.890982 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:35:20.890683 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 14:35:20.890982 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:35:20.890750 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/208712d7-ea7e-430c-b730-e6bf290b2fcd-metrics-certs podName:208712d7-ea7e-430c-b730-e6bf290b2fcd nodeName:}" failed. No retries permitted until 2026-07-24 14:35:52.89073559 +0000 UTC m=+66.172125154 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/208712d7-ea7e-430c-b730-e6bf290b2fcd-metrics-certs") pod "network-metrics-daemon-2jd76" (UID: "208712d7-ea7e-430c-b730-e6bf290b2fcd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 14:35:20.890982 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:35:20.890683 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 14:35:20.890982 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:35:20.890837 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f269d799-9553-4954-8bdf-4a76fafcdc06-original-pull-secret podName:f269d799-9553-4954-8bdf-4a76fafcdc06 nodeName:}" failed. No retries permitted until 2026-07-24 14:35:52.890822106 +0000 UTC m=+66.172211668 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f269d799-9553-4954-8bdf-4a76fafcdc06-original-pull-secret") pod "global-pull-secret-syncer-v7jqr" (UID: "f269d799-9553-4954-8bdf-4a76fafcdc06") : object "kube-system"/"original-pull-secret" not registered Jul 24 14:35:20.962380 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:20.962345 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:35:20.991526 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:20.991495 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7jxn\" (UniqueName: \"kubernetes.io/projected/9e71e9e2-8727-4639-a971-7d92acd69928-kube-api-access-g7jxn\") pod \"network-check-target-cjzwq\" (UID: \"9e71e9e2-8727-4639-a971-7d92acd69928\") " pod="openshift-network-diagnostics/network-check-target-cjzwq" Jul 24 14:35:20.991711 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:35:20.991620 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 14:35:20.991711 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:35:20.991638 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 14:35:20.991711 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:35:20.991647 2565 projected.go:196] Error preparing data for projected volume kube-api-access-g7jxn for pod openshift-network-diagnostics/network-check-target-cjzwq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 14:35:20.991711 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:35:20.991699 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e71e9e2-8727-4639-a971-7d92acd69928-kube-api-access-g7jxn podName:9e71e9e2-8727-4639-a971-7d92acd69928 nodeName:}" failed. No retries permitted until 2026-07-24 14:35:52.991681383 +0000 UTC m=+66.273070961 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-g7jxn" (UniqueName: "kubernetes.io/projected/9e71e9e2-8727-4639-a971-7d92acd69928-kube-api-access-g7jxn") pod "network-check-target-cjzwq" (UID: "9e71e9e2-8727-4639-a971-7d92acd69928") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 14:35:21.610578 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:21.610553 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-87.ec2.internal" event="NodeReady" Jul 24 14:35:21.610716 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:21.610678 2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 24 14:35:21.658631 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:21.658603 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xz4zn"] Jul 24 14:35:21.684613 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:21.684581 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-n8zfk"] Jul 24 14:35:21.684782 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:21.684716 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xz4zn" Jul 24 14:35:21.687110 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:21.687089 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 24 14:35:21.687239 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:21.687115 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 24 14:35:21.687499 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:21.687482 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7ps4v\"" Jul 24 14:35:21.700648 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:21.700620 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n8zfk"] Jul 24 14:35:21.700742 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:21.700661 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xz4zn"] Jul 24 14:35:21.700742 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:21.700728 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n8zfk" Jul 24 14:35:21.703947 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:21.703927 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 24 14:35:21.704042 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:21.703997 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-j5xkl\"" Jul 24 14:35:21.704525 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:21.704303 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 24 14:35:21.704525 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:21.704357 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 24 14:35:21.797819 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:21.797785 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26vnl\" (UniqueName: \"kubernetes.io/projected/ee6a54e6-fe4a-461a-85cd-fb141a505fb5-kube-api-access-26vnl\") pod \"ingress-canary-n8zfk\" (UID: \"ee6a54e6-fe4a-461a-85cd-fb141a505fb5\") " pod="openshift-ingress-canary/ingress-canary-n8zfk" Jul 24 14:35:21.797979 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:21.797844 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee6a54e6-fe4a-461a-85cd-fb141a505fb5-cert\") pod \"ingress-canary-n8zfk\" (UID: \"ee6a54e6-fe4a-461a-85cd-fb141a505fb5\") " pod="openshift-ingress-canary/ingress-canary-n8zfk" Jul 24 14:35:21.797979 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:21.797893 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fnnx\" (UniqueName: \"kubernetes.io/projected/03a80cf6-686d-4e98-bb23-e31b95c3e823-kube-api-access-2fnnx\") pod \"dns-default-xz4zn\" (UID: \"03a80cf6-686d-4e98-bb23-e31b95c3e823\") " pod="openshift-dns/dns-default-xz4zn" Jul 24 14:35:21.797979 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:21.797943 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/03a80cf6-686d-4e98-bb23-e31b95c3e823-config-volume\") pod \"dns-default-xz4zn\" (UID: \"03a80cf6-686d-4e98-bb23-e31b95c3e823\") " pod="openshift-dns/dns-default-xz4zn" Jul 24 14:35:21.797979 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:21.797966 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03a80cf6-686d-4e98-bb23-e31b95c3e823-tmp-dir\") pod \"dns-default-xz4zn\" (UID: \"03a80cf6-686d-4e98-bb23-e31b95c3e823\") " pod="openshift-dns/dns-default-xz4zn" Jul 24 14:35:21.798131 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:21.798018 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/03a80cf6-686d-4e98-bb23-e31b95c3e823-metrics-tls\") pod \"dns-default-xz4zn\" (UID: \"03a80cf6-686d-4e98-bb23-e31b95c3e823\") " pod="openshift-dns/dns-default-xz4zn" Jul 24 14:35:21.802139 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:21.802111 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:35:21.862885 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:21.862812 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:35:21.898841 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:21.898813 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03a80cf6-686d-4e98-bb23-e31b95c3e823-tmp-dir\") pod \"dns-default-xz4zn\" (UID: \"03a80cf6-686d-4e98-bb23-e31b95c3e823\") " pod="openshift-dns/dns-default-xz4zn" Jul 24 14:35:21.899256 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:21.898848 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/03a80cf6-686d-4e98-bb23-e31b95c3e823-metrics-tls\") pod \"dns-default-xz4zn\" (UID: \"03a80cf6-686d-4e98-bb23-e31b95c3e823\") " pod="openshift-dns/dns-default-xz4zn" Jul 24 14:35:21.899256 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:21.898882 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26vnl\" (UniqueName: \"kubernetes.io/projected/ee6a54e6-fe4a-461a-85cd-fb141a505fb5-kube-api-access-26vnl\") pod \"ingress-canary-n8zfk\" (UID: \"ee6a54e6-fe4a-461a-85cd-fb141a505fb5\") " pod="openshift-ingress-canary/ingress-canary-n8zfk" Jul 24 14:35:21.899256 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:21.898913 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee6a54e6-fe4a-461a-85cd-fb141a505fb5-cert\") pod \"ingress-canary-n8zfk\" (UID: \"ee6a54e6-fe4a-461a-85cd-fb141a505fb5\") " pod="openshift-ingress-canary/ingress-canary-n8zfk" Jul 24 14:35:21.899256 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:21.898927 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fnnx\" (UniqueName: \"kubernetes.io/projected/03a80cf6-686d-4e98-bb23-e31b95c3e823-kube-api-access-2fnnx\") pod \"dns-default-xz4zn\" (UID: \"03a80cf6-686d-4e98-bb23-e31b95c3e823\") " pod="openshift-dns/dns-default-xz4zn" Jul 24 14:35:21.899256 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:21.898964 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/03a80cf6-686d-4e98-bb23-e31b95c3e823-config-volume\") pod \"dns-default-xz4zn\" (UID: \"03a80cf6-686d-4e98-bb23-e31b95c3e823\") " pod="openshift-dns/dns-default-xz4zn" Jul 24 14:35:21.899256 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:35:21.898967 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 14:35:21.899256 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:35:21.899037 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03a80cf6-686d-4e98-bb23-e31b95c3e823-metrics-tls podName:03a80cf6-686d-4e98-bb23-e31b95c3e823 nodeName:}" failed. No retries permitted until 2026-07-24 14:35:22.399014517 +0000 UTC m=+35.680404080 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/03a80cf6-686d-4e98-bb23-e31b95c3e823-metrics-tls") pod "dns-default-xz4zn" (UID: "03a80cf6-686d-4e98-bb23-e31b95c3e823") : secret "dns-default-metrics-tls" not found Jul 24 14:35:21.899256 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:21.899212 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03a80cf6-686d-4e98-bb23-e31b95c3e823-tmp-dir\") pod \"dns-default-xz4zn\" (UID: \"03a80cf6-686d-4e98-bb23-e31b95c3e823\") " pod="openshift-dns/dns-default-xz4zn" Jul 24 14:35:21.899601 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:21.899492 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/03a80cf6-686d-4e98-bb23-e31b95c3e823-config-volume\") pod \"dns-default-xz4zn\" (UID: \"03a80cf6-686d-4e98-bb23-e31b95c3e823\") " pod="openshift-dns/dns-default-xz4zn" Jul 24 14:35:21.903101 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:21.903078 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee6a54e6-fe4a-461a-85cd-fb141a505fb5-cert\") pod \"ingress-canary-n8zfk\" (UID: \"ee6a54e6-fe4a-461a-85cd-fb141a505fb5\") " pod="openshift-ingress-canary/ingress-canary-n8zfk" Jul 24 14:35:21.909374 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:21.909355 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fnnx\" (UniqueName: \"kubernetes.io/projected/03a80cf6-686d-4e98-bb23-e31b95c3e823-kube-api-access-2fnnx\") pod \"dns-default-xz4zn\" (UID: \"03a80cf6-686d-4e98-bb23-e31b95c3e823\") " pod="openshift-dns/dns-default-xz4zn" Jul 24 14:35:21.909553 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:21.909535 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26vnl\" (UniqueName: \"kubernetes.io/projected/ee6a54e6-fe4a-461a-85cd-fb141a505fb5-kube-api-access-26vnl\") pod \"ingress-canary-n8zfk\" (UID: \"ee6a54e6-fe4a-461a-85cd-fb141a505fb5\") " pod="openshift-ingress-canary/ingress-canary-n8zfk" Jul 24 14:35:22.010197 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:22.010160 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n8zfk" Jul 24 14:35:22.165332 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:22.165245 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjzwq" Jul 24 14:35:22.165332 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:22.165280 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7jqr" Jul 24 14:35:22.165332 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:22.165280 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jd76" Jul 24 14:35:22.168431 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:22.168149 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 24 14:35:22.168431 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:22.168156 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j79rf\"" Jul 24 14:35:22.168431 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:22.168269 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-k7d8n\"" Jul 24 14:35:22.168431 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:22.168159 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 24 14:35:22.168431 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:22.168430 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 24 14:35:22.168754 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:22.168565 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 24 14:35:22.402820 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:22.402784 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/03a80cf6-686d-4e98-bb23-e31b95c3e823-metrics-tls\") pod \"dns-default-xz4zn\" (UID: \"03a80cf6-686d-4e98-bb23-e31b95c3e823\") " pod="openshift-dns/dns-default-xz4zn" Jul 24 14:35:22.403016 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:35:22.402947 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 14:35:22.403080 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:35:22.403025 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03a80cf6-686d-4e98-bb23-e31b95c3e823-metrics-tls podName:03a80cf6-686d-4e98-bb23-e31b95c3e823 nodeName:}" failed. No retries permitted until 2026-07-24 14:35:23.403002921 +0000 UTC m=+36.684392484 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/03a80cf6-686d-4e98-bb23-e31b95c3e823-metrics-tls") pod "dns-default-xz4zn" (UID: "03a80cf6-686d-4e98-bb23-e31b95c3e823") : secret "dns-default-metrics-tls" not found Jul 24 14:35:23.409655 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:23.409620 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/03a80cf6-686d-4e98-bb23-e31b95c3e823-metrics-tls\") pod \"dns-default-xz4zn\" (UID: \"03a80cf6-686d-4e98-bb23-e31b95c3e823\") " pod="openshift-dns/dns-default-xz4zn" Jul 24 14:35:23.410314 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:35:23.409787 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 14:35:23.410314 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:35:23.409863 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03a80cf6-686d-4e98-bb23-e31b95c3e823-metrics-tls podName:03a80cf6-686d-4e98-bb23-e31b95c3e823 nodeName:}" failed. No retries permitted until 2026-07-24 14:35:25.409839084 +0000 UTC m=+38.691228642 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/03a80cf6-686d-4e98-bb23-e31b95c3e823-metrics-tls") pod "dns-default-xz4zn" (UID: "03a80cf6-686d-4e98-bb23-e31b95c3e823") : secret "dns-default-metrics-tls" not found Jul 24 14:35:23.599373 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:23.598891 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n8zfk"] Jul 24 14:35:23.636526 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:35:23.636497 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee6a54e6_fe4a_461a_85cd_fb141a505fb5.slice/crio-b8f3a38e673e343924645787d04e4478de050ba7cc0c5197fbda91c00394bb4c WatchSource:0}: Error finding container b8f3a38e673e343924645787d04e4478de050ba7cc0c5197fbda91c00394bb4c: Status 404 returned error can't find the container with id b8f3a38e673e343924645787d04e4478de050ba7cc0c5197fbda91c00394bb4c Jul 24 14:35:24.329502 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:24.329458 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:35:24.334152 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:24.334119 2565 generic.go:356] "Generic (PLEG): container finished" podID="b8ade508-14e0-4f5b-b508-0a542b29d1c3" containerID="9b5f7d6e829a2d2421f7258e4fad6152e80e181cfed69d52696a7fa3e9a38345" exitCode=0 Jul 24 14:35:24.334280 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:24.334199 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vvk6x" event={"ID":"b8ade508-14e0-4f5b-b508-0a542b29d1c3","Type":"ContainerDied","Data":"9b5f7d6e829a2d2421f7258e4fad6152e80e181cfed69d52696a7fa3e9a38345"} Jul 24 14:35:24.335617 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:24.335521 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n8zfk" event={"ID":"ee6a54e6-fe4a-461a-85cd-fb141a505fb5","Type":"ContainerStarted","Data":"b8f3a38e673e343924645787d04e4478de050ba7cc0c5197fbda91c00394bb4c"} Jul 24 14:35:24.392340 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:24.392301 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:35:24.458930 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:24.458903 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:35:25.341880 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:25.341845 2565 generic.go:356] "Generic (PLEG): container finished" podID="b8ade508-14e0-4f5b-b508-0a542b29d1c3" containerID="06f3759d48d80695c246eccd44f37a944fbab21bd5d1fe137a6068521b85a952" exitCode=0 Jul 24 14:35:25.342085 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:25.341887 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vvk6x" event={"ID":"b8ade508-14e0-4f5b-b508-0a542b29d1c3","Type":"ContainerDied","Data":"06f3759d48d80695c246eccd44f37a944fbab21bd5d1fe137a6068521b85a952"} Jul 24 14:35:25.367226 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:25.367191 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:35:25.424642 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:25.424608 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:35:25.426652 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:25.426621 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/03a80cf6-686d-4e98-bb23-e31b95c3e823-metrics-tls\") pod \"dns-default-xz4zn\" (UID: \"03a80cf6-686d-4e98-bb23-e31b95c3e823\") " pod="openshift-dns/dns-default-xz4zn" Jul 24 14:35:25.426782 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:35:25.426759 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 14:35:25.426859 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:35:25.426838 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03a80cf6-686d-4e98-bb23-e31b95c3e823-metrics-tls podName:03a80cf6-686d-4e98-bb23-e31b95c3e823 nodeName:}" failed. No retries permitted until 2026-07-24 14:35:29.426817774 +0000 UTC m=+42.708207360 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/03a80cf6-686d-4e98-bb23-e31b95c3e823-metrics-tls") pod "dns-default-xz4zn" (UID: "03a80cf6-686d-4e98-bb23-e31b95c3e823") : secret "dns-default-metrics-tls" not found Jul 24 14:35:26.349186 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:26.349159 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vvk6x" event={"ID":"b8ade508-14e0-4f5b-b508-0a542b29d1c3","Type":"ContainerStarted","Data":"ab127fb7bfa5fc5004f8c2d7a290f929a71d32bf09c583d5cad135c4c1059ec7"} Jul 24 14:35:26.373360 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:26.372675 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-vvk6x" podStartSLOduration=9.034329173 podStartE2EDuration="39.372655523s" totalImagesPullingTime="30.33832635s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:34:47 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:35:26.371091193 +0000 UTC m=+39.652480773" watchObservedRunningTime="2026-07-24 14:35:26.372655523 +0000 UTC m=+39.654045105" Jul 24 14:35:26.495881 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:26.495840 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:35:26.562176 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:26.562002 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:35:26.719753 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:26.719724 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:35:26.780050 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:26.780019 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:35:26.940623 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:26.940544 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:35:27.353453 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:27.353419 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n8zfk" event={"ID":"ee6a54e6-fe4a-461a-85cd-fb141a505fb5","Type":"ContainerStarted","Data":"bceb1106842592ff2f76503029f15dea6db5170b3ee8ca7acd48c0ac7a92dd02"} Jul 24 14:35:29.456212 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:29.456172 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/03a80cf6-686d-4e98-bb23-e31b95c3e823-metrics-tls\") pod \"dns-default-xz4zn\" (UID: \"03a80cf6-686d-4e98-bb23-e31b95c3e823\") " pod="openshift-dns/dns-default-xz4zn" Jul 24 14:35:29.456601 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:35:29.456298 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 14:35:29.456601 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:35:29.456357 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03a80cf6-686d-4e98-bb23-e31b95c3e823-metrics-tls podName:03a80cf6-686d-4e98-bb23-e31b95c3e823 nodeName:}" failed. No retries permitted until 2026-07-24 14:35:37.456341811 +0000 UTC m=+50.737731389 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/03a80cf6-686d-4e98-bb23-e31b95c3e823-metrics-tls") pod "dns-default-xz4zn" (UID: "03a80cf6-686d-4e98-bb23-e31b95c3e823") : secret "dns-default-metrics-tls" not found Jul 24 14:35:33.643676 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:33.643639 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:35:33.713249 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:33.713221 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:35:36.113817 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:36.113784 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:35:37.509111 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:37.509068 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/03a80cf6-686d-4e98-bb23-e31b95c3e823-metrics-tls\") pod \"dns-default-xz4zn\" (UID: \"03a80cf6-686d-4e98-bb23-e31b95c3e823\") " pod="openshift-dns/dns-default-xz4zn" Jul 24 14:35:37.509499 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:35:37.509220 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 14:35:37.509499 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:35:37.509295 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03a80cf6-686d-4e98-bb23-e31b95c3e823-metrics-tls podName:03a80cf6-686d-4e98-bb23-e31b95c3e823 nodeName:}" failed. No retries permitted until 2026-07-24 14:35:53.509279678 +0000 UTC m=+66.790669236 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/03a80cf6-686d-4e98-bb23-e31b95c3e823-metrics-tls") pod "dns-default-xz4zn" (UID: "03a80cf6-686d-4e98-bb23-e31b95c3e823") : secret "dns-default-metrics-tls" not found Jul 24 14:35:40.354670 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:40.354638 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:35:40.458374 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:40.458343 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:35:40.529876 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:40.529833 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:35:46.318761 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:46.318731 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n8n54" Jul 24 14:35:46.352715 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:46.352666 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-n8zfk" podStartSLOduration=22.696457899 podStartE2EDuration="25.352650738s" totalImagesPullingTime="2.656192839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:35:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:35:27.370054912 +0000 UTC m=+40.651444494" watchObservedRunningTime="2026-07-24 14:35:46.352650738 +0000 UTC m=+59.634040318" Jul 24 14:35:46.477775 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:46.477738 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:35:46.538875 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:46.538842 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:35:52.926374 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:52.926334 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/208712d7-ea7e-430c-b730-e6bf290b2fcd-metrics-certs\") pod \"network-metrics-daemon-2jd76\" (UID: \"208712d7-ea7e-430c-b730-e6bf290b2fcd\") " pod="openshift-multus/network-metrics-daemon-2jd76" Jul 24 14:35:52.926374 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:52.926378 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f269d799-9553-4954-8bdf-4a76fafcdc06-original-pull-secret\") pod \"global-pull-secret-syncer-v7jqr\" (UID: \"f269d799-9553-4954-8bdf-4a76fafcdc06\") " pod="kube-system/global-pull-secret-syncer-v7jqr" Jul 24 14:35:52.929578 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:52.929558 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 24 14:35:52.929644 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:52.929559 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 24 14:35:52.936940 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:35:52.936915 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 24 14:35:52.937081 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:35:52.936998 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/208712d7-ea7e-430c-b730-e6bf290b2fcd-metrics-certs podName:208712d7-ea7e-430c-b730-e6bf290b2fcd nodeName:}" failed. No retries permitted until 2026-07-24 14:36:56.936978937 +0000 UTC m=+130.218368496 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/208712d7-ea7e-430c-b730-e6bf290b2fcd-metrics-certs") pod "network-metrics-daemon-2jd76" (UID: "208712d7-ea7e-430c-b730-e6bf290b2fcd") : secret "metrics-daemon-secret" not found Jul 24 14:35:52.940611 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:52.940595 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f269d799-9553-4954-8bdf-4a76fafcdc06-original-pull-secret\") pod \"global-pull-secret-syncer-v7jqr\" (UID: \"f269d799-9553-4954-8bdf-4a76fafcdc06\") " pod="kube-system/global-pull-secret-syncer-v7jqr" Jul 24 14:35:53.027608 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:53.027553 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7jxn\" (UniqueName: \"kubernetes.io/projected/9e71e9e2-8727-4639-a971-7d92acd69928-kube-api-access-g7jxn\") pod \"network-check-target-cjzwq\" (UID: \"9e71e9e2-8727-4639-a971-7d92acd69928\") " pod="openshift-network-diagnostics/network-check-target-cjzwq" Jul 24 14:35:53.031095 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:53.031077 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 24 14:35:53.040761 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:53.040741 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 24 14:35:53.051331 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:53.051304 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7jxn\" (UniqueName: \"kubernetes.io/projected/9e71e9e2-8727-4639-a971-7d92acd69928-kube-api-access-g7jxn\") pod \"network-check-target-cjzwq\" (UID: \"9e71e9e2-8727-4639-a971-7d92acd69928\") " pod="openshift-network-diagnostics/network-check-target-cjzwq" Jul 24 14:35:53.080091 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:53.080071 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-k7d8n\"" Jul 24 14:35:53.084205 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:53.084181 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7jqr" Jul 24 14:35:53.087317 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:53.087296 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjzwq" Jul 24 14:35:53.215332 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:53.215299 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cjzwq"] Jul 24 14:35:53.218542 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:35:53.218512 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e71e9e2_8727_4639_a971_7d92acd69928.slice/crio-04780d330e5123ee83e30a2a6548cbcf49023aa6ac272e2c325ffa60762bffcd WatchSource:0}: Error finding container 04780d330e5123ee83e30a2a6548cbcf49023aa6ac272e2c325ffa60762bffcd: Status 404 returned error can't find the container with id 04780d330e5123ee83e30a2a6548cbcf49023aa6ac272e2c325ffa60762bffcd Jul 24 14:35:53.232387 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:53.232352 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-v7jqr"] Jul 24 14:35:53.234616 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:35:53.234590 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf269d799_9553_4954_8bdf_4a76fafcdc06.slice/crio-38a9dd9b9ad5a99e64c2291665739300e88cfbf16892229f76e17a1175fd280e WatchSource:0}: Error finding container 38a9dd9b9ad5a99e64c2291665739300e88cfbf16892229f76e17a1175fd280e: Status 404 returned error can't find the container with id 38a9dd9b9ad5a99e64c2291665739300e88cfbf16892229f76e17a1175fd280e Jul 24 14:35:53.413031 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:53.412990 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cjzwq" event={"ID":"9e71e9e2-8727-4639-a971-7d92acd69928","Type":"ContainerStarted","Data":"04780d330e5123ee83e30a2a6548cbcf49023aa6ac272e2c325ffa60762bffcd"} Jul 24 14:35:53.413979 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:53.413954 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-v7jqr" event={"ID":"f269d799-9553-4954-8bdf-4a76fafcdc06","Type":"ContainerStarted","Data":"38a9dd9b9ad5a99e64c2291665739300e88cfbf16892229f76e17a1175fd280e"} Jul 24 14:35:53.530790 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:53.530716 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/03a80cf6-686d-4e98-bb23-e31b95c3e823-metrics-tls\") pod \"dns-default-xz4zn\" (UID: \"03a80cf6-686d-4e98-bb23-e31b95c3e823\") " pod="openshift-dns/dns-default-xz4zn" Jul 24 14:35:53.530913 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:35:53.530858 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 14:35:53.530946 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:35:53.530916 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03a80cf6-686d-4e98-bb23-e31b95c3e823-metrics-tls podName:03a80cf6-686d-4e98-bb23-e31b95c3e823 nodeName:}" failed. No retries permitted until 2026-07-24 14:36:25.530901895 +0000 UTC m=+98.812291454 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/03a80cf6-686d-4e98-bb23-e31b95c3e823-metrics-tls") pod "dns-default-xz4zn" (UID: "03a80cf6-686d-4e98-bb23-e31b95c3e823") : secret "dns-default-metrics-tls" not found Jul 24 14:35:58.429485 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:58.429430 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cjzwq" event={"ID":"9e71e9e2-8727-4639-a971-7d92acd69928","Type":"ContainerStarted","Data":"b4bef3d94f1784493c55c5c6e69eabd97da8aae15d30ac0211264de2a68ddbca"} Jul 24 14:35:58.430001 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:58.429561 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-cjzwq" Jul 24 14:35:58.430916 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:58.430895 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-v7jqr" event={"ID":"f269d799-9553-4954-8bdf-4a76fafcdc06","Type":"ContainerStarted","Data":"fbd81ef085edacf0279ec3b0d38b67786dbc6df3bea33c39d225de1454b58f50"} Jul 24 14:35:58.447919 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:58.447876 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-cjzwq" podStartSLOduration=66.744503455 podStartE2EDuration="1m11.447843576s" totalImagesPullingTime="4.703340121s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:34:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:35:58.447063023 +0000 UTC m=+71.728452608" watchObservedRunningTime="2026-07-24 14:35:58.447843576 +0000 UTC m=+71.729233157" Jul 24 14:35:58.463095 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:35:58.463051 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-v7jqr" podStartSLOduration=66.764773063 podStartE2EDuration="1m11.463036108s" totalImagesPullingTime="4.698263045s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:34:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:35:58.462123569 +0000 UTC m=+71.743513150" watchObservedRunningTime="2026-07-24 14:35:58.463036108 +0000 UTC m=+71.744425689" Jul 24 14:36:00.736190 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:00.736154 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-hcs97"] Jul 24 14:36:00.737790 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:00.737771 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-hcs97" Jul 24 14:36:00.742660 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:00.742630 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-jcd7b\"" Jul 24 14:36:00.743005 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:00.742702 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 24 14:36:00.743306 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:00.742738 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 24 14:36:00.743428 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:00.742744 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 24 14:36:00.743623 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:00.742753 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 24 14:36:00.754609 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:00.754577 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-hcs97"] Jul 24 14:36:00.781211 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:00.781175 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jg9m2\" (UniqueName: \"kubernetes.io/projected/ae7f7131-970f-4dfb-b418-13eeb937222e-kube-api-access-jg9m2\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-hcs97\" (UID: \"ae7f7131-970f-4dfb-b418-13eeb937222e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-hcs97" Jul 24 14:36:00.781369 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:00.781227 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ae7f7131-970f-4dfb-b418-13eeb937222e-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-hcs97\" (UID: \"ae7f7131-970f-4dfb-b418-13eeb937222e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-hcs97" Jul 24 14:36:00.781369 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:00.781256 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ae7f7131-970f-4dfb-b418-13eeb937222e-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-hcs97\" (UID: \"ae7f7131-970f-4dfb-b418-13eeb937222e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-hcs97" Jul 24 14:36:00.847379 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:00.847340 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-675bf47bbf-4s7tz"] Jul 24 14:36:00.849102 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:00.849080 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-675bf47bbf-4s7tz" Jul 24 14:36:00.852057 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:00.852040 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 24 14:36:00.856547 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:00.856529 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 24 14:36:00.856626 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:00.856542 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 24 14:36:00.856626 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:00.856571 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 24 14:36:00.857293 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:00.857278 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 24 14:36:00.859235 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:00.859221 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-mkrg8\"" Jul 24 14:36:00.859989 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:00.859976 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 24 14:36:00.882435 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:00.882407 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ae7f7131-970f-4dfb-b418-13eeb937222e-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-hcs97\" (UID: \"ae7f7131-970f-4dfb-b418-13eeb937222e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-hcs97" Jul 24 14:36:00.882580 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:00.882438 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07b08f83-bc4e-41b0-a34c-a91ec906b950-metrics-certs\") pod \"router-default-675bf47bbf-4s7tz\" (UID: \"07b08f83-bc4e-41b0-a34c-a91ec906b950\") " pod="openshift-ingress/router-default-675bf47bbf-4s7tz" Jul 24 14:36:00.882646 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:00.882624 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7q88p\" (UniqueName: \"kubernetes.io/projected/07b08f83-bc4e-41b0-a34c-a91ec906b950-kube-api-access-7q88p\") pod \"router-default-675bf47bbf-4s7tz\" (UID: \"07b08f83-bc4e-41b0-a34c-a91ec906b950\") " pod="openshift-ingress/router-default-675bf47bbf-4s7tz" Jul 24 14:36:00.882692 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:00.882670 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/07b08f83-bc4e-41b0-a34c-a91ec906b950-stats-auth\") pod \"router-default-675bf47bbf-4s7tz\" (UID: \"07b08f83-bc4e-41b0-a34c-a91ec906b950\") " pod="openshift-ingress/router-default-675bf47bbf-4s7tz" Jul 24 14:36:00.882751 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:00.882734 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jg9m2\" (UniqueName: \"kubernetes.io/projected/ae7f7131-970f-4dfb-b418-13eeb937222e-kube-api-access-jg9m2\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-hcs97\" (UID: \"ae7f7131-970f-4dfb-b418-13eeb937222e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-hcs97" Jul 24 14:36:00.882788 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:00.882772 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07b08f83-bc4e-41b0-a34c-a91ec906b950-service-ca-bundle\") pod \"router-default-675bf47bbf-4s7tz\" (UID: \"07b08f83-bc4e-41b0-a34c-a91ec906b950\") " pod="openshift-ingress/router-default-675bf47bbf-4s7tz" Jul 24 14:36:00.882828 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:00.882808 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/07b08f83-bc4e-41b0-a34c-a91ec906b950-default-certificate\") pod \"router-default-675bf47bbf-4s7tz\" (UID: \"07b08f83-bc4e-41b0-a34c-a91ec906b950\") " pod="openshift-ingress/router-default-675bf47bbf-4s7tz" Jul 24 14:36:00.882866 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:00.882850 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ae7f7131-970f-4dfb-b418-13eeb937222e-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-hcs97\" (UID: \"ae7f7131-970f-4dfb-b418-13eeb937222e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-hcs97" Jul 24 14:36:00.883070 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:00.883049 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ae7f7131-970f-4dfb-b418-13eeb937222e-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-hcs97\" (UID: \"ae7f7131-970f-4dfb-b418-13eeb937222e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-hcs97" Jul 24 14:36:00.885019 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:00.884994 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ae7f7131-970f-4dfb-b418-13eeb937222e-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-hcs97\" (UID: \"ae7f7131-970f-4dfb-b418-13eeb937222e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-hcs97" Jul 24 14:36:00.893665 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:00.893641 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-675bf47bbf-4s7tz"] Jul 24 14:36:00.909301 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:00.909277 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jg9m2\" (UniqueName: \"kubernetes.io/projected/ae7f7131-970f-4dfb-b418-13eeb937222e-kube-api-access-jg9m2\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-hcs97\" (UID: \"ae7f7131-970f-4dfb-b418-13eeb937222e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-hcs97" Jul 24 14:36:00.983912 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:00.983870 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/07b08f83-bc4e-41b0-a34c-a91ec906b950-default-certificate\") pod \"router-default-675bf47bbf-4s7tz\" (UID: \"07b08f83-bc4e-41b0-a34c-a91ec906b950\") " pod="openshift-ingress/router-default-675bf47bbf-4s7tz" Jul 24 14:36:00.984115 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:00.983926 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07b08f83-bc4e-41b0-a34c-a91ec906b950-metrics-certs\") pod \"router-default-675bf47bbf-4s7tz\" (UID: \"07b08f83-bc4e-41b0-a34c-a91ec906b950\") " pod="openshift-ingress/router-default-675bf47bbf-4s7tz" Jul 24 14:36:00.984115 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:00.983988 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7q88p\" (UniqueName: \"kubernetes.io/projected/07b08f83-bc4e-41b0-a34c-a91ec906b950-kube-api-access-7q88p\") pod \"router-default-675bf47bbf-4s7tz\" (UID: \"07b08f83-bc4e-41b0-a34c-a91ec906b950\") " pod="openshift-ingress/router-default-675bf47bbf-4s7tz" Jul 24 14:36:00.984115 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:00.984012 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/07b08f83-bc4e-41b0-a34c-a91ec906b950-stats-auth\") pod \"router-default-675bf47bbf-4s7tz\" (UID: \"07b08f83-bc4e-41b0-a34c-a91ec906b950\") " pod="openshift-ingress/router-default-675bf47bbf-4s7tz" Jul 24 14:36:00.984115 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:36:00.984019 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 24 14:36:00.984115 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:00.984041 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07b08f83-bc4e-41b0-a34c-a91ec906b950-service-ca-bundle\") pod \"router-default-675bf47bbf-4s7tz\" (UID: \"07b08f83-bc4e-41b0-a34c-a91ec906b950\") " pod="openshift-ingress/router-default-675bf47bbf-4s7tz" Jul 24 14:36:00.984115 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:36:00.984088 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07b08f83-bc4e-41b0-a34c-a91ec906b950-metrics-certs podName:07b08f83-bc4e-41b0-a34c-a91ec906b950 nodeName:}" failed. No retries permitted until 2026-07-24 14:36:01.484067243 +0000 UTC m=+74.765456805 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07b08f83-bc4e-41b0-a34c-a91ec906b950-metrics-certs") pod "router-default-675bf47bbf-4s7tz" (UID: "07b08f83-bc4e-41b0-a34c-a91ec906b950") : secret "router-metrics-certs-default" not found Jul 24 14:36:00.984354 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:36:00.984157 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/07b08f83-bc4e-41b0-a34c-a91ec906b950-service-ca-bundle podName:07b08f83-bc4e-41b0-a34c-a91ec906b950 nodeName:}" failed. No retries permitted until 2026-07-24 14:36:01.484141091 +0000 UTC m=+74.765530650 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/07b08f83-bc4e-41b0-a34c-a91ec906b950-service-ca-bundle") pod "router-default-675bf47bbf-4s7tz" (UID: "07b08f83-bc4e-41b0-a34c-a91ec906b950") : configmap references non-existent config key: service-ca.crt Jul 24 14:36:00.986264 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:00.986220 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/07b08f83-bc4e-41b0-a34c-a91ec906b950-default-certificate\") pod \"router-default-675bf47bbf-4s7tz\" (UID: \"07b08f83-bc4e-41b0-a34c-a91ec906b950\") " pod="openshift-ingress/router-default-675bf47bbf-4s7tz" Jul 24 14:36:00.986316 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:00.986296 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/07b08f83-bc4e-41b0-a34c-a91ec906b950-stats-auth\") pod \"router-default-675bf47bbf-4s7tz\" (UID: \"07b08f83-bc4e-41b0-a34c-a91ec906b950\") " pod="openshift-ingress/router-default-675bf47bbf-4s7tz" Jul 24 14:36:00.994688 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:00.994666 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7q88p\" (UniqueName: \"kubernetes.io/projected/07b08f83-bc4e-41b0-a34c-a91ec906b950-kube-api-access-7q88p\") pod \"router-default-675bf47bbf-4s7tz\" (UID: \"07b08f83-bc4e-41b0-a34c-a91ec906b950\") " pod="openshift-ingress/router-default-675bf47bbf-4s7tz" Jul 24 14:36:01.036902 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:01.036867 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:01.048516 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:01.048496 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-hcs97" Jul 24 14:36:01.138406 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:01.138373 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:01.168420 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:01.168398 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-hcs97"] Jul 24 14:36:01.169939 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:36:01.169915 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae7f7131_970f_4dfb_b418_13eeb937222e.slice/crio-45af4a9ce988fdffcbcff2f9644cfb65f0cba713f17959543a2168608545cb98 WatchSource:0}: Error finding container 45af4a9ce988fdffcbcff2f9644cfb65f0cba713f17959543a2168608545cb98: Status 404 returned error can't find the container with id 45af4a9ce988fdffcbcff2f9644cfb65f0cba713f17959543a2168608545cb98 Jul 24 14:36:01.439055 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:01.439014 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-hcs97" event={"ID":"ae7f7131-970f-4dfb-b418-13eeb937222e","Type":"ContainerStarted","Data":"45af4a9ce988fdffcbcff2f9644cfb65f0cba713f17959543a2168608545cb98"} Jul 24 14:36:01.488353 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:01.488316 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07b08f83-bc4e-41b0-a34c-a91ec906b950-service-ca-bundle\") pod \"router-default-675bf47bbf-4s7tz\" (UID: \"07b08f83-bc4e-41b0-a34c-a91ec906b950\") " pod="openshift-ingress/router-default-675bf47bbf-4s7tz" Jul 24 14:36:01.488520 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:01.488366 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07b08f83-bc4e-41b0-a34c-a91ec906b950-metrics-certs\") pod \"router-default-675bf47bbf-4s7tz\" (UID: \"07b08f83-bc4e-41b0-a34c-a91ec906b950\") " pod="openshift-ingress/router-default-675bf47bbf-4s7tz" Jul 24 14:36:01.488520 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:36:01.488456 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 24 14:36:01.488611 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:36:01.488521 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/07b08f83-bc4e-41b0-a34c-a91ec906b950-service-ca-bundle podName:07b08f83-bc4e-41b0-a34c-a91ec906b950 nodeName:}" failed. No retries permitted until 2026-07-24 14:36:02.488504158 +0000 UTC m=+75.769893733 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/07b08f83-bc4e-41b0-a34c-a91ec906b950-service-ca-bundle") pod "router-default-675bf47bbf-4s7tz" (UID: "07b08f83-bc4e-41b0-a34c-a91ec906b950") : configmap references non-existent config key: service-ca.crt Jul 24 14:36:01.488611 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:36:01.488543 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07b08f83-bc4e-41b0-a34c-a91ec906b950-metrics-certs podName:07b08f83-bc4e-41b0-a34c-a91ec906b950 nodeName:}" failed. No retries permitted until 2026-07-24 14:36:02.488536956 +0000 UTC m=+75.769926514 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07b08f83-bc4e-41b0-a34c-a91ec906b950-metrics-certs") pod "router-default-675bf47bbf-4s7tz" (UID: "07b08f83-bc4e-41b0-a34c-a91ec906b950") : secret "router-metrics-certs-default" not found Jul 24 14:36:02.429648 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:02.429614 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:02.493761 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:02.493726 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:02.495719 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:02.495692 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07b08f83-bc4e-41b0-a34c-a91ec906b950-metrics-certs\") pod \"router-default-675bf47bbf-4s7tz\" (UID: \"07b08f83-bc4e-41b0-a34c-a91ec906b950\") " pod="openshift-ingress/router-default-675bf47bbf-4s7tz" Jul 24 14:36:02.495807 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:02.495789 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07b08f83-bc4e-41b0-a34c-a91ec906b950-service-ca-bundle\") pod \"router-default-675bf47bbf-4s7tz\" (UID: \"07b08f83-bc4e-41b0-a34c-a91ec906b950\") " pod="openshift-ingress/router-default-675bf47bbf-4s7tz" Jul 24 14:36:02.495873 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:36:02.495855 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 24 14:36:02.495940 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:36:02.495929 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07b08f83-bc4e-41b0-a34c-a91ec906b950-metrics-certs podName:07b08f83-bc4e-41b0-a34c-a91ec906b950 nodeName:}" failed. No retries permitted until 2026-07-24 14:36:04.49591324 +0000 UTC m=+77.777302800 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07b08f83-bc4e-41b0-a34c-a91ec906b950-metrics-certs") pod "router-default-675bf47bbf-4s7tz" (UID: "07b08f83-bc4e-41b0-a34c-a91ec906b950") : secret "router-metrics-certs-default" not found Jul 24 14:36:02.495981 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:36:02.495947 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/07b08f83-bc4e-41b0-a34c-a91ec906b950-service-ca-bundle podName:07b08f83-bc4e-41b0-a34c-a91ec906b950 nodeName:}" failed. No retries permitted until 2026-07-24 14:36:04.495940504 +0000 UTC m=+77.777330063 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/07b08f83-bc4e-41b0-a34c-a91ec906b950-service-ca-bundle") pod "router-default-675bf47bbf-4s7tz" (UID: "07b08f83-bc4e-41b0-a34c-a91ec906b950") : configmap references non-existent config key: service-ca.crt Jul 24 14:36:02.556885 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:02.556849 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:03.445805 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:03.445768 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-hcs97" event={"ID":"ae7f7131-970f-4dfb-b418-13eeb937222e","Type":"ContainerStarted","Data":"a9a710e126a595a6c205fcd3e4e4d3919f9b8bb20d1b3d721a7464598a168e76"} Jul 24 14:36:03.464893 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:03.464840 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-hcs97" podStartSLOduration=1.687865459 podStartE2EDuration="3.464820745s" totalImagesPullingTime="1.776955286s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:36:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:36:03.464139062 +0000 UTC m=+76.745528644" watchObservedRunningTime="2026-07-24 14:36:03.464820745 +0000 UTC m=+76.746210326" Jul 24 14:36:03.465207 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:03.465182 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:03.563713 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:03.563676 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:03.578517 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:03.578487 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-p6ztw"] Jul 24 14:36:03.580362 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:03.580347 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-p6ztw" Jul 24 14:36:03.583733 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:03.583665 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 24 14:36:03.583733 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:03.583675 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 24 14:36:03.583733 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:03.583693 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 24 14:36:03.583733 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:03.583705 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 24 14:36:03.583979 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:03.583711 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-db4xw\"" Jul 24 14:36:03.594547 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:03.594522 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-p6ztw"] Jul 24 14:36:03.704869 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:03.704780 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfnxx\" (UniqueName: \"kubernetes.io/projected/43df2a75-c530-4bd2-a608-5b23407cba86-kube-api-access-wfnxx\") pod \"service-ca-operator-5d6c75f84f-p6ztw\" (UID: \"43df2a75-c530-4bd2-a608-5b23407cba86\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-p6ztw" Jul 24 14:36:03.704869 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:03.704826 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/43df2a75-c530-4bd2-a608-5b23407cba86-serving-cert\") pod \"service-ca-operator-5d6c75f84f-p6ztw\" (UID: \"43df2a75-c530-4bd2-a608-5b23407cba86\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-p6ztw" Jul 24 14:36:03.704869 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:03.704870 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/43df2a75-c530-4bd2-a608-5b23407cba86-config\") pod \"service-ca-operator-5d6c75f84f-p6ztw\" (UID: \"43df2a75-c530-4bd2-a608-5b23407cba86\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-p6ztw" Jul 24 14:36:03.805510 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:03.805455 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/43df2a75-c530-4bd2-a608-5b23407cba86-serving-cert\") pod \"service-ca-operator-5d6c75f84f-p6ztw\" (UID: \"43df2a75-c530-4bd2-a608-5b23407cba86\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-p6ztw" Jul 24 14:36:03.805667 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:03.805539 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/43df2a75-c530-4bd2-a608-5b23407cba86-config\") pod \"service-ca-operator-5d6c75f84f-p6ztw\" (UID: \"43df2a75-c530-4bd2-a608-5b23407cba86\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-p6ztw" Jul 24 14:36:03.805667 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:03.805588 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfnxx\" (UniqueName: \"kubernetes.io/projected/43df2a75-c530-4bd2-a608-5b23407cba86-kube-api-access-wfnxx\") pod \"service-ca-operator-5d6c75f84f-p6ztw\" (UID: \"43df2a75-c530-4bd2-a608-5b23407cba86\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-p6ztw" Jul 24 14:36:03.806087 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:03.806068 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/43df2a75-c530-4bd2-a608-5b23407cba86-config\") pod \"service-ca-operator-5d6c75f84f-p6ztw\" (UID: \"43df2a75-c530-4bd2-a608-5b23407cba86\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-p6ztw" Jul 24 14:36:03.807857 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:03.807836 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/43df2a75-c530-4bd2-a608-5b23407cba86-serving-cert\") pod \"service-ca-operator-5d6c75f84f-p6ztw\" (UID: \"43df2a75-c530-4bd2-a608-5b23407cba86\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-p6ztw" Jul 24 14:36:03.817913 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:03.817880 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfnxx\" (UniqueName: \"kubernetes.io/projected/43df2a75-c530-4bd2-a608-5b23407cba86-kube-api-access-wfnxx\") pod \"service-ca-operator-5d6c75f84f-p6ztw\" (UID: \"43df2a75-c530-4bd2-a608-5b23407cba86\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-p6ztw" Jul 24 14:36:03.833047 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:03.833016 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-w5qcp"] Jul 24 14:36:03.834835 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:03.834820 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-w5qcp" Jul 24 14:36:03.837332 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:03.837311 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-2mqxs\"" Jul 24 14:36:03.849326 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:03.849305 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-w5qcp"] Jul 24 14:36:03.889218 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:03.889186 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-p6ztw" Jul 24 14:36:03.906171 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:03.906142 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zltv7\" (UniqueName: \"kubernetes.io/projected/9ce9a674-79f4-4fcf-8b76-721f4da54246-kube-api-access-zltv7\") pod \"network-check-source-7d88cb55d8-w5qcp\" (UID: \"9ce9a674-79f4-4fcf-8b76-721f4da54246\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-w5qcp" Jul 24 14:36:04.007091 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:04.007059 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zltv7\" (UniqueName: \"kubernetes.io/projected/9ce9a674-79f4-4fcf-8b76-721f4da54246-kube-api-access-zltv7\") pod \"network-check-source-7d88cb55d8-w5qcp\" (UID: \"9ce9a674-79f4-4fcf-8b76-721f4da54246\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-w5qcp" Jul 24 14:36:04.009963 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:04.009935 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-p6ztw"] Jul 24 14:36:04.013634 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:36:04.013607 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43df2a75_c530_4bd2_a608_5b23407cba86.slice/crio-f7f412d417c1a9fbd08f7616b3733eb1c38c4595528e0448439a3183eb6893f3 WatchSource:0}: Error finding container f7f412d417c1a9fbd08f7616b3733eb1c38c4595528e0448439a3183eb6893f3: Status 404 returned error can't find the container with id f7f412d417c1a9fbd08f7616b3733eb1c38c4595528e0448439a3183eb6893f3 Jul 24 14:36:04.016783 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:04.016753 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zltv7\" (UniqueName: \"kubernetes.io/projected/9ce9a674-79f4-4fcf-8b76-721f4da54246-kube-api-access-zltv7\") pod \"network-check-source-7d88cb55d8-w5qcp\" (UID: \"9ce9a674-79f4-4fcf-8b76-721f4da54246\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-w5qcp" Jul 24 14:36:04.120535 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:04.120501 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:04.143577 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:04.143546 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-w5qcp" Jul 24 14:36:04.196147 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:04.196117 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:04.260501 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:04.260436 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:04.268518 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:04.268364 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-w5qcp"] Jul 24 14:36:04.270727 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:36:04.270698 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ce9a674_79f4_4fcf_8b76_721f4da54246.slice/crio-aef505292059d9c3e9ef9ddd326e7a1354e9ce63c322620914a1429b2c98f18b WatchSource:0}: Error finding container aef505292059d9c3e9ef9ddd326e7a1354e9ce63c322620914a1429b2c98f18b: Status 404 returned error can't find the container with id aef505292059d9c3e9ef9ddd326e7a1354e9ce63c322620914a1429b2c98f18b Jul 24 14:36:04.449488 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:04.449440 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-p6ztw" event={"ID":"43df2a75-c530-4bd2-a608-5b23407cba86","Type":"ContainerStarted","Data":"f7f412d417c1a9fbd08f7616b3733eb1c38c4595528e0448439a3183eb6893f3"} Jul 24 14:36:04.450898 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:04.450870 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-w5qcp" event={"ID":"9ce9a674-79f4-4fcf-8b76-721f4da54246","Type":"ContainerStarted","Data":"4492a616b0a778f858c6e0c58027d7ca3c8f7fe5afecf3fb8b22210f639cd51b"} Jul 24 14:36:04.451010 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:04.450920 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-w5qcp" event={"ID":"9ce9a674-79f4-4fcf-8b76-721f4da54246","Type":"ContainerStarted","Data":"aef505292059d9c3e9ef9ddd326e7a1354e9ce63c322620914a1429b2c98f18b"} Jul 24 14:36:04.470009 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:04.469958 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-w5qcp" podStartSLOduration=1.469942685 podStartE2EDuration="1.469942685s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:36:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:36:04.468799154 +0000 UTC m=+77.750188736" watchObservedRunningTime="2026-07-24 14:36:04.469942685 +0000 UTC m=+77.751332256" Jul 24 14:36:04.510696 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:04.510625 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07b08f83-bc4e-41b0-a34c-a91ec906b950-service-ca-bundle\") pod \"router-default-675bf47bbf-4s7tz\" (UID: \"07b08f83-bc4e-41b0-a34c-a91ec906b950\") " pod="openshift-ingress/router-default-675bf47bbf-4s7tz" Jul 24 14:36:04.510901 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:04.510871 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07b08f83-bc4e-41b0-a34c-a91ec906b950-metrics-certs\") pod \"router-default-675bf47bbf-4s7tz\" (UID: \"07b08f83-bc4e-41b0-a34c-a91ec906b950\") " pod="openshift-ingress/router-default-675bf47bbf-4s7tz" Jul 24 14:36:04.510972 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:36:04.510934 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/07b08f83-bc4e-41b0-a34c-a91ec906b950-service-ca-bundle podName:07b08f83-bc4e-41b0-a34c-a91ec906b950 nodeName:}" failed. No retries permitted until 2026-07-24 14:36:08.510915445 +0000 UTC m=+81.792305022 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/07b08f83-bc4e-41b0-a34c-a91ec906b950-service-ca-bundle") pod "router-default-675bf47bbf-4s7tz" (UID: "07b08f83-bc4e-41b0-a34c-a91ec906b950") : configmap references non-existent config key: service-ca.crt Jul 24 14:36:04.510972 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:36:04.510951 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 24 14:36:04.511060 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:36:04.511010 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07b08f83-bc4e-41b0-a34c-a91ec906b950-metrics-certs podName:07b08f83-bc4e-41b0-a34c-a91ec906b950 nodeName:}" failed. No retries permitted until 2026-07-24 14:36:08.510995925 +0000 UTC m=+81.792385489 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07b08f83-bc4e-41b0-a34c-a91ec906b950-metrics-certs") pod "router-default-675bf47bbf-4s7tz" (UID: "07b08f83-bc4e-41b0-a34c-a91ec906b950") : secret "router-metrics-certs-default" not found Jul 24 14:36:04.709155 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:04.709120 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-dvgnr"] Jul 24 14:36:04.711367 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:04.711335 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dvgnr" Jul 24 14:36:04.714067 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:04.714045 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 24 14:36:04.714575 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:04.714203 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 24 14:36:04.714575 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:04.714320 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6nbcz\"" Jul 24 14:36:04.714731 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:04.714581 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 24 14:36:04.714731 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:04.714608 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 24 14:36:04.723465 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:04.723443 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dvgnr"] Jul 24 14:36:04.813560 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:04.813515 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dvgnr\" (UID: \"9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c\") " pod="openshift-insights/insights-runtime-extractor-dvgnr" Jul 24 14:36:04.813768 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:04.813579 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8clf\" (UniqueName: \"kubernetes.io/projected/9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c-kube-api-access-r8clf\") pod \"insights-runtime-extractor-dvgnr\" (UID: \"9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c\") " pod="openshift-insights/insights-runtime-extractor-dvgnr" Jul 24 14:36:04.813768 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:04.813668 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c-crio-socket\") pod \"insights-runtime-extractor-dvgnr\" (UID: \"9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c\") " pod="openshift-insights/insights-runtime-extractor-dvgnr" Jul 24 14:36:04.813768 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:04.813698 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dvgnr\" (UID: \"9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c\") " pod="openshift-insights/insights-runtime-extractor-dvgnr" Jul 24 14:36:04.814020 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:04.813771 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c-data-volume\") pod \"insights-runtime-extractor-dvgnr\" (UID: \"9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c\") " pod="openshift-insights/insights-runtime-extractor-dvgnr" Jul 24 14:36:04.814020 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:04.813829 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:04.914502 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:04.914454 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8clf\" (UniqueName: \"kubernetes.io/projected/9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c-kube-api-access-r8clf\") pod \"insights-runtime-extractor-dvgnr\" (UID: \"9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c\") " pod="openshift-insights/insights-runtime-extractor-dvgnr" Jul 24 14:36:04.914675 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:04.914540 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c-crio-socket\") pod \"insights-runtime-extractor-dvgnr\" (UID: \"9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c\") " pod="openshift-insights/insights-runtime-extractor-dvgnr" Jul 24 14:36:04.914675 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:04.914571 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dvgnr\" (UID: \"9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c\") " pod="openshift-insights/insights-runtime-extractor-dvgnr" Jul 24 14:36:04.914675 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:04.914610 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c-data-volume\") pod \"insights-runtime-extractor-dvgnr\" (UID: \"9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c\") " pod="openshift-insights/insights-runtime-extractor-dvgnr" Jul 24 14:36:04.914837 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:36:04.914678 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 24 14:36:04.914837 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:04.914670 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dvgnr\" (UID: \"9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c\") " pod="openshift-insights/insights-runtime-extractor-dvgnr" Jul 24 14:36:04.914837 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:36:04.914748 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c-kube-rbac-proxy-cm podName:9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c nodeName:}" failed. No retries permitted until 2026-07-24 14:36:05.414728955 +0000 UTC m=+78.696118538 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dvgnr" (UID: "9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c") : configmap "kube-rbac-proxy" not found Jul 24 14:36:04.914837 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:36:04.914807 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 14:36:04.914837 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:04.914678 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c-crio-socket\") pod \"insights-runtime-extractor-dvgnr\" (UID: \"9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c\") " pod="openshift-insights/insights-runtime-extractor-dvgnr" Jul 24 14:36:04.915135 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:36:04.914870 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c-insights-runtime-extractor-tls podName:9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c nodeName:}" failed. No retries permitted until 2026-07-24 14:36:05.414855498 +0000 UTC m=+78.696245059 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dvgnr" (UID: "9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c") : secret "insights-runtime-extractor-tls" not found Jul 24 14:36:04.915135 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:04.915018 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c-data-volume\") pod \"insights-runtime-extractor-dvgnr\" (UID: \"9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c\") " pod="openshift-insights/insights-runtime-extractor-dvgnr" Jul 24 14:36:04.926331 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:04.926304 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8clf\" (UniqueName: \"kubernetes.io/projected/9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c-kube-api-access-r8clf\") pod \"insights-runtime-extractor-dvgnr\" (UID: \"9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c\") " pod="openshift-insights/insights-runtime-extractor-dvgnr" Jul 24 14:36:04.995687 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:04.995651 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:05.421739 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:05.421704 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dvgnr\" (UID: \"9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c\") " pod="openshift-insights/insights-runtime-extractor-dvgnr" Jul 24 14:36:05.422004 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:05.421789 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dvgnr\" (UID: \"9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c\") " pod="openshift-insights/insights-runtime-extractor-dvgnr" Jul 24 14:36:05.422004 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:36:05.421874 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 14:36:05.422004 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:36:05.421971 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c-insights-runtime-extractor-tls podName:9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c nodeName:}" failed. No retries permitted until 2026-07-24 14:36:06.421953194 +0000 UTC m=+79.703342777 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dvgnr" (UID: "9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c") : secret "insights-runtime-extractor-tls" not found Jul 24 14:36:05.422187 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:36:05.421874 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 24 14:36:05.422187 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:36:05.422110 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c-kube-rbac-proxy-cm podName:9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c nodeName:}" failed. No retries permitted until 2026-07-24 14:36:06.422085701 +0000 UTC m=+79.703475274 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dvgnr" (UID: "9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c") : configmap "kube-rbac-proxy" not found Jul 24 14:36:06.430221 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:06.430181 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dvgnr\" (UID: \"9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c\") " pod="openshift-insights/insights-runtime-extractor-dvgnr" Jul 24 14:36:06.430641 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:06.430286 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dvgnr\" (UID: \"9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c\") " pod="openshift-insights/insights-runtime-extractor-dvgnr" Jul 24 14:36:06.430641 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:36:06.430336 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 14:36:06.430641 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:36:06.430367 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 24 14:36:06.430641 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:36:06.430401 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c-insights-runtime-extractor-tls podName:9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c nodeName:}" failed. No retries permitted until 2026-07-24 14:36:08.43038429 +0000 UTC m=+81.711773849 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dvgnr" (UID: "9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c") : secret "insights-runtime-extractor-tls" not found Jul 24 14:36:06.430641 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:36:06.430415 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c-kube-rbac-proxy-cm podName:9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c nodeName:}" failed. No retries permitted until 2026-07-24 14:36:08.430408841 +0000 UTC m=+81.711798400 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dvgnr" (UID: "9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c") : configmap "kube-rbac-proxy" not found Jul 24 14:36:06.461073 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:06.461038 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-p6ztw" event={"ID":"43df2a75-c530-4bd2-a608-5b23407cba86","Type":"ContainerStarted","Data":"7e2d5de5f862d6a4659d2d9f01cf68ae82aa558d5f3d2fa0cf7261a2dd94722b"} Jul 24 14:36:06.476366 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:06.476313 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-p6ztw" podStartSLOduration=1.5664345769999999 podStartE2EDuration="3.476296953s" totalImagesPullingTime="1.909862376s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:36:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:36:06.475385942 +0000 UTC m=+79.756775525" watchObservedRunningTime="2026-07-24 14:36:06.476296953 +0000 UTC m=+79.757686534" Jul 24 14:36:06.494798 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:06.494766 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:06.655769 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:06.655734 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:07.215651 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:07.215608 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:07.291655 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:07.291621 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2w5hp_09a04909-4f60-48c8-8077-06b6dccf3df8/dns-node-resolver/0.log" Jul 24 14:36:07.446049 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:07.446015 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:07.547704 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:07.547617 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:07.920622 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:07.920588 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:08.023749 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:08.023717 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:08.291887 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:08.291819 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kt54d_4a748576-5432-4fcf-b10f-5c488963ba3d/node-ca/0.log" Jul 24 14:36:08.446577 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:08.446536 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dvgnr\" (UID: \"9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c\") " pod="openshift-insights/insights-runtime-extractor-dvgnr" Jul 24 14:36:08.446996 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:08.446633 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dvgnr\" (UID: \"9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c\") " pod="openshift-insights/insights-runtime-extractor-dvgnr" Jul 24 14:36:08.446996 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:36:08.446663 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 24 14:36:08.446996 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:36:08.446739 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c-kube-rbac-proxy-cm podName:9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c nodeName:}" failed. No retries permitted until 2026-07-24 14:36:12.446718379 +0000 UTC m=+85.728107940 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dvgnr" (UID: "9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c") : configmap "kube-rbac-proxy" not found Jul 24 14:36:08.446996 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:36:08.446780 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 14:36:08.446996 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:36:08.446827 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c-insights-runtime-extractor-tls podName:9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c nodeName:}" failed. No retries permitted until 2026-07-24 14:36:12.44681363 +0000 UTC m=+85.728203194 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dvgnr" (UID: "9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c") : secret "insights-runtime-extractor-tls" not found Jul 24 14:36:08.547767 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:08.547657 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07b08f83-bc4e-41b0-a34c-a91ec906b950-metrics-certs\") pod \"router-default-675bf47bbf-4s7tz\" (UID: \"07b08f83-bc4e-41b0-a34c-a91ec906b950\") " pod="openshift-ingress/router-default-675bf47bbf-4s7tz" Jul 24 14:36:08.547905 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:08.547789 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07b08f83-bc4e-41b0-a34c-a91ec906b950-service-ca-bundle\") pod \"router-default-675bf47bbf-4s7tz\" (UID: \"07b08f83-bc4e-41b0-a34c-a91ec906b950\") " pod="openshift-ingress/router-default-675bf47bbf-4s7tz" Jul 24 14:36:08.547905 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:36:08.547806 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 24 14:36:08.547905 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:36:08.547871 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07b08f83-bc4e-41b0-a34c-a91ec906b950-metrics-certs podName:07b08f83-bc4e-41b0-a34c-a91ec906b950 nodeName:}" failed. No retries permitted until 2026-07-24 14:36:16.547853574 +0000 UTC m=+89.829243152 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07b08f83-bc4e-41b0-a34c-a91ec906b950-metrics-certs") pod "router-default-675bf47bbf-4s7tz" (UID: "07b08f83-bc4e-41b0-a34c-a91ec906b950") : secret "router-metrics-certs-default" not found Jul 24 14:36:08.548030 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:36:08.547924 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/07b08f83-bc4e-41b0-a34c-a91ec906b950-service-ca-bundle podName:07b08f83-bc4e-41b0-a34c-a91ec906b950 nodeName:}" failed. No retries permitted until 2026-07-24 14:36:16.547912121 +0000 UTC m=+89.829301694 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/07b08f83-bc4e-41b0-a34c-a91ec906b950-service-ca-bundle") pod "router-default-675bf47bbf-4s7tz" (UID: "07b08f83-bc4e-41b0-a34c-a91ec906b950") : configmap references non-existent config key: service-ca.crt Jul 24 14:36:09.292934 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:09.292908 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n8zfk_ee6a54e6-fe4a-461a-85cd-fb141a505fb5/serve-healthcheck-canary/0.log" Jul 24 14:36:09.525231 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:09.525203 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-rss8g"] Jul 24 14:36:09.529174 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:09.529153 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-rss8g" Jul 24 14:36:09.532375 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:09.532355 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 24 14:36:09.533006 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:09.532985 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 24 14:36:09.533620 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:09.533599 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-jfbff\"" Jul 24 14:36:09.533969 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:09.533768 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 24 14:36:09.534109 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:09.534079 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 24 14:36:09.541528 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:09.541506 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-rss8g"] Jul 24 14:36:09.632710 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:09.632607 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:09.657748 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:09.657714 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c759f146-877b-44e6-b1f4-64b7f8881a1f-signing-key\") pod \"service-ca-658d7b7c78-rss8g\" (UID: \"c759f146-877b-44e6-b1f4-64b7f8881a1f\") " pod="openshift-service-ca/service-ca-658d7b7c78-rss8g" Jul 24 14:36:09.657873 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:09.657770 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c759f146-877b-44e6-b1f4-64b7f8881a1f-signing-cabundle\") pod \"service-ca-658d7b7c78-rss8g\" (UID: \"c759f146-877b-44e6-b1f4-64b7f8881a1f\") " pod="openshift-service-ca/service-ca-658d7b7c78-rss8g" Jul 24 14:36:09.657873 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:09.657794 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pc6hq\" (UniqueName: \"kubernetes.io/projected/c759f146-877b-44e6-b1f4-64b7f8881a1f-kube-api-access-pc6hq\") pod \"service-ca-658d7b7c78-rss8g\" (UID: \"c759f146-877b-44e6-b1f4-64b7f8881a1f\") " pod="openshift-service-ca/service-ca-658d7b7c78-rss8g" Jul 24 14:36:09.734419 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:09.734382 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:09.758343 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:09.758315 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c759f146-877b-44e6-b1f4-64b7f8881a1f-signing-key\") pod \"service-ca-658d7b7c78-rss8g\" (UID: \"c759f146-877b-44e6-b1f4-64b7f8881a1f\") " pod="openshift-service-ca/service-ca-658d7b7c78-rss8g" Jul 24 14:36:09.758460 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:09.758358 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c759f146-877b-44e6-b1f4-64b7f8881a1f-signing-cabundle\") pod \"service-ca-658d7b7c78-rss8g\" (UID: \"c759f146-877b-44e6-b1f4-64b7f8881a1f\") " pod="openshift-service-ca/service-ca-658d7b7c78-rss8g" Jul 24 14:36:09.758460 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:09.758375 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pc6hq\" (UniqueName: \"kubernetes.io/projected/c759f146-877b-44e6-b1f4-64b7f8881a1f-kube-api-access-pc6hq\") pod \"service-ca-658d7b7c78-rss8g\" (UID: \"c759f146-877b-44e6-b1f4-64b7f8881a1f\") " pod="openshift-service-ca/service-ca-658d7b7c78-rss8g" Jul 24 14:36:09.759025 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:09.759003 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c759f146-877b-44e6-b1f4-64b7f8881a1f-signing-cabundle\") pod \"service-ca-658d7b7c78-rss8g\" (UID: \"c759f146-877b-44e6-b1f4-64b7f8881a1f\") " pod="openshift-service-ca/service-ca-658d7b7c78-rss8g" Jul 24 14:36:09.760693 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:09.760674 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c759f146-877b-44e6-b1f4-64b7f8881a1f-signing-key\") pod \"service-ca-658d7b7c78-rss8g\" (UID: \"c759f146-877b-44e6-b1f4-64b7f8881a1f\") " pod="openshift-service-ca/service-ca-658d7b7c78-rss8g" Jul 24 14:36:09.770005 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:09.769977 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pc6hq\" (UniqueName: \"kubernetes.io/projected/c759f146-877b-44e6-b1f4-64b7f8881a1f-kube-api-access-pc6hq\") pod \"service-ca-658d7b7c78-rss8g\" (UID: \"c759f146-877b-44e6-b1f4-64b7f8881a1f\") " pod="openshift-service-ca/service-ca-658d7b7c78-rss8g" Jul 24 14:36:09.839102 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:09.839077 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-rss8g" Jul 24 14:36:09.901573 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:09.901491 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-hcs97_ae7f7131-970f-4dfb-b418-13eeb937222e/kube-storage-version-migrator-operator/0.log" Jul 24 14:36:09.968278 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:09.968221 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-rss8g"] Jul 24 14:36:09.970584 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:36:09.970554 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc759f146_877b_44e6_b1f4_64b7f8881a1f.slice/crio-e4b62594a098acb72d5d900eb9d8cbc49dbe8bfc26a97a18a7a3bf6e30f5edab WatchSource:0}: Error finding container e4b62594a098acb72d5d900eb9d8cbc49dbe8bfc26a97a18a7a3bf6e30f5edab: Status 404 returned error can't find the container with id e4b62594a098acb72d5d900eb9d8cbc49dbe8bfc26a97a18a7a3bf6e30f5edab Jul 24 14:36:10.474684 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:10.474647 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-rss8g" event={"ID":"c759f146-877b-44e6-b1f4-64b7f8881a1f","Type":"ContainerStarted","Data":"1153a3a376b77dfb4ac509191b4d926c85f0b4ec74b844a986e4afd8e33db2f2"} Jul 24 14:36:10.474849 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:10.474701 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-rss8g" event={"ID":"c759f146-877b-44e6-b1f4-64b7f8881a1f","Type":"ContainerStarted","Data":"e4b62594a098acb72d5d900eb9d8cbc49dbe8bfc26a97a18a7a3bf6e30f5edab"} Jul 24 14:36:10.494373 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:10.494324 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-rss8g" podStartSLOduration=1.494308717 podStartE2EDuration="1.494308717s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:36:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:36:10.493770965 +0000 UTC m=+83.775160545" watchObservedRunningTime="2026-07-24 14:36:10.494308717 +0000 UTC m=+83.775698298" Jul 24 14:36:10.876782 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:10.876748 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:11.408438 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:11.408403 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:11.615284 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:11.615242 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:11.737857 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:11.737746 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:11.820685 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:11.820650 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:11.921654 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:11.921619 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:12.023728 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:12.023637 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:12.123253 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:12.123219 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:12.477712 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:12.477675 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dvgnr\" (UID: \"9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c\") " pod="openshift-insights/insights-runtime-extractor-dvgnr" Jul 24 14:36:12.477938 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:12.477748 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dvgnr\" (UID: \"9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c\") " pod="openshift-insights/insights-runtime-extractor-dvgnr" Jul 24 14:36:12.477938 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:36:12.477825 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 24 14:36:12.477938 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:36:12.477853 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 14:36:12.477938 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:36:12.477900 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c-kube-rbac-proxy-cm podName:9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c nodeName:}" failed. No retries permitted until 2026-07-24 14:36:20.477884305 +0000 UTC m=+93.759273864 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dvgnr" (UID: "9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c") : configmap "kube-rbac-proxy" not found Jul 24 14:36:12.477938 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:36:12.477915 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c-insights-runtime-extractor-tls podName:9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c nodeName:}" failed. No retries permitted until 2026-07-24 14:36:20.477909163 +0000 UTC m=+93.759298722 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dvgnr" (UID: "9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c") : secret "insights-runtime-extractor-tls" not found Jul 24 14:36:12.708017 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:12.707986 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:13.308923 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:13.308891 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:13.906177 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:13.906142 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:14.110501 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:14.110453 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:14.176794 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:14.176681 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:14.321703 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:14.321671 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:14.512436 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:14.512313 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:14.791968 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:14.791858 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:15.107276 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:15.107229 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:15.340780 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:15.340746 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:15.508989 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:15.508882 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:15.899117 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:15.899074 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:16.110416 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:16.110381 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:16.170600 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:16.170495 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:16.306765 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:16.306725 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:16.613086 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:16.613046 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07b08f83-bc4e-41b0-a34c-a91ec906b950-service-ca-bundle\") pod \"router-default-675bf47bbf-4s7tz\" (UID: \"07b08f83-bc4e-41b0-a34c-a91ec906b950\") " pod="openshift-ingress/router-default-675bf47bbf-4s7tz" Jul 24 14:36:16.613558 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:16.613218 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07b08f83-bc4e-41b0-a34c-a91ec906b950-metrics-certs\") pod \"router-default-675bf47bbf-4s7tz\" (UID: \"07b08f83-bc4e-41b0-a34c-a91ec906b950\") " pod="openshift-ingress/router-default-675bf47bbf-4s7tz" Jul 24 14:36:16.613558 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:36:16.613247 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/07b08f83-bc4e-41b0-a34c-a91ec906b950-service-ca-bundle podName:07b08f83-bc4e-41b0-a34c-a91ec906b950 nodeName:}" failed. No retries permitted until 2026-07-24 14:36:32.613224465 +0000 UTC m=+105.894614029 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/07b08f83-bc4e-41b0-a34c-a91ec906b950-service-ca-bundle") pod "router-default-675bf47bbf-4s7tz" (UID: "07b08f83-bc4e-41b0-a34c-a91ec906b950") : configmap references non-existent config key: service-ca.crt Jul 24 14:36:16.615645 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:16.615621 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07b08f83-bc4e-41b0-a34c-a91ec906b950-metrics-certs\") pod \"router-default-675bf47bbf-4s7tz\" (UID: \"07b08f83-bc4e-41b0-a34c-a91ec906b950\") " pod="openshift-ingress/router-default-675bf47bbf-4s7tz" Jul 24 14:36:16.705006 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:16.704972 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:17.110455 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:17.110421 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:17.291767 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:17.291736 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:17.702532 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:17.702500 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:17.896326 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:17.896292 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:18.113543 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:18.113502 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:18.315236 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:18.315197 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:18.709692 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:18.709653 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:19.503669 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:19.503632 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:19.606169 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:19.606136 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:19.705145 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:19.705115 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:19.805744 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:19.805660 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:20.106633 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:20.106593 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:20.320242 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:20.320208 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:20.543447 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:20.543354 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dvgnr\" (UID: \"9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c\") " pod="openshift-insights/insights-runtime-extractor-dvgnr" Jul 24 14:36:20.543621 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:20.543548 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dvgnr\" (UID: \"9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c\") " pod="openshift-insights/insights-runtime-extractor-dvgnr" Jul 24 14:36:20.543684 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:36:20.543669 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 14:36:20.543744 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:36:20.543734 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c-insights-runtime-extractor-tls podName:9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c nodeName:}" failed. No retries permitted until 2026-07-24 14:36:36.543718669 +0000 UTC m=+109.825108228 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dvgnr" (UID: "9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c") : secret "insights-runtime-extractor-tls" not found Jul 24 14:36:20.543997 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:20.543979 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dvgnr\" (UID: \"9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c\") " pod="openshift-insights/insights-runtime-extractor-dvgnr" Jul 24 14:36:20.917639 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:20.917609 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:21.309504 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:21.309456 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:21.502141 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:21.502104 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:21.641020 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:21.640933 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:21.907923 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:21.907841 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:22.117490 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:22.117441 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:25.584024 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:25.583988 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/03a80cf6-686d-4e98-bb23-e31b95c3e823-metrics-tls\") pod \"dns-default-xz4zn\" (UID: \"03a80cf6-686d-4e98-bb23-e31b95c3e823\") " pod="openshift-dns/dns-default-xz4zn" Jul 24 14:36:25.584911 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:25.584889 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:25.586394 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:25.586372 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/03a80cf6-686d-4e98-bb23-e31b95c3e823-metrics-tls\") pod \"dns-default-xz4zn\" (UID: \"03a80cf6-686d-4e98-bb23-e31b95c3e823\") " pod="openshift-dns/dns-default-xz4zn" Jul 24 14:36:25.597726 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:25.597704 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7ps4v\"" Jul 24 14:36:25.606624 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:25.606607 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xz4zn" Jul 24 14:36:25.699556 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:25.699514 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:25.730969 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:25.730943 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xz4zn"] Jul 24 14:36:25.733790 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:36:25.733765 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03a80cf6_686d_4e98_bb23_e31b95c3e823.slice/crio-348ac9e2bd586abeea427282157d040b36f0584027cf25dba6f53214ae7443ec WatchSource:0}: Error finding container 348ac9e2bd586abeea427282157d040b36f0584027cf25dba6f53214ae7443ec: Status 404 returned error can't find the container with id 348ac9e2bd586abeea427282157d040b36f0584027cf25dba6f53214ae7443ec Jul 24 14:36:25.792891 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:25.792866 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:25.941976 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:25.941907 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:26.268443 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:26.268367 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:26.369408 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:26.369364 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:26.498769 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:26.498735 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:26.527277 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:26.525857 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xz4zn" event={"ID":"03a80cf6-686d-4e98-bb23-e31b95c3e823","Type":"ContainerStarted","Data":"348ac9e2bd586abeea427282157d040b36f0584027cf25dba6f53214ae7443ec"} Jul 24 14:36:26.674076 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:26.674040 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:26.783909 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:26.783828 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:27.278027 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:27.277994 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:27.455643 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:27.455614 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:27.530464 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:27.530380 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xz4zn" event={"ID":"03a80cf6-686d-4e98-bb23-e31b95c3e823","Type":"ContainerStarted","Data":"0f3967d0725d8fdd61e7757c94651909215d3475977153325b3be05e706babd9"} Jul 24 14:36:27.530464 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:27.530438 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xz4zn" event={"ID":"03a80cf6-686d-4e98-bb23-e31b95c3e823","Type":"ContainerStarted","Data":"6f01750c369feb389e46b634b94ce8b1c9616e85028f2c315c687de15b21672a"} Jul 24 14:36:27.530650 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:27.530503 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xz4zn" Jul 24 14:36:27.551143 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:27.551092 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-xz4zn" podStartSLOduration=64.960232163 podStartE2EDuration="1m6.551077651s" totalImagesPullingTime="1.590845488s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:35:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:36:27.549783983 +0000 UTC m=+100.831173566" watchObservedRunningTime="2026-07-24 14:36:27.551077651 +0000 UTC m=+100.832467232" Jul 24 14:36:27.554926 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:27.554904 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:28.295731 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:28.295700 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:28.394534 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:28.394505 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:29.435424 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:29.435392 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-cjzwq" Jul 24 14:36:32.642673 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:32.642633 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07b08f83-bc4e-41b0-a34c-a91ec906b950-service-ca-bundle\") pod \"router-default-675bf47bbf-4s7tz\" (UID: \"07b08f83-bc4e-41b0-a34c-a91ec906b950\") " pod="openshift-ingress/router-default-675bf47bbf-4s7tz" Jul 24 14:36:32.643199 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:32.643179 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07b08f83-bc4e-41b0-a34c-a91ec906b950-service-ca-bundle\") pod \"router-default-675bf47bbf-4s7tz\" (UID: \"07b08f83-bc4e-41b0-a34c-a91ec906b950\") " pod="openshift-ingress/router-default-675bf47bbf-4s7tz" Jul 24 14:36:32.657754 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:32.657734 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-675bf47bbf-4s7tz" Jul 24 14:36:32.813912 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:32.813876 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-675bf47bbf-4s7tz"] Jul 24 14:36:32.817140 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:36:32.817108 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07b08f83_bc4e_41b0_a34c_a91ec906b950.slice/crio-b4d70b3c3683812e8eda9edf8ea964fd2f86559646302de1135fc429ded8836a WatchSource:0}: Error finding container b4d70b3c3683812e8eda9edf8ea964fd2f86559646302de1135fc429ded8836a: Status 404 returned error can't find the container with id b4d70b3c3683812e8eda9edf8ea964fd2f86559646302de1135fc429ded8836a Jul 24 14:36:33.461295 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.461257 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-42ntb"] Jul 24 14:36:33.480594 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.480568 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-564bdb68b6-2p99t"] Jul 24 14:36:33.480732 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.480700 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-42ntb" Jul 24 14:36:33.483429 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.483400 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-66mpl\"" Jul 24 14:36:33.483583 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.483404 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 24 14:36:33.484139 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.484119 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 24 14:36:33.495191 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.495173 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-42ntb"] Jul 24 14:36:33.495281 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.495200 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-564bdb68b6-2p99t"] Jul 24 14:36:33.495320 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.495282 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-564bdb68b6-2p99t" Jul 24 14:36:33.497844 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.497829 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 24 14:36:33.498193 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.498177 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kzks8\"" Jul 24 14:36:33.498290 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.498272 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 24 14:36:33.499843 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.499825 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 24 14:36:33.505004 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.504988 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 24 14:36:33.544124 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.544092 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-564bdb68b6-2p99t"] Jul 24 14:36:33.544358 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:36:33.544333 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[bound-sa-token ca-trust-extracted image-registry-private-configuration installation-pull-secrets kube-api-access-4nvw9 registry-certificates registry-tls trusted-ca], unattached volumes=[], failed to process volumes=[bound-sa-token ca-trust-extracted image-registry-private-configuration installation-pull-secrets kube-api-access-4nvw9 registry-certificates registry-tls trusted-ca]: context canceled" pod="openshift-image-registry/image-registry-564bdb68b6-2p99t" podUID="a2cb0201-6e6d-423d-9306-fd710eb92d33" Jul 24 14:36:33.549424 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.549339 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b9b98d06-1186-4c51-b03a-57b92347ed7f-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-42ntb\" (UID: \"b9b98d06-1186-4c51-b03a-57b92347ed7f\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-42ntb" Jul 24 14:36:33.549587 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.549494 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b9b98d06-1186-4c51-b03a-57b92347ed7f-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-42ntb\" (UID: \"b9b98d06-1186-4c51-b03a-57b92347ed7f\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-42ntb" Jul 24 14:36:33.550492 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.550449 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-564bdb68b6-2p99t" Jul 24 14:36:33.550591 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.550492 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-675bf47bbf-4s7tz" event={"ID":"07b08f83-bc4e-41b0-a34c-a91ec906b950","Type":"ContainerStarted","Data":"c9d2502d8fabeb863fdffeaa34914638a60a6b82473ef18e3a9511dcfa473642"} Jul 24 14:36:33.550591 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.550541 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-675bf47bbf-4s7tz" event={"ID":"07b08f83-bc4e-41b0-a34c-a91ec906b950","Type":"ContainerStarted","Data":"b4d70b3c3683812e8eda9edf8ea964fd2f86559646302de1135fc429ded8836a"} Jul 24 14:36:33.573659 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.573638 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-phm58"] Jul 24 14:36:33.574672 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.574651 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-564bdb68b6-2p99t" Jul 24 14:36:33.590902 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.590879 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-phm58" Jul 24 14:36:33.593695 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.593668 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 24 14:36:33.593792 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.593741 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-7jh65\"" Jul 24 14:36:33.600350 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.600330 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-phm58"] Jul 24 14:36:33.600597 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.600581 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 24 14:36:33.614846 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.614804 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-675bf47bbf-4s7tz" podStartSLOduration=33.614789395 podStartE2EDuration="33.614789395s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:36:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:36:33.613919387 +0000 UTC m=+106.895308969" watchObservedRunningTime="2026-07-24 14:36:33.614789395 +0000 UTC m=+106.896178976" Jul 24 14:36:33.650853 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.650824 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b9b98d06-1186-4c51-b03a-57b92347ed7f-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-42ntb\" (UID: \"b9b98d06-1186-4c51-b03a-57b92347ed7f\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-42ntb" Jul 24 14:36:33.651225 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.650872 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a2cb0201-6e6d-423d-9306-fd710eb92d33-installation-pull-secrets\") pod \"image-registry-564bdb68b6-2p99t\" (UID: \"a2cb0201-6e6d-423d-9306-fd710eb92d33\") " pod="openshift-image-registry/image-registry-564bdb68b6-2p99t" Jul 24 14:36:33.651225 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.650920 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8q2vh\" (UniqueName: \"kubernetes.io/projected/c3bb914e-61ec-4d87-a7b1-5ca7c30b94ce-kube-api-access-8q2vh\") pod \"downloads-7c97dc4555-phm58\" (UID: \"c3bb914e-61ec-4d87-a7b1-5ca7c30b94ce\") " pod="openshift-console/downloads-7c97dc4555-phm58" Jul 24 14:36:33.651225 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.650964 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a2cb0201-6e6d-423d-9306-fd710eb92d33-image-registry-private-configuration\") pod \"image-registry-564bdb68b6-2p99t\" (UID: \"a2cb0201-6e6d-423d-9306-fd710eb92d33\") " pod="openshift-image-registry/image-registry-564bdb68b6-2p99t" Jul 24 14:36:33.651225 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.651014 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a2cb0201-6e6d-423d-9306-fd710eb92d33-registry-tls\") pod \"image-registry-564bdb68b6-2p99t\" (UID: \"a2cb0201-6e6d-423d-9306-fd710eb92d33\") " pod="openshift-image-registry/image-registry-564bdb68b6-2p99t" Jul 24 14:36:33.651225 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.651041 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a2cb0201-6e6d-423d-9306-fd710eb92d33-trusted-ca\") pod \"image-registry-564bdb68b6-2p99t\" (UID: \"a2cb0201-6e6d-423d-9306-fd710eb92d33\") " pod="openshift-image-registry/image-registry-564bdb68b6-2p99t" Jul 24 14:36:33.651225 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.651102 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a2cb0201-6e6d-423d-9306-fd710eb92d33-registry-certificates\") pod \"image-registry-564bdb68b6-2p99t\" (UID: \"a2cb0201-6e6d-423d-9306-fd710eb92d33\") " pod="openshift-image-registry/image-registry-564bdb68b6-2p99t" Jul 24 14:36:33.651225 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.651133 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nvw9\" (UniqueName: \"kubernetes.io/projected/a2cb0201-6e6d-423d-9306-fd710eb92d33-kube-api-access-4nvw9\") pod \"image-registry-564bdb68b6-2p99t\" (UID: \"a2cb0201-6e6d-423d-9306-fd710eb92d33\") " pod="openshift-image-registry/image-registry-564bdb68b6-2p99t" Jul 24 14:36:33.651225 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.651187 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a2cb0201-6e6d-423d-9306-fd710eb92d33-ca-trust-extracted\") pod \"image-registry-564bdb68b6-2p99t\" (UID: \"a2cb0201-6e6d-423d-9306-fd710eb92d33\") " pod="openshift-image-registry/image-registry-564bdb68b6-2p99t" Jul 24 14:36:33.651646 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.651239 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a2cb0201-6e6d-423d-9306-fd710eb92d33-bound-sa-token\") pod \"image-registry-564bdb68b6-2p99t\" (UID: \"a2cb0201-6e6d-423d-9306-fd710eb92d33\") " pod="openshift-image-registry/image-registry-564bdb68b6-2p99t" Jul 24 14:36:33.651646 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.651309 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b9b98d06-1186-4c51-b03a-57b92347ed7f-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-42ntb\" (UID: \"b9b98d06-1186-4c51-b03a-57b92347ed7f\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-42ntb" Jul 24 14:36:33.652060 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.652037 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b9b98d06-1186-4c51-b03a-57b92347ed7f-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-42ntb\" (UID: \"b9b98d06-1186-4c51-b03a-57b92347ed7f\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-42ntb" Jul 24 14:36:33.653397 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.653379 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b9b98d06-1186-4c51-b03a-57b92347ed7f-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-42ntb\" (UID: \"b9b98d06-1186-4c51-b03a-57b92347ed7f\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-42ntb" Jul 24 14:36:33.658298 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.658278 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-675bf47bbf-4s7tz" Jul 24 14:36:33.660701 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.660675 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-675bf47bbf-4s7tz" Jul 24 14:36:33.673511 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.673485 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:33.755399 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.752456 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a2cb0201-6e6d-423d-9306-fd710eb92d33-ca-trust-extracted\") pod \"image-registry-564bdb68b6-2p99t\" (UID: \"a2cb0201-6e6d-423d-9306-fd710eb92d33\") " pod="openshift-image-registry/image-registry-564bdb68b6-2p99t" Jul 24 14:36:33.755399 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.752550 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a2cb0201-6e6d-423d-9306-fd710eb92d33-bound-sa-token\") pod \"image-registry-564bdb68b6-2p99t\" (UID: \"a2cb0201-6e6d-423d-9306-fd710eb92d33\") " pod="openshift-image-registry/image-registry-564bdb68b6-2p99t" Jul 24 14:36:33.755399 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.752656 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a2cb0201-6e6d-423d-9306-fd710eb92d33-installation-pull-secrets\") pod \"image-registry-564bdb68b6-2p99t\" (UID: \"a2cb0201-6e6d-423d-9306-fd710eb92d33\") " pod="openshift-image-registry/image-registry-564bdb68b6-2p99t" Jul 24 14:36:33.755399 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.752691 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8q2vh\" (UniqueName: \"kubernetes.io/projected/c3bb914e-61ec-4d87-a7b1-5ca7c30b94ce-kube-api-access-8q2vh\") pod \"downloads-7c97dc4555-phm58\" (UID: \"c3bb914e-61ec-4d87-a7b1-5ca7c30b94ce\") " pod="openshift-console/downloads-7c97dc4555-phm58" Jul 24 14:36:33.755399 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.752728 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a2cb0201-6e6d-423d-9306-fd710eb92d33-image-registry-private-configuration\") pod \"image-registry-564bdb68b6-2p99t\" (UID: \"a2cb0201-6e6d-423d-9306-fd710eb92d33\") " pod="openshift-image-registry/image-registry-564bdb68b6-2p99t" Jul 24 14:36:33.755399 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.752776 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a2cb0201-6e6d-423d-9306-fd710eb92d33-registry-tls\") pod \"image-registry-564bdb68b6-2p99t\" (UID: \"a2cb0201-6e6d-423d-9306-fd710eb92d33\") " pod="openshift-image-registry/image-registry-564bdb68b6-2p99t" Jul 24 14:36:33.755399 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.752818 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a2cb0201-6e6d-423d-9306-fd710eb92d33-trusted-ca\") pod \"image-registry-564bdb68b6-2p99t\" (UID: \"a2cb0201-6e6d-423d-9306-fd710eb92d33\") " pod="openshift-image-registry/image-registry-564bdb68b6-2p99t" Jul 24 14:36:33.755399 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.752855 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a2cb0201-6e6d-423d-9306-fd710eb92d33-registry-certificates\") pod \"image-registry-564bdb68b6-2p99t\" (UID: \"a2cb0201-6e6d-423d-9306-fd710eb92d33\") " pod="openshift-image-registry/image-registry-564bdb68b6-2p99t" Jul 24 14:36:33.755399 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.752883 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nvw9\" (UniqueName: \"kubernetes.io/projected/a2cb0201-6e6d-423d-9306-fd710eb92d33-kube-api-access-4nvw9\") pod \"image-registry-564bdb68b6-2p99t\" (UID: \"a2cb0201-6e6d-423d-9306-fd710eb92d33\") " pod="openshift-image-registry/image-registry-564bdb68b6-2p99t" Jul 24 14:36:33.755399 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.753608 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a2cb0201-6e6d-423d-9306-fd710eb92d33-ca-trust-extracted\") pod \"image-registry-564bdb68b6-2p99t\" (UID: \"a2cb0201-6e6d-423d-9306-fd710eb92d33\") " pod="openshift-image-registry/image-registry-564bdb68b6-2p99t" Jul 24 14:36:33.756265 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.756239 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a2cb0201-6e6d-423d-9306-fd710eb92d33-registry-certificates\") pod \"image-registry-564bdb68b6-2p99t\" (UID: \"a2cb0201-6e6d-423d-9306-fd710eb92d33\") " pod="openshift-image-registry/image-registry-564bdb68b6-2p99t" Jul 24 14:36:33.756706 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.756683 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a2cb0201-6e6d-423d-9306-fd710eb92d33-trusted-ca\") pod \"image-registry-564bdb68b6-2p99t\" (UID: \"a2cb0201-6e6d-423d-9306-fd710eb92d33\") " pod="openshift-image-registry/image-registry-564bdb68b6-2p99t" Jul 24 14:36:33.756900 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.756870 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a2cb0201-6e6d-423d-9306-fd710eb92d33-installation-pull-secrets\") pod \"image-registry-564bdb68b6-2p99t\" (UID: \"a2cb0201-6e6d-423d-9306-fd710eb92d33\") " pod="openshift-image-registry/image-registry-564bdb68b6-2p99t" Jul 24 14:36:33.757876 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.757843 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:33.758271 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.758254 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a2cb0201-6e6d-423d-9306-fd710eb92d33-image-registry-private-configuration\") pod \"image-registry-564bdb68b6-2p99t\" (UID: \"a2cb0201-6e6d-423d-9306-fd710eb92d33\") " pod="openshift-image-registry/image-registry-564bdb68b6-2p99t" Jul 24 14:36:33.758344 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.758255 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a2cb0201-6e6d-423d-9306-fd710eb92d33-registry-tls\") pod \"image-registry-564bdb68b6-2p99t\" (UID: \"a2cb0201-6e6d-423d-9306-fd710eb92d33\") " pod="openshift-image-registry/image-registry-564bdb68b6-2p99t" Jul 24 14:36:33.762716 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.762694 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a2cb0201-6e6d-423d-9306-fd710eb92d33-bound-sa-token\") pod \"image-registry-564bdb68b6-2p99t\" (UID: \"a2cb0201-6e6d-423d-9306-fd710eb92d33\") " pod="openshift-image-registry/image-registry-564bdb68b6-2p99t" Jul 24 14:36:33.762929 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.762906 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nvw9\" (UniqueName: \"kubernetes.io/projected/a2cb0201-6e6d-423d-9306-fd710eb92d33-kube-api-access-4nvw9\") pod \"image-registry-564bdb68b6-2p99t\" (UID: \"a2cb0201-6e6d-423d-9306-fd710eb92d33\") " pod="openshift-image-registry/image-registry-564bdb68b6-2p99t" Jul 24 14:36:33.776239 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.776216 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8q2vh\" (UniqueName: \"kubernetes.io/projected/c3bb914e-61ec-4d87-a7b1-5ca7c30b94ce-kube-api-access-8q2vh\") pod \"downloads-7c97dc4555-phm58\" (UID: \"c3bb914e-61ec-4d87-a7b1-5ca7c30b94ce\") " pod="openshift-console/downloads-7c97dc4555-phm58" Jul 24 14:36:33.790076 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.790053 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-42ntb" Jul 24 14:36:33.854023 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.853989 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a2cb0201-6e6d-423d-9306-fd710eb92d33-ca-trust-extracted\") pod \"a2cb0201-6e6d-423d-9306-fd710eb92d33\" (UID: \"a2cb0201-6e6d-423d-9306-fd710eb92d33\") " Jul 24 14:36:33.854023 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.854025 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4nvw9\" (UniqueName: \"kubernetes.io/projected/a2cb0201-6e6d-423d-9306-fd710eb92d33-kube-api-access-4nvw9\") pod \"a2cb0201-6e6d-423d-9306-fd710eb92d33\" (UID: \"a2cb0201-6e6d-423d-9306-fd710eb92d33\") " Jul 24 14:36:33.854249 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.854058 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a2cb0201-6e6d-423d-9306-fd710eb92d33-image-registry-private-configuration\") pod \"a2cb0201-6e6d-423d-9306-fd710eb92d33\" (UID: \"a2cb0201-6e6d-423d-9306-fd710eb92d33\") " Jul 24 14:36:33.854249 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.854089 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a2cb0201-6e6d-423d-9306-fd710eb92d33-installation-pull-secrets\") pod \"a2cb0201-6e6d-423d-9306-fd710eb92d33\" (UID: \"a2cb0201-6e6d-423d-9306-fd710eb92d33\") " Jul 24 14:36:33.854249 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.854118 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a2cb0201-6e6d-423d-9306-fd710eb92d33-registry-tls\") pod \"a2cb0201-6e6d-423d-9306-fd710eb92d33\" (UID: \"a2cb0201-6e6d-423d-9306-fd710eb92d33\") " Jul 24 14:36:33.854249 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.854137 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a2cb0201-6e6d-423d-9306-fd710eb92d33-registry-certificates\") pod \"a2cb0201-6e6d-423d-9306-fd710eb92d33\" (UID: \"a2cb0201-6e6d-423d-9306-fd710eb92d33\") " Jul 24 14:36:33.854249 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.854162 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a2cb0201-6e6d-423d-9306-fd710eb92d33-trusted-ca\") pod \"a2cb0201-6e6d-423d-9306-fd710eb92d33\" (UID: \"a2cb0201-6e6d-423d-9306-fd710eb92d33\") " Jul 24 14:36:33.854249 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.854189 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a2cb0201-6e6d-423d-9306-fd710eb92d33-bound-sa-token\") pod \"a2cb0201-6e6d-423d-9306-fd710eb92d33\" (UID: \"a2cb0201-6e6d-423d-9306-fd710eb92d33\") " Jul 24 14:36:33.854569 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.854311 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2cb0201-6e6d-423d-9306-fd710eb92d33-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "a2cb0201-6e6d-423d-9306-fd710eb92d33" (UID: "a2cb0201-6e6d-423d-9306-fd710eb92d33"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 14:36:33.854569 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.854444 2565 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a2cb0201-6e6d-423d-9306-fd710eb92d33-ca-trust-extracted\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 14:36:33.854933 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.854854 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2cb0201-6e6d-423d-9306-fd710eb92d33-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "a2cb0201-6e6d-423d-9306-fd710eb92d33" (UID: "a2cb0201-6e6d-423d-9306-fd710eb92d33"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 14:36:33.854933 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.854891 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2cb0201-6e6d-423d-9306-fd710eb92d33-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "a2cb0201-6e6d-423d-9306-fd710eb92d33" (UID: "a2cb0201-6e6d-423d-9306-fd710eb92d33"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 14:36:33.856811 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.856773 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2cb0201-6e6d-423d-9306-fd710eb92d33-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "a2cb0201-6e6d-423d-9306-fd710eb92d33" (UID: "a2cb0201-6e6d-423d-9306-fd710eb92d33"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 14:36:33.856911 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.856867 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2cb0201-6e6d-423d-9306-fd710eb92d33-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "a2cb0201-6e6d-423d-9306-fd710eb92d33" (UID: "a2cb0201-6e6d-423d-9306-fd710eb92d33"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 14:36:33.856911 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.856867 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2cb0201-6e6d-423d-9306-fd710eb92d33-kube-api-access-4nvw9" (OuterVolumeSpecName: "kube-api-access-4nvw9") pod "a2cb0201-6e6d-423d-9306-fd710eb92d33" (UID: "a2cb0201-6e6d-423d-9306-fd710eb92d33"). InnerVolumeSpecName "kube-api-access-4nvw9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 14:36:33.857020 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.856939 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2cb0201-6e6d-423d-9306-fd710eb92d33-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a2cb0201-6e6d-423d-9306-fd710eb92d33" (UID: "a2cb0201-6e6d-423d-9306-fd710eb92d33"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 14:36:33.857167 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.857147 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2cb0201-6e6d-423d-9306-fd710eb92d33-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "a2cb0201-6e6d-423d-9306-fd710eb92d33" (UID: "a2cb0201-6e6d-423d-9306-fd710eb92d33"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 14:36:33.899694 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.899666 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-phm58" Jul 24 14:36:33.947810 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.947681 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-42ntb"] Jul 24 14:36:33.949746 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:36:33.949722 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9b98d06_1186_4c51_b03a_57b92347ed7f.slice/crio-3fe4436d125c9a6d70ed862107df7b427fec5a4305367f0e3c1905e2f54bd18d WatchSource:0}: Error finding container 3fe4436d125c9a6d70ed862107df7b427fec5a4305367f0e3c1905e2f54bd18d: Status 404 returned error can't find the container with id 3fe4436d125c9a6d70ed862107df7b427fec5a4305367f0e3c1905e2f54bd18d Jul 24 14:36:33.954969 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.954943 2565 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a2cb0201-6e6d-423d-9306-fd710eb92d33-bound-sa-token\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 14:36:33.954969 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.954964 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4nvw9\" (UniqueName: \"kubernetes.io/projected/a2cb0201-6e6d-423d-9306-fd710eb92d33-kube-api-access-4nvw9\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 14:36:33.954969 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.954975 2565 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a2cb0201-6e6d-423d-9306-fd710eb92d33-image-registry-private-configuration\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 14:36:33.955204 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.954985 2565 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a2cb0201-6e6d-423d-9306-fd710eb92d33-installation-pull-secrets\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 14:36:33.955204 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.954993 2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a2cb0201-6e6d-423d-9306-fd710eb92d33-registry-tls\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 14:36:33.955204 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.955001 2565 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a2cb0201-6e6d-423d-9306-fd710eb92d33-registry-certificates\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 14:36:33.955204 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:33.955009 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a2cb0201-6e6d-423d-9306-fd710eb92d33-trusted-ca\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 14:36:34.075932 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:34.075898 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-phm58"] Jul 24 14:36:34.079517 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:36:34.079491 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3bb914e_61ec_4d87_a7b1_5ca7c30b94ce.slice/crio-91889a5cc28a5c80c5eb7d38744d67c473502d78dcbead73ae034806e7459051 WatchSource:0}: Error finding container 91889a5cc28a5c80c5eb7d38744d67c473502d78dcbead73ae034806e7459051: Status 404 returned error can't find the container with id 91889a5cc28a5c80c5eb7d38744d67c473502d78dcbead73ae034806e7459051 Jul 24 14:36:34.301942 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:34.301858 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:34.371364 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:34.371329 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:34.555610 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:34.555511 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-42ntb" event={"ID":"b9b98d06-1186-4c51-b03a-57b92347ed7f","Type":"ContainerStarted","Data":"3fe4436d125c9a6d70ed862107df7b427fec5a4305367f0e3c1905e2f54bd18d"} Jul 24 14:36:34.556761 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:34.556728 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-phm58" event={"ID":"c3bb914e-61ec-4d87-a7b1-5ca7c30b94ce","Type":"ContainerStarted","Data":"91889a5cc28a5c80c5eb7d38744d67c473502d78dcbead73ae034806e7459051"} Jul 24 14:36:34.556959 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:34.556777 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-564bdb68b6-2p99t" Jul 24 14:36:34.557318 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:34.557288 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-675bf47bbf-4s7tz" Jul 24 14:36:34.558587 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:34.558565 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-675bf47bbf-4s7tz" Jul 24 14:36:34.605795 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:34.605753 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-564bdb68b6-2p99t"] Jul 24 14:36:34.609282 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:34.609231 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-564bdb68b6-2p99t"] Jul 24 14:36:35.170242 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:35.170028 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2cb0201-6e6d-423d-9306-fd710eb92d33" path="/var/lib/kubelet/pods/a2cb0201-6e6d-423d-9306-fd710eb92d33/volumes" Jul 24 14:36:35.522386 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:35.522337 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:35.564378 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:35.564162 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-42ntb" event={"ID":"b9b98d06-1186-4c51-b03a-57b92347ed7f","Type":"ContainerStarted","Data":"d3804c6945e2196f6446d962b495d8074f1769de2629fdc72bc3d56ef1ba19d9"} Jul 24 14:36:35.582956 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:35.582900 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-42ntb" podStartSLOduration=1.183669998 podStartE2EDuration="2.582881118s" totalImagesPullingTime="1.39921112s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:36:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:36:35.582501579 +0000 UTC m=+108.863891162" watchObservedRunningTime="2026-07-24 14:36:35.582881118 +0000 UTC m=+108.864270680" Jul 24 14:36:35.681523 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:35.681432 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:35.706810 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:35.706778 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-mn8tw"] Jul 24 14:36:35.709810 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:35.709784 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-mn8tw" Jul 24 14:36:35.712304 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:35.712278 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 24 14:36:35.712304 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:35.712306 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-pqxmx\"" Jul 24 14:36:35.722315 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:35.722250 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-mn8tw"] Jul 24 14:36:35.747245 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:35.747209 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:35.767875 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:35.767840 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7c7acad7-ecd4-4230-aa04-b8ec9d0470d2-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-mn8tw\" (UID: \"7c7acad7-ecd4-4230-aa04-b8ec9d0470d2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-mn8tw" Jul 24 14:36:35.810865 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:35.810830 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:35.871462 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:35.871411 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7c7acad7-ecd4-4230-aa04-b8ec9d0470d2-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-mn8tw\" (UID: \"7c7acad7-ecd4-4230-aa04-b8ec9d0470d2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-mn8tw" Jul 24 14:36:35.871676 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:36:35.871563 2565 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 24 14:36:35.871676 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:36:35.871623 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c7acad7-ecd4-4230-aa04-b8ec9d0470d2-tls-certificates podName:7c7acad7-ecd4-4230-aa04-b8ec9d0470d2 nodeName:}" failed. No retries permitted until 2026-07-24 14:36:36.371609215 +0000 UTC m=+109.652998775 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/7c7acad7-ecd4-4230-aa04-b8ec9d0470d2-tls-certificates") pod "prometheus-operator-admission-webhook-7f8d78f54b-mn8tw" (UID: "7c7acad7-ecd4-4230-aa04-b8ec9d0470d2") : secret "prometheus-operator-admission-webhook-tls" not found Jul 24 14:36:36.035637 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:36.035563 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:36.374800 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:36.374757 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7c7acad7-ecd4-4230-aa04-b8ec9d0470d2-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-mn8tw\" (UID: \"7c7acad7-ecd4-4230-aa04-b8ec9d0470d2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-mn8tw" Jul 24 14:36:36.377420 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:36.377394 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7c7acad7-ecd4-4230-aa04-b8ec9d0470d2-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-mn8tw\" (UID: \"7c7acad7-ecd4-4230-aa04-b8ec9d0470d2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-mn8tw" Jul 24 14:36:36.576907 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:36.576872 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dvgnr\" (UID: \"9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c\") " pod="openshift-insights/insights-runtime-extractor-dvgnr" Jul 24 14:36:36.579250 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:36.579227 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dvgnr\" (UID: \"9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c\") " pod="openshift-insights/insights-runtime-extractor-dvgnr" Jul 24 14:36:36.620347 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:36.620310 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-mn8tw" Jul 24 14:36:36.706600 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:36.706528 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:36.707490 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:36.707449 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-bd8c9cdc5-j67g9"] Jul 24 14:36:36.710726 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:36.710703 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bd8c9cdc5-j67g9" Jul 24 14:36:36.713502 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:36.713284 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 24 14:36:36.713502 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:36.713337 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 24 14:36:36.714495 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:36.714122 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 24 14:36:36.714495 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:36.714293 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 24 14:36:36.714972 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:36.714653 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-stgc5\"" Jul 24 14:36:36.714972 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:36.714659 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 24 14:36:36.719903 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:36.719878 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bd8c9cdc5-j67g9"] Jul 24 14:36:36.728190 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:36.727541 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 24 14:36:36.768183 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:36.768149 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-mn8tw"] Jul 24 14:36:36.770928 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:36:36.770904 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c7acad7_ecd4_4230_aa04_b8ec9d0470d2.slice/crio-e3314cd694a4138ba3071a4e8b726951e5e40058caac1f8f39f65d9e5c0e367a WatchSource:0}: Error finding container e3314cd694a4138ba3071a4e8b726951e5e40058caac1f8f39f65d9e5c0e367a: Status 404 returned error can't find the container with id e3314cd694a4138ba3071a4e8b726951e5e40058caac1f8f39f65d9e5c0e367a Jul 24 14:36:36.774885 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:36.774859 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:36.779194 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:36.779175 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sxx7\" (UniqueName: \"kubernetes.io/projected/fbe74433-6ee1-4934-ac0a-db453ea78a8f-kube-api-access-7sxx7\") pod \"console-bd8c9cdc5-j67g9\" (UID: \"fbe74433-6ee1-4934-ac0a-db453ea78a8f\") " pod="openshift-console/console-bd8c9cdc5-j67g9" Jul 24 14:36:36.779274 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:36.779202 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fbe74433-6ee1-4934-ac0a-db453ea78a8f-console-serving-cert\") pod \"console-bd8c9cdc5-j67g9\" (UID: \"fbe74433-6ee1-4934-ac0a-db453ea78a8f\") " pod="openshift-console/console-bd8c9cdc5-j67g9" Jul 24 14:36:36.779274 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:36.779218 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fbe74433-6ee1-4934-ac0a-db453ea78a8f-console-oauth-config\") pod \"console-bd8c9cdc5-j67g9\" (UID: \"fbe74433-6ee1-4934-ac0a-db453ea78a8f\") " pod="openshift-console/console-bd8c9cdc5-j67g9" Jul 24 14:36:36.779274 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:36.779255 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fbe74433-6ee1-4934-ac0a-db453ea78a8f-oauth-serving-cert\") pod \"console-bd8c9cdc5-j67g9\" (UID: \"fbe74433-6ee1-4934-ac0a-db453ea78a8f\") " pod="openshift-console/console-bd8c9cdc5-j67g9" Jul 24 14:36:36.779372 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:36.779294 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fbe74433-6ee1-4934-ac0a-db453ea78a8f-service-ca\") pod \"console-bd8c9cdc5-j67g9\" (UID: \"fbe74433-6ee1-4934-ac0a-db453ea78a8f\") " pod="openshift-console/console-bd8c9cdc5-j67g9" Jul 24 14:36:36.779372 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:36.779327 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbe74433-6ee1-4934-ac0a-db453ea78a8f-trusted-ca-bundle\") pod \"console-bd8c9cdc5-j67g9\" (UID: \"fbe74433-6ee1-4934-ac0a-db453ea78a8f\") " pod="openshift-console/console-bd8c9cdc5-j67g9" Jul 24 14:36:36.779372 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:36.779359 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fbe74433-6ee1-4934-ac0a-db453ea78a8f-console-config\") pod \"console-bd8c9cdc5-j67g9\" (UID: \"fbe74433-6ee1-4934-ac0a-db453ea78a8f\") " pod="openshift-console/console-bd8c9cdc5-j67g9" Jul 24 14:36:36.822258 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:36.822229 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dvgnr" Jul 24 14:36:36.880158 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:36.879882 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbe74433-6ee1-4934-ac0a-db453ea78a8f-trusted-ca-bundle\") pod \"console-bd8c9cdc5-j67g9\" (UID: \"fbe74433-6ee1-4934-ac0a-db453ea78a8f\") " pod="openshift-console/console-bd8c9cdc5-j67g9" Jul 24 14:36:36.880158 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:36.879960 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fbe74433-6ee1-4934-ac0a-db453ea78a8f-console-config\") pod \"console-bd8c9cdc5-j67g9\" (UID: \"fbe74433-6ee1-4934-ac0a-db453ea78a8f\") " pod="openshift-console/console-bd8c9cdc5-j67g9" Jul 24 14:36:36.880158 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:36.880005 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sxx7\" (UniqueName: \"kubernetes.io/projected/fbe74433-6ee1-4934-ac0a-db453ea78a8f-kube-api-access-7sxx7\") pod \"console-bd8c9cdc5-j67g9\" (UID: \"fbe74433-6ee1-4934-ac0a-db453ea78a8f\") " pod="openshift-console/console-bd8c9cdc5-j67g9" Jul 24 14:36:36.880158 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:36.880041 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fbe74433-6ee1-4934-ac0a-db453ea78a8f-console-serving-cert\") pod \"console-bd8c9cdc5-j67g9\" (UID: \"fbe74433-6ee1-4934-ac0a-db453ea78a8f\") " pod="openshift-console/console-bd8c9cdc5-j67g9" Jul 24 14:36:36.880158 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:36.880067 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fbe74433-6ee1-4934-ac0a-db453ea78a8f-console-oauth-config\") pod \"console-bd8c9cdc5-j67g9\" (UID: \"fbe74433-6ee1-4934-ac0a-db453ea78a8f\") " pod="openshift-console/console-bd8c9cdc5-j67g9" Jul 24 14:36:36.880158 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:36.880118 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fbe74433-6ee1-4934-ac0a-db453ea78a8f-oauth-serving-cert\") pod \"console-bd8c9cdc5-j67g9\" (UID: \"fbe74433-6ee1-4934-ac0a-db453ea78a8f\") " pod="openshift-console/console-bd8c9cdc5-j67g9" Jul 24 14:36:36.880158 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:36.880151 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fbe74433-6ee1-4934-ac0a-db453ea78a8f-service-ca\") pod \"console-bd8c9cdc5-j67g9\" (UID: \"fbe74433-6ee1-4934-ac0a-db453ea78a8f\") " pod="openshift-console/console-bd8c9cdc5-j67g9" Jul 24 14:36:36.880988 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:36.880924 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fbe74433-6ee1-4934-ac0a-db453ea78a8f-service-ca\") pod \"console-bd8c9cdc5-j67g9\" (UID: \"fbe74433-6ee1-4934-ac0a-db453ea78a8f\") " pod="openshift-console/console-bd8c9cdc5-j67g9" Jul 24 14:36:36.882058 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:36.882029 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fbe74433-6ee1-4934-ac0a-db453ea78a8f-console-config\") pod \"console-bd8c9cdc5-j67g9\" (UID: \"fbe74433-6ee1-4934-ac0a-db453ea78a8f\") " pod="openshift-console/console-bd8c9cdc5-j67g9" Jul 24 14:36:36.882199 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:36.882150 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbe74433-6ee1-4934-ac0a-db453ea78a8f-trusted-ca-bundle\") pod \"console-bd8c9cdc5-j67g9\" (UID: \"fbe74433-6ee1-4934-ac0a-db453ea78a8f\") " pod="openshift-console/console-bd8c9cdc5-j67g9" Jul 24 14:36:36.882720 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:36.882677 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fbe74433-6ee1-4934-ac0a-db453ea78a8f-oauth-serving-cert\") pod \"console-bd8c9cdc5-j67g9\" (UID: \"fbe74433-6ee1-4934-ac0a-db453ea78a8f\") " pod="openshift-console/console-bd8c9cdc5-j67g9" Jul 24 14:36:36.885819 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:36.885776 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fbe74433-6ee1-4934-ac0a-db453ea78a8f-console-serving-cert\") pod \"console-bd8c9cdc5-j67g9\" (UID: \"fbe74433-6ee1-4934-ac0a-db453ea78a8f\") " pod="openshift-console/console-bd8c9cdc5-j67g9" Jul 24 14:36:36.886243 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:36.886190 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fbe74433-6ee1-4934-ac0a-db453ea78a8f-console-oauth-config\") pod \"console-bd8c9cdc5-j67g9\" (UID: \"fbe74433-6ee1-4934-ac0a-db453ea78a8f\") " pod="openshift-console/console-bd8c9cdc5-j67g9" Jul 24 14:36:36.892669 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:36.892644 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sxx7\" (UniqueName: \"kubernetes.io/projected/fbe74433-6ee1-4934-ac0a-db453ea78a8f-kube-api-access-7sxx7\") pod \"console-bd8c9cdc5-j67g9\" (UID: \"fbe74433-6ee1-4934-ac0a-db453ea78a8f\") " pod="openshift-console/console-bd8c9cdc5-j67g9" Jul 24 14:36:36.968675 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:36.968643 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dvgnr"] Jul 24 14:36:36.971506 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:36:36.971460 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c04eca5_ac13_4d0e_97d4_7de0e3bf2d4c.slice/crio-44e7716938b77e8ecfd7b48ef56d6f3ba44a2bbaf582502db5d3058dcbfee1cf WatchSource:0}: Error finding container 44e7716938b77e8ecfd7b48ef56d6f3ba44a2bbaf582502db5d3058dcbfee1cf: Status 404 returned error can't find the container with id 44e7716938b77e8ecfd7b48ef56d6f3ba44a2bbaf582502db5d3058dcbfee1cf Jul 24 14:36:37.027097 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:37.027059 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bd8c9cdc5-j67g9" Jul 24 14:36:37.180903 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:37.180834 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bd8c9cdc5-j67g9"] Jul 24 14:36:37.183705 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:36:37.183675 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbe74433_6ee1_4934_ac0a_db453ea78a8f.slice/crio-4cf31a119ce04d1f00888e61673fbccca7369f32deb1de4da8a6f0b016f8d79a WatchSource:0}: Error finding container 4cf31a119ce04d1f00888e61673fbccca7369f32deb1de4da8a6f0b016f8d79a: Status 404 returned error can't find the container with id 4cf31a119ce04d1f00888e61673fbccca7369f32deb1de4da8a6f0b016f8d79a Jul 24 14:36:37.536720 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:37.536638 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xz4zn" Jul 24 14:36:37.576400 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:37.576358 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bd8c9cdc5-j67g9" event={"ID":"fbe74433-6ee1-4934-ac0a-db453ea78a8f","Type":"ContainerStarted","Data":"4cf31a119ce04d1f00888e61673fbccca7369f32deb1de4da8a6f0b016f8d79a"} Jul 24 14:36:37.579413 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:37.579382 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dvgnr" event={"ID":"9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c","Type":"ContainerStarted","Data":"44e7716938b77e8ecfd7b48ef56d6f3ba44a2bbaf582502db5d3058dcbfee1cf"} Jul 24 14:36:37.582769 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:37.582742 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-mn8tw" event={"ID":"7c7acad7-ecd4-4230-aa04-b8ec9d0470d2","Type":"ContainerStarted","Data":"e3314cd694a4138ba3071a4e8b726951e5e40058caac1f8f39f65d9e5c0e367a"} Jul 24 14:36:39.594795 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:39.594732 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-mn8tw" event={"ID":"7c7acad7-ecd4-4230-aa04-b8ec9d0470d2","Type":"ContainerStarted","Data":"1168768ae4bb158ace6d0958adeb60eda4adba140968e8a8aaf4e75036c0637b"} Jul 24 14:36:39.595517 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:39.595495 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-mn8tw" Jul 24 14:36:39.600906 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:39.600881 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-mn8tw" Jul 24 14:36:39.611362 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:39.611315 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-mn8tw" podStartSLOduration=2.741378483 podStartE2EDuration="4.61129841s" totalImagesPullingTime="1.869919927s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:36:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:36:39.610808027 +0000 UTC m=+112.892197609" watchObservedRunningTime="2026-07-24 14:36:39.61129841 +0000 UTC m=+112.892687986" Jul 24 14:36:39.734338 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:39.734261 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:39.775940 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:39.775890 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-ld9dp"] Jul 24 14:36:39.780306 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:39.780282 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-ld9dp" Jul 24 14:36:39.784772 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:39.783657 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-nhgt2\"" Jul 24 14:36:39.784772 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:39.784174 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 24 14:36:39.784772 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:39.784408 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 24 14:36:39.784772 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:39.784628 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 24 14:36:39.784772 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:39.784748 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 24 14:36:39.785150 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:39.784925 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 24 14:36:39.792688 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:39.792522 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-ld9dp"] Jul 24 14:36:39.807686 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:39.807578 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/854346e2-5c61-49f2-9d0e-5661d26da305-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-ld9dp\" (UID: \"854346e2-5c61-49f2-9d0e-5661d26da305\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-ld9dp" Jul 24 14:36:39.807686 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:39.807619 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/854346e2-5c61-49f2-9d0e-5661d26da305-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-ld9dp\" (UID: \"854346e2-5c61-49f2-9d0e-5661d26da305\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-ld9dp" Jul 24 14:36:39.807686 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:39.807688 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4txb\" (UniqueName: \"kubernetes.io/projected/854346e2-5c61-49f2-9d0e-5661d26da305-kube-api-access-v4txb\") pod \"prometheus-operator-84d69f794d-ld9dp\" (UID: \"854346e2-5c61-49f2-9d0e-5661d26da305\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-ld9dp" Jul 24 14:36:39.807944 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:39.807722 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/854346e2-5c61-49f2-9d0e-5661d26da305-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-ld9dp\" (UID: \"854346e2-5c61-49f2-9d0e-5661d26da305\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-ld9dp" Jul 24 14:36:39.908873 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:39.908787 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/854346e2-5c61-49f2-9d0e-5661d26da305-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-ld9dp\" (UID: \"854346e2-5c61-49f2-9d0e-5661d26da305\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-ld9dp" Jul 24 14:36:39.908873 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:39.908835 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/854346e2-5c61-49f2-9d0e-5661d26da305-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-ld9dp\" (UID: \"854346e2-5c61-49f2-9d0e-5661d26da305\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-ld9dp" Jul 24 14:36:39.909088 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:39.908904 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4txb\" (UniqueName: \"kubernetes.io/projected/854346e2-5c61-49f2-9d0e-5661d26da305-kube-api-access-v4txb\") pod \"prometheus-operator-84d69f794d-ld9dp\" (UID: \"854346e2-5c61-49f2-9d0e-5661d26da305\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-ld9dp" Jul 24 14:36:39.909088 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:39.908943 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/854346e2-5c61-49f2-9d0e-5661d26da305-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-ld9dp\" (UID: \"854346e2-5c61-49f2-9d0e-5661d26da305\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-ld9dp" Jul 24 14:36:39.909088 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:36:39.909072 2565 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 24 14:36:39.909238 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:36:39.909134 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/854346e2-5c61-49f2-9d0e-5661d26da305-prometheus-operator-tls podName:854346e2-5c61-49f2-9d0e-5661d26da305 nodeName:}" failed. No retries permitted until 2026-07-24 14:36:40.409115848 +0000 UTC m=+113.690505413 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/854346e2-5c61-49f2-9d0e-5661d26da305-prometheus-operator-tls") pod "prometheus-operator-84d69f794d-ld9dp" (UID: "854346e2-5c61-49f2-9d0e-5661d26da305") : secret "prometheus-operator-tls" not found Jul 24 14:36:39.910567 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:39.910539 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/854346e2-5c61-49f2-9d0e-5661d26da305-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-ld9dp\" (UID: \"854346e2-5c61-49f2-9d0e-5661d26da305\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-ld9dp" Jul 24 14:36:39.913289 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:39.913263 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/854346e2-5c61-49f2-9d0e-5661d26da305-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-ld9dp\" (UID: \"854346e2-5c61-49f2-9d0e-5661d26da305\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-ld9dp" Jul 24 14:36:39.924136 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:39.924086 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4txb\" (UniqueName: \"kubernetes.io/projected/854346e2-5c61-49f2-9d0e-5661d26da305-kube-api-access-v4txb\") pod \"prometheus-operator-84d69f794d-ld9dp\" (UID: \"854346e2-5c61-49f2-9d0e-5661d26da305\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-ld9dp" Jul 24 14:36:40.075666 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:40.075631 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:40.142109 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:40.142055 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:40.414158 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:40.414119 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/854346e2-5c61-49f2-9d0e-5661d26da305-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-ld9dp\" (UID: \"854346e2-5c61-49f2-9d0e-5661d26da305\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-ld9dp" Jul 24 14:36:40.417671 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:40.417640 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/854346e2-5c61-49f2-9d0e-5661d26da305-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-ld9dp\" (UID: \"854346e2-5c61-49f2-9d0e-5661d26da305\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-ld9dp" Jul 24 14:36:40.697172 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:40.697059 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-ld9dp" Jul 24 14:36:42.394025 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:42.393990 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:42.494652 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:42.494609 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:44.008860 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:44.008833 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-ld9dp"] Jul 24 14:36:44.014589 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:36:44.014547 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod854346e2_5c61_49f2_9d0e_5661d26da305.slice/crio-cc941b6f4717a8f11bc73b7771e6c1dfc8b6fa397685459de6dc51319ba738ed WatchSource:0}: Error finding container cc941b6f4717a8f11bc73b7771e6c1dfc8b6fa397685459de6dc51319ba738ed: Status 404 returned error can't find the container with id cc941b6f4717a8f11bc73b7771e6c1dfc8b6fa397685459de6dc51319ba738ed Jul 24 14:36:44.618000 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:44.617917 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-ld9dp" event={"ID":"854346e2-5c61-49f2-9d0e-5661d26da305","Type":"ContainerStarted","Data":"cc941b6f4717a8f11bc73b7771e6c1dfc8b6fa397685459de6dc51319ba738ed"} Jul 24 14:36:44.619799 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:44.619766 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bd8c9cdc5-j67g9" event={"ID":"fbe74433-6ee1-4934-ac0a-db453ea78a8f","Type":"ContainerStarted","Data":"ef0d141915d3bb495c30a8e2bdd4403fe80e294a9cf98ee0cdfab42af2b864c6"} Jul 24 14:36:44.622347 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:44.622300 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dvgnr" event={"ID":"9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c","Type":"ContainerStarted","Data":"05635cfd4208153d7dfa1bf29aa6dc5da3b07c102b31a2d8d585eca956948fba"} Jul 24 14:36:44.643721 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:44.642126 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-bd8c9cdc5-j67g9" podStartSLOduration=1.959904219 podStartE2EDuration="8.642107712s" totalImagesPullingTime="6.682203493s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:36:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:36:44.641024884 +0000 UTC m=+117.922414465" watchObservedRunningTime="2026-07-24 14:36:44.642107712 +0000 UTC m=+117.923497275" Jul 24 14:36:45.318203 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:45.318126 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:45.388165 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:45.388116 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:46.109381 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:46.109308 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:46.632387 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:46.632346 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-ld9dp" event={"ID":"854346e2-5c61-49f2-9d0e-5661d26da305","Type":"ContainerStarted","Data":"61bc810526c95a559027baa86a89ad85b68bd61acd251e9e4ae2de7aec44f9ee"} Jul 24 14:36:46.743040 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:46.742996 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:46.846360 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:46.846324 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:46.956147 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:46.956062 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:47.027242 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:47.027211 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-bd8c9cdc5-j67g9" Jul 24 14:36:47.027428 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:47.027278 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-bd8c9cdc5-j67g9" Jul 24 14:36:47.032594 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:47.032573 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-bd8c9cdc5-j67g9" Jul 24 14:36:47.059807 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:47.059771 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:47.640402 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:47.640369 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-bd8c9cdc5-j67g9" Jul 24 14:36:49.126782 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:49.126741 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:49.228183 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:49.228068 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:51.504023 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:51.503961 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:51.601982 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:51.601936 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:54.510787 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:54.510752 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:54.612273 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:54.612239 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:55.645628 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:55.645572 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:55.665954 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:55.665917 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-phm58" event={"ID":"c3bb914e-61ec-4d87-a7b1-5ca7c30b94ce","Type":"ContainerStarted","Data":"34416a189f2d5320a3dc044df4661c378f90160c75ed9e937b45b74ddcd9f4f9"} Jul 24 14:36:55.666155 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:55.666131 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-phm58" Jul 24 14:36:55.669280 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:55.669246 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dvgnr" event={"ID":"9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c","Type":"ContainerStarted","Data":"9622cf3346ef4e64e52f5bb1300ad0aeba3c741c4d4e8aaef24731ba46c4c1fd"} Jul 24 14:36:55.671135 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:55.671104 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-ld9dp" event={"ID":"854346e2-5c61-49f2-9d0e-5661d26da305","Type":"ContainerStarted","Data":"59f8b66df61ba52ba7594899a1bcc7e8d760d0fe5bd3052d95a191a3e198a9ff"} Jul 24 14:36:55.682562 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:55.682536 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-phm58" Jul 24 14:36:55.686143 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:55.686095 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-phm58" podStartSLOduration=1.4305043849999999 podStartE2EDuration="22.68608131s" totalImagesPullingTime="21.255576925s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:36:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:36:55.685845403 +0000 UTC m=+128.967234988" watchObservedRunningTime="2026-07-24 14:36:55.68608131 +0000 UTC m=+128.967470891" Jul 24 14:36:55.708763 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:55.708731 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:55.913855 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:55.913757 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:56.011921 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:56.011875 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:56.880561 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:56.880525 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:56.962994 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:56.962477 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/208712d7-ea7e-430c-b730-e6bf290b2fcd-metrics-certs\") pod \"network-metrics-daemon-2jd76\" (UID: \"208712d7-ea7e-430c-b730-e6bf290b2fcd\") " pod="openshift-multus/network-metrics-daemon-2jd76" Jul 24 14:36:56.967640 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:56.967605 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/208712d7-ea7e-430c-b730-e6bf290b2fcd-metrics-certs\") pod \"network-metrics-daemon-2jd76\" (UID: \"208712d7-ea7e-430c-b730-e6bf290b2fcd\") " pod="openshift-multus/network-metrics-daemon-2jd76" Jul 24 14:36:56.992585 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:56.992394 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j79rf\"" Jul 24 14:36:56.999868 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:56.999841 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jd76" Jul 24 14:36:57.100684 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.100607 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:57.159609 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.154246 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-ld9dp" podStartSLOduration=16.413289403 podStartE2EDuration="18.154220215s" totalImagesPullingTime="1.740930812s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:36:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:36:55.722871638 +0000 UTC m=+129.004261221" watchObservedRunningTime="2026-07-24 14:36:57.154220215 +0000 UTC m=+130.435609797" Jul 24 14:36:57.159609 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.154440 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-qw4kn"] Jul 24 14:36:57.190501 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.190252 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:57.196526 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.195640 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-qw4kn" Jul 24 14:36:57.209439 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.209040 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 24 14:36:57.209439 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.209301 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 24 14:36:57.212550 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.210522 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 24 14:36:57.212550 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.210724 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-gxmps\"" Jul 24 14:36:57.226567 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.226442 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-h4d82"] Jul 24 14:36:57.256566 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.256348 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-qw4kn"] Jul 24 14:36:57.268136 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.256759 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-h4d82" Jul 24 14:36:57.268136 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.267909 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/854eb30d-5387-4733-bec3-abf1faee681e-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-qw4kn\" (UID: \"854eb30d-5387-4733-bec3-abf1faee681e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-qw4kn" Jul 24 14:36:57.268136 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.267959 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/854eb30d-5387-4733-bec3-abf1faee681e-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-qw4kn\" (UID: \"854eb30d-5387-4733-bec3-abf1faee681e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-qw4kn" Jul 24 14:36:57.268136 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.268012 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/854eb30d-5387-4733-bec3-abf1faee681e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-qw4kn\" (UID: \"854eb30d-5387-4733-bec3-abf1faee681e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-qw4kn" Jul 24 14:36:57.268136 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.268054 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/854eb30d-5387-4733-bec3-abf1faee681e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-qw4kn\" (UID: \"854eb30d-5387-4733-bec3-abf1faee681e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-qw4kn" Jul 24 14:36:57.268136 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.268090 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkcz9\" (UniqueName: \"kubernetes.io/projected/854eb30d-5387-4733-bec3-abf1faee681e-kube-api-access-hkcz9\") pod \"kube-state-metrics-56d9f944b4-qw4kn\" (UID: \"854eb30d-5387-4733-bec3-abf1faee681e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-qw4kn" Jul 24 14:36:57.268136 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.268124 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/854eb30d-5387-4733-bec3-abf1faee681e-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-qw4kn\" (UID: \"854eb30d-5387-4733-bec3-abf1faee681e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-qw4kn" Jul 24 14:36:57.277725 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.277695 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:57.283307 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.278026 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 24 14:36:57.283307 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.278026 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 24 14:36:57.283307 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.278190 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 24 14:36:57.283307 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.282122 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-r4h9z\"" Jul 24 14:36:57.316754 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.312711 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2jd76"] Jul 24 14:36:57.368879 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.368837 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/854eb30d-5387-4733-bec3-abf1faee681e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-qw4kn\" (UID: \"854eb30d-5387-4733-bec3-abf1faee681e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-qw4kn" Jul 24 14:36:57.369061 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.368929 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkcz9\" (UniqueName: \"kubernetes.io/projected/854eb30d-5387-4733-bec3-abf1faee681e-kube-api-access-hkcz9\") pod \"kube-state-metrics-56d9f944b4-qw4kn\" (UID: \"854eb30d-5387-4733-bec3-abf1faee681e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-qw4kn" Jul 24 14:36:57.369061 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.368958 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/af09bc92-6610-41b6-9722-164ee7d14f7c-sys\") pod \"node-exporter-h4d82\" (UID: \"af09bc92-6610-41b6-9722-164ee7d14f7c\") " pod="openshift-monitoring/node-exporter-h4d82" Jul 24 14:36:57.369061 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.368982 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/af09bc92-6610-41b6-9722-164ee7d14f7c-node-exporter-tls\") pod \"node-exporter-h4d82\" (UID: \"af09bc92-6610-41b6-9722-164ee7d14f7c\") " pod="openshift-monitoring/node-exporter-h4d82" Jul 24 14:36:57.369061 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.369006 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/af09bc92-6610-41b6-9722-164ee7d14f7c-node-exporter-wtmp\") pod \"node-exporter-h4d82\" (UID: \"af09bc92-6610-41b6-9722-164ee7d14f7c\") " pod="openshift-monitoring/node-exporter-h4d82" Jul 24 14:36:57.369061 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.369040 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/854eb30d-5387-4733-bec3-abf1faee681e-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-qw4kn\" (UID: \"854eb30d-5387-4733-bec3-abf1faee681e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-qw4kn" Jul 24 14:36:57.369332 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.369071 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/af09bc92-6610-41b6-9722-164ee7d14f7c-root\") pod \"node-exporter-h4d82\" (UID: \"af09bc92-6610-41b6-9722-164ee7d14f7c\") " pod="openshift-monitoring/node-exporter-h4d82" Jul 24 14:36:57.369332 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.369118 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/af09bc92-6610-41b6-9722-164ee7d14f7c-node-exporter-accelerators-collector-config\") pod \"node-exporter-h4d82\" (UID: \"af09bc92-6610-41b6-9722-164ee7d14f7c\") " pod="openshift-monitoring/node-exporter-h4d82" Jul 24 14:36:57.369332 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.369144 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-br2z9\" (UniqueName: \"kubernetes.io/projected/af09bc92-6610-41b6-9722-164ee7d14f7c-kube-api-access-br2z9\") pod \"node-exporter-h4d82\" (UID: \"af09bc92-6610-41b6-9722-164ee7d14f7c\") " pod="openshift-monitoring/node-exporter-h4d82" Jul 24 14:36:57.369332 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.369177 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/854eb30d-5387-4733-bec3-abf1faee681e-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-qw4kn\" (UID: \"854eb30d-5387-4733-bec3-abf1faee681e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-qw4kn" Jul 24 14:36:57.369332 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.369200 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af09bc92-6610-41b6-9722-164ee7d14f7c-metrics-client-ca\") pod \"node-exporter-h4d82\" (UID: \"af09bc92-6610-41b6-9722-164ee7d14f7c\") " pod="openshift-monitoring/node-exporter-h4d82" Jul 24 14:36:57.369332 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.369234 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/854eb30d-5387-4733-bec3-abf1faee681e-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-qw4kn\" (UID: \"854eb30d-5387-4733-bec3-abf1faee681e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-qw4kn" Jul 24 14:36:57.369332 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.369269 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/af09bc92-6610-41b6-9722-164ee7d14f7c-node-exporter-textfile\") pod \"node-exporter-h4d82\" (UID: \"af09bc92-6610-41b6-9722-164ee7d14f7c\") " pod="openshift-monitoring/node-exporter-h4d82" Jul 24 14:36:57.369332 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.369310 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/af09bc92-6610-41b6-9722-164ee7d14f7c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-h4d82\" (UID: \"af09bc92-6610-41b6-9722-164ee7d14f7c\") " pod="openshift-monitoring/node-exporter-h4d82" Jul 24 14:36:57.369735 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.369340 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/854eb30d-5387-4733-bec3-abf1faee681e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-qw4kn\" (UID: \"854eb30d-5387-4733-bec3-abf1faee681e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-qw4kn" Jul 24 14:36:57.370582 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.370551 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/854eb30d-5387-4733-bec3-abf1faee681e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-qw4kn\" (UID: \"854eb30d-5387-4733-bec3-abf1faee681e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-qw4kn" Jul 24 14:36:57.371269 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.371232 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/854eb30d-5387-4733-bec3-abf1faee681e-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-qw4kn\" (UID: \"854eb30d-5387-4733-bec3-abf1faee681e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-qw4kn" Jul 24 14:36:57.371374 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:36:57.371346 2565 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 24 14:36:57.371442 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:36:57.371400 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/854eb30d-5387-4733-bec3-abf1faee681e-kube-state-metrics-tls podName:854eb30d-5387-4733-bec3-abf1faee681e nodeName:}" failed. No retries permitted until 2026-07-24 14:36:57.871380606 +0000 UTC m=+131.152770171 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/854eb30d-5387-4733-bec3-abf1faee681e-kube-state-metrics-tls") pod "kube-state-metrics-56d9f944b4-qw4kn" (UID: "854eb30d-5387-4733-bec3-abf1faee681e") : secret "kube-state-metrics-tls" not found Jul 24 14:36:57.372184 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.372159 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/854eb30d-5387-4733-bec3-abf1faee681e-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-qw4kn\" (UID: \"854eb30d-5387-4733-bec3-abf1faee681e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-qw4kn" Jul 24 14:36:57.373172 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.373142 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/854eb30d-5387-4733-bec3-abf1faee681e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-qw4kn\" (UID: \"854eb30d-5387-4733-bec3-abf1faee681e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-qw4kn" Jul 24 14:36:57.385137 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.385100 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkcz9\" (UniqueName: \"kubernetes.io/projected/854eb30d-5387-4733-bec3-abf1faee681e-kube-api-access-hkcz9\") pod \"kube-state-metrics-56d9f944b4-qw4kn\" (UID: \"854eb30d-5387-4733-bec3-abf1faee681e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-qw4kn" Jul 24 14:36:57.386593 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.386559 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:57.470230 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.469844 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/af09bc92-6610-41b6-9722-164ee7d14f7c-node-exporter-accelerators-collector-config\") pod \"node-exporter-h4d82\" (UID: \"af09bc92-6610-41b6-9722-164ee7d14f7c\") " pod="openshift-monitoring/node-exporter-h4d82" Jul 24 14:36:57.470230 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.469890 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-br2z9\" (UniqueName: \"kubernetes.io/projected/af09bc92-6610-41b6-9722-164ee7d14f7c-kube-api-access-br2z9\") pod \"node-exporter-h4d82\" (UID: \"af09bc92-6610-41b6-9722-164ee7d14f7c\") " pod="openshift-monitoring/node-exporter-h4d82" Jul 24 14:36:57.470230 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.469922 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af09bc92-6610-41b6-9722-164ee7d14f7c-metrics-client-ca\") pod \"node-exporter-h4d82\" (UID: \"af09bc92-6610-41b6-9722-164ee7d14f7c\") " pod="openshift-monitoring/node-exporter-h4d82" Jul 24 14:36:57.470230 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.469971 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/af09bc92-6610-41b6-9722-164ee7d14f7c-node-exporter-textfile\") pod \"node-exporter-h4d82\" (UID: \"af09bc92-6610-41b6-9722-164ee7d14f7c\") " pod="openshift-monitoring/node-exporter-h4d82" Jul 24 14:36:57.470230 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.470007 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/af09bc92-6610-41b6-9722-164ee7d14f7c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-h4d82\" (UID: \"af09bc92-6610-41b6-9722-164ee7d14f7c\") " pod="openshift-monitoring/node-exporter-h4d82" Jul 24 14:36:57.470230 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.470043 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/af09bc92-6610-41b6-9722-164ee7d14f7c-sys\") pod \"node-exporter-h4d82\" (UID: \"af09bc92-6610-41b6-9722-164ee7d14f7c\") " pod="openshift-monitoring/node-exporter-h4d82" Jul 24 14:36:57.470230 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.470068 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/af09bc92-6610-41b6-9722-164ee7d14f7c-node-exporter-tls\") pod \"node-exporter-h4d82\" (UID: \"af09bc92-6610-41b6-9722-164ee7d14f7c\") " pod="openshift-monitoring/node-exporter-h4d82" Jul 24 14:36:57.470230 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.470091 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/af09bc92-6610-41b6-9722-164ee7d14f7c-node-exporter-wtmp\") pod \"node-exporter-h4d82\" (UID: \"af09bc92-6610-41b6-9722-164ee7d14f7c\") " pod="openshift-monitoring/node-exporter-h4d82" Jul 24 14:36:57.470230 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.470127 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/af09bc92-6610-41b6-9722-164ee7d14f7c-root\") pod \"node-exporter-h4d82\" (UID: \"af09bc92-6610-41b6-9722-164ee7d14f7c\") " pod="openshift-monitoring/node-exporter-h4d82" Jul 24 14:36:57.470230 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.470212 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/af09bc92-6610-41b6-9722-164ee7d14f7c-root\") pod \"node-exporter-h4d82\" (UID: \"af09bc92-6610-41b6-9722-164ee7d14f7c\") " pod="openshift-monitoring/node-exporter-h4d82" Jul 24 14:36:57.470861 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.470812 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/af09bc92-6610-41b6-9722-164ee7d14f7c-node-exporter-accelerators-collector-config\") pod \"node-exporter-h4d82\" (UID: \"af09bc92-6610-41b6-9722-164ee7d14f7c\") " pod="openshift-monitoring/node-exporter-h4d82" Jul 24 14:36:57.472011 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.471559 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af09bc92-6610-41b6-9722-164ee7d14f7c-metrics-client-ca\") pod \"node-exporter-h4d82\" (UID: \"af09bc92-6610-41b6-9722-164ee7d14f7c\") " pod="openshift-monitoring/node-exporter-h4d82" Jul 24 14:36:57.472011 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.471788 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/af09bc92-6610-41b6-9722-164ee7d14f7c-node-exporter-textfile\") pod \"node-exporter-h4d82\" (UID: \"af09bc92-6610-41b6-9722-164ee7d14f7c\") " pod="openshift-monitoring/node-exporter-h4d82" Jul 24 14:36:57.472340 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:36:57.472259 2565 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 24 14:36:57.472340 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:36:57.472323 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af09bc92-6610-41b6-9722-164ee7d14f7c-node-exporter-tls podName:af09bc92-6610-41b6-9722-164ee7d14f7c nodeName:}" failed. No retries permitted until 2026-07-24 14:36:57.972302994 +0000 UTC m=+131.253692560 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/af09bc92-6610-41b6-9722-164ee7d14f7c-node-exporter-tls") pod "node-exporter-h4d82" (UID: "af09bc92-6610-41b6-9722-164ee7d14f7c") : secret "node-exporter-tls" not found Jul 24 14:36:57.472561 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.472542 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/af09bc92-6610-41b6-9722-164ee7d14f7c-sys\") pod \"node-exporter-h4d82\" (UID: \"af09bc92-6610-41b6-9722-164ee7d14f7c\") " pod="openshift-monitoring/node-exporter-h4d82" Jul 24 14:36:57.472697 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.472679 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/af09bc92-6610-41b6-9722-164ee7d14f7c-node-exporter-wtmp\") pod \"node-exporter-h4d82\" (UID: \"af09bc92-6610-41b6-9722-164ee7d14f7c\") " pod="openshift-monitoring/node-exporter-h4d82" Jul 24 14:36:57.483328 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.483279 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/af09bc92-6610-41b6-9722-164ee7d14f7c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-h4d82\" (UID: \"af09bc92-6610-41b6-9722-164ee7d14f7c\") " pod="openshift-monitoring/node-exporter-h4d82" Jul 24 14:36:57.484496 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.483987 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-br2z9\" (UniqueName: \"kubernetes.io/projected/af09bc92-6610-41b6-9722-164ee7d14f7c-kube-api-access-br2z9\") pod \"node-exporter-h4d82\" (UID: \"af09bc92-6610-41b6-9722-164ee7d14f7c\") " pod="openshift-monitoring/node-exporter-h4d82" Jul 24 14:36:57.487165 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.486332 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:57.595197 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.595154 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:57.685887 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.685845 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2jd76" event={"ID":"208712d7-ea7e-430c-b730-e6bf290b2fcd","Type":"ContainerStarted","Data":"17cab980d68de2851f154e8f685b5eb24a27ab8d30eba5c2f99d3a0ae4c0db18"} Jul 24 14:36:57.686278 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.686250 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:57.874090 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.873629 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/854eb30d-5387-4733-bec3-abf1faee681e-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-qw4kn\" (UID: \"854eb30d-5387-4733-bec3-abf1faee681e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-qw4kn" Jul 24 14:36:57.877310 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.877277 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/854eb30d-5387-4733-bec3-abf1faee681e-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-qw4kn\" (UID: \"854eb30d-5387-4733-bec3-abf1faee681e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-qw4kn" Jul 24 14:36:57.978215 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.975036 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/af09bc92-6610-41b6-9722-164ee7d14f7c-node-exporter-tls\") pod \"node-exporter-h4d82\" (UID: \"af09bc92-6610-41b6-9722-164ee7d14f7c\") " pod="openshift-monitoring/node-exporter-h4d82" Jul 24 14:36:57.987035 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:57.986896 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/af09bc92-6610-41b6-9722-164ee7d14f7c-node-exporter-tls\") pod \"node-exporter-h4d82\" (UID: \"af09bc92-6610-41b6-9722-164ee7d14f7c\") " pod="openshift-monitoring/node-exporter-h4d82" Jul 24 14:36:58.123678 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:58.123397 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:58.129075 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:58.128992 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-qw4kn" Jul 24 14:36:58.188272 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:58.188223 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-h4d82" Jul 24 14:36:58.213355 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:58.213292 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:58.337765 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:58.337662 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:36:58.436862 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:36:58.436765 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:37:00.086907 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:00.086866 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:37:00.160859 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:00.160819 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6fbdd56d86-x96wc"] Jul 24 14:37:00.182199 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:00.182165 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:37:00.311500 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:00.311443 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:37:00.363691 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:00.363615 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6fbdd56d86-x96wc"] Jul 24 14:37:00.363860 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:00.363767 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6fbdd56d86-x96wc" Jul 24 14:37:00.366402 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:00.366357 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 24 14:37:00.366583 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:00.366554 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 24 14:37:00.366701 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:00.366631 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-c73kp3t5s2sl3\"" Jul 24 14:37:00.366802 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:00.366780 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-g94ww\"" Jul 24 14:37:00.366907 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:00.366815 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 24 14:37:00.366907 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:00.366817 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 24 14:37:00.367166 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:00.367140 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 24 14:37:00.381451 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:00.381422 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:37:00.503394 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:00.503287 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5e49aa5d-709d-4c1d-9a82-6348f60cdc06-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6fbdd56d86-x96wc\" (UID: \"5e49aa5d-709d-4c1d-9a82-6348f60cdc06\") " pod="openshift-monitoring/thanos-querier-6fbdd56d86-x96wc" Jul 24 14:37:00.503394 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:00.503338 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5e49aa5d-709d-4c1d-9a82-6348f60cdc06-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6fbdd56d86-x96wc\" (UID: \"5e49aa5d-709d-4c1d-9a82-6348f60cdc06\") " pod="openshift-monitoring/thanos-querier-6fbdd56d86-x96wc" Jul 24 14:37:00.503716 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:00.503405 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e49aa5d-709d-4c1d-9a82-6348f60cdc06-metrics-client-ca\") pod \"thanos-querier-6fbdd56d86-x96wc\" (UID: \"5e49aa5d-709d-4c1d-9a82-6348f60cdc06\") " pod="openshift-monitoring/thanos-querier-6fbdd56d86-x96wc" Jul 24 14:37:00.503716 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:00.503491 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5e49aa5d-709d-4c1d-9a82-6348f60cdc06-secret-grpc-tls\") pod \"thanos-querier-6fbdd56d86-x96wc\" (UID: \"5e49aa5d-709d-4c1d-9a82-6348f60cdc06\") " pod="openshift-monitoring/thanos-querier-6fbdd56d86-x96wc" Jul 24 14:37:00.503716 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:00.503523 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5e49aa5d-709d-4c1d-9a82-6348f60cdc06-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6fbdd56d86-x96wc\" (UID: \"5e49aa5d-709d-4c1d-9a82-6348f60cdc06\") " pod="openshift-monitoring/thanos-querier-6fbdd56d86-x96wc" Jul 24 14:37:00.503716 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:00.503662 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5e49aa5d-709d-4c1d-9a82-6348f60cdc06-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6fbdd56d86-x96wc\" (UID: \"5e49aa5d-709d-4c1d-9a82-6348f60cdc06\") " pod="openshift-monitoring/thanos-querier-6fbdd56d86-x96wc" Jul 24 14:37:00.503716 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:00.503705 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndpp8\" (UniqueName: \"kubernetes.io/projected/5e49aa5d-709d-4c1d-9a82-6348f60cdc06-kube-api-access-ndpp8\") pod \"thanos-querier-6fbdd56d86-x96wc\" (UID: \"5e49aa5d-709d-4c1d-9a82-6348f60cdc06\") " pod="openshift-monitoring/thanos-querier-6fbdd56d86-x96wc" Jul 24 14:37:00.503948 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:00.503736 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5e49aa5d-709d-4c1d-9a82-6348f60cdc06-secret-thanos-querier-tls\") pod \"thanos-querier-6fbdd56d86-x96wc\" (UID: \"5e49aa5d-709d-4c1d-9a82-6348f60cdc06\") " pod="openshift-monitoring/thanos-querier-6fbdd56d86-x96wc" Jul 24 14:37:00.605057 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:00.605011 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e49aa5d-709d-4c1d-9a82-6348f60cdc06-metrics-client-ca\") pod \"thanos-querier-6fbdd56d86-x96wc\" (UID: \"5e49aa5d-709d-4c1d-9a82-6348f60cdc06\") " pod="openshift-monitoring/thanos-querier-6fbdd56d86-x96wc" Jul 24 14:37:00.605233 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:00.605078 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5e49aa5d-709d-4c1d-9a82-6348f60cdc06-secret-grpc-tls\") pod \"thanos-querier-6fbdd56d86-x96wc\" (UID: \"5e49aa5d-709d-4c1d-9a82-6348f60cdc06\") " pod="openshift-monitoring/thanos-querier-6fbdd56d86-x96wc" Jul 24 14:37:00.605233 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:00.605108 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5e49aa5d-709d-4c1d-9a82-6348f60cdc06-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6fbdd56d86-x96wc\" (UID: \"5e49aa5d-709d-4c1d-9a82-6348f60cdc06\") " pod="openshift-monitoring/thanos-querier-6fbdd56d86-x96wc" Jul 24 14:37:00.605233 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:00.605169 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5e49aa5d-709d-4c1d-9a82-6348f60cdc06-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6fbdd56d86-x96wc\" (UID: \"5e49aa5d-709d-4c1d-9a82-6348f60cdc06\") " pod="openshift-monitoring/thanos-querier-6fbdd56d86-x96wc" Jul 24 14:37:00.605233 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:00.605189 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndpp8\" (UniqueName: \"kubernetes.io/projected/5e49aa5d-709d-4c1d-9a82-6348f60cdc06-kube-api-access-ndpp8\") pod \"thanos-querier-6fbdd56d86-x96wc\" (UID: \"5e49aa5d-709d-4c1d-9a82-6348f60cdc06\") " pod="openshift-monitoring/thanos-querier-6fbdd56d86-x96wc" Jul 24 14:37:00.605233 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:00.605215 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5e49aa5d-709d-4c1d-9a82-6348f60cdc06-secret-thanos-querier-tls\") pod \"thanos-querier-6fbdd56d86-x96wc\" (UID: \"5e49aa5d-709d-4c1d-9a82-6348f60cdc06\") " pod="openshift-monitoring/thanos-querier-6fbdd56d86-x96wc" Jul 24 14:37:00.605562 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:00.605258 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5e49aa5d-709d-4c1d-9a82-6348f60cdc06-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6fbdd56d86-x96wc\" (UID: \"5e49aa5d-709d-4c1d-9a82-6348f60cdc06\") " pod="openshift-monitoring/thanos-querier-6fbdd56d86-x96wc" Jul 24 14:37:00.605562 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:00.605290 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5e49aa5d-709d-4c1d-9a82-6348f60cdc06-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6fbdd56d86-x96wc\" (UID: \"5e49aa5d-709d-4c1d-9a82-6348f60cdc06\") " pod="openshift-monitoring/thanos-querier-6fbdd56d86-x96wc" Jul 24 14:37:00.610325 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:00.609916 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5e49aa5d-709d-4c1d-9a82-6348f60cdc06-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6fbdd56d86-x96wc\" (UID: \"5e49aa5d-709d-4c1d-9a82-6348f60cdc06\") " pod="openshift-monitoring/thanos-querier-6fbdd56d86-x96wc" Jul 24 14:37:00.614572 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:00.610833 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5e49aa5d-709d-4c1d-9a82-6348f60cdc06-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6fbdd56d86-x96wc\" (UID: \"5e49aa5d-709d-4c1d-9a82-6348f60cdc06\") " pod="openshift-monitoring/thanos-querier-6fbdd56d86-x96wc" Jul 24 14:37:00.615930 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:00.614770 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e49aa5d-709d-4c1d-9a82-6348f60cdc06-metrics-client-ca\") pod \"thanos-querier-6fbdd56d86-x96wc\" (UID: \"5e49aa5d-709d-4c1d-9a82-6348f60cdc06\") " pod="openshift-monitoring/thanos-querier-6fbdd56d86-x96wc" Jul 24 14:37:00.617892 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:00.617186 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5e49aa5d-709d-4c1d-9a82-6348f60cdc06-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6fbdd56d86-x96wc\" (UID: \"5e49aa5d-709d-4c1d-9a82-6348f60cdc06\") " pod="openshift-monitoring/thanos-querier-6fbdd56d86-x96wc" Jul 24 14:37:00.617892 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:00.617365 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5e49aa5d-709d-4c1d-9a82-6348f60cdc06-secret-grpc-tls\") pod \"thanos-querier-6fbdd56d86-x96wc\" (UID: \"5e49aa5d-709d-4c1d-9a82-6348f60cdc06\") " pod="openshift-monitoring/thanos-querier-6fbdd56d86-x96wc" Jul 24 14:37:00.617892 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:00.617375 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5e49aa5d-709d-4c1d-9a82-6348f60cdc06-secret-thanos-querier-tls\") pod \"thanos-querier-6fbdd56d86-x96wc\" (UID: \"5e49aa5d-709d-4c1d-9a82-6348f60cdc06\") " pod="openshift-monitoring/thanos-querier-6fbdd56d86-x96wc" Jul 24 14:37:00.619398 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:00.619348 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5e49aa5d-709d-4c1d-9a82-6348f60cdc06-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6fbdd56d86-x96wc\" (UID: \"5e49aa5d-709d-4c1d-9a82-6348f60cdc06\") " pod="openshift-monitoring/thanos-querier-6fbdd56d86-x96wc" Jul 24 14:37:00.621969 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:00.621948 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndpp8\" (UniqueName: \"kubernetes.io/projected/5e49aa5d-709d-4c1d-9a82-6348f60cdc06-kube-api-access-ndpp8\") pod \"thanos-querier-6fbdd56d86-x96wc\" (UID: \"5e49aa5d-709d-4c1d-9a82-6348f60cdc06\") " pod="openshift-monitoring/thanos-querier-6fbdd56d86-x96wc" Jul 24 14:37:00.675127 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:00.675051 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6fbdd56d86-x96wc" Jul 24 14:37:01.370742 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:01.370682 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-qw4kn"] Jul 24 14:37:01.373874 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:37:01.373835 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod854eb30d_5387_4733_bec3_abf1faee681e.slice/crio-f535f30fcc132a4e985851dcb38178358c9421eda8b6a4509520d63e9ad4563a WatchSource:0}: Error finding container f535f30fcc132a4e985851dcb38178358c9421eda8b6a4509520d63e9ad4563a: Status 404 returned error can't find the container with id f535f30fcc132a4e985851dcb38178358c9421eda8b6a4509520d63e9ad4563a Jul 24 14:37:01.401606 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:01.401498 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6fbdd56d86-x96wc"] Jul 24 14:37:01.404095 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:37:01.404066 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e49aa5d_709d_4c1d_9a82_6348f60cdc06.slice/crio-32fe7da073f8d1e2a8d3572852f740c172e117e69fb2d0835c73dab4c1228765 WatchSource:0}: Error finding container 32fe7da073f8d1e2a8d3572852f740c172e117e69fb2d0835c73dab4c1228765: Status 404 returned error can't find the container with id 32fe7da073f8d1e2a8d3572852f740c172e117e69fb2d0835c73dab4c1228765 Jul 24 14:37:01.710158 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:01.710072 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2jd76" event={"ID":"208712d7-ea7e-430c-b730-e6bf290b2fcd","Type":"ContainerStarted","Data":"fd2fcec726bc37bdd1ad7a6dd50772cd9c91c37d9e7a10fe8b663b9c3f1e91cc"} Jul 24 14:37:01.710158 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:01.710132 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2jd76" event={"ID":"208712d7-ea7e-430c-b730-e6bf290b2fcd","Type":"ContainerStarted","Data":"16aae79bd9e2dd2b326d5f828e4b2b4d447288621536d0bd5db3b2d2fd702a94"} Jul 24 14:37:01.712288 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:01.712258 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-qw4kn" event={"ID":"854eb30d-5387-4733-bec3-abf1faee681e","Type":"ContainerStarted","Data":"f535f30fcc132a4e985851dcb38178358c9421eda8b6a4509520d63e9ad4563a"} Jul 24 14:37:01.714197 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:01.714123 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6fbdd56d86-x96wc" event={"ID":"5e49aa5d-709d-4c1d-9a82-6348f60cdc06","Type":"ContainerStarted","Data":"32fe7da073f8d1e2a8d3572852f740c172e117e69fb2d0835c73dab4c1228765"} Jul 24 14:37:01.715886 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:01.715857 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h4d82" event={"ID":"af09bc92-6610-41b6-9722-164ee7d14f7c","Type":"ContainerStarted","Data":"ebcb89d65850e4af42cf8f14a4e502a923ae46f2c15f41e1cd6d7c9522712986"} Jul 24 14:37:01.719111 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:01.719033 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dvgnr" event={"ID":"9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c","Type":"ContainerStarted","Data":"a29542be1d56072e09950235e3fe318fe668318f09b3d1a608c0402468abdc90"} Jul 24 14:37:01.731747 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:01.731696 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2jd76" podStartSLOduration=130.843388178 podStartE2EDuration="2m14.731678033s" totalImagesPullingTime="3.888289855s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:34:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:37:01.730427612 +0000 UTC m=+135.011817194" watchObservedRunningTime="2026-07-24 14:37:01.731678033 +0000 UTC m=+135.013067615" Jul 24 14:37:01.754077 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:01.754020 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-dvgnr" podStartSLOduration=33.668781674 podStartE2EDuration="57.753999485s" totalImagesPullingTime="24.085217811s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:36:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:37:01.751719353 +0000 UTC m=+135.033108936" watchObservedRunningTime="2026-07-24 14:37:01.753999485 +0000 UTC m=+135.035389067" Jul 24 14:37:01.889523 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:01.889461 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:37:01.967362 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:01.967286 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:37:02.123752 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:02.123677 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6fdfd7f6fd-9kvxm"] Jul 24 14:37:02.150017 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:02.145636 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fdfd7f6fd-9kvxm"] Jul 24 14:37:02.150017 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:02.145767 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fdfd7f6fd-9kvxm" Jul 24 14:37:02.222841 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:02.222389 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37f8679f-7415-4d50-ad53-bbd16f5df42a-console-serving-cert\") pod \"console-6fdfd7f6fd-9kvxm\" (UID: \"37f8679f-7415-4d50-ad53-bbd16f5df42a\") " pod="openshift-console/console-6fdfd7f6fd-9kvxm" Jul 24 14:37:02.222841 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:02.222438 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37f8679f-7415-4d50-ad53-bbd16f5df42a-console-oauth-config\") pod \"console-6fdfd7f6fd-9kvxm\" (UID: \"37f8679f-7415-4d50-ad53-bbd16f5df42a\") " pod="openshift-console/console-6fdfd7f6fd-9kvxm" Jul 24 14:37:02.222841 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:02.222488 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37f8679f-7415-4d50-ad53-bbd16f5df42a-console-config\") pod \"console-6fdfd7f6fd-9kvxm\" (UID: \"37f8679f-7415-4d50-ad53-bbd16f5df42a\") " pod="openshift-console/console-6fdfd7f6fd-9kvxm" Jul 24 14:37:02.222841 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:02.222518 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37f8679f-7415-4d50-ad53-bbd16f5df42a-service-ca\") pod \"console-6fdfd7f6fd-9kvxm\" (UID: \"37f8679f-7415-4d50-ad53-bbd16f5df42a\") " pod="openshift-console/console-6fdfd7f6fd-9kvxm" Jul 24 14:37:02.222841 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:02.222590 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37f8679f-7415-4d50-ad53-bbd16f5df42a-oauth-serving-cert\") pod \"console-6fdfd7f6fd-9kvxm\" (UID: \"37f8679f-7415-4d50-ad53-bbd16f5df42a\") " pod="openshift-console/console-6fdfd7f6fd-9kvxm" Jul 24 14:37:02.222841 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:02.222623 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqcnf\" (UniqueName: \"kubernetes.io/projected/37f8679f-7415-4d50-ad53-bbd16f5df42a-kube-api-access-jqcnf\") pod \"console-6fdfd7f6fd-9kvxm\" (UID: \"37f8679f-7415-4d50-ad53-bbd16f5df42a\") " pod="openshift-console/console-6fdfd7f6fd-9kvxm" Jul 24 14:37:02.222841 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:02.222665 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37f8679f-7415-4d50-ad53-bbd16f5df42a-trusted-ca-bundle\") pod \"console-6fdfd7f6fd-9kvxm\" (UID: \"37f8679f-7415-4d50-ad53-bbd16f5df42a\") " pod="openshift-console/console-6fdfd7f6fd-9kvxm" Jul 24 14:37:02.323789 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:02.323755 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37f8679f-7415-4d50-ad53-bbd16f5df42a-oauth-serving-cert\") pod \"console-6fdfd7f6fd-9kvxm\" (UID: \"37f8679f-7415-4d50-ad53-bbd16f5df42a\") " pod="openshift-console/console-6fdfd7f6fd-9kvxm" Jul 24 14:37:02.323789 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:02.323801 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqcnf\" (UniqueName: \"kubernetes.io/projected/37f8679f-7415-4d50-ad53-bbd16f5df42a-kube-api-access-jqcnf\") pod \"console-6fdfd7f6fd-9kvxm\" (UID: \"37f8679f-7415-4d50-ad53-bbd16f5df42a\") " pod="openshift-console/console-6fdfd7f6fd-9kvxm" Jul 24 14:37:02.324139 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:02.323839 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37f8679f-7415-4d50-ad53-bbd16f5df42a-trusted-ca-bundle\") pod \"console-6fdfd7f6fd-9kvxm\" (UID: \"37f8679f-7415-4d50-ad53-bbd16f5df42a\") " pod="openshift-console/console-6fdfd7f6fd-9kvxm" Jul 24 14:37:02.324139 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:02.323898 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37f8679f-7415-4d50-ad53-bbd16f5df42a-console-serving-cert\") pod \"console-6fdfd7f6fd-9kvxm\" (UID: \"37f8679f-7415-4d50-ad53-bbd16f5df42a\") " pod="openshift-console/console-6fdfd7f6fd-9kvxm" Jul 24 14:37:02.324139 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:02.323923 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37f8679f-7415-4d50-ad53-bbd16f5df42a-console-oauth-config\") pod \"console-6fdfd7f6fd-9kvxm\" (UID: \"37f8679f-7415-4d50-ad53-bbd16f5df42a\") " pod="openshift-console/console-6fdfd7f6fd-9kvxm" Jul 24 14:37:02.324139 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:02.323955 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37f8679f-7415-4d50-ad53-bbd16f5df42a-console-config\") pod \"console-6fdfd7f6fd-9kvxm\" (UID: \"37f8679f-7415-4d50-ad53-bbd16f5df42a\") " pod="openshift-console/console-6fdfd7f6fd-9kvxm" Jul 24 14:37:02.324139 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:02.323978 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37f8679f-7415-4d50-ad53-bbd16f5df42a-service-ca\") pod \"console-6fdfd7f6fd-9kvxm\" (UID: \"37f8679f-7415-4d50-ad53-bbd16f5df42a\") " pod="openshift-console/console-6fdfd7f6fd-9kvxm" Jul 24 14:37:02.325727 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:02.324726 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37f8679f-7415-4d50-ad53-bbd16f5df42a-service-ca\") pod \"console-6fdfd7f6fd-9kvxm\" (UID: \"37f8679f-7415-4d50-ad53-bbd16f5df42a\") " pod="openshift-console/console-6fdfd7f6fd-9kvxm" Jul 24 14:37:02.325727 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:02.325333 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37f8679f-7415-4d50-ad53-bbd16f5df42a-oauth-serving-cert\") pod \"console-6fdfd7f6fd-9kvxm\" (UID: \"37f8679f-7415-4d50-ad53-bbd16f5df42a\") " pod="openshift-console/console-6fdfd7f6fd-9kvxm" Jul 24 14:37:02.325727 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:02.325638 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37f8679f-7415-4d50-ad53-bbd16f5df42a-trusted-ca-bundle\") pod \"console-6fdfd7f6fd-9kvxm\" (UID: \"37f8679f-7415-4d50-ad53-bbd16f5df42a\") " pod="openshift-console/console-6fdfd7f6fd-9kvxm" Jul 24 14:37:02.325979 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:02.325894 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37f8679f-7415-4d50-ad53-bbd16f5df42a-console-config\") pod \"console-6fdfd7f6fd-9kvxm\" (UID: \"37f8679f-7415-4d50-ad53-bbd16f5df42a\") " pod="openshift-console/console-6fdfd7f6fd-9kvxm" Jul 24 14:37:02.328655 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:02.328633 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37f8679f-7415-4d50-ad53-bbd16f5df42a-console-serving-cert\") pod \"console-6fdfd7f6fd-9kvxm\" (UID: \"37f8679f-7415-4d50-ad53-bbd16f5df42a\") " pod="openshift-console/console-6fdfd7f6fd-9kvxm" Jul 24 14:37:02.334169 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:02.334117 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37f8679f-7415-4d50-ad53-bbd16f5df42a-console-oauth-config\") pod \"console-6fdfd7f6fd-9kvxm\" (UID: \"37f8679f-7415-4d50-ad53-bbd16f5df42a\") " pod="openshift-console/console-6fdfd7f6fd-9kvxm" Jul 24 14:37:02.335809 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:02.335768 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqcnf\" (UniqueName: \"kubernetes.io/projected/37f8679f-7415-4d50-ad53-bbd16f5df42a-kube-api-access-jqcnf\") pod \"console-6fdfd7f6fd-9kvxm\" (UID: \"37f8679f-7415-4d50-ad53-bbd16f5df42a\") " pod="openshift-console/console-6fdfd7f6fd-9kvxm" Jul 24 14:37:02.371784 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:02.371716 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:37:02.463303 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:02.463267 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:37:02.484038 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:02.483871 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fdfd7f6fd-9kvxm" Jul 24 14:37:02.845913 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:02.845880 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fdfd7f6fd-9kvxm"] Jul 24 14:37:02.925465 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:37:02.925418 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37f8679f_7415_4d50_ad53_bbd16f5df42a.slice/crio-80ff3069c19c165e24935324ef942efc11bfa90a0c024068bd72dc826d50475a WatchSource:0}: Error finding container 80ff3069c19c165e24935324ef942efc11bfa90a0c024068bd72dc826d50475a: Status 404 returned error can't find the container with id 80ff3069c19c165e24935324ef942efc11bfa90a0c024068bd72dc826d50475a Jul 24 14:37:02.977709 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:02.977678 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:37:03.484589 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:03.484169 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:37:03.735074 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:03.734854 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fdfd7f6fd-9kvxm" event={"ID":"37f8679f-7415-4d50-ad53-bbd16f5df42a","Type":"ContainerStarted","Data":"d25e5f76df813a3f366c3e40d7a802c26b48d6b1329a7bf6b7e6a36d704ade47"} Jul 24 14:37:03.735074 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:03.734925 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fdfd7f6fd-9kvxm" event={"ID":"37f8679f-7415-4d50-ad53-bbd16f5df42a","Type":"ContainerStarted","Data":"80ff3069c19c165e24935324ef942efc11bfa90a0c024068bd72dc826d50475a"} Jul 24 14:37:03.737874 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:03.737841 2565 generic.go:356] "Generic (PLEG): container finished" podID="af09bc92-6610-41b6-9722-164ee7d14f7c" containerID="a863a84ef3760fa2edd70694393e83bc63d9230976338a0ec02355d89ca0e155" exitCode=0 Jul 24 14:37:03.738435 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:03.737930 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h4d82" event={"ID":"af09bc92-6610-41b6-9722-164ee7d14f7c","Type":"ContainerDied","Data":"a863a84ef3760fa2edd70694393e83bc63d9230976338a0ec02355d89ca0e155"} Jul 24 14:37:03.758787 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:03.758697 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6fdfd7f6fd-9kvxm" podStartSLOduration=1.758676399 podStartE2EDuration="1.758676399s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:37:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:37:03.757945474 +0000 UTC m=+137.039335056" watchObservedRunningTime="2026-07-24 14:37:03.758676399 +0000 UTC m=+137.040065978" Jul 24 14:37:04.233171 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:04.233128 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:37:04.327783 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:04.327753 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:37:04.582058 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:04.582025 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:37:04.682520 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:04.682464 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:37:05.751341 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:05.751305 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h4d82" event={"ID":"af09bc92-6610-41b6-9722-164ee7d14f7c","Type":"ContainerStarted","Data":"c6510dc00237330139809965bbeecfba7e3e8c27e87274702465df193d78670e"} Jul 24 14:37:05.751862 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:05.751364 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h4d82" event={"ID":"af09bc92-6610-41b6-9722-164ee7d14f7c","Type":"ContainerStarted","Data":"05d066c3b7e5118042398b7b609851eb18350b1eb660bf27383fd86b60418b47"} Jul 24 14:37:05.754251 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:05.754224 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-qw4kn" event={"ID":"854eb30d-5387-4733-bec3-abf1faee681e","Type":"ContainerStarted","Data":"17807b31b3df6b872c12b4af62332e887ef138fc2a22838cb96d2a64289e6b39"} Jul 24 14:37:05.754367 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:05.754280 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-qw4kn" event={"ID":"854eb30d-5387-4733-bec3-abf1faee681e","Type":"ContainerStarted","Data":"4234dc73f96677c120098b1eaa50d382c790fb489ca9bf73f23cf10def4c9100"} Jul 24 14:37:05.754367 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:05.754317 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-qw4kn" event={"ID":"854eb30d-5387-4733-bec3-abf1faee681e","Type":"ContainerStarted","Data":"820a5c3b516f6163c04566d69ceb122291f9abbd806de7b18d13401333d3f4db"} Jul 24 14:37:05.756630 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:05.756605 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6fbdd56d86-x96wc" event={"ID":"5e49aa5d-709d-4c1d-9a82-6348f60cdc06","Type":"ContainerStarted","Data":"a06b0ceff32294c7ec0b5bc05c13625af95249103b142febd181072af7b69d9f"} Jul 24 14:37:05.756738 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:05.756671 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6fbdd56d86-x96wc" event={"ID":"5e49aa5d-709d-4c1d-9a82-6348f60cdc06","Type":"ContainerStarted","Data":"a4f82e4bd5991cee6f3be63f8366e99e8463510848aa146f1462afe5c8062327"} Jul 24 14:37:05.756738 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:05.756703 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6fbdd56d86-x96wc" event={"ID":"5e49aa5d-709d-4c1d-9a82-6348f60cdc06","Type":"ContainerStarted","Data":"b4b2dc1e76c110e57b86374f2ed4630f673ddc352fc359c06055a8f0e2517aa3"} Jul 24 14:37:05.779242 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:05.779218 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:37:05.787091 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:05.787049 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-h4d82" podStartSLOduration=6.921425149 podStartE2EDuration="8.787034113s" totalImagesPullingTime="1.743504167s" totalInitContainerRuntime="122.104797ms" isStatefulPod=true podCreationTimestamp="2026-07-24 14:36:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:37:05.785713312 +0000 UTC m=+139.067102907" watchObservedRunningTime="2026-07-24 14:37:05.787034113 +0000 UTC m=+139.068423694" Jul 24 14:37:05.809914 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:05.809872 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-qw4kn" podStartSLOduration=5.48471946 podStartE2EDuration="8.809858385s" totalImagesPullingTime="3.325138925s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:36:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:37:05.807681092 +0000 UTC m=+139.089070675" watchObservedRunningTime="2026-07-24 14:37:05.809858385 +0000 UTC m=+139.091248224" Jul 24 14:37:05.873326 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:05.873299 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:37:06.764447 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:06.764351 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6fbdd56d86-x96wc" event={"ID":"5e49aa5d-709d-4c1d-9a82-6348f60cdc06","Type":"ContainerStarted","Data":"8b7efe23f5da6d1d8180b10ddfea852160a0508ceb98ed88848dbe1accf8190e"} Jul 24 14:37:06.764872 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:06.764834 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6fbdd56d86-x96wc" Jul 24 14:37:06.764941 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:06.764906 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6fbdd56d86-x96wc" event={"ID":"5e49aa5d-709d-4c1d-9a82-6348f60cdc06","Type":"ContainerStarted","Data":"3e4ea272f4450dd668c8bbe72377fc152d184fb2a6f106ace4d9ac94846e8e03"} Jul 24 14:37:06.765002 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:06.764963 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6fbdd56d86-x96wc" event={"ID":"5e49aa5d-709d-4c1d-9a82-6348f60cdc06","Type":"ContainerStarted","Data":"9598d91a89a5de21b9f2b23403a1b5ed4cbfab7c585148ecd6d822afa78e9ff8"} Jul 24 14:37:06.789635 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:06.789593 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6fbdd56d86-x96wc" podStartSLOduration=2.414878771 podStartE2EDuration="6.789580241s" totalImagesPullingTime="4.37470147s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:37:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:37:06.787804194 +0000 UTC m=+140.069193787" watchObservedRunningTime="2026-07-24 14:37:06.789580241 +0000 UTC m=+140.070969821" Jul 24 14:37:07.522033 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:07.521995 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fdfd7f6fd-9kvxm"] Jul 24 14:37:07.557526 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:07.557490 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5bd74d9585-svmkn"] Jul 24 14:37:07.580100 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:07.580064 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bd74d9585-svmkn" Jul 24 14:37:07.580655 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:07.580624 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bd74d9585-svmkn"] Jul 24 14:37:07.674350 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:07.674319 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a7a82277-4f2e-4cb7-84e3-5a4a67acce14-console-config\") pod \"console-5bd74d9585-svmkn\" (UID: \"a7a82277-4f2e-4cb7-84e3-5a4a67acce14\") " pod="openshift-console/console-5bd74d9585-svmkn" Jul 24 14:37:07.674564 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:07.674368 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a7a82277-4f2e-4cb7-84e3-5a4a67acce14-service-ca\") pod \"console-5bd74d9585-svmkn\" (UID: \"a7a82277-4f2e-4cb7-84e3-5a4a67acce14\") " pod="openshift-console/console-5bd74d9585-svmkn" Jul 24 14:37:07.674564 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:07.674453 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4rdp\" (UniqueName: \"kubernetes.io/projected/a7a82277-4f2e-4cb7-84e3-5a4a67acce14-kube-api-access-n4rdp\") pod \"console-5bd74d9585-svmkn\" (UID: \"a7a82277-4f2e-4cb7-84e3-5a4a67acce14\") " pod="openshift-console/console-5bd74d9585-svmkn" Jul 24 14:37:07.674564 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:07.674545 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a7a82277-4f2e-4cb7-84e3-5a4a67acce14-oauth-serving-cert\") pod \"console-5bd74d9585-svmkn\" (UID: \"a7a82277-4f2e-4cb7-84e3-5a4a67acce14\") " pod="openshift-console/console-5bd74d9585-svmkn" Jul 24 14:37:07.674745 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:07.674598 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a7a82277-4f2e-4cb7-84e3-5a4a67acce14-console-serving-cert\") pod \"console-5bd74d9585-svmkn\" (UID: \"a7a82277-4f2e-4cb7-84e3-5a4a67acce14\") " pod="openshift-console/console-5bd74d9585-svmkn" Jul 24 14:37:07.674745 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:07.674622 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a7a82277-4f2e-4cb7-84e3-5a4a67acce14-console-oauth-config\") pod \"console-5bd74d9585-svmkn\" (UID: \"a7a82277-4f2e-4cb7-84e3-5a4a67acce14\") " pod="openshift-console/console-5bd74d9585-svmkn" Jul 24 14:37:07.674745 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:07.674654 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7a82277-4f2e-4cb7-84e3-5a4a67acce14-trusted-ca-bundle\") pod \"console-5bd74d9585-svmkn\" (UID: \"a7a82277-4f2e-4cb7-84e3-5a4a67acce14\") " pod="openshift-console/console-5bd74d9585-svmkn" Jul 24 14:37:07.776046 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:07.775952 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a7a82277-4f2e-4cb7-84e3-5a4a67acce14-console-config\") pod \"console-5bd74d9585-svmkn\" (UID: \"a7a82277-4f2e-4cb7-84e3-5a4a67acce14\") " pod="openshift-console/console-5bd74d9585-svmkn" Jul 24 14:37:07.776046 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:07.776008 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a7a82277-4f2e-4cb7-84e3-5a4a67acce14-service-ca\") pod \"console-5bd74d9585-svmkn\" (UID: \"a7a82277-4f2e-4cb7-84e3-5a4a67acce14\") " pod="openshift-console/console-5bd74d9585-svmkn" Jul 24 14:37:07.776560 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:07.776053 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4rdp\" (UniqueName: \"kubernetes.io/projected/a7a82277-4f2e-4cb7-84e3-5a4a67acce14-kube-api-access-n4rdp\") pod \"console-5bd74d9585-svmkn\" (UID: \"a7a82277-4f2e-4cb7-84e3-5a4a67acce14\") " pod="openshift-console/console-5bd74d9585-svmkn" Jul 24 14:37:07.776560 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:07.776081 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a7a82277-4f2e-4cb7-84e3-5a4a67acce14-oauth-serving-cert\") pod \"console-5bd74d9585-svmkn\" (UID: \"a7a82277-4f2e-4cb7-84e3-5a4a67acce14\") " pod="openshift-console/console-5bd74d9585-svmkn" Jul 24 14:37:07.776560 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:07.776218 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a7a82277-4f2e-4cb7-84e3-5a4a67acce14-console-serving-cert\") pod \"console-5bd74d9585-svmkn\" (UID: \"a7a82277-4f2e-4cb7-84e3-5a4a67acce14\") " pod="openshift-console/console-5bd74d9585-svmkn" Jul 24 14:37:07.776560 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:07.776274 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a7a82277-4f2e-4cb7-84e3-5a4a67acce14-console-oauth-config\") pod \"console-5bd74d9585-svmkn\" (UID: \"a7a82277-4f2e-4cb7-84e3-5a4a67acce14\") " pod="openshift-console/console-5bd74d9585-svmkn" Jul 24 14:37:07.776560 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:07.776299 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7a82277-4f2e-4cb7-84e3-5a4a67acce14-trusted-ca-bundle\") pod \"console-5bd74d9585-svmkn\" (UID: \"a7a82277-4f2e-4cb7-84e3-5a4a67acce14\") " pod="openshift-console/console-5bd74d9585-svmkn" Jul 24 14:37:07.783444 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:07.783259 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a7a82277-4f2e-4cb7-84e3-5a4a67acce14-console-config\") pod \"console-5bd74d9585-svmkn\" (UID: \"a7a82277-4f2e-4cb7-84e3-5a4a67acce14\") " pod="openshift-console/console-5bd74d9585-svmkn" Jul 24 14:37:07.783444 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:07.783366 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a7a82277-4f2e-4cb7-84e3-5a4a67acce14-service-ca\") pod \"console-5bd74d9585-svmkn\" (UID: \"a7a82277-4f2e-4cb7-84e3-5a4a67acce14\") " pod="openshift-console/console-5bd74d9585-svmkn" Jul 24 14:37:07.783444 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:07.783405 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a7a82277-4f2e-4cb7-84e3-5a4a67acce14-oauth-serving-cert\") pod \"console-5bd74d9585-svmkn\" (UID: \"a7a82277-4f2e-4cb7-84e3-5a4a67acce14\") " pod="openshift-console/console-5bd74d9585-svmkn" Jul 24 14:37:07.783667 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:07.783531 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7a82277-4f2e-4cb7-84e3-5a4a67acce14-trusted-ca-bundle\") pod \"console-5bd74d9585-svmkn\" (UID: \"a7a82277-4f2e-4cb7-84e3-5a4a67acce14\") " pod="openshift-console/console-5bd74d9585-svmkn" Jul 24 14:37:07.785181 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:07.785152 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a7a82277-4f2e-4cb7-84e3-5a4a67acce14-console-serving-cert\") pod \"console-5bd74d9585-svmkn\" (UID: \"a7a82277-4f2e-4cb7-84e3-5a4a67acce14\") " pod="openshift-console/console-5bd74d9585-svmkn" Jul 24 14:37:07.785279 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:07.785179 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a7a82277-4f2e-4cb7-84e3-5a4a67acce14-console-oauth-config\") pod \"console-5bd74d9585-svmkn\" (UID: \"a7a82277-4f2e-4cb7-84e3-5a4a67acce14\") " pod="openshift-console/console-5bd74d9585-svmkn" Jul 24 14:37:07.785566 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:07.785549 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4rdp\" (UniqueName: \"kubernetes.io/projected/a7a82277-4f2e-4cb7-84e3-5a4a67acce14-kube-api-access-n4rdp\") pod \"console-5bd74d9585-svmkn\" (UID: \"a7a82277-4f2e-4cb7-84e3-5a4a67acce14\") " pod="openshift-console/console-5bd74d9585-svmkn" Jul 24 14:37:07.891733 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:07.891696 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bd74d9585-svmkn" Jul 24 14:37:08.055795 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:08.055716 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bd74d9585-svmkn"] Jul 24 14:37:08.058544 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:37:08.058514 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7a82277_4f2e_4cb7_84e3_5a4a67acce14.slice/crio-2021afc212943f194f64dcb4b305f90baa763213f0c2d6c61bb73d4c11a1129e WatchSource:0}: Error finding container 2021afc212943f194f64dcb4b305f90baa763213f0c2d6c61bb73d4c11a1129e: Status 404 returned error can't find the container with id 2021afc212943f194f64dcb4b305f90baa763213f0c2d6c61bb73d4c11a1129e Jul 24 14:37:08.775263 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:08.775230 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bd74d9585-svmkn" event={"ID":"a7a82277-4f2e-4cb7-84e3-5a4a67acce14","Type":"ContainerStarted","Data":"d26306abbc375018dd0285293050ebfbadc1b086cc26f486be3c99733759a1ab"} Jul 24 14:37:08.775514 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:08.775312 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bd74d9585-svmkn" event={"ID":"a7a82277-4f2e-4cb7-84e3-5a4a67acce14","Type":"ContainerStarted","Data":"2021afc212943f194f64dcb4b305f90baa763213f0c2d6c61bb73d4c11a1129e"} Jul 24 14:37:08.795575 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:08.795526 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5bd74d9585-svmkn" podStartSLOduration=1.795511314 podStartE2EDuration="1.795511314s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:37:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:37:08.794206678 +0000 UTC m=+142.075596259" watchObservedRunningTime="2026-07-24 14:37:08.795511314 +0000 UTC m=+142.076900902" Jul 24 14:37:10.770681 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:10.770641 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-675bf47bbf-4s7tz_07b08f83-bc4e-41b0-a34c-a91ec906b950/router/0.log" Jul 24 14:37:10.797569 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:10.797545 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n8zfk_ee6a54e6-fe4a-461a-85cd-fb141a505fb5/serve-healthcheck-canary/0.log" Jul 24 14:37:12.233414 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:12.233364 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:37:12.334009 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:12.333978 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:37:12.397755 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:12.397719 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:37:12.485123 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:12.485038 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6fdfd7f6fd-9kvxm" Jul 24 14:37:12.776058 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:12.775980 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6fbdd56d86-x96wc" Jul 24 14:37:13.796829 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:13.796748 2565 generic.go:356] "Generic (PLEG): container finished" podID="ae7f7131-970f-4dfb-b418-13eeb937222e" containerID="a9a710e126a595a6c205fcd3e4e4d3919f9b8bb20d1b3d721a7464598a168e76" exitCode=0 Jul 24 14:37:13.796829 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:13.796816 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-hcs97" event={"ID":"ae7f7131-970f-4dfb-b418-13eeb937222e","Type":"ContainerDied","Data":"a9a710e126a595a6c205fcd3e4e4d3919f9b8bb20d1b3d721a7464598a168e76"} Jul 24 14:37:13.797194 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:13.797122 2565 scope.go:117] "RemoveContainer" containerID="a9a710e126a595a6c205fcd3e4e4d3919f9b8bb20d1b3d721a7464598a168e76" Jul 24 14:37:13.897561 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:13.897530 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:37:13.998897 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:13.998862 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:37:14.803069 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:14.803037 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-hcs97" event={"ID":"ae7f7131-970f-4dfb-b418-13eeb937222e","Type":"ContainerStarted","Data":"f3b13d33b77cb675323b66ae452836e2d7e7dc2a8188347cb23601ad003228ab"} Jul 24 14:37:17.891935 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:17.891891 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5bd74d9585-svmkn" Jul 24 14:37:17.892404 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:17.891955 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5bd74d9585-svmkn" Jul 24 14:37:17.896627 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:17.896603 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5bd74d9585-svmkn" Jul 24 14:37:18.822037 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:18.822007 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5bd74d9585-svmkn" Jul 24 14:37:18.878977 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:18.878943 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bd8c9cdc5-j67g9"] Jul 24 14:37:19.024814 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:19.024783 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:37:19.133533 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:19.133426 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:37:19.250624 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:19.250587 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:37:19.349955 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:19.349922 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:37:19.616152 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:19.616120 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:37:19.698904 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:19.698869 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:37:21.832364 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:21.832330 2565 generic.go:356] "Generic (PLEG): container finished" podID="43df2a75-c530-4bd2-a608-5b23407cba86" containerID="7e2d5de5f862d6a4659d2d9f01cf68ae82aa558d5f3d2fa0cf7261a2dd94722b" exitCode=0 Jul 24 14:37:21.832850 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:21.832413 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-p6ztw" event={"ID":"43df2a75-c530-4bd2-a608-5b23407cba86","Type":"ContainerDied","Data":"7e2d5de5f862d6a4659d2d9f01cf68ae82aa558d5f3d2fa0cf7261a2dd94722b"} Jul 24 14:37:21.832850 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:21.832762 2565 scope.go:117] "RemoveContainer" containerID="7e2d5de5f862d6a4659d2d9f01cf68ae82aa558d5f3d2fa0cf7261a2dd94722b" Jul 24 14:37:22.840281 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:22.840237 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-p6ztw" event={"ID":"43df2a75-c530-4bd2-a608-5b23407cba86","Type":"ContainerStarted","Data":"468cd211d1e8c726efb19345dcbd523d585e095ea91f70a74e6a80d69a0b144f"} Jul 24 14:37:32.542191 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:32.542141 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6fdfd7f6fd-9kvxm" podUID="37f8679f-7415-4d50-ad53-bbd16f5df42a" containerName="console" containerID="cri-o://d25e5f76df813a3f366c3e40d7a802c26b48d6b1329a7bf6b7e6a36d704ade47" gracePeriod=15 Jul 24 14:37:32.829138 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:32.829101 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fdfd7f6fd-9kvxm" Jul 24 14:37:32.882268 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:32.882238 2565 generic.go:356] "Generic (PLEG): container finished" podID="37f8679f-7415-4d50-ad53-bbd16f5df42a" containerID="d25e5f76df813a3f366c3e40d7a802c26b48d6b1329a7bf6b7e6a36d704ade47" exitCode=0 Jul 24 14:37:32.882415 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:32.882281 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fdfd7f6fd-9kvxm" Jul 24 14:37:32.882415 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:32.882309 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fdfd7f6fd-9kvxm" event={"ID":"37f8679f-7415-4d50-ad53-bbd16f5df42a","Type":"ContainerDied","Data":"d25e5f76df813a3f366c3e40d7a802c26b48d6b1329a7bf6b7e6a36d704ade47"} Jul 24 14:37:32.882415 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:32.882376 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fdfd7f6fd-9kvxm" event={"ID":"37f8679f-7415-4d50-ad53-bbd16f5df42a","Type":"ContainerDied","Data":"80ff3069c19c165e24935324ef942efc11bfa90a0c024068bd72dc826d50475a"} Jul 24 14:37:32.882415 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:32.882404 2565 scope.go:117] "RemoveContainer" containerID="d25e5f76df813a3f366c3e40d7a802c26b48d6b1329a7bf6b7e6a36d704ade47" Jul 24 14:37:32.890436 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:32.890419 2565 scope.go:117] "RemoveContainer" containerID="d25e5f76df813a3f366c3e40d7a802c26b48d6b1329a7bf6b7e6a36d704ade47" Jul 24 14:37:32.890724 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:37:32.890702 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d25e5f76df813a3f366c3e40d7a802c26b48d6b1329a7bf6b7e6a36d704ade47\": container with ID starting with d25e5f76df813a3f366c3e40d7a802c26b48d6b1329a7bf6b7e6a36d704ade47 not found: ID does not exist" containerID="d25e5f76df813a3f366c3e40d7a802c26b48d6b1329a7bf6b7e6a36d704ade47" Jul 24 14:37:32.890787 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:32.890733 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d25e5f76df813a3f366c3e40d7a802c26b48d6b1329a7bf6b7e6a36d704ade47"} err="failed to get container status \"d25e5f76df813a3f366c3e40d7a802c26b48d6b1329a7bf6b7e6a36d704ade47\": rpc error: code = NotFound desc = could not find container \"d25e5f76df813a3f366c3e40d7a802c26b48d6b1329a7bf6b7e6a36d704ade47\": container with ID starting with d25e5f76df813a3f366c3e40d7a802c26b48d6b1329a7bf6b7e6a36d704ade47 not found: ID does not exist" Jul 24 14:37:32.900986 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:32.900968 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37f8679f-7415-4d50-ad53-bbd16f5df42a-console-config\") pod \"37f8679f-7415-4d50-ad53-bbd16f5df42a\" (UID: \"37f8679f-7415-4d50-ad53-bbd16f5df42a\") " Jul 24 14:37:32.901046 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:32.901003 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jqcnf\" (UniqueName: \"kubernetes.io/projected/37f8679f-7415-4d50-ad53-bbd16f5df42a-kube-api-access-jqcnf\") pod \"37f8679f-7415-4d50-ad53-bbd16f5df42a\" (UID: \"37f8679f-7415-4d50-ad53-bbd16f5df42a\") " Jul 24 14:37:32.901046 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:32.901026 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37f8679f-7415-4d50-ad53-bbd16f5df42a-console-oauth-config\") pod \"37f8679f-7415-4d50-ad53-bbd16f5df42a\" (UID: \"37f8679f-7415-4d50-ad53-bbd16f5df42a\") " Jul 24 14:37:32.901125 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:32.901067 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37f8679f-7415-4d50-ad53-bbd16f5df42a-oauth-serving-cert\") pod \"37f8679f-7415-4d50-ad53-bbd16f5df42a\" (UID: \"37f8679f-7415-4d50-ad53-bbd16f5df42a\") " Jul 24 14:37:32.901125 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:32.901105 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37f8679f-7415-4d50-ad53-bbd16f5df42a-trusted-ca-bundle\") pod \"37f8679f-7415-4d50-ad53-bbd16f5df42a\" (UID: \"37f8679f-7415-4d50-ad53-bbd16f5df42a\") " Jul 24 14:37:32.901225 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:32.901130 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37f8679f-7415-4d50-ad53-bbd16f5df42a-service-ca\") pod \"37f8679f-7415-4d50-ad53-bbd16f5df42a\" (UID: \"37f8679f-7415-4d50-ad53-bbd16f5df42a\") " Jul 24 14:37:32.901225 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:32.901217 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37f8679f-7415-4d50-ad53-bbd16f5df42a-console-serving-cert\") pod \"37f8679f-7415-4d50-ad53-bbd16f5df42a\" (UID: \"37f8679f-7415-4d50-ad53-bbd16f5df42a\") " Jul 24 14:37:32.901418 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:32.901392 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37f8679f-7415-4d50-ad53-bbd16f5df42a-console-config" (OuterVolumeSpecName: "console-config") pod "37f8679f-7415-4d50-ad53-bbd16f5df42a" (UID: "37f8679f-7415-4d50-ad53-bbd16f5df42a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 14:37:32.901585 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:32.901558 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37f8679f-7415-4d50-ad53-bbd16f5df42a-service-ca" (OuterVolumeSpecName: "service-ca") pod "37f8679f-7415-4d50-ad53-bbd16f5df42a" (UID: "37f8679f-7415-4d50-ad53-bbd16f5df42a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 14:37:32.901585 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:32.901523 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37f8679f-7415-4d50-ad53-bbd16f5df42a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "37f8679f-7415-4d50-ad53-bbd16f5df42a" (UID: "37f8679f-7415-4d50-ad53-bbd16f5df42a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 14:37:32.901735 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:32.901534 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37f8679f-7415-4d50-ad53-bbd16f5df42a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "37f8679f-7415-4d50-ad53-bbd16f5df42a" (UID: "37f8679f-7415-4d50-ad53-bbd16f5df42a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 14:37:32.903202 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:32.903167 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37f8679f-7415-4d50-ad53-bbd16f5df42a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "37f8679f-7415-4d50-ad53-bbd16f5df42a" (UID: "37f8679f-7415-4d50-ad53-bbd16f5df42a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 14:37:32.903265 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:32.903239 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37f8679f-7415-4d50-ad53-bbd16f5df42a-kube-api-access-jqcnf" (OuterVolumeSpecName: "kube-api-access-jqcnf") pod "37f8679f-7415-4d50-ad53-bbd16f5df42a" (UID: "37f8679f-7415-4d50-ad53-bbd16f5df42a"). InnerVolumeSpecName "kube-api-access-jqcnf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 14:37:32.903308 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:32.903276 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37f8679f-7415-4d50-ad53-bbd16f5df42a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "37f8679f-7415-4d50-ad53-bbd16f5df42a" (UID: "37f8679f-7415-4d50-ad53-bbd16f5df42a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 14:37:33.002157 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:33.002121 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37f8679f-7415-4d50-ad53-bbd16f5df42a-oauth-serving-cert\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 14:37:33.002157 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:33.002151 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37f8679f-7415-4d50-ad53-bbd16f5df42a-trusted-ca-bundle\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 14:37:33.002157 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:33.002163 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37f8679f-7415-4d50-ad53-bbd16f5df42a-service-ca\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 14:37:33.002383 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:33.002171 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37f8679f-7415-4d50-ad53-bbd16f5df42a-console-serving-cert\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 14:37:33.002383 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:33.002180 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37f8679f-7415-4d50-ad53-bbd16f5df42a-console-config\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 14:37:33.002383 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:33.002188 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jqcnf\" (UniqueName: \"kubernetes.io/projected/37f8679f-7415-4d50-ad53-bbd16f5df42a-kube-api-access-jqcnf\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 14:37:33.002383 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:33.002196 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37f8679f-7415-4d50-ad53-bbd16f5df42a-console-oauth-config\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 14:37:33.203102 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:33.203070 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fdfd7f6fd-9kvxm"] Jul 24 14:37:33.208541 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:33.208512 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6fdfd7f6fd-9kvxm"] Jul 24 14:37:34.581787 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:34.581753 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:37:34.648208 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:34.648175 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:37:35.174050 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:35.174018 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37f8679f-7415-4d50-ad53-bbd16f5df42a" path="/var/lib/kubelet/pods/37f8679f-7415-4d50-ad53-bbd16f5df42a/volumes" Jul 24 14:37:39.101661 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:39.101622 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:37:39.169952 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:39.169922 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:37:43.904589 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:43.904490 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-bd8c9cdc5-j67g9" podUID="fbe74433-6ee1-4934-ac0a-db453ea78a8f" containerName="console" containerID="cri-o://ef0d141915d3bb495c30a8e2bdd4403fe80e294a9cf98ee0cdfab42af2b864c6" gracePeriod=15 Jul 24 14:37:44.171711 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:44.171651 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bd8c9cdc5-j67g9" Jul 24 14:37:44.294886 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:44.294849 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fbe74433-6ee1-4934-ac0a-db453ea78a8f-console-serving-cert\") pod \"fbe74433-6ee1-4934-ac0a-db453ea78a8f\" (UID: \"fbe74433-6ee1-4934-ac0a-db453ea78a8f\") " Jul 24 14:37:44.295057 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:44.294900 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fbe74433-6ee1-4934-ac0a-db453ea78a8f-oauth-serving-cert\") pod \"fbe74433-6ee1-4934-ac0a-db453ea78a8f\" (UID: \"fbe74433-6ee1-4934-ac0a-db453ea78a8f\") " Jul 24 14:37:44.295057 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:44.294933 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fbe74433-6ee1-4934-ac0a-db453ea78a8f-console-config\") pod \"fbe74433-6ee1-4934-ac0a-db453ea78a8f\" (UID: \"fbe74433-6ee1-4934-ac0a-db453ea78a8f\") " Jul 24 14:37:44.295057 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:44.294972 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fbe74433-6ee1-4934-ac0a-db453ea78a8f-service-ca\") pod \"fbe74433-6ee1-4934-ac0a-db453ea78a8f\" (UID: \"fbe74433-6ee1-4934-ac0a-db453ea78a8f\") " Jul 24 14:37:44.295057 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:44.295007 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbe74433-6ee1-4934-ac0a-db453ea78a8f-trusted-ca-bundle\") pod \"fbe74433-6ee1-4934-ac0a-db453ea78a8f\" (UID: \"fbe74433-6ee1-4934-ac0a-db453ea78a8f\") " Jul 24 14:37:44.295057 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:44.295042 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fbe74433-6ee1-4934-ac0a-db453ea78a8f-console-oauth-config\") pod \"fbe74433-6ee1-4934-ac0a-db453ea78a8f\" (UID: \"fbe74433-6ee1-4934-ac0a-db453ea78a8f\") " Jul 24 14:37:44.295324 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:44.295087 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7sxx7\" (UniqueName: \"kubernetes.io/projected/fbe74433-6ee1-4934-ac0a-db453ea78a8f-kube-api-access-7sxx7\") pod \"fbe74433-6ee1-4934-ac0a-db453ea78a8f\" (UID: \"fbe74433-6ee1-4934-ac0a-db453ea78a8f\") " Jul 24 14:37:44.295415 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:44.295380 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbe74433-6ee1-4934-ac0a-db453ea78a8f-service-ca" (OuterVolumeSpecName: "service-ca") pod "fbe74433-6ee1-4934-ac0a-db453ea78a8f" (UID: "fbe74433-6ee1-4934-ac0a-db453ea78a8f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 14:37:44.295526 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:44.295389 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbe74433-6ee1-4934-ac0a-db453ea78a8f-console-config" (OuterVolumeSpecName: "console-config") pod "fbe74433-6ee1-4934-ac0a-db453ea78a8f" (UID: "fbe74433-6ee1-4934-ac0a-db453ea78a8f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 14:37:44.295526 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:44.295397 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbe74433-6ee1-4934-ac0a-db453ea78a8f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "fbe74433-6ee1-4934-ac0a-db453ea78a8f" (UID: "fbe74433-6ee1-4934-ac0a-db453ea78a8f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 14:37:44.295526 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:44.295447 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbe74433-6ee1-4934-ac0a-db453ea78a8f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "fbe74433-6ee1-4934-ac0a-db453ea78a8f" (UID: "fbe74433-6ee1-4934-ac0a-db453ea78a8f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 14:37:44.297072 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:44.297050 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fbe74433-6ee1-4934-ac0a-db453ea78a8f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "fbe74433-6ee1-4934-ac0a-db453ea78a8f" (UID: "fbe74433-6ee1-4934-ac0a-db453ea78a8f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 14:37:44.297160 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:44.297133 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fbe74433-6ee1-4934-ac0a-db453ea78a8f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "fbe74433-6ee1-4934-ac0a-db453ea78a8f" (UID: "fbe74433-6ee1-4934-ac0a-db453ea78a8f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 14:37:44.297241 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:44.297221 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbe74433-6ee1-4934-ac0a-db453ea78a8f-kube-api-access-7sxx7" (OuterVolumeSpecName: "kube-api-access-7sxx7") pod "fbe74433-6ee1-4934-ac0a-db453ea78a8f" (UID: "fbe74433-6ee1-4934-ac0a-db453ea78a8f"). InnerVolumeSpecName "kube-api-access-7sxx7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 14:37:44.395649 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:44.395616 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fbe74433-6ee1-4934-ac0a-db453ea78a8f-console-config\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 14:37:44.395649 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:44.395641 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fbe74433-6ee1-4934-ac0a-db453ea78a8f-service-ca\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 14:37:44.395826 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:44.395658 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbe74433-6ee1-4934-ac0a-db453ea78a8f-trusted-ca-bundle\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 14:37:44.395826 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:44.395668 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fbe74433-6ee1-4934-ac0a-db453ea78a8f-console-oauth-config\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 14:37:44.395826 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:44.395677 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7sxx7\" (UniqueName: \"kubernetes.io/projected/fbe74433-6ee1-4934-ac0a-db453ea78a8f-kube-api-access-7sxx7\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 14:37:44.395826 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:44.395686 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fbe74433-6ee1-4934-ac0a-db453ea78a8f-console-serving-cert\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 14:37:44.395826 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:44.395695 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fbe74433-6ee1-4934-ac0a-db453ea78a8f-oauth-serving-cert\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 14:37:44.930288 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:44.930252 2565 generic.go:356] "Generic (PLEG): container finished" podID="fbe74433-6ee1-4934-ac0a-db453ea78a8f" containerID="ef0d141915d3bb495c30a8e2bdd4403fe80e294a9cf98ee0cdfab42af2b864c6" exitCode=0 Jul 24 14:37:44.930747 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:44.930299 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bd8c9cdc5-j67g9" Jul 24 14:37:44.930747 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:44.930347 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bd8c9cdc5-j67g9" event={"ID":"fbe74433-6ee1-4934-ac0a-db453ea78a8f","Type":"ContainerDied","Data":"ef0d141915d3bb495c30a8e2bdd4403fe80e294a9cf98ee0cdfab42af2b864c6"} Jul 24 14:37:44.930747 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:44.930393 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bd8c9cdc5-j67g9" event={"ID":"fbe74433-6ee1-4934-ac0a-db453ea78a8f","Type":"ContainerDied","Data":"4cf31a119ce04d1f00888e61673fbccca7369f32deb1de4da8a6f0b016f8d79a"} Jul 24 14:37:44.930747 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:44.930412 2565 scope.go:117] "RemoveContainer" containerID="ef0d141915d3bb495c30a8e2bdd4403fe80e294a9cf98ee0cdfab42af2b864c6" Jul 24 14:37:44.939100 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:44.939082 2565 scope.go:117] "RemoveContainer" containerID="ef0d141915d3bb495c30a8e2bdd4403fe80e294a9cf98ee0cdfab42af2b864c6" Jul 24 14:37:44.939346 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:37:44.939327 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef0d141915d3bb495c30a8e2bdd4403fe80e294a9cf98ee0cdfab42af2b864c6\": container with ID starting with ef0d141915d3bb495c30a8e2bdd4403fe80e294a9cf98ee0cdfab42af2b864c6 not found: ID does not exist" containerID="ef0d141915d3bb495c30a8e2bdd4403fe80e294a9cf98ee0cdfab42af2b864c6" Jul 24 14:37:44.939404 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:44.939359 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef0d141915d3bb495c30a8e2bdd4403fe80e294a9cf98ee0cdfab42af2b864c6"} err="failed to get container status \"ef0d141915d3bb495c30a8e2bdd4403fe80e294a9cf98ee0cdfab42af2b864c6\": rpc error: code = NotFound desc = could not find container \"ef0d141915d3bb495c30a8e2bdd4403fe80e294a9cf98ee0cdfab42af2b864c6\": container with ID starting with ef0d141915d3bb495c30a8e2bdd4403fe80e294a9cf98ee0cdfab42af2b864c6 not found: ID does not exist" Jul 24 14:37:44.953857 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:44.953831 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bd8c9cdc5-j67g9"] Jul 24 14:37:44.956270 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:44.956249 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-bd8c9cdc5-j67g9"] Jul 24 14:37:45.169292 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:45.169259 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fbe74433-6ee1-4934-ac0a-db453ea78a8f" path="/var/lib/kubelet/pods/fbe74433-6ee1-4934-ac0a-db453ea78a8f/volumes" Jul 24 14:37:59.743037 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:37:59.743005 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:38:13.274440 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:13.274404 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:38:13.340288 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:13.340259 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:38:14.361951 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:14.361917 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-77c9cfbdff-m8842"] Jul 24 14:38:14.362357 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:14.362229 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbe74433-6ee1-4934-ac0a-db453ea78a8f" containerName="console" Jul 24 14:38:14.362357 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:14.362241 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbe74433-6ee1-4934-ac0a-db453ea78a8f" containerName="console" Jul 24 14:38:14.362357 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:14.362249 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37f8679f-7415-4d50-ad53-bbd16f5df42a" containerName="console" Jul 24 14:38:14.362357 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:14.362255 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="37f8679f-7415-4d50-ad53-bbd16f5df42a" containerName="console" Jul 24 14:38:14.362357 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:14.362323 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbe74433-6ee1-4934-ac0a-db453ea78a8f" containerName="console" Jul 24 14:38:14.362357 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:14.362357 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="37f8679f-7415-4d50-ad53-bbd16f5df42a" containerName="console" Jul 24 14:38:14.364200 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:14.364181 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77c9cfbdff-m8842" Jul 24 14:38:14.377000 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:14.376976 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77c9cfbdff-m8842"] Jul 24 14:38:14.413942 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:14.413906 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:38:14.534818 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:14.534784 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/900a38b5-5a75-4770-afb9-9a21279633cf-trusted-ca-bundle\") pod \"console-77c9cfbdff-m8842\" (UID: \"900a38b5-5a75-4770-afb9-9a21279633cf\") " pod="openshift-console/console-77c9cfbdff-m8842" Jul 24 14:38:14.535016 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:14.534839 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/900a38b5-5a75-4770-afb9-9a21279633cf-console-serving-cert\") pod \"console-77c9cfbdff-m8842\" (UID: \"900a38b5-5a75-4770-afb9-9a21279633cf\") " pod="openshift-console/console-77c9cfbdff-m8842" Jul 24 14:38:14.535016 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:14.534865 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/900a38b5-5a75-4770-afb9-9a21279633cf-console-oauth-config\") pod \"console-77c9cfbdff-m8842\" (UID: \"900a38b5-5a75-4770-afb9-9a21279633cf\") " pod="openshift-console/console-77c9cfbdff-m8842" Jul 24 14:38:14.535016 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:14.534898 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/900a38b5-5a75-4770-afb9-9a21279633cf-oauth-serving-cert\") pod \"console-77c9cfbdff-m8842\" (UID: \"900a38b5-5a75-4770-afb9-9a21279633cf\") " pod="openshift-console/console-77c9cfbdff-m8842" Jul 24 14:38:14.535016 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:14.534930 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/900a38b5-5a75-4770-afb9-9a21279633cf-console-config\") pod \"console-77c9cfbdff-m8842\" (UID: \"900a38b5-5a75-4770-afb9-9a21279633cf\") " pod="openshift-console/console-77c9cfbdff-m8842" Jul 24 14:38:14.535016 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:14.534994 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/900a38b5-5a75-4770-afb9-9a21279633cf-service-ca\") pod \"console-77c9cfbdff-m8842\" (UID: \"900a38b5-5a75-4770-afb9-9a21279633cf\") " pod="openshift-console/console-77c9cfbdff-m8842" Jul 24 14:38:14.535219 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:14.535042 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d92b8\" (UniqueName: \"kubernetes.io/projected/900a38b5-5a75-4770-afb9-9a21279633cf-kube-api-access-d92b8\") pod \"console-77c9cfbdff-m8842\" (UID: \"900a38b5-5a75-4770-afb9-9a21279633cf\") " pod="openshift-console/console-77c9cfbdff-m8842" Jul 24 14:38:14.635573 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:14.635448 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d92b8\" (UniqueName: \"kubernetes.io/projected/900a38b5-5a75-4770-afb9-9a21279633cf-kube-api-access-d92b8\") pod \"console-77c9cfbdff-m8842\" (UID: \"900a38b5-5a75-4770-afb9-9a21279633cf\") " pod="openshift-console/console-77c9cfbdff-m8842" Jul 24 14:38:14.635573 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:14.635549 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/900a38b5-5a75-4770-afb9-9a21279633cf-trusted-ca-bundle\") pod \"console-77c9cfbdff-m8842\" (UID: \"900a38b5-5a75-4770-afb9-9a21279633cf\") " pod="openshift-console/console-77c9cfbdff-m8842" Jul 24 14:38:14.635811 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:14.635585 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/900a38b5-5a75-4770-afb9-9a21279633cf-console-serving-cert\") pod \"console-77c9cfbdff-m8842\" (UID: \"900a38b5-5a75-4770-afb9-9a21279633cf\") " pod="openshift-console/console-77c9cfbdff-m8842" Jul 24 14:38:14.635811 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:14.635609 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/900a38b5-5a75-4770-afb9-9a21279633cf-console-oauth-config\") pod \"console-77c9cfbdff-m8842\" (UID: \"900a38b5-5a75-4770-afb9-9a21279633cf\") " pod="openshift-console/console-77c9cfbdff-m8842" Jul 24 14:38:14.635811 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:14.635645 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/900a38b5-5a75-4770-afb9-9a21279633cf-oauth-serving-cert\") pod \"console-77c9cfbdff-m8842\" (UID: \"900a38b5-5a75-4770-afb9-9a21279633cf\") " pod="openshift-console/console-77c9cfbdff-m8842" Jul 24 14:38:14.635811 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:14.635681 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/900a38b5-5a75-4770-afb9-9a21279633cf-console-config\") pod \"console-77c9cfbdff-m8842\" (UID: \"900a38b5-5a75-4770-afb9-9a21279633cf\") " pod="openshift-console/console-77c9cfbdff-m8842" Jul 24 14:38:14.635811 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:14.635724 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/900a38b5-5a75-4770-afb9-9a21279633cf-service-ca\") pod \"console-77c9cfbdff-m8842\" (UID: \"900a38b5-5a75-4770-afb9-9a21279633cf\") " pod="openshift-console/console-77c9cfbdff-m8842" Jul 24 14:38:14.636442 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:14.636408 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/900a38b5-5a75-4770-afb9-9a21279633cf-oauth-serving-cert\") pod \"console-77c9cfbdff-m8842\" (UID: \"900a38b5-5a75-4770-afb9-9a21279633cf\") " pod="openshift-console/console-77c9cfbdff-m8842" Jul 24 14:38:14.636600 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:14.636577 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/900a38b5-5a75-4770-afb9-9a21279633cf-console-config\") pod \"console-77c9cfbdff-m8842\" (UID: \"900a38b5-5a75-4770-afb9-9a21279633cf\") " pod="openshift-console/console-77c9cfbdff-m8842" Jul 24 14:38:14.636600 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:14.636586 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/900a38b5-5a75-4770-afb9-9a21279633cf-service-ca\") pod \"console-77c9cfbdff-m8842\" (UID: \"900a38b5-5a75-4770-afb9-9a21279633cf\") " pod="openshift-console/console-77c9cfbdff-m8842" Jul 24 14:38:14.636727 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:14.636618 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/900a38b5-5a75-4770-afb9-9a21279633cf-trusted-ca-bundle\") pod \"console-77c9cfbdff-m8842\" (UID: \"900a38b5-5a75-4770-afb9-9a21279633cf\") " pod="openshift-console/console-77c9cfbdff-m8842" Jul 24 14:38:14.638064 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:14.638040 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/900a38b5-5a75-4770-afb9-9a21279633cf-console-oauth-config\") pod \"console-77c9cfbdff-m8842\" (UID: \"900a38b5-5a75-4770-afb9-9a21279633cf\") " pod="openshift-console/console-77c9cfbdff-m8842" Jul 24 14:38:14.638276 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:14.638258 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/900a38b5-5a75-4770-afb9-9a21279633cf-console-serving-cert\") pod \"console-77c9cfbdff-m8842\" (UID: \"900a38b5-5a75-4770-afb9-9a21279633cf\") " pod="openshift-console/console-77c9cfbdff-m8842" Jul 24 14:38:14.644658 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:14.644635 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d92b8\" (UniqueName: \"kubernetes.io/projected/900a38b5-5a75-4770-afb9-9a21279633cf-kube-api-access-d92b8\") pod \"console-77c9cfbdff-m8842\" (UID: \"900a38b5-5a75-4770-afb9-9a21279633cf\") " pod="openshift-console/console-77c9cfbdff-m8842" Jul 24 14:38:14.673725 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:14.673682 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77c9cfbdff-m8842" Jul 24 14:38:14.799171 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:14.799146 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77c9cfbdff-m8842"] Jul 24 14:38:14.801602 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:38:14.801575 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod900a38b5_5a75_4770_afb9_9a21279633cf.slice/crio-5e09c4df5e2061ed47a1aa2c629233af3b28a5254871c70c7b7726f839ff5a67 WatchSource:0}: Error finding container 5e09c4df5e2061ed47a1aa2c629233af3b28a5254871c70c7b7726f839ff5a67: Status 404 returned error can't find the container with id 5e09c4df5e2061ed47a1aa2c629233af3b28a5254871c70c7b7726f839ff5a67 Jul 24 14:38:15.041319 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:15.041229 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77c9cfbdff-m8842" event={"ID":"900a38b5-5a75-4770-afb9-9a21279633cf","Type":"ContainerStarted","Data":"b9509a25c9b1eb796fe3e5e50e72837ec7dfdbaa269d3666da31bd3cad0d7560"} Jul 24 14:38:15.041319 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:15.041275 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77c9cfbdff-m8842" event={"ID":"900a38b5-5a75-4770-afb9-9a21279633cf","Type":"ContainerStarted","Data":"5e09c4df5e2061ed47a1aa2c629233af3b28a5254871c70c7b7726f839ff5a67"} Jul 24 14:38:15.060300 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:15.060253 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-77c9cfbdff-m8842" podStartSLOduration=1.060236818 podStartE2EDuration="1.060236818s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:38:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:38:15.059722712 +0000 UTC m=+208.341112295" watchObservedRunningTime="2026-07-24 14:38:15.060236818 +0000 UTC m=+208.341626398" Jul 24 14:38:24.673993 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:24.673957 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-77c9cfbdff-m8842" Jul 24 14:38:24.674459 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:24.674027 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-77c9cfbdff-m8842" Jul 24 14:38:24.678228 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:24.678204 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-77c9cfbdff-m8842" Jul 24 14:38:25.086049 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:25.086018 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-77c9cfbdff-m8842" Jul 24 14:38:25.139556 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:25.139526 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bd74d9585-svmkn"] Jul 24 14:38:25.208465 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:25.208427 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:38:25.308169 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:25.308125 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:38:25.410158 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:25.410065 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:38:34.585807 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:34.585773 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:38:34.687618 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:34.687582 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:38:34.788096 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:34.788049 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:38:36.628080 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:36.628035 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:38:40.869282 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:40.869244 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:38:40.924002 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:40.923969 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:38:50.160617 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:50.160566 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5bd74d9585-svmkn" podUID="a7a82277-4f2e-4cb7-84e3-5a4a67acce14" containerName="console" containerID="cri-o://d26306abbc375018dd0285293050ebfbadc1b086cc26f486be3c99733759a1ab" gracePeriod=15 Jul 24 14:38:50.393263 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:50.393239 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bd74d9585-svmkn" Jul 24 14:38:50.524018 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:50.523942 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a7a82277-4f2e-4cb7-84e3-5a4a67acce14-console-config\") pod \"a7a82277-4f2e-4cb7-84e3-5a4a67acce14\" (UID: \"a7a82277-4f2e-4cb7-84e3-5a4a67acce14\") " Jul 24 14:38:50.524018 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:50.523979 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n4rdp\" (UniqueName: \"kubernetes.io/projected/a7a82277-4f2e-4cb7-84e3-5a4a67acce14-kube-api-access-n4rdp\") pod \"a7a82277-4f2e-4cb7-84e3-5a4a67acce14\" (UID: \"a7a82277-4f2e-4cb7-84e3-5a4a67acce14\") " Jul 24 14:38:50.524018 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:50.524000 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a7a82277-4f2e-4cb7-84e3-5a4a67acce14-console-serving-cert\") pod \"a7a82277-4f2e-4cb7-84e3-5a4a67acce14\" (UID: \"a7a82277-4f2e-4cb7-84e3-5a4a67acce14\") " Jul 24 14:38:50.524252 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:50.524028 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7a82277-4f2e-4cb7-84e3-5a4a67acce14-trusted-ca-bundle\") pod \"a7a82277-4f2e-4cb7-84e3-5a4a67acce14\" (UID: \"a7a82277-4f2e-4cb7-84e3-5a4a67acce14\") " Jul 24 14:38:50.524252 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:50.524044 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a7a82277-4f2e-4cb7-84e3-5a4a67acce14-service-ca\") pod \"a7a82277-4f2e-4cb7-84e3-5a4a67acce14\" (UID: \"a7a82277-4f2e-4cb7-84e3-5a4a67acce14\") " Jul 24 14:38:50.524252 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:50.524092 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a7a82277-4f2e-4cb7-84e3-5a4a67acce14-console-oauth-config\") pod \"a7a82277-4f2e-4cb7-84e3-5a4a67acce14\" (UID: \"a7a82277-4f2e-4cb7-84e3-5a4a67acce14\") " Jul 24 14:38:50.524252 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:50.524117 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a7a82277-4f2e-4cb7-84e3-5a4a67acce14-oauth-serving-cert\") pod \"a7a82277-4f2e-4cb7-84e3-5a4a67acce14\" (UID: \"a7a82277-4f2e-4cb7-84e3-5a4a67acce14\") " Jul 24 14:38:50.524543 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:50.524508 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7a82277-4f2e-4cb7-84e3-5a4a67acce14-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a7a82277-4f2e-4cb7-84e3-5a4a67acce14" (UID: "a7a82277-4f2e-4cb7-84e3-5a4a67acce14"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 14:38:50.524629 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:50.524518 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7a82277-4f2e-4cb7-84e3-5a4a67acce14-console-config" (OuterVolumeSpecName: "console-config") pod "a7a82277-4f2e-4cb7-84e3-5a4a67acce14" (UID: "a7a82277-4f2e-4cb7-84e3-5a4a67acce14"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 14:38:50.524629 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:50.524596 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7a82277-4f2e-4cb7-84e3-5a4a67acce14-service-ca" (OuterVolumeSpecName: "service-ca") pod "a7a82277-4f2e-4cb7-84e3-5a4a67acce14" (UID: "a7a82277-4f2e-4cb7-84e3-5a4a67acce14"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 14:38:50.524704 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:50.524604 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7a82277-4f2e-4cb7-84e3-5a4a67acce14-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a7a82277-4f2e-4cb7-84e3-5a4a67acce14" (UID: "a7a82277-4f2e-4cb7-84e3-5a4a67acce14"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 14:38:50.526236 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:50.526216 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7a82277-4f2e-4cb7-84e3-5a4a67acce14-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a7a82277-4f2e-4cb7-84e3-5a4a67acce14" (UID: "a7a82277-4f2e-4cb7-84e3-5a4a67acce14"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 14:38:50.526294 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:50.526216 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7a82277-4f2e-4cb7-84e3-5a4a67acce14-kube-api-access-n4rdp" (OuterVolumeSpecName: "kube-api-access-n4rdp") pod "a7a82277-4f2e-4cb7-84e3-5a4a67acce14" (UID: "a7a82277-4f2e-4cb7-84e3-5a4a67acce14"). InnerVolumeSpecName "kube-api-access-n4rdp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 14:38:50.526294 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:50.526244 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7a82277-4f2e-4cb7-84e3-5a4a67acce14-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a7a82277-4f2e-4cb7-84e3-5a4a67acce14" (UID: "a7a82277-4f2e-4cb7-84e3-5a4a67acce14"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 14:38:50.625343 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:50.625300 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a7a82277-4f2e-4cb7-84e3-5a4a67acce14-console-config\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 14:38:50.625343 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:50.625340 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n4rdp\" (UniqueName: \"kubernetes.io/projected/a7a82277-4f2e-4cb7-84e3-5a4a67acce14-kube-api-access-n4rdp\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 14:38:50.625343 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:50.625350 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a7a82277-4f2e-4cb7-84e3-5a4a67acce14-console-serving-cert\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 14:38:50.625343 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:50.625358 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7a82277-4f2e-4cb7-84e3-5a4a67acce14-trusted-ca-bundle\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 14:38:50.625594 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:50.625366 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a7a82277-4f2e-4cb7-84e3-5a4a67acce14-service-ca\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 14:38:50.625594 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:50.625374 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a7a82277-4f2e-4cb7-84e3-5a4a67acce14-console-oauth-config\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 14:38:50.625594 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:50.625382 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a7a82277-4f2e-4cb7-84e3-5a4a67acce14-oauth-serving-cert\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 14:38:51.178155 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:51.178124 2565 generic.go:356] "Generic (PLEG): container finished" podID="a7a82277-4f2e-4cb7-84e3-5a4a67acce14" containerID="d26306abbc375018dd0285293050ebfbadc1b086cc26f486be3c99733759a1ab" exitCode=0 Jul 24 14:38:51.178452 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:51.178170 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bd74d9585-svmkn" Jul 24 14:38:51.178452 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:51.178190 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bd74d9585-svmkn" event={"ID":"a7a82277-4f2e-4cb7-84e3-5a4a67acce14","Type":"ContainerDied","Data":"d26306abbc375018dd0285293050ebfbadc1b086cc26f486be3c99733759a1ab"} Jul 24 14:38:51.178452 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:51.178233 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bd74d9585-svmkn" event={"ID":"a7a82277-4f2e-4cb7-84e3-5a4a67acce14","Type":"ContainerDied","Data":"2021afc212943f194f64dcb4b305f90baa763213f0c2d6c61bb73d4c11a1129e"} Jul 24 14:38:51.178452 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:51.178254 2565 scope.go:117] "RemoveContainer" containerID="d26306abbc375018dd0285293050ebfbadc1b086cc26f486be3c99733759a1ab" Jul 24 14:38:51.186310 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:51.186293 2565 scope.go:117] "RemoveContainer" containerID="d26306abbc375018dd0285293050ebfbadc1b086cc26f486be3c99733759a1ab" Jul 24 14:38:51.186548 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:38:51.186528 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d26306abbc375018dd0285293050ebfbadc1b086cc26f486be3c99733759a1ab\": container with ID starting with d26306abbc375018dd0285293050ebfbadc1b086cc26f486be3c99733759a1ab not found: ID does not exist" containerID="d26306abbc375018dd0285293050ebfbadc1b086cc26f486be3c99733759a1ab" Jul 24 14:38:51.186619 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:51.186561 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d26306abbc375018dd0285293050ebfbadc1b086cc26f486be3c99733759a1ab"} err="failed to get container status \"d26306abbc375018dd0285293050ebfbadc1b086cc26f486be3c99733759a1ab\": rpc error: code = NotFound desc = could not find container \"d26306abbc375018dd0285293050ebfbadc1b086cc26f486be3c99733759a1ab\": container with ID starting with d26306abbc375018dd0285293050ebfbadc1b086cc26f486be3c99733759a1ab not found: ID does not exist" Jul 24 14:38:51.199541 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:51.199498 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bd74d9585-svmkn"] Jul 24 14:38:51.204279 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:51.204256 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5bd74d9585-svmkn"] Jul 24 14:38:53.170317 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:38:53.170276 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7a82277-4f2e-4cb7-84e3-5a4a67acce14" path="/var/lib/kubelet/pods/a7a82277-4f2e-4cb7-84e3-5a4a67acce14/volumes" Jul 24 14:39:07.500185 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:07.500147 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:39:07.598156 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:07.598124 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:39:08.215700 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:08.215668 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfftt"] Jul 24 14:39:08.215961 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:08.215949 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7a82277-4f2e-4cb7-84e3-5a4a67acce14" containerName="console" Jul 24 14:39:08.216008 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:08.215963 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7a82277-4f2e-4cb7-84e3-5a4a67acce14" containerName="console" Jul 24 14:39:08.216049 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:08.216026 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7a82277-4f2e-4cb7-84e3-5a4a67acce14" containerName="console" Jul 24 14:39:08.218643 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:08.218623 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfftt" Jul 24 14:39:08.221532 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:08.221461 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 24 14:39:08.221648 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:08.221461 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 24 14:39:08.222402 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:08.222374 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2lppj\"" Jul 24 14:39:08.233021 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:08.232997 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfftt"] Jul 24 14:39:08.374512 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:08.374451 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4146b38b-a219-438d-af33-c25cac167448-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfftt\" (UID: \"4146b38b-a219-438d-af33-c25cac167448\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfftt" Jul 24 14:39:08.374713 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:08.374524 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4146b38b-a219-438d-af33-c25cac167448-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfftt\" (UID: \"4146b38b-a219-438d-af33-c25cac167448\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfftt" Jul 24 14:39:08.374713 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:08.374634 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjfw8\" (UniqueName: \"kubernetes.io/projected/4146b38b-a219-438d-af33-c25cac167448-kube-api-access-bjfw8\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfftt\" (UID: \"4146b38b-a219-438d-af33-c25cac167448\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfftt" Jul 24 14:39:08.475212 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:08.475132 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4146b38b-a219-438d-af33-c25cac167448-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfftt\" (UID: \"4146b38b-a219-438d-af33-c25cac167448\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfftt" Jul 24 14:39:08.475212 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:08.475188 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjfw8\" (UniqueName: \"kubernetes.io/projected/4146b38b-a219-438d-af33-c25cac167448-kube-api-access-bjfw8\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfftt\" (UID: \"4146b38b-a219-438d-af33-c25cac167448\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfftt" Jul 24 14:39:08.475389 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:08.475227 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4146b38b-a219-438d-af33-c25cac167448-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfftt\" (UID: \"4146b38b-a219-438d-af33-c25cac167448\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfftt" Jul 24 14:39:08.475566 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:08.475531 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4146b38b-a219-438d-af33-c25cac167448-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfftt\" (UID: \"4146b38b-a219-438d-af33-c25cac167448\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfftt" Jul 24 14:39:08.475614 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:08.475563 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4146b38b-a219-438d-af33-c25cac167448-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfftt\" (UID: \"4146b38b-a219-438d-af33-c25cac167448\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfftt" Jul 24 14:39:08.484195 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:08.484173 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjfw8\" (UniqueName: \"kubernetes.io/projected/4146b38b-a219-438d-af33-c25cac167448-kube-api-access-bjfw8\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfftt\" (UID: \"4146b38b-a219-438d-af33-c25cac167448\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfftt" Jul 24 14:39:08.528298 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:08.528270 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfftt" Jul 24 14:39:08.654811 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:08.654781 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfftt"] Jul 24 14:39:08.657371 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:39:08.657349 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4146b38b_a219_438d_af33_c25cac167448.slice/crio-221c77592ee675bc1572756251dc91e7e808254bde7097fd4374019daa083189 WatchSource:0}: Error finding container 221c77592ee675bc1572756251dc91e7e808254bde7097fd4374019daa083189: Status 404 returned error can't find the container with id 221c77592ee675bc1572756251dc91e7e808254bde7097fd4374019daa083189 Jul 24 14:39:09.249151 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:09.249106 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfftt" event={"ID":"4146b38b-a219-438d-af33-c25cac167448","Type":"ContainerStarted","Data":"221c77592ee675bc1572756251dc91e7e808254bde7097fd4374019daa083189"} Jul 24 14:39:16.278511 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:16.278451 2565 generic.go:356] "Generic (PLEG): container finished" podID="4146b38b-a219-438d-af33-c25cac167448" containerID="263497a12712471a35715a52033308a3cee7d6bebaa85425942cca8bd5bacf96" exitCode=0 Jul 24 14:39:16.278966 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:16.278527 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfftt" event={"ID":"4146b38b-a219-438d-af33-c25cac167448","Type":"ContainerDied","Data":"263497a12712471a35715a52033308a3cee7d6bebaa85425942cca8bd5bacf96"} Jul 24 14:39:18.288597 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:18.288562 2565 generic.go:356] "Generic (PLEG): container finished" podID="4146b38b-a219-438d-af33-c25cac167448" containerID="9c5037b38aa3248cf50f35e5c6b868c093af6baac5b344c8b073f4fdb55f4875" exitCode=0 Jul 24 14:39:18.288988 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:18.288641 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfftt" event={"ID":"4146b38b-a219-438d-af33-c25cac167448","Type":"ContainerDied","Data":"9c5037b38aa3248cf50f35e5c6b868c093af6baac5b344c8b073f4fdb55f4875"} Jul 24 14:39:25.319942 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:25.319897 2565 generic.go:356] "Generic (PLEG): container finished" podID="4146b38b-a219-438d-af33-c25cac167448" containerID="6525352f51f506bbc6699575a7f0106c91107b557c63c093baba144d98e932ac" exitCode=0 Jul 24 14:39:25.320295 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:25.319962 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfftt" event={"ID":"4146b38b-a219-438d-af33-c25cac167448","Type":"ContainerDied","Data":"6525352f51f506bbc6699575a7f0106c91107b557c63c093baba144d98e932ac"} Jul 24 14:39:26.449530 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:26.449504 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfftt" Jul 24 14:39:26.532308 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:26.532268 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4146b38b-a219-438d-af33-c25cac167448-util\") pod \"4146b38b-a219-438d-af33-c25cac167448\" (UID: \"4146b38b-a219-438d-af33-c25cac167448\") " Jul 24 14:39:26.532518 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:26.532327 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4146b38b-a219-438d-af33-c25cac167448-bundle\") pod \"4146b38b-a219-438d-af33-c25cac167448\" (UID: \"4146b38b-a219-438d-af33-c25cac167448\") " Jul 24 14:39:26.532518 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:26.532354 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bjfw8\" (UniqueName: \"kubernetes.io/projected/4146b38b-a219-438d-af33-c25cac167448-kube-api-access-bjfw8\") pod \"4146b38b-a219-438d-af33-c25cac167448\" (UID: \"4146b38b-a219-438d-af33-c25cac167448\") " Jul 24 14:39:26.532981 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:26.532953 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4146b38b-a219-438d-af33-c25cac167448-bundle" (OuterVolumeSpecName: "bundle") pod "4146b38b-a219-438d-af33-c25cac167448" (UID: "4146b38b-a219-438d-af33-c25cac167448"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 14:39:26.534525 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:26.534500 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4146b38b-a219-438d-af33-c25cac167448-kube-api-access-bjfw8" (OuterVolumeSpecName: "kube-api-access-bjfw8") pod "4146b38b-a219-438d-af33-c25cac167448" (UID: "4146b38b-a219-438d-af33-c25cac167448"). InnerVolumeSpecName "kube-api-access-bjfw8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 14:39:26.536825 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:26.536795 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4146b38b-a219-438d-af33-c25cac167448-util" (OuterVolumeSpecName: "util") pod "4146b38b-a219-438d-af33-c25cac167448" (UID: "4146b38b-a219-438d-af33-c25cac167448"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 14:39:26.633324 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:26.633242 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4146b38b-a219-438d-af33-c25cac167448-util\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 14:39:26.633324 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:26.633270 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4146b38b-a219-438d-af33-c25cac167448-bundle\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 14:39:26.633324 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:26.633279 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bjfw8\" (UniqueName: \"kubernetes.io/projected/4146b38b-a219-438d-af33-c25cac167448-kube-api-access-bjfw8\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 14:39:27.329197 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:27.329157 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfftt" event={"ID":"4146b38b-a219-438d-af33-c25cac167448","Type":"ContainerDied","Data":"221c77592ee675bc1572756251dc91e7e808254bde7097fd4374019daa083189"} Jul 24 14:39:27.329354 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:27.329199 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfftt" Jul 24 14:39:27.329354 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:27.329213 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="221c77592ee675bc1572756251dc91e7e808254bde7097fd4374019daa083189" Jul 24 14:39:29.245839 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:29.245794 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:39:30.054789 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:30.054756 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:39:31.189705 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:31.189674 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pkr2s"] Jul 24 14:39:31.190070 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:31.189969 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4146b38b-a219-438d-af33-c25cac167448" containerName="extract" Jul 24 14:39:31.190070 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:31.189979 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4146b38b-a219-438d-af33-c25cac167448" containerName="extract" Jul 24 14:39:31.190070 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:31.189988 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4146b38b-a219-438d-af33-c25cac167448" containerName="util" Jul 24 14:39:31.190070 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:31.189994 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4146b38b-a219-438d-af33-c25cac167448" containerName="util" Jul 24 14:39:31.190070 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:31.190002 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4146b38b-a219-438d-af33-c25cac167448" containerName="pull" Jul 24 14:39:31.190070 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:31.190007 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4146b38b-a219-438d-af33-c25cac167448" containerName="pull" Jul 24 14:39:31.190070 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:31.190053 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4146b38b-a219-438d-af33-c25cac167448" containerName="extract" Jul 24 14:39:31.193335 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:31.193313 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pkr2s" Jul 24 14:39:31.196206 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:31.196179 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-cwvpm\"" Jul 24 14:39:31.196429 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:31.196411 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 24 14:39:31.196429 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:31.196425 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 24 14:39:31.207275 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:31.207253 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pkr2s"] Jul 24 14:39:31.274729 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:31.274697 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f5b4fe45-f995-4b61-83b7-705f49feb8dc-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-pkr2s\" (UID: \"f5b4fe45-f995-4b61-83b7-705f49feb8dc\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pkr2s" Jul 24 14:39:31.274874 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:31.274788 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llgj5\" (UniqueName: \"kubernetes.io/projected/f5b4fe45-f995-4b61-83b7-705f49feb8dc-kube-api-access-llgj5\") pod \"cert-manager-operator-controller-manager-55c444bf86-pkr2s\" (UID: \"f5b4fe45-f995-4b61-83b7-705f49feb8dc\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pkr2s" Jul 24 14:39:31.376181 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:31.376139 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llgj5\" (UniqueName: \"kubernetes.io/projected/f5b4fe45-f995-4b61-83b7-705f49feb8dc-kube-api-access-llgj5\") pod \"cert-manager-operator-controller-manager-55c444bf86-pkr2s\" (UID: \"f5b4fe45-f995-4b61-83b7-705f49feb8dc\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pkr2s" Jul 24 14:39:31.376350 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:31.376217 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f5b4fe45-f995-4b61-83b7-705f49feb8dc-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-pkr2s\" (UID: \"f5b4fe45-f995-4b61-83b7-705f49feb8dc\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pkr2s" Jul 24 14:39:31.376659 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:31.376639 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f5b4fe45-f995-4b61-83b7-705f49feb8dc-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-pkr2s\" (UID: \"f5b4fe45-f995-4b61-83b7-705f49feb8dc\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pkr2s" Jul 24 14:39:31.386677 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:31.386654 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llgj5\" (UniqueName: \"kubernetes.io/projected/f5b4fe45-f995-4b61-83b7-705f49feb8dc-kube-api-access-llgj5\") pod \"cert-manager-operator-controller-manager-55c444bf86-pkr2s\" (UID: \"f5b4fe45-f995-4b61-83b7-705f49feb8dc\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pkr2s" Jul 24 14:39:31.502124 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:31.502041 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pkr2s" Jul 24 14:39:31.634965 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:31.634859 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pkr2s"] Jul 24 14:39:31.640963 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:39:31.640934 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5b4fe45_f995_4b61_83b7_705f49feb8dc.slice/crio-d125555c74ce9e5ed033906ba5bb7f3e6ebbeb049ec6636f76ec4ab4577fe1cd WatchSource:0}: Error finding container d125555c74ce9e5ed033906ba5bb7f3e6ebbeb049ec6636f76ec4ab4577fe1cd: Status 404 returned error can't find the container with id d125555c74ce9e5ed033906ba5bb7f3e6ebbeb049ec6636f76ec4ab4577fe1cd Jul 24 14:39:32.350703 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:32.350667 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pkr2s" event={"ID":"f5b4fe45-f995-4b61-83b7-705f49feb8dc","Type":"ContainerStarted","Data":"d125555c74ce9e5ed033906ba5bb7f3e6ebbeb049ec6636f76ec4ab4577fe1cd"} Jul 24 14:39:33.035491 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:33.035409 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:39:33.136281 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:33.136244 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:39:34.196962 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:34.196914 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:39:34.299752 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:34.299702 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:39:34.361762 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:34.361712 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pkr2s" event={"ID":"f5b4fe45-f995-4b61-83b7-705f49feb8dc","Type":"ContainerStarted","Data":"aa805f20fa31417ebd33e47c1e47190157dc6ebda5290fd660132ec74546a71e"} Jul 24 14:39:34.373849 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:34.373821 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-f9wjt"] Jul 24 14:39:34.376065 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:34.376044 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-f9wjt" Jul 24 14:39:34.378447 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:34.378426 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 24 14:39:34.378562 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:34.378534 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-clw9f\"" Jul 24 14:39:34.378626 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:34.378597 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 24 14:39:34.385535 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:34.385456 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pkr2s" podStartSLOduration=1.522461543 podStartE2EDuration="3.385441621s" totalImagesPullingTime="1.862980078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:39:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:39:34.383022176 +0000 UTC m=+287.664411771" watchObservedRunningTime="2026-07-24 14:39:34.385441621 +0000 UTC m=+287.666831202" Jul 24 14:39:34.388386 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:34.388361 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-f9wjt"] Jul 24 14:39:34.503833 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:34.503730 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2llj\" (UniqueName: \"kubernetes.io/projected/08237945-c5fc-47cd-a872-075faecfee92-kube-api-access-p2llj\") pod \"cert-manager-webhook-6486ffd997-f9wjt\" (UID: \"08237945-c5fc-47cd-a872-075faecfee92\") " pod="cert-manager/cert-manager-webhook-6486ffd997-f9wjt" Jul 24 14:39:34.503992 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:34.503881 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/08237945-c5fc-47cd-a872-075faecfee92-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-f9wjt\" (UID: \"08237945-c5fc-47cd-a872-075faecfee92\") " pod="cert-manager/cert-manager-webhook-6486ffd997-f9wjt" Jul 24 14:39:34.604770 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:34.604720 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2llj\" (UniqueName: \"kubernetes.io/projected/08237945-c5fc-47cd-a872-075faecfee92-kube-api-access-p2llj\") pod \"cert-manager-webhook-6486ffd997-f9wjt\" (UID: \"08237945-c5fc-47cd-a872-075faecfee92\") " pod="cert-manager/cert-manager-webhook-6486ffd997-f9wjt" Jul 24 14:39:34.604949 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:34.604832 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/08237945-c5fc-47cd-a872-075faecfee92-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-f9wjt\" (UID: \"08237945-c5fc-47cd-a872-075faecfee92\") " pod="cert-manager/cert-manager-webhook-6486ffd997-f9wjt" Jul 24 14:39:34.613223 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:34.613194 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/08237945-c5fc-47cd-a872-075faecfee92-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-f9wjt\" (UID: \"08237945-c5fc-47cd-a872-075faecfee92\") " pod="cert-manager/cert-manager-webhook-6486ffd997-f9wjt" Jul 24 14:39:34.613350 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:34.613331 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2llj\" (UniqueName: \"kubernetes.io/projected/08237945-c5fc-47cd-a872-075faecfee92-kube-api-access-p2llj\") pod \"cert-manager-webhook-6486ffd997-f9wjt\" (UID: \"08237945-c5fc-47cd-a872-075faecfee92\") " pod="cert-manager/cert-manager-webhook-6486ffd997-f9wjt" Jul 24 14:39:34.693369 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:34.693335 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-f9wjt" Jul 24 14:39:34.764869 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:34.764784 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:39:34.828520 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:34.828493 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-f9wjt"] Jul 24 14:39:34.830916 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:39:34.830891 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod08237945_c5fc_47cd_a872_075faecfee92.slice/crio-f1b0128f1cfffbdaf5dc3ff84a0a2acff1cebfaaf1845d1e7bdfa1a9b939556b WatchSource:0}: Error finding container f1b0128f1cfffbdaf5dc3ff84a0a2acff1cebfaaf1845d1e7bdfa1a9b939556b: Status 404 returned error can't find the container with id f1b0128f1cfffbdaf5dc3ff84a0a2acff1cebfaaf1845d1e7bdfa1a9b939556b Jul 24 14:39:34.864904 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:34.864872 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:39:35.274699 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:35.274661 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7pbxm"] Jul 24 14:39:35.277611 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:35.277588 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7pbxm" Jul 24 14:39:35.280630 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:35.280608 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2lppj\"" Jul 24 14:39:35.280796 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:35.280781 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 24 14:39:35.281417 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:35.281403 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 24 14:39:35.292762 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:35.292741 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7pbxm"] Jul 24 14:39:35.367230 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:35.367195 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-f9wjt" event={"ID":"08237945-c5fc-47cd-a872-075faecfee92","Type":"ContainerStarted","Data":"f1b0128f1cfffbdaf5dc3ff84a0a2acff1cebfaaf1845d1e7bdfa1a9b939556b"} Jul 24 14:39:35.414014 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:35.413981 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/527d3ded-534d-44e5-91f5-9c0e7d0439c7-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7pbxm\" (UID: \"527d3ded-534d-44e5-91f5-9c0e7d0439c7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7pbxm" Jul 24 14:39:35.414144 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:35.414032 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wd2m\" (UniqueName: \"kubernetes.io/projected/527d3ded-534d-44e5-91f5-9c0e7d0439c7-kube-api-access-4wd2m\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7pbxm\" (UID: \"527d3ded-534d-44e5-91f5-9c0e7d0439c7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7pbxm" Jul 24 14:39:35.414144 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:35.414107 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/527d3ded-534d-44e5-91f5-9c0e7d0439c7-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7pbxm\" (UID: \"527d3ded-534d-44e5-91f5-9c0e7d0439c7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7pbxm" Jul 24 14:39:35.515483 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:35.515427 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/527d3ded-534d-44e5-91f5-9c0e7d0439c7-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7pbxm\" (UID: \"527d3ded-534d-44e5-91f5-9c0e7d0439c7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7pbxm" Jul 24 14:39:35.515644 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:35.515579 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wd2m\" (UniqueName: \"kubernetes.io/projected/527d3ded-534d-44e5-91f5-9c0e7d0439c7-kube-api-access-4wd2m\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7pbxm\" (UID: \"527d3ded-534d-44e5-91f5-9c0e7d0439c7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7pbxm" Jul 24 14:39:35.515644 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:35.515626 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/527d3ded-534d-44e5-91f5-9c0e7d0439c7-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7pbxm\" (UID: \"527d3ded-534d-44e5-91f5-9c0e7d0439c7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7pbxm" Jul 24 14:39:35.515830 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:35.515807 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/527d3ded-534d-44e5-91f5-9c0e7d0439c7-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7pbxm\" (UID: \"527d3ded-534d-44e5-91f5-9c0e7d0439c7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7pbxm" Jul 24 14:39:35.515961 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:35.515939 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/527d3ded-534d-44e5-91f5-9c0e7d0439c7-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7pbxm\" (UID: \"527d3ded-534d-44e5-91f5-9c0e7d0439c7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7pbxm" Jul 24 14:39:35.528439 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:35.528376 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wd2m\" (UniqueName: \"kubernetes.io/projected/527d3ded-534d-44e5-91f5-9c0e7d0439c7-kube-api-access-4wd2m\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7pbxm\" (UID: \"527d3ded-534d-44e5-91f5-9c0e7d0439c7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7pbxm" Jul 24 14:39:35.587423 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:35.587374 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7pbxm" Jul 24 14:39:35.729353 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:35.729322 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7pbxm"] Jul 24 14:39:35.731101 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:39:35.731070 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod527d3ded_534d_44e5_91f5_9c0e7d0439c7.slice/crio-f32dd573b9577e4934d5f4d96cfa3514b0d53a7f8925214d2295310973179303 WatchSource:0}: Error finding container f32dd573b9577e4934d5f4d96cfa3514b0d53a7f8925214d2295310973179303: Status 404 returned error can't find the container with id f32dd573b9577e4934d5f4d96cfa3514b0d53a7f8925214d2295310973179303 Jul 24 14:39:36.206883 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:36.206844 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:39:36.374328 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:36.374295 2565 generic.go:356] "Generic (PLEG): container finished" podID="527d3ded-534d-44e5-91f5-9c0e7d0439c7" containerID="e5f295a1b882e8964f83a69d852a6e327e3f7d42c8f8a464eca23291be1cd586" exitCode=0 Jul 24 14:39:36.374765 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:36.374366 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7pbxm" event={"ID":"527d3ded-534d-44e5-91f5-9c0e7d0439c7","Type":"ContainerDied","Data":"e5f295a1b882e8964f83a69d852a6e327e3f7d42c8f8a464eca23291be1cd586"} Jul 24 14:39:36.374765 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:36.374406 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7pbxm" event={"ID":"527d3ded-534d-44e5-91f5-9c0e7d0439c7","Type":"ContainerStarted","Data":"f32dd573b9577e4934d5f4d96cfa3514b0d53a7f8925214d2295310973179303"} Jul 24 14:39:36.639702 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:36.639660 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:39:38.386982 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:38.386942 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-f9wjt" event={"ID":"08237945-c5fc-47cd-a872-075faecfee92","Type":"ContainerStarted","Data":"ee17aab37aac6c28e81e3e2b74a39f9e7ed4779bc611a2365a9692f8a8276f35"} Jul 24 14:39:38.387439 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:38.387070 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-f9wjt" Jul 24 14:39:38.406954 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:38.406894 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-f9wjt" podStartSLOduration=1.619081918 podStartE2EDuration="4.406878049s" totalImagesPullingTime="2.787796131s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:39:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:39:38.404631114 +0000 UTC m=+291.686020695" watchObservedRunningTime="2026-07-24 14:39:38.406878049 +0000 UTC m=+291.688267630" Jul 24 14:39:39.393413 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:39.393377 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7pbxm" event={"ID":"527d3ded-534d-44e5-91f5-9c0e7d0439c7","Type":"ContainerStarted","Data":"385300a3448cf3b4e06057e31665cc0c51338687da6c36b5fef1364e5bd585d8"} Jul 24 14:39:39.952685 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:39.952645 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:39:40.051581 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:40.051540 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:39:40.399575 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:40.399541 2565 generic.go:356] "Generic (PLEG): container finished" podID="527d3ded-534d-44e5-91f5-9c0e7d0439c7" containerID="385300a3448cf3b4e06057e31665cc0c51338687da6c36b5fef1364e5bd585d8" exitCode=0 Jul 24 14:39:40.399971 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:40.399629 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7pbxm" event={"ID":"527d3ded-534d-44e5-91f5-9c0e7d0439c7","Type":"ContainerDied","Data":"385300a3448cf3b4e06057e31665cc0c51338687da6c36b5fef1364e5bd585d8"} Jul 24 14:39:41.405653 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:41.405622 2565 generic.go:356] "Generic (PLEG): container finished" podID="527d3ded-534d-44e5-91f5-9c0e7d0439c7" containerID="d4b6e9aff8696250ec97e1bf7c82ebfc2bc61042c8a76391f6d56f57b77f5a33" exitCode=0 Jul 24 14:39:41.406000 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:41.405657 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7pbxm" event={"ID":"527d3ded-534d-44e5-91f5-9c0e7d0439c7","Type":"ContainerDied","Data":"d4b6e9aff8696250ec97e1bf7c82ebfc2bc61042c8a76391f6d56f57b77f5a33"} Jul 24 14:39:41.505115 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:41.505079 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:39:41.598610 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:41.598573 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:39:42.535245 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:42.535221 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7pbxm" Jul 24 14:39:42.678961 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:42.678873 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/527d3ded-534d-44e5-91f5-9c0e7d0439c7-util\") pod \"527d3ded-534d-44e5-91f5-9c0e7d0439c7\" (UID: \"527d3ded-534d-44e5-91f5-9c0e7d0439c7\") " Jul 24 14:39:42.678961 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:42.678945 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4wd2m\" (UniqueName: \"kubernetes.io/projected/527d3ded-534d-44e5-91f5-9c0e7d0439c7-kube-api-access-4wd2m\") pod \"527d3ded-534d-44e5-91f5-9c0e7d0439c7\" (UID: \"527d3ded-534d-44e5-91f5-9c0e7d0439c7\") " Jul 24 14:39:42.679198 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:42.678986 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/527d3ded-534d-44e5-91f5-9c0e7d0439c7-bundle\") pod \"527d3ded-534d-44e5-91f5-9c0e7d0439c7\" (UID: \"527d3ded-534d-44e5-91f5-9c0e7d0439c7\") " Jul 24 14:39:42.679401 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:42.679369 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/527d3ded-534d-44e5-91f5-9c0e7d0439c7-bundle" (OuterVolumeSpecName: "bundle") pod "527d3ded-534d-44e5-91f5-9c0e7d0439c7" (UID: "527d3ded-534d-44e5-91f5-9c0e7d0439c7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 14:39:42.681068 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:42.681050 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/527d3ded-534d-44e5-91f5-9c0e7d0439c7-kube-api-access-4wd2m" (OuterVolumeSpecName: "kube-api-access-4wd2m") pod "527d3ded-534d-44e5-91f5-9c0e7d0439c7" (UID: "527d3ded-534d-44e5-91f5-9c0e7d0439c7"). InnerVolumeSpecName "kube-api-access-4wd2m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 14:39:42.683099 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:42.683078 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/527d3ded-534d-44e5-91f5-9c0e7d0439c7-util" (OuterVolumeSpecName: "util") pod "527d3ded-534d-44e5-91f5-9c0e7d0439c7" (UID: "527d3ded-534d-44e5-91f5-9c0e7d0439c7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 14:39:42.780287 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:42.780255 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/527d3ded-534d-44e5-91f5-9c0e7d0439c7-bundle\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 14:39:42.780287 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:42.780280 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/527d3ded-534d-44e5-91f5-9c0e7d0439c7-util\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 14:39:42.780287 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:42.780291 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4wd2m\" (UniqueName: \"kubernetes.io/projected/527d3ded-534d-44e5-91f5-9c0e7d0439c7-kube-api-access-4wd2m\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 14:39:43.415629 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:43.415600 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7pbxm" Jul 24 14:39:43.415629 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:43.415607 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7pbxm" event={"ID":"527d3ded-534d-44e5-91f5-9c0e7d0439c7","Type":"ContainerDied","Data":"f32dd573b9577e4934d5f4d96cfa3514b0d53a7f8925214d2295310973179303"} Jul 24 14:39:43.415811 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:43.415657 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f32dd573b9577e4934d5f4d96cfa3514b0d53a7f8925214d2295310973179303" Jul 24 14:39:44.396288 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:44.396254 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-f9wjt" Jul 24 14:39:45.025223 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:45.025185 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:39:46.045086 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:46.045051 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-km2vm"] Jul 24 14:39:46.045497 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:46.045398 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="527d3ded-534d-44e5-91f5-9c0e7d0439c7" containerName="extract" Jul 24 14:39:46.045497 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:46.045414 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="527d3ded-534d-44e5-91f5-9c0e7d0439c7" containerName="extract" Jul 24 14:39:46.045497 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:46.045427 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="527d3ded-534d-44e5-91f5-9c0e7d0439c7" containerName="util" Jul 24 14:39:46.045497 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:46.045433 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="527d3ded-534d-44e5-91f5-9c0e7d0439c7" containerName="util" Jul 24 14:39:46.045497 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:46.045445 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="527d3ded-534d-44e5-91f5-9c0e7d0439c7" containerName="pull" Jul 24 14:39:46.045497 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:46.045450 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="527d3ded-534d-44e5-91f5-9c0e7d0439c7" containerName="pull" Jul 24 14:39:46.045718 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:46.045541 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="527d3ded-534d-44e5-91f5-9c0e7d0439c7" containerName="extract" Jul 24 14:39:46.051633 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:46.051606 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-km2vm" Jul 24 14:39:46.054180 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:46.054157 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-dp9fk\"" Jul 24 14:39:46.062941 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:46.062918 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-km2vm"] Jul 24 14:39:46.209975 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:46.209939 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5mpv\" (UniqueName: \"kubernetes.io/projected/51b6397a-ccf3-4b9a-9ba2-009c03d75f43-kube-api-access-z5mpv\") pod \"cert-manager-55b4d954d5-km2vm\" (UID: \"51b6397a-ccf3-4b9a-9ba2-009c03d75f43\") " pod="cert-manager/cert-manager-55b4d954d5-km2vm" Jul 24 14:39:46.210149 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:46.209988 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/51b6397a-ccf3-4b9a-9ba2-009c03d75f43-bound-sa-token\") pod \"cert-manager-55b4d954d5-km2vm\" (UID: \"51b6397a-ccf3-4b9a-9ba2-009c03d75f43\") " pod="cert-manager/cert-manager-55b4d954d5-km2vm" Jul 24 14:39:46.310482 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:46.310436 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/51b6397a-ccf3-4b9a-9ba2-009c03d75f43-bound-sa-token\") pod \"cert-manager-55b4d954d5-km2vm\" (UID: \"51b6397a-ccf3-4b9a-9ba2-009c03d75f43\") " pod="cert-manager/cert-manager-55b4d954d5-km2vm" Jul 24 14:39:46.310641 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:46.310527 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5mpv\" (UniqueName: \"kubernetes.io/projected/51b6397a-ccf3-4b9a-9ba2-009c03d75f43-kube-api-access-z5mpv\") pod \"cert-manager-55b4d954d5-km2vm\" (UID: \"51b6397a-ccf3-4b9a-9ba2-009c03d75f43\") " pod="cert-manager/cert-manager-55b4d954d5-km2vm" Jul 24 14:39:46.320119 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:46.320087 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/51b6397a-ccf3-4b9a-9ba2-009c03d75f43-bound-sa-token\") pod \"cert-manager-55b4d954d5-km2vm\" (UID: \"51b6397a-ccf3-4b9a-9ba2-009c03d75f43\") " pod="cert-manager/cert-manager-55b4d954d5-km2vm" Jul 24 14:39:46.320249 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:46.320163 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5mpv\" (UniqueName: \"kubernetes.io/projected/51b6397a-ccf3-4b9a-9ba2-009c03d75f43-kube-api-access-z5mpv\") pod \"cert-manager-55b4d954d5-km2vm\" (UID: \"51b6397a-ccf3-4b9a-9ba2-009c03d75f43\") " pod="cert-manager/cert-manager-55b4d954d5-km2vm" Jul 24 14:39:46.361277 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:46.361249 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-km2vm" Jul 24 14:39:46.495963 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:46.495840 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-km2vm"] Jul 24 14:39:46.498541 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:39:46.498510 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod51b6397a_ccf3_4b9a_9ba2_009c03d75f43.slice/crio-9c2b971ef8639f29b573fa9151e4f07d5abd1170a98fc9edf89a711fe5a18fd9 WatchSource:0}: Error finding container 9c2b971ef8639f29b573fa9151e4f07d5abd1170a98fc9edf89a711fe5a18fd9: Status 404 returned error can't find the container with id 9c2b971ef8639f29b573fa9151e4f07d5abd1170a98fc9edf89a711fe5a18fd9 Jul 24 14:39:47.045891 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:47.045864 2565 kubelet.go:1648] "Image garbage collection succeeded" Jul 24 14:39:47.187576 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:47.187369 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:39:47.308547 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:47.308516 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:39:47.436175 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:47.436139 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-km2vm" event={"ID":"51b6397a-ccf3-4b9a-9ba2-009c03d75f43","Type":"ContainerStarted","Data":"e3fe9d6848adf266e983d62c45643940c3c5e1addeadd4975c76858c49cc4da3"} Jul 24 14:39:47.436335 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:47.436192 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-km2vm" event={"ID":"51b6397a-ccf3-4b9a-9ba2-009c03d75f43","Type":"ContainerStarted","Data":"9c2b971ef8639f29b573fa9151e4f07d5abd1170a98fc9edf89a711fe5a18fd9"} Jul 24 14:39:47.453735 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:47.453664 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-km2vm" podStartSLOduration=1.453645729 podStartE2EDuration="1.453645729s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:39:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:39:47.453384971 +0000 UTC m=+300.734774552" watchObservedRunningTime="2026-07-24 14:39:47.453645729 +0000 UTC m=+300.735035308" Jul 24 14:39:48.640574 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:48.640538 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9jkq8"] Jul 24 14:39:48.643768 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:48.643751 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9jkq8" Jul 24 14:39:48.646153 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:48.646132 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 24 14:39:48.646251 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:48.646212 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-2psj7\"" Jul 24 14:39:48.646349 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:48.646324 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 24 14:39:48.654174 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:48.654154 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9jkq8"] Jul 24 14:39:48.732627 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:48.732595 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fb9b5749-8215-4ada-b846-d96b2521b149-tmp\") pod \"openshift-lws-operator-fd8ccff4c-9jkq8\" (UID: \"fb9b5749-8215-4ada-b846-d96b2521b149\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9jkq8" Jul 24 14:39:48.732808 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:48.732641 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jksm\" (UniqueName: \"kubernetes.io/projected/fb9b5749-8215-4ada-b846-d96b2521b149-kube-api-access-8jksm\") pod \"openshift-lws-operator-fd8ccff4c-9jkq8\" (UID: \"fb9b5749-8215-4ada-b846-d96b2521b149\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9jkq8" Jul 24 14:39:48.833410 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:48.833370 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fb9b5749-8215-4ada-b846-d96b2521b149-tmp\") pod \"openshift-lws-operator-fd8ccff4c-9jkq8\" (UID: \"fb9b5749-8215-4ada-b846-d96b2521b149\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9jkq8" Jul 24 14:39:48.833593 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:48.833427 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jksm\" (UniqueName: \"kubernetes.io/projected/fb9b5749-8215-4ada-b846-d96b2521b149-kube-api-access-8jksm\") pod \"openshift-lws-operator-fd8ccff4c-9jkq8\" (UID: \"fb9b5749-8215-4ada-b846-d96b2521b149\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9jkq8" Jul 24 14:39:48.833785 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:48.833764 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fb9b5749-8215-4ada-b846-d96b2521b149-tmp\") pod \"openshift-lws-operator-fd8ccff4c-9jkq8\" (UID: \"fb9b5749-8215-4ada-b846-d96b2521b149\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9jkq8" Jul 24 14:39:48.844251 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:48.844223 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jksm\" (UniqueName: \"kubernetes.io/projected/fb9b5749-8215-4ada-b846-d96b2521b149-kube-api-access-8jksm\") pod \"openshift-lws-operator-fd8ccff4c-9jkq8\" (UID: \"fb9b5749-8215-4ada-b846-d96b2521b149\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9jkq8" Jul 24 14:39:48.953779 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:48.953699 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9jkq8" Jul 24 14:39:49.084163 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:49.084137 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9jkq8"] Jul 24 14:39:49.086393 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:39:49.086363 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfb9b5749_8215_4ada_b846_d96b2521b149.slice/crio-6a4721f63226324eee980518516f1acb4e3362981d32df81b3a0d423d493e8b2 WatchSource:0}: Error finding container 6a4721f63226324eee980518516f1acb4e3362981d32df81b3a0d423d493e8b2: Status 404 returned error can't find the container with id 6a4721f63226324eee980518516f1acb4e3362981d32df81b3a0d423d493e8b2 Jul 24 14:39:49.088054 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:49.088038 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 24 14:39:49.445978 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:49.445939 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9jkq8" event={"ID":"fb9b5749-8215-4ada-b846-d96b2521b149","Type":"ContainerStarted","Data":"6a4721f63226324eee980518516f1acb4e3362981d32df81b3a0d423d493e8b2"} Jul 24 14:39:51.457232 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:51.457131 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9jkq8" event={"ID":"fb9b5749-8215-4ada-b846-d96b2521b149","Type":"ContainerStarted","Data":"024c9b4bc5525f92f46e776083ebac83dbe3fdbcc4f3fa9a7bf92daae09a6030"} Jul 24 14:39:51.481888 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:51.481839 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9jkq8" podStartSLOduration=1.431183967 podStartE2EDuration="3.481822843s" totalImagesPullingTime="2.050638876s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:39:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:39:51.479221226 +0000 UTC m=+304.760610811" watchObservedRunningTime="2026-07-24 14:39:51.481822843 +0000 UTC m=+304.763212424" Jul 24 14:39:52.278633 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:52.278597 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:39:52.383601 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:52.383565 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:39:54.252209 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:54.252172 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9jvs"] Jul 24 14:39:54.254823 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:54.254805 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9jvs" Jul 24 14:39:54.257532 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:54.257507 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 24 14:39:54.257662 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:54.257582 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 24 14:39:54.258350 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:54.258325 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2lppj\"" Jul 24 14:39:54.269666 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:54.269640 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9jvs"] Jul 24 14:39:54.383382 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:54.383350 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ps7hd\" (UniqueName: \"kubernetes.io/projected/1c5a76f2-36be-4aa6-8062-7a2e7243acca-kube-api-access-ps7hd\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9jvs\" (UID: \"1c5a76f2-36be-4aa6-8062-7a2e7243acca\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9jvs" Jul 24 14:39:54.383578 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:54.383396 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c5a76f2-36be-4aa6-8062-7a2e7243acca-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9jvs\" (UID: \"1c5a76f2-36be-4aa6-8062-7a2e7243acca\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9jvs" Jul 24 14:39:54.383578 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:54.383418 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c5a76f2-36be-4aa6-8062-7a2e7243acca-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9jvs\" (UID: \"1c5a76f2-36be-4aa6-8062-7a2e7243acca\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9jvs" Jul 24 14:39:54.441067 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:54.441033 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:39:54.484138 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:54.484104 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ps7hd\" (UniqueName: \"kubernetes.io/projected/1c5a76f2-36be-4aa6-8062-7a2e7243acca-kube-api-access-ps7hd\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9jvs\" (UID: \"1c5a76f2-36be-4aa6-8062-7a2e7243acca\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9jvs" Jul 24 14:39:54.484301 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:54.484150 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c5a76f2-36be-4aa6-8062-7a2e7243acca-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9jvs\" (UID: \"1c5a76f2-36be-4aa6-8062-7a2e7243acca\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9jvs" Jul 24 14:39:54.484301 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:54.484167 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c5a76f2-36be-4aa6-8062-7a2e7243acca-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9jvs\" (UID: \"1c5a76f2-36be-4aa6-8062-7a2e7243acca\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9jvs" Jul 24 14:39:54.484532 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:54.484513 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c5a76f2-36be-4aa6-8062-7a2e7243acca-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9jvs\" (UID: \"1c5a76f2-36be-4aa6-8062-7a2e7243acca\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9jvs" Jul 24 14:39:54.484782 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:54.484544 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c5a76f2-36be-4aa6-8062-7a2e7243acca-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9jvs\" (UID: \"1c5a76f2-36be-4aa6-8062-7a2e7243acca\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9jvs" Jul 24 14:39:54.493516 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:54.493497 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ps7hd\" (UniqueName: \"kubernetes.io/projected/1c5a76f2-36be-4aa6-8062-7a2e7243acca-kube-api-access-ps7hd\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9jvs\" (UID: \"1c5a76f2-36be-4aa6-8062-7a2e7243acca\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9jvs" Jul 24 14:39:54.564124 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:54.564097 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9jvs" Jul 24 14:39:54.698260 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:54.698236 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9jvs"] Jul 24 14:39:54.700794 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:39:54.700770 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c5a76f2_36be_4aa6_8062_7a2e7243acca.slice/crio-1e11a48dcb362150042d49202a720959802ee0e3750c562ad00d2b8960cd1114 WatchSource:0}: Error finding container 1e11a48dcb362150042d49202a720959802ee0e3750c562ad00d2b8960cd1114: Status 404 returned error can't find the container with id 1e11a48dcb362150042d49202a720959802ee0e3750c562ad00d2b8960cd1114 Jul 24 14:39:55.475662 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:55.475624 2565 generic.go:356] "Generic (PLEG): container finished" podID="1c5a76f2-36be-4aa6-8062-7a2e7243acca" containerID="aa2e1400ee9a2ee5550b97959cf7247e9af4b4bf791b8153565fb7acd2c938dd" exitCode=0 Jul 24 14:39:55.476057 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:55.475700 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9jvs" event={"ID":"1c5a76f2-36be-4aa6-8062-7a2e7243acca","Type":"ContainerDied","Data":"aa2e1400ee9a2ee5550b97959cf7247e9af4b4bf791b8153565fb7acd2c938dd"} Jul 24 14:39:55.476057 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:55.475742 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9jvs" event={"ID":"1c5a76f2-36be-4aa6-8062-7a2e7243acca","Type":"ContainerStarted","Data":"1e11a48dcb362150042d49202a720959802ee0e3750c562ad00d2b8960cd1114"} Jul 24 14:39:56.482424 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:56.482347 2565 generic.go:356] "Generic (PLEG): container finished" podID="1c5a76f2-36be-4aa6-8062-7a2e7243acca" containerID="e82b0e30d46f26975d31525db3e39ad665ae773fee9a47e368a75e5b8444393a" exitCode=0 Jul 24 14:39:56.482879 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:56.482427 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9jvs" event={"ID":"1c5a76f2-36be-4aa6-8062-7a2e7243acca","Type":"ContainerDied","Data":"e82b0e30d46f26975d31525db3e39ad665ae773fee9a47e368a75e5b8444393a"} Jul 24 14:39:57.488975 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:57.488942 2565 generic.go:356] "Generic (PLEG): container finished" podID="1c5a76f2-36be-4aa6-8062-7a2e7243acca" containerID="5141ed740d8f26504c00c30fee31ee0e5db856c90c1a51542b28eae2156f1ab4" exitCode=0 Jul 24 14:39:57.489357 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:57.489029 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9jvs" event={"ID":"1c5a76f2-36be-4aa6-8062-7a2e7243acca","Type":"ContainerDied","Data":"5141ed740d8f26504c00c30fee31ee0e5db856c90c1a51542b28eae2156f1ab4"} Jul 24 14:39:58.641811 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:58.641782 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9jvs" Jul 24 14:39:58.725336 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:58.725297 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ps7hd\" (UniqueName: \"kubernetes.io/projected/1c5a76f2-36be-4aa6-8062-7a2e7243acca-kube-api-access-ps7hd\") pod \"1c5a76f2-36be-4aa6-8062-7a2e7243acca\" (UID: \"1c5a76f2-36be-4aa6-8062-7a2e7243acca\") " Jul 24 14:39:58.725541 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:58.725350 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c5a76f2-36be-4aa6-8062-7a2e7243acca-bundle\") pod \"1c5a76f2-36be-4aa6-8062-7a2e7243acca\" (UID: \"1c5a76f2-36be-4aa6-8062-7a2e7243acca\") " Jul 24 14:39:58.725541 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:58.725373 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c5a76f2-36be-4aa6-8062-7a2e7243acca-util\") pod \"1c5a76f2-36be-4aa6-8062-7a2e7243acca\" (UID: \"1c5a76f2-36be-4aa6-8062-7a2e7243acca\") " Jul 24 14:39:58.726092 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:58.726064 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c5a76f2-36be-4aa6-8062-7a2e7243acca-bundle" (OuterVolumeSpecName: "bundle") pod "1c5a76f2-36be-4aa6-8062-7a2e7243acca" (UID: "1c5a76f2-36be-4aa6-8062-7a2e7243acca"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 14:39:58.727562 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:58.727541 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c5a76f2-36be-4aa6-8062-7a2e7243acca-kube-api-access-ps7hd" (OuterVolumeSpecName: "kube-api-access-ps7hd") pod "1c5a76f2-36be-4aa6-8062-7a2e7243acca" (UID: "1c5a76f2-36be-4aa6-8062-7a2e7243acca"). InnerVolumeSpecName "kube-api-access-ps7hd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 14:39:58.731518 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:58.731485 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c5a76f2-36be-4aa6-8062-7a2e7243acca-util" (OuterVolumeSpecName: "util") pod "1c5a76f2-36be-4aa6-8062-7a2e7243acca" (UID: "1c5a76f2-36be-4aa6-8062-7a2e7243acca"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 14:39:58.826320 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:58.826288 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c5a76f2-36be-4aa6-8062-7a2e7243acca-bundle\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 14:39:58.826320 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:58.826317 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c5a76f2-36be-4aa6-8062-7a2e7243acca-util\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 14:39:58.826520 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:58.826330 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ps7hd\" (UniqueName: \"kubernetes.io/projected/1c5a76f2-36be-4aa6-8062-7a2e7243acca-kube-api-access-ps7hd\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 14:39:59.500545 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:59.500459 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9jvs" Jul 24 14:39:59.500545 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:59.500500 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9jvs" event={"ID":"1c5a76f2-36be-4aa6-8062-7a2e7243acca","Type":"ContainerDied","Data":"1e11a48dcb362150042d49202a720959802ee0e3750c562ad00d2b8960cd1114"} Jul 24 14:39:59.500545 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:39:59.500544 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1e11a48dcb362150042d49202a720959802ee0e3750c562ad00d2b8960cd1114" Jul 24 14:40:06.905611 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:06.905576 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:40:07.007061 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:07.007026 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:40:07.503915 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:07.503883 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:40:07.691092 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:07.691020 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:40:07.791799 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:07.791714 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:40:07.850483 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:07.850449 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78954f66f5-8jqsf"] Jul 24 14:40:07.850847 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:07.850829 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c5a76f2-36be-4aa6-8062-7a2e7243acca" containerName="util" Jul 24 14:40:07.850945 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:07.850850 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c5a76f2-36be-4aa6-8062-7a2e7243acca" containerName="util" Jul 24 14:40:07.850945 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:07.850883 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c5a76f2-36be-4aa6-8062-7a2e7243acca" containerName="extract" Jul 24 14:40:07.850945 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:07.850892 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c5a76f2-36be-4aa6-8062-7a2e7243acca" containerName="extract" Jul 24 14:40:07.850945 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:07.850913 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c5a76f2-36be-4aa6-8062-7a2e7243acca" containerName="pull" Jul 24 14:40:07.850945 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:07.850921 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c5a76f2-36be-4aa6-8062-7a2e7243acca" containerName="pull" Jul 24 14:40:07.851212 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:07.851005 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c5a76f2-36be-4aa6-8062-7a2e7243acca" containerName="extract" Jul 24 14:40:07.853946 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:07.853923 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-78954f66f5-8jqsf" Jul 24 14:40:07.856321 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:07.856296 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 24 14:40:07.856446 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:07.856300 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 24 14:40:07.856692 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:07.856677 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-hgf94\"" Jul 24 14:40:07.856848 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:07.856830 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 24 14:40:07.858331 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:07.858313 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 24 14:40:07.871311 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:07.871289 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78954f66f5-8jqsf"] Jul 24 14:40:07.895655 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:07.895629 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p66sc\" (UniqueName: \"kubernetes.io/projected/0f8a5e8c-3d07-4b71-bd50-33842caf8bf3-kube-api-access-p66sc\") pod \"opendatahub-operator-controller-manager-78954f66f5-8jqsf\" (UID: \"0f8a5e8c-3d07-4b71-bd50-33842caf8bf3\") " pod="opendatahub/opendatahub-operator-controller-manager-78954f66f5-8jqsf" Jul 24 14:40:07.895768 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:07.895662 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0f8a5e8c-3d07-4b71-bd50-33842caf8bf3-webhook-cert\") pod \"opendatahub-operator-controller-manager-78954f66f5-8jqsf\" (UID: \"0f8a5e8c-3d07-4b71-bd50-33842caf8bf3\") " pod="opendatahub/opendatahub-operator-controller-manager-78954f66f5-8jqsf" Jul 24 14:40:07.895768 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:07.895684 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f8a5e8c-3d07-4b71-bd50-33842caf8bf3-tmp\") pod \"opendatahub-operator-controller-manager-78954f66f5-8jqsf\" (UID: \"0f8a5e8c-3d07-4b71-bd50-33842caf8bf3\") " pod="opendatahub/opendatahub-operator-controller-manager-78954f66f5-8jqsf" Jul 24 14:40:07.895839 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:07.895775 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0f8a5e8c-3d07-4b71-bd50-33842caf8bf3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78954f66f5-8jqsf\" (UID: \"0f8a5e8c-3d07-4b71-bd50-33842caf8bf3\") " pod="opendatahub/opendatahub-operator-controller-manager-78954f66f5-8jqsf" Jul 24 14:40:07.895839 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:07.895801 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0f8a5e8c-3d07-4b71-bd50-33842caf8bf3-manifests\") pod \"opendatahub-operator-controller-manager-78954f66f5-8jqsf\" (UID: \"0f8a5e8c-3d07-4b71-bd50-33842caf8bf3\") " pod="opendatahub/opendatahub-operator-controller-manager-78954f66f5-8jqsf" Jul 24 14:40:07.997187 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:07.997146 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0f8a5e8c-3d07-4b71-bd50-33842caf8bf3-manifests\") pod \"opendatahub-operator-controller-manager-78954f66f5-8jqsf\" (UID: \"0f8a5e8c-3d07-4b71-bd50-33842caf8bf3\") " pod="opendatahub/opendatahub-operator-controller-manager-78954f66f5-8jqsf" Jul 24 14:40:07.997682 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:07.997240 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p66sc\" (UniqueName: \"kubernetes.io/projected/0f8a5e8c-3d07-4b71-bd50-33842caf8bf3-kube-api-access-p66sc\") pod \"opendatahub-operator-controller-manager-78954f66f5-8jqsf\" (UID: \"0f8a5e8c-3d07-4b71-bd50-33842caf8bf3\") " pod="opendatahub/opendatahub-operator-controller-manager-78954f66f5-8jqsf" Jul 24 14:40:07.997682 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:07.997272 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0f8a5e8c-3d07-4b71-bd50-33842caf8bf3-webhook-cert\") pod \"opendatahub-operator-controller-manager-78954f66f5-8jqsf\" (UID: \"0f8a5e8c-3d07-4b71-bd50-33842caf8bf3\") " pod="opendatahub/opendatahub-operator-controller-manager-78954f66f5-8jqsf" Jul 24 14:40:07.997682 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:07.997300 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f8a5e8c-3d07-4b71-bd50-33842caf8bf3-tmp\") pod \"opendatahub-operator-controller-manager-78954f66f5-8jqsf\" (UID: \"0f8a5e8c-3d07-4b71-bd50-33842caf8bf3\") " pod="opendatahub/opendatahub-operator-controller-manager-78954f66f5-8jqsf" Jul 24 14:40:07.997682 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:07.997347 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0f8a5e8c-3d07-4b71-bd50-33842caf8bf3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78954f66f5-8jqsf\" (UID: \"0f8a5e8c-3d07-4b71-bd50-33842caf8bf3\") " pod="opendatahub/opendatahub-operator-controller-manager-78954f66f5-8jqsf" Jul 24 14:40:07.997682 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:07.997561 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0f8a5e8c-3d07-4b71-bd50-33842caf8bf3-manifests\") pod \"opendatahub-operator-controller-manager-78954f66f5-8jqsf\" (UID: \"0f8a5e8c-3d07-4b71-bd50-33842caf8bf3\") " pod="opendatahub/opendatahub-operator-controller-manager-78954f66f5-8jqsf" Jul 24 14:40:07.999749 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:07.999725 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f8a5e8c-3d07-4b71-bd50-33842caf8bf3-tmp\") pod \"opendatahub-operator-controller-manager-78954f66f5-8jqsf\" (UID: \"0f8a5e8c-3d07-4b71-bd50-33842caf8bf3\") " pod="opendatahub/opendatahub-operator-controller-manager-78954f66f5-8jqsf" Jul 24 14:40:07.999918 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:07.999898 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0f8a5e8c-3d07-4b71-bd50-33842caf8bf3-webhook-cert\") pod \"opendatahub-operator-controller-manager-78954f66f5-8jqsf\" (UID: \"0f8a5e8c-3d07-4b71-bd50-33842caf8bf3\") " pod="opendatahub/opendatahub-operator-controller-manager-78954f66f5-8jqsf" Jul 24 14:40:07.999962 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:07.999931 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0f8a5e8c-3d07-4b71-bd50-33842caf8bf3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78954f66f5-8jqsf\" (UID: \"0f8a5e8c-3d07-4b71-bd50-33842caf8bf3\") " pod="opendatahub/opendatahub-operator-controller-manager-78954f66f5-8jqsf" Jul 24 14:40:08.013246 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:08.013223 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p66sc\" (UniqueName: \"kubernetes.io/projected/0f8a5e8c-3d07-4b71-bd50-33842caf8bf3-kube-api-access-p66sc\") pod \"opendatahub-operator-controller-manager-78954f66f5-8jqsf\" (UID: \"0f8a5e8c-3d07-4b71-bd50-33842caf8bf3\") " pod="opendatahub/opendatahub-operator-controller-manager-78954f66f5-8jqsf" Jul 24 14:40:08.058257 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:08.058232 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:40:08.144061 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:08.144028 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:40:08.164558 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:08.164520 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-78954f66f5-8jqsf" Jul 24 14:40:08.243980 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:08.243945 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:40:08.311498 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:08.311448 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78954f66f5-8jqsf"] Jul 24 14:40:08.312694 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:40:08.312666 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f8a5e8c_3d07_4b71_bd50_33842caf8bf3.slice/crio-53dfe487a99a0f04153c365887caa868ece5a13ba4d2c572a97d83aad84dc255 WatchSource:0}: Error finding container 53dfe487a99a0f04153c365887caa868ece5a13ba4d2c572a97d83aad84dc255: Status 404 returned error can't find the container with id 53dfe487a99a0f04153c365887caa868ece5a13ba4d2c572a97d83aad84dc255 Jul 24 14:40:08.345331 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:08.345307 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:40:08.448589 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:08.448551 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:40:08.541236 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:08.541194 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78954f66f5-8jqsf" event={"ID":"0f8a5e8c-3d07-4b71-bd50-33842caf8bf3","Type":"ContainerStarted","Data":"53dfe487a99a0f04153c365887caa868ece5a13ba4d2c572a97d83aad84dc255"} Jul 24 14:40:08.550515 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:08.550491 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:40:08.649338 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:08.649266 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:40:09.454660 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:09.454630 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:40:13.568032 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:13.567984 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78954f66f5-8jqsf" event={"ID":"0f8a5e8c-3d07-4b71-bd50-33842caf8bf3","Type":"ContainerStarted","Data":"358552addc66569f3a1139ff32f5cf4db6684a1e7eb3695a561577b4e5c53a14"} Jul 24 14:40:14.575381 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:14.575347 2565 generic.go:356] "Generic (PLEG): container finished" podID="0f8a5e8c-3d07-4b71-bd50-33842caf8bf3" containerID="358552addc66569f3a1139ff32f5cf4db6684a1e7eb3695a561577b4e5c53a14" exitCode=0 Jul 24 14:40:14.575809 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:14.575442 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78954f66f5-8jqsf" event={"ID":"0f8a5e8c-3d07-4b71-bd50-33842caf8bf3","Type":"ContainerDied","Data":"358552addc66569f3a1139ff32f5cf4db6684a1e7eb3695a561577b4e5c53a14"} Jul 24 14:40:15.582535 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:15.582495 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78954f66f5-8jqsf" event={"ID":"0f8a5e8c-3d07-4b71-bd50-33842caf8bf3","Type":"ContainerStarted","Data":"30edd825e3c57fa7e6b34fe3666e81d3cf8f7398dd38f83955c7f804218a9a9e"} Jul 24 14:40:15.582892 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:15.582638 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-78954f66f5-8jqsf" Jul 24 14:40:15.607804 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:15.607761 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-78954f66f5-8jqsf" podStartSLOduration=2.5727901490000002 podStartE2EDuration="8.607745573s" totalImagesPullingTime="4.997720801s" totalInitContainerRuntime="1.037234623s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:40:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:40:15.606872903 +0000 UTC m=+328.888262484" watchObservedRunningTime="2026-07-24 14:40:15.607745573 +0000 UTC m=+328.889135154" Jul 24 14:40:16.528979 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:16.528939 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:40:19.077684 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:19.077654 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:40:19.169374 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:19.169329 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:40:20.744493 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:20.744433 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:40:20.885523 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:20.885492 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:40:26.589738 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:26.589687 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-78954f66f5-8jqsf" Jul 24 14:40:28.341881 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:28.341839 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:40:29.114327 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:29.114293 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-64476444cd-964t4"] Jul 24 14:40:29.122744 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:29.122722 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-64476444cd-964t4" Jul 24 14:40:29.125693 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:29.125668 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 24 14:40:29.125794 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:29.125747 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 24 14:40:29.137371 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:29.137349 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-64476444cd-964t4"] Jul 24 14:40:29.274658 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:29.274622 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgbjn\" (UniqueName: \"kubernetes.io/projected/f9c336e7-a868-4c30-afb8-81659246dd44-kube-api-access-fgbjn\") pod \"kube-auth-proxy-64476444cd-964t4\" (UID: \"f9c336e7-a868-4c30-afb8-81659246dd44\") " pod="openshift-ingress/kube-auth-proxy-64476444cd-964t4" Jul 24 14:40:29.274818 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:29.274676 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f9c336e7-a868-4c30-afb8-81659246dd44-tmp\") pod \"kube-auth-proxy-64476444cd-964t4\" (UID: \"f9c336e7-a868-4c30-afb8-81659246dd44\") " pod="openshift-ingress/kube-auth-proxy-64476444cd-964t4" Jul 24 14:40:29.274818 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:29.274728 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9c336e7-a868-4c30-afb8-81659246dd44-tls-certs\") pod \"kube-auth-proxy-64476444cd-964t4\" (UID: \"f9c336e7-a868-4c30-afb8-81659246dd44\") " pod="openshift-ingress/kube-auth-proxy-64476444cd-964t4" Jul 24 14:40:29.376044 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:29.375952 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f9c336e7-a868-4c30-afb8-81659246dd44-tmp\") pod \"kube-auth-proxy-64476444cd-964t4\" (UID: \"f9c336e7-a868-4c30-afb8-81659246dd44\") " pod="openshift-ingress/kube-auth-proxy-64476444cd-964t4" Jul 24 14:40:29.376044 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:29.375999 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9c336e7-a868-4c30-afb8-81659246dd44-tls-certs\") pod \"kube-auth-proxy-64476444cd-964t4\" (UID: \"f9c336e7-a868-4c30-afb8-81659246dd44\") " pod="openshift-ingress/kube-auth-proxy-64476444cd-964t4" Jul 24 14:40:29.376543 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:29.376070 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgbjn\" (UniqueName: \"kubernetes.io/projected/f9c336e7-a868-4c30-afb8-81659246dd44-kube-api-access-fgbjn\") pod \"kube-auth-proxy-64476444cd-964t4\" (UID: \"f9c336e7-a868-4c30-afb8-81659246dd44\") " pod="openshift-ingress/kube-auth-proxy-64476444cd-964t4" Jul 24 14:40:29.378198 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:29.378165 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f9c336e7-a868-4c30-afb8-81659246dd44-tmp\") pod \"kube-auth-proxy-64476444cd-964t4\" (UID: \"f9c336e7-a868-4c30-afb8-81659246dd44\") " pod="openshift-ingress/kube-auth-proxy-64476444cd-964t4" Jul 24 14:40:29.378331 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:29.378312 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9c336e7-a868-4c30-afb8-81659246dd44-tls-certs\") pod \"kube-auth-proxy-64476444cd-964t4\" (UID: \"f9c336e7-a868-4c30-afb8-81659246dd44\") " pod="openshift-ingress/kube-auth-proxy-64476444cd-964t4" Jul 24 14:40:29.389366 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:29.389345 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgbjn\" (UniqueName: \"kubernetes.io/projected/f9c336e7-a868-4c30-afb8-81659246dd44-kube-api-access-fgbjn\") pod \"kube-auth-proxy-64476444cd-964t4\" (UID: \"f9c336e7-a868-4c30-afb8-81659246dd44\") " pod="openshift-ingress/kube-auth-proxy-64476444cd-964t4" Jul 24 14:40:29.432518 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:29.432492 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-64476444cd-964t4" Jul 24 14:40:29.505343 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:29.505313 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-4bw72"] Jul 24 14:40:29.509637 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:29.509621 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-4bw72" Jul 24 14:40:29.513492 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:29.513448 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-jqvrm\"" Jul 24 14:40:29.513629 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:29.513382 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 24 14:40:29.521775 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:29.521751 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-4bw72"] Jul 24 14:40:29.577288 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:29.577257 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fbrc\" (UniqueName: \"kubernetes.io/projected/d415d1d7-5297-45b0-8d34-ed61dd7afc88-kube-api-access-5fbrc\") pod \"odh-model-controller-7998c67dc4-4bw72\" (UID: \"d415d1d7-5297-45b0-8d34-ed61dd7afc88\") " pod="opendatahub/odh-model-controller-7998c67dc4-4bw72" Jul 24 14:40:29.577441 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:29.577297 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d415d1d7-5297-45b0-8d34-ed61dd7afc88-cert\") pod \"odh-model-controller-7998c67dc4-4bw72\" (UID: \"d415d1d7-5297-45b0-8d34-ed61dd7afc88\") " pod="opendatahub/odh-model-controller-7998c67dc4-4bw72" Jul 24 14:40:29.606235 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:29.606211 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-64476444cd-964t4"] Jul 24 14:40:29.608676 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:40:29.608648 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9c336e7_a868_4c30_afb8_81659246dd44.slice/crio-c1cc2698a518668781d6cded9897d6ef06157e614f7bb1cdf9b5c10daccb6042 WatchSource:0}: Error finding container c1cc2698a518668781d6cded9897d6ef06157e614f7bb1cdf9b5c10daccb6042: Status 404 returned error can't find the container with id c1cc2698a518668781d6cded9897d6ef06157e614f7bb1cdf9b5c10daccb6042 Jul 24 14:40:29.650507 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:29.650425 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-64476444cd-964t4" event={"ID":"f9c336e7-a868-4c30-afb8-81659246dd44","Type":"ContainerStarted","Data":"c1cc2698a518668781d6cded9897d6ef06157e614f7bb1cdf9b5c10daccb6042"} Jul 24 14:40:29.677909 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:29.677881 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fbrc\" (UniqueName: \"kubernetes.io/projected/d415d1d7-5297-45b0-8d34-ed61dd7afc88-kube-api-access-5fbrc\") pod \"odh-model-controller-7998c67dc4-4bw72\" (UID: \"d415d1d7-5297-45b0-8d34-ed61dd7afc88\") " pod="opendatahub/odh-model-controller-7998c67dc4-4bw72" Jul 24 14:40:29.678015 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:29.677920 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d415d1d7-5297-45b0-8d34-ed61dd7afc88-cert\") pod \"odh-model-controller-7998c67dc4-4bw72\" (UID: \"d415d1d7-5297-45b0-8d34-ed61dd7afc88\") " pod="opendatahub/odh-model-controller-7998c67dc4-4bw72" Jul 24 14:40:29.678061 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:40:29.678046 2565 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 24 14:40:29.678110 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:40:29.678100 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d415d1d7-5297-45b0-8d34-ed61dd7afc88-cert podName:d415d1d7-5297-45b0-8d34-ed61dd7afc88 nodeName:}" failed. No retries permitted until 2026-07-24 14:40:30.178079382 +0000 UTC m=+343.459468941 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d415d1d7-5297-45b0-8d34-ed61dd7afc88-cert") pod "odh-model-controller-7998c67dc4-4bw72" (UID: "d415d1d7-5297-45b0-8d34-ed61dd7afc88") : secret "odh-model-controller-webhook-cert" not found Jul 24 14:40:29.699840 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:29.699809 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fbrc\" (UniqueName: \"kubernetes.io/projected/d415d1d7-5297-45b0-8d34-ed61dd7afc88-kube-api-access-5fbrc\") pod \"odh-model-controller-7998c67dc4-4bw72\" (UID: \"d415d1d7-5297-45b0-8d34-ed61dd7afc88\") " pod="opendatahub/odh-model-controller-7998c67dc4-4bw72" Jul 24 14:40:30.183536 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:30.183501 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d415d1d7-5297-45b0-8d34-ed61dd7afc88-cert\") pod \"odh-model-controller-7998c67dc4-4bw72\" (UID: \"d415d1d7-5297-45b0-8d34-ed61dd7afc88\") " pod="opendatahub/odh-model-controller-7998c67dc4-4bw72" Jul 24 14:40:30.185850 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:30.185828 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d415d1d7-5297-45b0-8d34-ed61dd7afc88-cert\") pod \"odh-model-controller-7998c67dc4-4bw72\" (UID: \"d415d1d7-5297-45b0-8d34-ed61dd7afc88\") " pod="opendatahub/odh-model-controller-7998c67dc4-4bw72" Jul 24 14:40:30.422585 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:30.422547 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-4bw72" Jul 24 14:40:30.592947 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:30.592851 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-4bw72"] Jul 24 14:40:30.595825 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:40:30.595793 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd415d1d7_5297_45b0_8d34_ed61dd7afc88.slice/crio-b0d64c67aa728ecf64a364a3eb1e7c3499e50a21a4db211d0b39ddb4c76e678e WatchSource:0}: Error finding container b0d64c67aa728ecf64a364a3eb1e7c3499e50a21a4db211d0b39ddb4c76e678e: Status 404 returned error can't find the container with id b0d64c67aa728ecf64a364a3eb1e7c3499e50a21a4db211d0b39ddb4c76e678e Jul 24 14:40:30.658625 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:30.658582 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-4bw72" event={"ID":"d415d1d7-5297-45b0-8d34-ed61dd7afc88","Type":"ContainerStarted","Data":"b0d64c67aa728ecf64a364a3eb1e7c3499e50a21a4db211d0b39ddb4c76e678e"} Jul 24 14:40:30.730926 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:30.730834 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bfhgw"] Jul 24 14:40:30.735890 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:30.735859 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bfhgw" Jul 24 14:40:30.739072 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:30.739037 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 24 14:40:30.739072 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:30.739068 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 24 14:40:30.739381 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:30.739360 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 24 14:40:30.740946 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:30.740516 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 24 14:40:30.740946 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:30.740856 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-g6ghl\"" Jul 24 14:40:30.751186 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:30.750368 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bfhgw"] Jul 24 14:40:30.889824 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:30.889788 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/04116d55-b799-4538-abe9-c3018498c1d5-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-bfhgw\" (UID: \"04116d55-b799-4538-abe9-c3018498c1d5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bfhgw" Jul 24 14:40:30.890013 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:30.889843 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04116d55-b799-4538-abe9-c3018498c1d5-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-bfhgw\" (UID: \"04116d55-b799-4538-abe9-c3018498c1d5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bfhgw" Jul 24 14:40:30.890013 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:30.889937 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjc2q\" (UniqueName: \"kubernetes.io/projected/04116d55-b799-4538-abe9-c3018498c1d5-kube-api-access-mjc2q\") pod \"istiod-openshift-gateway-7b7995d5cd-bfhgw\" (UID: \"04116d55-b799-4538-abe9-c3018498c1d5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bfhgw" Jul 24 14:40:30.890013 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:30.889975 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/04116d55-b799-4538-abe9-c3018498c1d5-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-bfhgw\" (UID: \"04116d55-b799-4538-abe9-c3018498c1d5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bfhgw" Jul 24 14:40:30.890013 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:30.889995 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/04116d55-b799-4538-abe9-c3018498c1d5-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-bfhgw\" (UID: \"04116d55-b799-4538-abe9-c3018498c1d5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bfhgw" Jul 24 14:40:30.890163 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:30.890022 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/04116d55-b799-4538-abe9-c3018498c1d5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-bfhgw\" (UID: \"04116d55-b799-4538-abe9-c3018498c1d5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bfhgw" Jul 24 14:40:30.890163 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:30.890143 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/04116d55-b799-4538-abe9-c3018498c1d5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-bfhgw\" (UID: \"04116d55-b799-4538-abe9-c3018498c1d5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bfhgw" Jul 24 14:40:30.991067 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:30.990978 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjc2q\" (UniqueName: \"kubernetes.io/projected/04116d55-b799-4538-abe9-c3018498c1d5-kube-api-access-mjc2q\") pod \"istiod-openshift-gateway-7b7995d5cd-bfhgw\" (UID: \"04116d55-b799-4538-abe9-c3018498c1d5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bfhgw" Jul 24 14:40:30.991067 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:30.991025 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/04116d55-b799-4538-abe9-c3018498c1d5-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-bfhgw\" (UID: \"04116d55-b799-4538-abe9-c3018498c1d5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bfhgw" Jul 24 14:40:30.991067 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:30.991047 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/04116d55-b799-4538-abe9-c3018498c1d5-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-bfhgw\" (UID: \"04116d55-b799-4538-abe9-c3018498c1d5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bfhgw" Jul 24 14:40:30.991067 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:30.991068 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/04116d55-b799-4538-abe9-c3018498c1d5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-bfhgw\" (UID: \"04116d55-b799-4538-abe9-c3018498c1d5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bfhgw" Jul 24 14:40:30.991370 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:30.991125 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/04116d55-b799-4538-abe9-c3018498c1d5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-bfhgw\" (UID: \"04116d55-b799-4538-abe9-c3018498c1d5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bfhgw" Jul 24 14:40:30.991453 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:30.991418 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/04116d55-b799-4538-abe9-c3018498c1d5-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-bfhgw\" (UID: \"04116d55-b799-4538-abe9-c3018498c1d5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bfhgw" Jul 24 14:40:30.991569 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:30.991544 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04116d55-b799-4538-abe9-c3018498c1d5-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-bfhgw\" (UID: \"04116d55-b799-4538-abe9-c3018498c1d5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bfhgw" Jul 24 14:40:30.991846 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:30.991799 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/04116d55-b799-4538-abe9-c3018498c1d5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-bfhgw\" (UID: \"04116d55-b799-4538-abe9-c3018498c1d5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bfhgw" Jul 24 14:40:30.993900 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:30.993874 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/04116d55-b799-4538-abe9-c3018498c1d5-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-bfhgw\" (UID: \"04116d55-b799-4538-abe9-c3018498c1d5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bfhgw" Jul 24 14:40:30.993900 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:30.993886 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/04116d55-b799-4538-abe9-c3018498c1d5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-bfhgw\" (UID: \"04116d55-b799-4538-abe9-c3018498c1d5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bfhgw" Jul 24 14:40:30.994277 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:30.994252 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/04116d55-b799-4538-abe9-c3018498c1d5-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-bfhgw\" (UID: \"04116d55-b799-4538-abe9-c3018498c1d5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bfhgw" Jul 24 14:40:30.994391 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:30.994368 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/04116d55-b799-4538-abe9-c3018498c1d5-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-bfhgw\" (UID: \"04116d55-b799-4538-abe9-c3018498c1d5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bfhgw" Jul 24 14:40:31.005359 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:31.005339 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjc2q\" (UniqueName: \"kubernetes.io/projected/04116d55-b799-4538-abe9-c3018498c1d5-kube-api-access-mjc2q\") pod \"istiod-openshift-gateway-7b7995d5cd-bfhgw\" (UID: \"04116d55-b799-4538-abe9-c3018498c1d5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bfhgw" Jul 24 14:40:31.006052 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:31.006029 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04116d55-b799-4538-abe9-c3018498c1d5-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-bfhgw\" (UID: \"04116d55-b799-4538-abe9-c3018498c1d5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bfhgw" Jul 24 14:40:31.054697 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:31.054671 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bfhgw" Jul 24 14:40:31.314424 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:31.314342 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bfhgw"] Jul 24 14:40:31.315031 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:40:31.314973 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04116d55_b799_4538_abe9_c3018498c1d5.slice/crio-6acfb6cdac63ca68b6563bc3fc48f7e36ea5708fdf45523dfca814411c8537b9 WatchSource:0}: Error finding container 6acfb6cdac63ca68b6563bc3fc48f7e36ea5708fdf45523dfca814411c8537b9: Status 404 returned error can't find the container with id 6acfb6cdac63ca68b6563bc3fc48f7e36ea5708fdf45523dfca814411c8537b9 Jul 24 14:40:31.627568 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:31.627481 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:40:31.666894 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:31.666822 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bfhgw" event={"ID":"04116d55-b799-4538-abe9-c3018498c1d5","Type":"ContainerStarted","Data":"6acfb6cdac63ca68b6563bc3fc48f7e36ea5708fdf45523dfca814411c8537b9"} Jul 24 14:40:32.311859 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:32.311822 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:40:34.684912 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:34.684867 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-64476444cd-964t4" event={"ID":"f9c336e7-a868-4c30-afb8-81659246dd44","Type":"ContainerStarted","Data":"111905e28d9b1fa455fe9f78ec1c52a13ab7a45955d65deb81ccfbddfb3cdedc"} Jul 24 14:40:34.686568 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:34.686533 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-4bw72" event={"ID":"d415d1d7-5297-45b0-8d34-ed61dd7afc88","Type":"ContainerStarted","Data":"d3320e13a3de297acc148f0182153d4f43bf0c86401ca5de411a058e1f86f68c"} Jul 24 14:40:34.686697 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:34.686681 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-4bw72" Jul 24 14:40:34.704420 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:34.704364 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-64476444cd-964t4" podStartSLOduration=1.535591672 podStartE2EDuration="5.704346826s" totalImagesPullingTime="4.168755154s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:40:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:40:34.703181502 +0000 UTC m=+347.984571297" watchObservedRunningTime="2026-07-24 14:40:34.704346826 +0000 UTC m=+347.985736409" Jul 24 14:40:34.724865 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:34.724809 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-4bw72" podStartSLOduration=2.496219645 podStartE2EDuration="5.724786647s" totalImagesPullingTime="3.228567002s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:40:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:40:34.72087005 +0000 UTC m=+348.002259634" watchObservedRunningTime="2026-07-24 14:40:34.724786647 +0000 UTC m=+348.006176230" Jul 24 14:40:35.138987 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:35.138953 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 24 14:40:35.139058 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:35.139020 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 24 14:40:35.693191 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:35.693148 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bfhgw" event={"ID":"04116d55-b799-4538-abe9-c3018498c1d5","Type":"ContainerStarted","Data":"c88881e1e8fc2af08f11ba43bab58ffc7fdb9f7eff42b99bd714ff1a5cab78d3"} Jul 24 14:40:35.693678 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:35.693440 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bfhgw" Jul 24 14:40:35.717279 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:35.717223 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bfhgw" podStartSLOduration=1.896826163 podStartE2EDuration="5.717204239s" totalImagesPullingTime="3.820378076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:40:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:40:35.714020278 +0000 UTC m=+348.995409864" watchObservedRunningTime="2026-07-24 14:40:35.717204239 +0000 UTC m=+348.998593821" Jul 24 14:40:36.137645 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:36.137608 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:40:36.326488 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:36.326443 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:40:36.700354 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:36.700323 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:40:36.700745 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:36.700383 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bfhgw" Jul 24 14:40:36.929792 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:36.929759 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:40:37.019299 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:37.019209 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:40:37.328725 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:37.328689 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-b97j4"] Jul 24 14:40:37.332543 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:37.332516 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b97j4" Jul 24 14:40:37.349944 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:37.349907 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-b97j4"] Jul 24 14:40:37.458491 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:37.455973 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0159436c-f13e-4554-964b-fc81765f9e3c-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-b97j4\" (UID: \"0159436c-f13e-4554-964b-fc81765f9e3c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b97j4" Jul 24 14:40:37.458491 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:37.456049 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0159436c-f13e-4554-964b-fc81765f9e3c-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-b97j4\" (UID: \"0159436c-f13e-4554-964b-fc81765f9e3c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b97j4" Jul 24 14:40:37.458491 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:37.456087 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0159436c-f13e-4554-964b-fc81765f9e3c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-b97j4\" (UID: \"0159436c-f13e-4554-964b-fc81765f9e3c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b97j4" Jul 24 14:40:37.458491 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:37.456129 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0159436c-f13e-4554-964b-fc81765f9e3c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-b97j4\" (UID: \"0159436c-f13e-4554-964b-fc81765f9e3c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b97j4" Jul 24 14:40:37.458491 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:37.456159 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0159436c-f13e-4554-964b-fc81765f9e3c-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-b97j4\" (UID: \"0159436c-f13e-4554-964b-fc81765f9e3c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b97j4" Jul 24 14:40:37.458491 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:37.456189 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hw6z\" (UniqueName: \"kubernetes.io/projected/0159436c-f13e-4554-964b-fc81765f9e3c-kube-api-access-7hw6z\") pod \"istiod-openshift-gateway-5677ccb49b-b97j4\" (UID: \"0159436c-f13e-4554-964b-fc81765f9e3c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b97j4" Jul 24 14:40:37.458491 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:37.456272 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0159436c-f13e-4554-964b-fc81765f9e3c-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-b97j4\" (UID: \"0159436c-f13e-4554-964b-fc81765f9e3c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b97j4" Jul 24 14:40:37.557691 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:37.557650 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0159436c-f13e-4554-964b-fc81765f9e3c-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-b97j4\" (UID: \"0159436c-f13e-4554-964b-fc81765f9e3c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b97j4" Jul 24 14:40:37.557885 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:37.557705 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0159436c-f13e-4554-964b-fc81765f9e3c-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-b97j4\" (UID: \"0159436c-f13e-4554-964b-fc81765f9e3c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b97j4" Jul 24 14:40:37.557885 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:37.557734 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0159436c-f13e-4554-964b-fc81765f9e3c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-b97j4\" (UID: \"0159436c-f13e-4554-964b-fc81765f9e3c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b97j4" Jul 24 14:40:37.557885 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:37.557758 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0159436c-f13e-4554-964b-fc81765f9e3c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-b97j4\" (UID: \"0159436c-f13e-4554-964b-fc81765f9e3c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b97j4" Jul 24 14:40:37.557885 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:37.557779 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0159436c-f13e-4554-964b-fc81765f9e3c-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-b97j4\" (UID: \"0159436c-f13e-4554-964b-fc81765f9e3c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b97j4" Jul 24 14:40:37.557885 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:37.557802 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hw6z\" (UniqueName: \"kubernetes.io/projected/0159436c-f13e-4554-964b-fc81765f9e3c-kube-api-access-7hw6z\") pod \"istiod-openshift-gateway-5677ccb49b-b97j4\" (UID: \"0159436c-f13e-4554-964b-fc81765f9e3c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b97j4" Jul 24 14:40:37.557885 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:37.557882 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0159436c-f13e-4554-964b-fc81765f9e3c-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-b97j4\" (UID: \"0159436c-f13e-4554-964b-fc81765f9e3c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b97j4" Jul 24 14:40:37.558610 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:37.558579 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0159436c-f13e-4554-964b-fc81765f9e3c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-b97j4\" (UID: \"0159436c-f13e-4554-964b-fc81765f9e3c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b97j4" Jul 24 14:40:37.560306 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:37.560273 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0159436c-f13e-4554-964b-fc81765f9e3c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-b97j4\" (UID: \"0159436c-f13e-4554-964b-fc81765f9e3c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b97j4" Jul 24 14:40:37.560414 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:37.560357 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0159436c-f13e-4554-964b-fc81765f9e3c-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-b97j4\" (UID: \"0159436c-f13e-4554-964b-fc81765f9e3c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b97j4" Jul 24 14:40:37.560414 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:37.560368 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0159436c-f13e-4554-964b-fc81765f9e3c-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-b97j4\" (UID: \"0159436c-f13e-4554-964b-fc81765f9e3c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b97j4" Jul 24 14:40:37.560414 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:37.560399 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0159436c-f13e-4554-964b-fc81765f9e3c-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-b97j4\" (UID: \"0159436c-f13e-4554-964b-fc81765f9e3c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b97j4" Jul 24 14:40:37.569518 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:37.569495 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0159436c-f13e-4554-964b-fc81765f9e3c-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-b97j4\" (UID: \"0159436c-f13e-4554-964b-fc81765f9e3c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b97j4" Jul 24 14:40:37.570014 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:37.569994 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hw6z\" (UniqueName: \"kubernetes.io/projected/0159436c-f13e-4554-964b-fc81765f9e3c-kube-api-access-7hw6z\") pod \"istiod-openshift-gateway-5677ccb49b-b97j4\" (UID: \"0159436c-f13e-4554-964b-fc81765f9e3c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b97j4" Jul 24 14:40:37.645328 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:37.645246 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b97j4" Jul 24 14:40:37.796347 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:37.796311 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-b97j4"] Jul 24 14:40:37.797176 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:40:37.797149 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0159436c_f13e_4554_964b_fc81765f9e3c.slice/crio-6b925cbfa8ecb91d87c3be12bdaadcb80e755047c2a5ced7aaaa5a104843e542 WatchSource:0}: Error finding container 6b925cbfa8ecb91d87c3be12bdaadcb80e755047c2a5ced7aaaa5a104843e542: Status 404 returned error can't find the container with id 6b925cbfa8ecb91d87c3be12bdaadcb80e755047c2a5ced7aaaa5a104843e542 Jul 24 14:40:37.800144 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:37.800114 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 24 14:40:37.800248 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:37.800187 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 24 14:40:38.715075 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:38.715042 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b97j4" event={"ID":"0159436c-f13e-4554-964b-fc81765f9e3c","Type":"ContainerStarted","Data":"b3a7032e83205fc60e99bff8ecee3d6474f7ccf1a9ffcda8dd3503860f1f196e"} Jul 24 14:40:38.715253 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:38.715103 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b97j4" Jul 24 14:40:38.715253 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:38.715124 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b97j4" event={"ID":"0159436c-f13e-4554-964b-fc81765f9e3c","Type":"ContainerStarted","Data":"6b925cbfa8ecb91d87c3be12bdaadcb80e755047c2a5ced7aaaa5a104843e542"} Jul 24 14:40:38.716901 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:38.716877 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b97j4" Jul 24 14:40:38.743065 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:38.743016 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b97j4" podStartSLOduration=1.743003879 podStartE2EDuration="1.743003879s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:40:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:40:38.739990068 +0000 UTC m=+352.021379649" watchObservedRunningTime="2026-07-24 14:40:38.743003879 +0000 UTC m=+352.024393460" Jul 24 14:40:38.818288 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:38.818254 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bfhgw"] Jul 24 14:40:38.818717 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:38.818414 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bfhgw" podUID="04116d55-b799-4538-abe9-c3018498c1d5" containerName="discovery" containerID="cri-o://c88881e1e8fc2af08f11ba43bab58ffc7fdb9f7eff42b99bd714ff1a5cab78d3" gracePeriod=30 Jul 24 14:40:39.063557 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:39.063533 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bfhgw" Jul 24 14:40:39.173081 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:39.173051 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/04116d55-b799-4538-abe9-c3018498c1d5-cacerts\") pod \"04116d55-b799-4538-abe9-c3018498c1d5\" (UID: \"04116d55-b799-4538-abe9-c3018498c1d5\") " Jul 24 14:40:39.173244 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:39.173099 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/04116d55-b799-4538-abe9-c3018498c1d5-istio-csr-dns-cert\") pod \"04116d55-b799-4538-abe9-c3018498c1d5\" (UID: \"04116d55-b799-4538-abe9-c3018498c1d5\") " Jul 24 14:40:39.173244 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:39.173128 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/04116d55-b799-4538-abe9-c3018498c1d5-local-certs\") pod \"04116d55-b799-4538-abe9-c3018498c1d5\" (UID: \"04116d55-b799-4538-abe9-c3018498c1d5\") " Jul 24 14:40:39.173244 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:39.173148 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mjc2q\" (UniqueName: \"kubernetes.io/projected/04116d55-b799-4538-abe9-c3018498c1d5-kube-api-access-mjc2q\") pod \"04116d55-b799-4538-abe9-c3018498c1d5\" (UID: \"04116d55-b799-4538-abe9-c3018498c1d5\") " Jul 24 14:40:39.173244 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:39.173177 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04116d55-b799-4538-abe9-c3018498c1d5-istio-token\") pod \"04116d55-b799-4538-abe9-c3018498c1d5\" (UID: \"04116d55-b799-4538-abe9-c3018498c1d5\") " Jul 24 14:40:39.173244 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:39.173229 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/04116d55-b799-4538-abe9-c3018498c1d5-istio-kubeconfig\") pod \"04116d55-b799-4538-abe9-c3018498c1d5\" (UID: \"04116d55-b799-4538-abe9-c3018498c1d5\") " Jul 24 14:40:39.173567 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:39.173273 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/04116d55-b799-4538-abe9-c3018498c1d5-istio-csr-ca-configmap\") pod \"04116d55-b799-4538-abe9-c3018498c1d5\" (UID: \"04116d55-b799-4538-abe9-c3018498c1d5\") " Jul 24 14:40:39.173855 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:39.173803 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04116d55-b799-4538-abe9-c3018498c1d5-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "04116d55-b799-4538-abe9-c3018498c1d5" (UID: "04116d55-b799-4538-abe9-c3018498c1d5"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 14:40:39.175663 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:39.175634 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04116d55-b799-4538-abe9-c3018498c1d5-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "04116d55-b799-4538-abe9-c3018498c1d5" (UID: "04116d55-b799-4538-abe9-c3018498c1d5"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 14:40:39.175779 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:39.175726 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04116d55-b799-4538-abe9-c3018498c1d5-local-certs" (OuterVolumeSpecName: "local-certs") pod "04116d55-b799-4538-abe9-c3018498c1d5" (UID: "04116d55-b799-4538-abe9-c3018498c1d5"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 14:40:39.175779 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:39.175753 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04116d55-b799-4538-abe9-c3018498c1d5-cacerts" (OuterVolumeSpecName: "cacerts") pod "04116d55-b799-4538-abe9-c3018498c1d5" (UID: "04116d55-b799-4538-abe9-c3018498c1d5"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 14:40:39.175890 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:39.175851 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04116d55-b799-4538-abe9-c3018498c1d5-istio-token" (OuterVolumeSpecName: "istio-token") pod "04116d55-b799-4538-abe9-c3018498c1d5" (UID: "04116d55-b799-4538-abe9-c3018498c1d5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 14:40:39.175890 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:39.175854 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04116d55-b799-4538-abe9-c3018498c1d5-kube-api-access-mjc2q" (OuterVolumeSpecName: "kube-api-access-mjc2q") pod "04116d55-b799-4538-abe9-c3018498c1d5" (UID: "04116d55-b799-4538-abe9-c3018498c1d5"). InnerVolumeSpecName "kube-api-access-mjc2q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 14:40:39.176023 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:39.176000 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04116d55-b799-4538-abe9-c3018498c1d5-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "04116d55-b799-4538-abe9-c3018498c1d5" (UID: "04116d55-b799-4538-abe9-c3018498c1d5"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 14:40:39.274959 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:39.274828 2565 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/04116d55-b799-4538-abe9-c3018498c1d5-cacerts\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 14:40:39.274959 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:39.274869 2565 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/04116d55-b799-4538-abe9-c3018498c1d5-istio-csr-dns-cert\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 14:40:39.274959 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:39.274884 2565 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/04116d55-b799-4538-abe9-c3018498c1d5-local-certs\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 14:40:39.274959 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:39.274896 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mjc2q\" (UniqueName: \"kubernetes.io/projected/04116d55-b799-4538-abe9-c3018498c1d5-kube-api-access-mjc2q\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 14:40:39.274959 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:39.274909 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04116d55-b799-4538-abe9-c3018498c1d5-istio-token\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 14:40:39.274959 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:39.274924 2565 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/04116d55-b799-4538-abe9-c3018498c1d5-istio-kubeconfig\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 14:40:39.274959 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:39.274937 2565 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/04116d55-b799-4538-abe9-c3018498c1d5-istio-csr-ca-configmap\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 14:40:39.721693 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:39.721618 2565 generic.go:356] "Generic (PLEG): container finished" podID="04116d55-b799-4538-abe9-c3018498c1d5" containerID="c88881e1e8fc2af08f11ba43bab58ffc7fdb9f7eff42b99bd714ff1a5cab78d3" exitCode=0 Jul 24 14:40:39.721693 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:39.721661 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bfhgw" Jul 24 14:40:39.721865 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:39.721704 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bfhgw" event={"ID":"04116d55-b799-4538-abe9-c3018498c1d5","Type":"ContainerDied","Data":"c88881e1e8fc2af08f11ba43bab58ffc7fdb9f7eff42b99bd714ff1a5cab78d3"} Jul 24 14:40:39.721865 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:39.721754 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bfhgw" event={"ID":"04116d55-b799-4538-abe9-c3018498c1d5","Type":"ContainerDied","Data":"6acfb6cdac63ca68b6563bc3fc48f7e36ea5708fdf45523dfca814411c8537b9"} Jul 24 14:40:39.721865 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:39.721777 2565 scope.go:117] "RemoveContainer" containerID="c88881e1e8fc2af08f11ba43bab58ffc7fdb9f7eff42b99bd714ff1a5cab78d3" Jul 24 14:40:39.730398 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:39.730332 2565 scope.go:117] "RemoveContainer" containerID="c88881e1e8fc2af08f11ba43bab58ffc7fdb9f7eff42b99bd714ff1a5cab78d3" Jul 24 14:40:39.730727 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:40:39.730707 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c88881e1e8fc2af08f11ba43bab58ffc7fdb9f7eff42b99bd714ff1a5cab78d3\": container with ID starting with c88881e1e8fc2af08f11ba43bab58ffc7fdb9f7eff42b99bd714ff1a5cab78d3 not found: ID does not exist" containerID="c88881e1e8fc2af08f11ba43bab58ffc7fdb9f7eff42b99bd714ff1a5cab78d3" Jul 24 14:40:39.730784 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:39.730737 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c88881e1e8fc2af08f11ba43bab58ffc7fdb9f7eff42b99bd714ff1a5cab78d3"} err="failed to get container status \"c88881e1e8fc2af08f11ba43bab58ffc7fdb9f7eff42b99bd714ff1a5cab78d3\": rpc error: code = NotFound desc = could not find container \"c88881e1e8fc2af08f11ba43bab58ffc7fdb9f7eff42b99bd714ff1a5cab78d3\": container with ID starting with c88881e1e8fc2af08f11ba43bab58ffc7fdb9f7eff42b99bd714ff1a5cab78d3 not found: ID does not exist" Jul 24 14:40:39.755438 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:39.755416 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bfhgw"] Jul 24 14:40:39.773659 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:39.773635 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bfhgw"] Jul 24 14:40:41.172072 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:41.171975 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04116d55-b799-4538-abe9-c3018498c1d5" path="/var/lib/kubelet/pods/04116d55-b799-4538-abe9-c3018498c1d5/volumes" Jul 24 14:40:41.718059 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:41.718027 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-s6fbp"] Jul 24 14:40:41.718388 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:41.718368 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04116d55-b799-4538-abe9-c3018498c1d5" containerName="discovery" Jul 24 14:40:41.718388 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:41.718384 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="04116d55-b799-4538-abe9-c3018498c1d5" containerName="discovery" Jul 24 14:40:41.718606 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:41.718464 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="04116d55-b799-4538-abe9-c3018498c1d5" containerName="discovery" Jul 24 14:40:41.722482 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:41.722450 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-s6fbp" Jul 24 14:40:41.750233 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:41.750204 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-9sj47\"" Jul 24 14:40:41.750366 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:41.750246 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 24 14:40:41.758020 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:41.757983 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-62rcl"] Jul 24 14:40:41.768008 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:41.767987 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-s6fbp"] Jul 24 14:40:41.768123 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:41.768017 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-62rcl"] Jul 24 14:40:41.768123 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:41.768081 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-62rcl" Jul 24 14:40:41.772588 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:41.772559 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-j5x8q\"" Jul 24 14:40:41.773190 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:41.773168 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 24 14:40:41.899880 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:41.899853 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7c9f6bc5-a512-4d71-9cf2-a91f839f5445-cert\") pod \"kserve-controller-manager-d6f4b65b8-s6fbp\" (UID: \"7c9f6bc5-a512-4d71-9cf2-a91f839f5445\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-s6fbp" Jul 24 14:40:41.900028 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:41.899896 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/96effeca-20b1-40c0-bdc0-c5ecc3eafc29-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-62rcl\" (UID: \"96effeca-20b1-40c0-bdc0-c5ecc3eafc29\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-62rcl" Jul 24 14:40:41.900028 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:41.899918 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpxgp\" (UniqueName: \"kubernetes.io/projected/96effeca-20b1-40c0-bdc0-c5ecc3eafc29-kube-api-access-gpxgp\") pod \"llmisvc-controller-manager-777c6bd7d5-62rcl\" (UID: \"96effeca-20b1-40c0-bdc0-c5ecc3eafc29\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-62rcl" Jul 24 14:40:41.900028 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:41.900014 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2s9s\" (UniqueName: \"kubernetes.io/projected/7c9f6bc5-a512-4d71-9cf2-a91f839f5445-kube-api-access-m2s9s\") pod \"kserve-controller-manager-d6f4b65b8-s6fbp\" (UID: \"7c9f6bc5-a512-4d71-9cf2-a91f839f5445\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-s6fbp" Jul 24 14:40:42.000689 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:42.000596 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/96effeca-20b1-40c0-bdc0-c5ecc3eafc29-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-62rcl\" (UID: \"96effeca-20b1-40c0-bdc0-c5ecc3eafc29\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-62rcl" Jul 24 14:40:42.000689 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:42.000635 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpxgp\" (UniqueName: \"kubernetes.io/projected/96effeca-20b1-40c0-bdc0-c5ecc3eafc29-kube-api-access-gpxgp\") pod \"llmisvc-controller-manager-777c6bd7d5-62rcl\" (UID: \"96effeca-20b1-40c0-bdc0-c5ecc3eafc29\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-62rcl" Jul 24 14:40:42.000912 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:42.000705 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2s9s\" (UniqueName: \"kubernetes.io/projected/7c9f6bc5-a512-4d71-9cf2-a91f839f5445-kube-api-access-m2s9s\") pod \"kserve-controller-manager-d6f4b65b8-s6fbp\" (UID: \"7c9f6bc5-a512-4d71-9cf2-a91f839f5445\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-s6fbp" Jul 24 14:40:42.000912 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:40:42.000740 2565 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 24 14:40:42.000912 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:42.000777 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7c9f6bc5-a512-4d71-9cf2-a91f839f5445-cert\") pod \"kserve-controller-manager-d6f4b65b8-s6fbp\" (UID: \"7c9f6bc5-a512-4d71-9cf2-a91f839f5445\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-s6fbp" Jul 24 14:40:42.000912 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:40:42.000814 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96effeca-20b1-40c0-bdc0-c5ecc3eafc29-cert podName:96effeca-20b1-40c0-bdc0-c5ecc3eafc29 nodeName:}" failed. No retries permitted until 2026-07-24 14:40:42.500793623 +0000 UTC m=+355.782183203 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/96effeca-20b1-40c0-bdc0-c5ecc3eafc29-cert") pod "llmisvc-controller-manager-777c6bd7d5-62rcl" (UID: "96effeca-20b1-40c0-bdc0-c5ecc3eafc29") : secret "llmisvc-webhook-server-cert" not found Jul 24 14:40:42.003306 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:42.003274 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7c9f6bc5-a512-4d71-9cf2-a91f839f5445-cert\") pod \"kserve-controller-manager-d6f4b65b8-s6fbp\" (UID: \"7c9f6bc5-a512-4d71-9cf2-a91f839f5445\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-s6fbp" Jul 24 14:40:42.024217 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:42.024192 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpxgp\" (UniqueName: \"kubernetes.io/projected/96effeca-20b1-40c0-bdc0-c5ecc3eafc29-kube-api-access-gpxgp\") pod \"llmisvc-controller-manager-777c6bd7d5-62rcl\" (UID: \"96effeca-20b1-40c0-bdc0-c5ecc3eafc29\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-62rcl" Jul 24 14:40:42.027647 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:42.027622 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2s9s\" (UniqueName: \"kubernetes.io/projected/7c9f6bc5-a512-4d71-9cf2-a91f839f5445-kube-api-access-m2s9s\") pod \"kserve-controller-manager-d6f4b65b8-s6fbp\" (UID: \"7c9f6bc5-a512-4d71-9cf2-a91f839f5445\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-s6fbp" Jul 24 14:40:42.033454 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:42.033432 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-s6fbp" Jul 24 14:40:42.183294 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:42.183273 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-s6fbp"] Jul 24 14:40:42.185642 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:40:42.185576 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c9f6bc5_a512_4d71_9cf2_a91f839f5445.slice/crio-2639a793cf0944b7a2a5583158bbf6f2fb89a21af02dda42853c9fb9b5b872ba WatchSource:0}: Error finding container 2639a793cf0944b7a2a5583158bbf6f2fb89a21af02dda42853c9fb9b5b872ba: Status 404 returned error can't find the container with id 2639a793cf0944b7a2a5583158bbf6f2fb89a21af02dda42853c9fb9b5b872ba Jul 24 14:40:42.506466 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:42.506426 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/96effeca-20b1-40c0-bdc0-c5ecc3eafc29-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-62rcl\" (UID: \"96effeca-20b1-40c0-bdc0-c5ecc3eafc29\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-62rcl" Jul 24 14:40:42.508826 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:42.508796 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/96effeca-20b1-40c0-bdc0-c5ecc3eafc29-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-62rcl\" (UID: \"96effeca-20b1-40c0-bdc0-c5ecc3eafc29\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-62rcl" Jul 24 14:40:42.679110 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:42.679072 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-62rcl" Jul 24 14:40:42.741773 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:42.741741 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-s6fbp" event={"ID":"7c9f6bc5-a512-4d71-9cf2-a91f839f5445","Type":"ContainerStarted","Data":"2639a793cf0944b7a2a5583158bbf6f2fb89a21af02dda42853c9fb9b5b872ba"} Jul 24 14:40:42.811594 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:42.811568 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-62rcl"] Jul 24 14:40:42.813330 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:40:42.813303 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod96effeca_20b1_40c0_bdc0_c5ecc3eafc29.slice/crio-1ec6635947bac456a5db3097bdd056e2834052f4ed87d0e3de7d838651b41269 WatchSource:0}: Error finding container 1ec6635947bac456a5db3097bdd056e2834052f4ed87d0e3de7d838651b41269: Status 404 returned error can't find the container with id 1ec6635947bac456a5db3097bdd056e2834052f4ed87d0e3de7d838651b41269 Jul 24 14:40:43.748995 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:43.748942 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-62rcl" event={"ID":"96effeca-20b1-40c0-bdc0-c5ecc3eafc29","Type":"ContainerStarted","Data":"1ec6635947bac456a5db3097bdd056e2834052f4ed87d0e3de7d838651b41269"} Jul 24 14:40:44.232255 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:44.232211 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:40:44.336191 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:44.336157 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:40:45.696145 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:45.696115 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-4bw72" Jul 24 14:40:46.769688 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:46.769644 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-62rcl" event={"ID":"96effeca-20b1-40c0-bdc0-c5ecc3eafc29","Type":"ContainerStarted","Data":"457f24b49a32a93dca271646bbfbf7221903058977a13351e5b78a687d10a427"} Jul 24 14:40:46.770411 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:46.770385 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-62rcl" Jul 24 14:40:46.772812 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:46.772265 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-s6fbp" event={"ID":"7c9f6bc5-a512-4d71-9cf2-a91f839f5445","Type":"ContainerStarted","Data":"c1c18bc8203d351fa683ffe9e7140501c3cb4ff93a0012fc34c5e297b1fb0521"} Jul 24 14:40:46.772812 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:46.772756 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-s6fbp" Jul 24 14:40:46.803997 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:46.803956 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-62rcl" podStartSLOduration=2.559343439 podStartE2EDuration="5.803942703s" totalImagesPullingTime="3.244599264s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:40:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:40:46.801318253 +0000 UTC m=+360.082707833" watchObservedRunningTime="2026-07-24 14:40:46.803942703 +0000 UTC m=+360.085332285" Jul 24 14:40:46.847146 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:46.847090 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-s6fbp" podStartSLOduration=2.011264154 podStartE2EDuration="5.847075112s" totalImagesPullingTime="3.835810958s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:40:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:40:46.84445993 +0000 UTC m=+360.125849514" watchObservedRunningTime="2026-07-24 14:40:46.847075112 +0000 UTC m=+360.128464693" Jul 24 14:40:51.473004 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:40:51.472961 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:41:18.783865 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:18.783832 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-62rcl" Jul 24 14:41:18.786743 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:18.786725 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-s6fbp" Jul 24 14:41:29.928124 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:29.928090 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:41:30.024760 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:30.024728 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:41:30.153015 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:30.152984 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:41:45.462993 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:45.462957 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v5hlf"] Jul 24 14:41:45.465825 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:45.465804 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v5hlf" Jul 24 14:41:45.468648 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:45.468629 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 24 14:41:45.469626 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:45.469602 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 24 14:41:45.469717 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:45.469682 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-k452s\"" Jul 24 14:41:45.476283 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:45.476256 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v5hlf"] Jul 24 14:41:45.538120 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:45.538072 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e00157b4-a22f-48c2-9ab8-cbf6a8c91894-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v5hlf\" (UID: \"e00157b4-a22f-48c2-9ab8-cbf6a8c91894\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v5hlf" Jul 24 14:41:45.538383 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:45.538134 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86mdb\" (UniqueName: \"kubernetes.io/projected/e00157b4-a22f-48c2-9ab8-cbf6a8c91894-kube-api-access-86mdb\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v5hlf\" (UID: \"e00157b4-a22f-48c2-9ab8-cbf6a8c91894\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v5hlf" Jul 24 14:41:45.538742 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:45.538276 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e00157b4-a22f-48c2-9ab8-cbf6a8c91894-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v5hlf\" (UID: \"e00157b4-a22f-48c2-9ab8-cbf6a8c91894\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v5hlf" Jul 24 14:41:45.639867 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:45.639835 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e00157b4-a22f-48c2-9ab8-cbf6a8c91894-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v5hlf\" (UID: \"e00157b4-a22f-48c2-9ab8-cbf6a8c91894\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v5hlf" Jul 24 14:41:45.639867 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:45.639878 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86mdb\" (UniqueName: \"kubernetes.io/projected/e00157b4-a22f-48c2-9ab8-cbf6a8c91894-kube-api-access-86mdb\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v5hlf\" (UID: \"e00157b4-a22f-48c2-9ab8-cbf6a8c91894\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v5hlf" Jul 24 14:41:45.640098 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:45.639933 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e00157b4-a22f-48c2-9ab8-cbf6a8c91894-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v5hlf\" (UID: \"e00157b4-a22f-48c2-9ab8-cbf6a8c91894\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v5hlf" Jul 24 14:41:45.640241 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:45.640219 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e00157b4-a22f-48c2-9ab8-cbf6a8c91894-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v5hlf\" (UID: \"e00157b4-a22f-48c2-9ab8-cbf6a8c91894\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v5hlf" Jul 24 14:41:45.640296 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:45.640280 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e00157b4-a22f-48c2-9ab8-cbf6a8c91894-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v5hlf\" (UID: \"e00157b4-a22f-48c2-9ab8-cbf6a8c91894\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v5hlf" Jul 24 14:41:45.649685 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:45.649659 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86mdb\" (UniqueName: \"kubernetes.io/projected/e00157b4-a22f-48c2-9ab8-cbf6a8c91894-kube-api-access-86mdb\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v5hlf\" (UID: \"e00157b4-a22f-48c2-9ab8-cbf6a8c91894\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v5hlf" Jul 24 14:41:45.775790 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:45.775711 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v5hlf" Jul 24 14:41:45.905740 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:45.905540 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v5hlf"] Jul 24 14:41:45.908131 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:41:45.908108 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode00157b4_a22f_48c2_9ab8_cbf6a8c91894.slice/crio-96bff7438e918eb5cb73d183362e6b263d95affafc33c4af753dd271b48f7096 WatchSource:0}: Error finding container 96bff7438e918eb5cb73d183362e6b263d95affafc33c4af753dd271b48f7096: Status 404 returned error can't find the container with id 96bff7438e918eb5cb73d183362e6b263d95affafc33c4af753dd271b48f7096 Jul 24 14:41:46.063207 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:46.063179 2565 generic.go:356] "Generic (PLEG): container finished" podID="e00157b4-a22f-48c2-9ab8-cbf6a8c91894" containerID="157454cbb8ca14db34a0469eb4c25a83a1387b344b3593c9735ad5914bffbe4b" exitCode=0 Jul 24 14:41:46.063355 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:46.063265 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v5hlf" event={"ID":"e00157b4-a22f-48c2-9ab8-cbf6a8c91894","Type":"ContainerDied","Data":"157454cbb8ca14db34a0469eb4c25a83a1387b344b3593c9735ad5914bffbe4b"} Jul 24 14:41:46.063355 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:46.063323 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v5hlf" event={"ID":"e00157b4-a22f-48c2-9ab8-cbf6a8c91894","Type":"ContainerStarted","Data":"96bff7438e918eb5cb73d183362e6b263d95affafc33c4af753dd271b48f7096"} Jul 24 14:41:46.072506 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:46.072459 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12665f"] Jul 24 14:41:46.075458 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:46.075444 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12665f" Jul 24 14:41:46.085823 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:46.085799 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12665f"] Jul 24 14:41:46.143406 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:46.143381 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c421b3c4-1fa2-4fec-a6da-76c62dcc9a6d-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12665f\" (UID: \"c421b3c4-1fa2-4fec-a6da-76c62dcc9a6d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12665f" Jul 24 14:41:46.143547 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:46.143432 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2j7sn\" (UniqueName: \"kubernetes.io/projected/c421b3c4-1fa2-4fec-a6da-76c62dcc9a6d-kube-api-access-2j7sn\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12665f\" (UID: \"c421b3c4-1fa2-4fec-a6da-76c62dcc9a6d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12665f" Jul 24 14:41:46.143592 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:46.143569 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c421b3c4-1fa2-4fec-a6da-76c62dcc9a6d-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12665f\" (UID: \"c421b3c4-1fa2-4fec-a6da-76c62dcc9a6d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12665f" Jul 24 14:41:46.244229 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:46.244196 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2j7sn\" (UniqueName: \"kubernetes.io/projected/c421b3c4-1fa2-4fec-a6da-76c62dcc9a6d-kube-api-access-2j7sn\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12665f\" (UID: \"c421b3c4-1fa2-4fec-a6da-76c62dcc9a6d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12665f" Jul 24 14:41:46.244379 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:46.244258 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c421b3c4-1fa2-4fec-a6da-76c62dcc9a6d-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12665f\" (UID: \"c421b3c4-1fa2-4fec-a6da-76c62dcc9a6d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12665f" Jul 24 14:41:46.244379 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:46.244297 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c421b3c4-1fa2-4fec-a6da-76c62dcc9a6d-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12665f\" (UID: \"c421b3c4-1fa2-4fec-a6da-76c62dcc9a6d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12665f" Jul 24 14:41:46.244724 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:46.244704 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c421b3c4-1fa2-4fec-a6da-76c62dcc9a6d-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12665f\" (UID: \"c421b3c4-1fa2-4fec-a6da-76c62dcc9a6d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12665f" Jul 24 14:41:46.244816 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:46.244718 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c421b3c4-1fa2-4fec-a6da-76c62dcc9a6d-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12665f\" (UID: \"c421b3c4-1fa2-4fec-a6da-76c62dcc9a6d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12665f" Jul 24 14:41:46.254822 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:46.254800 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2j7sn\" (UniqueName: \"kubernetes.io/projected/c421b3c4-1fa2-4fec-a6da-76c62dcc9a6d-kube-api-access-2j7sn\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12665f\" (UID: \"c421b3c4-1fa2-4fec-a6da-76c62dcc9a6d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12665f" Jul 24 14:41:46.406659 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:46.406582 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12665f" Jul 24 14:41:46.477969 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:46.477941 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qndtl"] Jul 24 14:41:46.482024 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:46.482003 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qndtl" Jul 24 14:41:46.499785 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:46.499757 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qndtl"] Jul 24 14:41:46.542676 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:46.542587 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12665f"] Jul 24 14:41:46.544904 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:41:46.544875 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc421b3c4_1fa2_4fec_a6da_76c62dcc9a6d.slice/crio-b5e0ac76dd9b9ba3a0d9302282df8b9f8c081e4765d4a3f61c4b6dee0fdf11c4 WatchSource:0}: Error finding container b5e0ac76dd9b9ba3a0d9302282df8b9f8c081e4765d4a3f61c4b6dee0fdf11c4: Status 404 returned error can't find the container with id b5e0ac76dd9b9ba3a0d9302282df8b9f8c081e4765d4a3f61c4b6dee0fdf11c4 Jul 24 14:41:46.545973 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:46.545950 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3ff7fded-716e-401f-81a8-216d33dcc89d-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qndtl\" (UID: \"3ff7fded-716e-401f-81a8-216d33dcc89d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qndtl" Jul 24 14:41:46.546079 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:46.545983 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mp2nt\" (UniqueName: \"kubernetes.io/projected/3ff7fded-716e-401f-81a8-216d33dcc89d-kube-api-access-mp2nt\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qndtl\" (UID: \"3ff7fded-716e-401f-81a8-216d33dcc89d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qndtl" Jul 24 14:41:46.546079 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:46.546008 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3ff7fded-716e-401f-81a8-216d33dcc89d-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qndtl\" (UID: \"3ff7fded-716e-401f-81a8-216d33dcc89d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qndtl" Jul 24 14:41:46.647418 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:46.647388 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3ff7fded-716e-401f-81a8-216d33dcc89d-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qndtl\" (UID: \"3ff7fded-716e-401f-81a8-216d33dcc89d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qndtl" Jul 24 14:41:46.647617 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:46.647429 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp2nt\" (UniqueName: \"kubernetes.io/projected/3ff7fded-716e-401f-81a8-216d33dcc89d-kube-api-access-mp2nt\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qndtl\" (UID: \"3ff7fded-716e-401f-81a8-216d33dcc89d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qndtl" Jul 24 14:41:46.647617 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:46.647454 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3ff7fded-716e-401f-81a8-216d33dcc89d-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qndtl\" (UID: \"3ff7fded-716e-401f-81a8-216d33dcc89d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qndtl" Jul 24 14:41:46.647795 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:46.647779 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3ff7fded-716e-401f-81a8-216d33dcc89d-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qndtl\" (UID: \"3ff7fded-716e-401f-81a8-216d33dcc89d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qndtl" Jul 24 14:41:46.647842 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:46.647817 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3ff7fded-716e-401f-81a8-216d33dcc89d-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qndtl\" (UID: \"3ff7fded-716e-401f-81a8-216d33dcc89d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qndtl" Jul 24 14:41:46.658725 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:46.658668 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mp2nt\" (UniqueName: \"kubernetes.io/projected/3ff7fded-716e-401f-81a8-216d33dcc89d-kube-api-access-mp2nt\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qndtl\" (UID: \"3ff7fded-716e-401f-81a8-216d33dcc89d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qndtl" Jul 24 14:41:46.794492 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:46.794441 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qndtl" Jul 24 14:41:46.899976 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:46.899663 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6jkv"] Jul 24 14:41:46.907463 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:46.903662 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6jkv" Jul 24 14:41:46.916586 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:46.916558 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6jkv"] Jul 24 14:41:46.937104 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:46.936999 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qndtl"] Jul 24 14:41:46.950517 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:46.950483 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/133c48eb-d517-4873-95f3-27c6d1f061fb-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6jkv\" (UID: \"133c48eb-d517-4873-95f3-27c6d1f061fb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6jkv" Jul 24 14:41:46.950642 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:46.950550 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4f627\" (UniqueName: \"kubernetes.io/projected/133c48eb-d517-4873-95f3-27c6d1f061fb-kube-api-access-4f627\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6jkv\" (UID: \"133c48eb-d517-4873-95f3-27c6d1f061fb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6jkv" Jul 24 14:41:46.950642 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:46.950594 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/133c48eb-d517-4873-95f3-27c6d1f061fb-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6jkv\" (UID: \"133c48eb-d517-4873-95f3-27c6d1f061fb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6jkv" Jul 24 14:41:47.051560 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:47.051530 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/133c48eb-d517-4873-95f3-27c6d1f061fb-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6jkv\" (UID: \"133c48eb-d517-4873-95f3-27c6d1f061fb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6jkv" Jul 24 14:41:47.051702 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:47.051571 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4f627\" (UniqueName: \"kubernetes.io/projected/133c48eb-d517-4873-95f3-27c6d1f061fb-kube-api-access-4f627\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6jkv\" (UID: \"133c48eb-d517-4873-95f3-27c6d1f061fb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6jkv" Jul 24 14:41:47.051702 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:47.051594 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/133c48eb-d517-4873-95f3-27c6d1f061fb-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6jkv\" (UID: \"133c48eb-d517-4873-95f3-27c6d1f061fb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6jkv" Jul 24 14:41:47.051901 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:47.051884 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/133c48eb-d517-4873-95f3-27c6d1f061fb-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6jkv\" (UID: \"133c48eb-d517-4873-95f3-27c6d1f061fb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6jkv" Jul 24 14:41:47.051901 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:47.051894 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/133c48eb-d517-4873-95f3-27c6d1f061fb-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6jkv\" (UID: \"133c48eb-d517-4873-95f3-27c6d1f061fb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6jkv" Jul 24 14:41:47.059555 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:41:47.059524 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ff7fded_716e_401f_81a8_216d33dcc89d.slice/crio-b09c8fa03a6bb074b381f9bc483406328fd86f52ca55902cd6d689de1bd57712 WatchSource:0}: Error finding container b09c8fa03a6bb074b381f9bc483406328fd86f52ca55902cd6d689de1bd57712: Status 404 returned error can't find the container with id b09c8fa03a6bb074b381f9bc483406328fd86f52ca55902cd6d689de1bd57712 Jul 24 14:41:47.062399 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:47.062375 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4f627\" (UniqueName: \"kubernetes.io/projected/133c48eb-d517-4873-95f3-27c6d1f061fb-kube-api-access-4f627\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6jkv\" (UID: \"133c48eb-d517-4873-95f3-27c6d1f061fb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6jkv" Jul 24 14:41:47.072685 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:47.072662 2565 generic.go:356] "Generic (PLEG): container finished" podID="c421b3c4-1fa2-4fec-a6da-76c62dcc9a6d" containerID="a1e9eb5966506f41c29813c8175d19e1db0f55b16a16a91cc0e45cca2831da86" exitCode=0 Jul 24 14:41:47.073005 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:47.072806 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12665f" event={"ID":"c421b3c4-1fa2-4fec-a6da-76c62dcc9a6d","Type":"ContainerDied","Data":"a1e9eb5966506f41c29813c8175d19e1db0f55b16a16a91cc0e45cca2831da86"} Jul 24 14:41:47.073005 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:47.072867 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12665f" event={"ID":"c421b3c4-1fa2-4fec-a6da-76c62dcc9a6d","Type":"ContainerStarted","Data":"b5e0ac76dd9b9ba3a0d9302282df8b9f8c081e4765d4a3f61c4b6dee0fdf11c4"} Jul 24 14:41:47.074137 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:47.074113 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qndtl" event={"ID":"3ff7fded-716e-401f-81a8-216d33dcc89d","Type":"ContainerStarted","Data":"b09c8fa03a6bb074b381f9bc483406328fd86f52ca55902cd6d689de1bd57712"} Jul 24 14:41:47.216670 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:47.216640 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6jkv" Jul 24 14:41:47.350177 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:47.350152 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6jkv"] Jul 24 14:41:47.352213 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:41:47.352184 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod133c48eb_d517_4873_95f3_27c6d1f061fb.slice/crio-d40d84d22257092f5849679490f409176b8f628b21c915b26cbc0878825f4513 WatchSource:0}: Error finding container d40d84d22257092f5849679490f409176b8f628b21c915b26cbc0878825f4513: Status 404 returned error can't find the container with id d40d84d22257092f5849679490f409176b8f628b21c915b26cbc0878825f4513 Jul 24 14:41:48.080200 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:48.080170 2565 generic.go:356] "Generic (PLEG): container finished" podID="133c48eb-d517-4873-95f3-27c6d1f061fb" containerID="f6fa8379c465751cbb40c5c5406318e7df68f131b457d29207414838f36dbfca" exitCode=0 Jul 24 14:41:48.080665 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:48.080257 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6jkv" event={"ID":"133c48eb-d517-4873-95f3-27c6d1f061fb","Type":"ContainerDied","Data":"f6fa8379c465751cbb40c5c5406318e7df68f131b457d29207414838f36dbfca"} Jul 24 14:41:48.080665 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:48.080348 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6jkv" event={"ID":"133c48eb-d517-4873-95f3-27c6d1f061fb","Type":"ContainerStarted","Data":"d40d84d22257092f5849679490f409176b8f628b21c915b26cbc0878825f4513"} Jul 24 14:41:48.082216 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:48.082193 2565 generic.go:356] "Generic (PLEG): container finished" podID="e00157b4-a22f-48c2-9ab8-cbf6a8c91894" containerID="5684ce136eb7f57c8095269cfa33aa613578ffe6e0decd941a96fee7a171671b" exitCode=0 Jul 24 14:41:48.082332 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:48.082280 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v5hlf" event={"ID":"e00157b4-a22f-48c2-9ab8-cbf6a8c91894","Type":"ContainerDied","Data":"5684ce136eb7f57c8095269cfa33aa613578ffe6e0decd941a96fee7a171671b"} Jul 24 14:41:48.083820 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:48.083802 2565 generic.go:356] "Generic (PLEG): container finished" podID="3ff7fded-716e-401f-81a8-216d33dcc89d" containerID="cf840c22cea8121651209b07471816b15111957c12f46f20e06ed67b74bf14f5" exitCode=0 Jul 24 14:41:48.083913 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:48.083888 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qndtl" event={"ID":"3ff7fded-716e-401f-81a8-216d33dcc89d","Type":"ContainerDied","Data":"cf840c22cea8121651209b07471816b15111957c12f46f20e06ed67b74bf14f5"} Jul 24 14:41:48.085886 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:48.085843 2565 generic.go:356] "Generic (PLEG): container finished" podID="c421b3c4-1fa2-4fec-a6da-76c62dcc9a6d" containerID="171c58ff06ed87a278765a465b6240d19ee4ff39145aac2ac72ea89d773b4d9f" exitCode=0 Jul 24 14:41:48.085972 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:48.085906 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12665f" event={"ID":"c421b3c4-1fa2-4fec-a6da-76c62dcc9a6d","Type":"ContainerDied","Data":"171c58ff06ed87a278765a465b6240d19ee4ff39145aac2ac72ea89d773b4d9f"} Jul 24 14:41:49.093460 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:49.093425 2565 generic.go:356] "Generic (PLEG): container finished" podID="133c48eb-d517-4873-95f3-27c6d1f061fb" containerID="f7795b4299b2ace8ce3fed6c2a2792d8f55e559a1a0e66c43a6530cc244711d5" exitCode=0 Jul 24 14:41:49.093853 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:49.093564 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6jkv" event={"ID":"133c48eb-d517-4873-95f3-27c6d1f061fb","Type":"ContainerDied","Data":"f7795b4299b2ace8ce3fed6c2a2792d8f55e559a1a0e66c43a6530cc244711d5"} Jul 24 14:41:49.095952 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:49.095930 2565 generic.go:356] "Generic (PLEG): container finished" podID="e00157b4-a22f-48c2-9ab8-cbf6a8c91894" containerID="0b06753dce1b34d2602f370a499756b5bb3797e7e233def818ee785054351f30" exitCode=0 Jul 24 14:41:49.096044 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:49.096002 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v5hlf" event={"ID":"e00157b4-a22f-48c2-9ab8-cbf6a8c91894","Type":"ContainerDied","Data":"0b06753dce1b34d2602f370a499756b5bb3797e7e233def818ee785054351f30"} Jul 24 14:41:49.097867 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:49.097843 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qndtl" event={"ID":"3ff7fded-716e-401f-81a8-216d33dcc89d","Type":"ContainerStarted","Data":"5b350713c2550553d6ba2e07b1ae25a93a478a74160c762d65a4b2a048f12536"} Jul 24 14:41:49.100136 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:49.100117 2565 generic.go:356] "Generic (PLEG): container finished" podID="c421b3c4-1fa2-4fec-a6da-76c62dcc9a6d" containerID="a361bca5ebfc4c621aff44c16723f16144effd4f119c4083d403527af7beb7a9" exitCode=0 Jul 24 14:41:49.100233 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:49.100210 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12665f" event={"ID":"c421b3c4-1fa2-4fec-a6da-76c62dcc9a6d","Type":"ContainerDied","Data":"a361bca5ebfc4c621aff44c16723f16144effd4f119c4083d403527af7beb7a9"} Jul 24 14:41:50.108893 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:50.108853 2565 generic.go:356] "Generic (PLEG): container finished" podID="133c48eb-d517-4873-95f3-27c6d1f061fb" containerID="2c3d42ff0c9a282ea7aa4c250fbfc2540ebae966550abbc6cc90bc79e4f43ccc" exitCode=0 Jul 24 14:41:50.109373 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:50.108990 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6jkv" event={"ID":"133c48eb-d517-4873-95f3-27c6d1f061fb","Type":"ContainerDied","Data":"2c3d42ff0c9a282ea7aa4c250fbfc2540ebae966550abbc6cc90bc79e4f43ccc"} Jul 24 14:41:50.111999 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:50.111797 2565 generic.go:356] "Generic (PLEG): container finished" podID="3ff7fded-716e-401f-81a8-216d33dcc89d" containerID="5b350713c2550553d6ba2e07b1ae25a93a478a74160c762d65a4b2a048f12536" exitCode=0 Jul 24 14:41:50.112113 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:50.111971 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qndtl" event={"ID":"3ff7fded-716e-401f-81a8-216d33dcc89d","Type":"ContainerDied","Data":"5b350713c2550553d6ba2e07b1ae25a93a478a74160c762d65a4b2a048f12536"} Jul 24 14:41:50.255308 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:50.255273 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12665f" Jul 24 14:41:50.278903 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:50.278879 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c421b3c4-1fa2-4fec-a6da-76c62dcc9a6d-bundle\") pod \"c421b3c4-1fa2-4fec-a6da-76c62dcc9a6d\" (UID: \"c421b3c4-1fa2-4fec-a6da-76c62dcc9a6d\") " Jul 24 14:41:50.279019 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:50.278920 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2j7sn\" (UniqueName: \"kubernetes.io/projected/c421b3c4-1fa2-4fec-a6da-76c62dcc9a6d-kube-api-access-2j7sn\") pod \"c421b3c4-1fa2-4fec-a6da-76c62dcc9a6d\" (UID: \"c421b3c4-1fa2-4fec-a6da-76c62dcc9a6d\") " Jul 24 14:41:50.279019 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:50.278959 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c421b3c4-1fa2-4fec-a6da-76c62dcc9a6d-util\") pod \"c421b3c4-1fa2-4fec-a6da-76c62dcc9a6d\" (UID: \"c421b3c4-1fa2-4fec-a6da-76c62dcc9a6d\") " Jul 24 14:41:50.279570 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:50.279514 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c421b3c4-1fa2-4fec-a6da-76c62dcc9a6d-bundle" (OuterVolumeSpecName: "bundle") pod "c421b3c4-1fa2-4fec-a6da-76c62dcc9a6d" (UID: "c421b3c4-1fa2-4fec-a6da-76c62dcc9a6d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 14:41:50.281152 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:50.281124 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c421b3c4-1fa2-4fec-a6da-76c62dcc9a6d-kube-api-access-2j7sn" (OuterVolumeSpecName: "kube-api-access-2j7sn") pod "c421b3c4-1fa2-4fec-a6da-76c62dcc9a6d" (UID: "c421b3c4-1fa2-4fec-a6da-76c62dcc9a6d"). InnerVolumeSpecName "kube-api-access-2j7sn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 14:41:50.284591 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:50.284567 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c421b3c4-1fa2-4fec-a6da-76c62dcc9a6d-util" (OuterVolumeSpecName: "util") pod "c421b3c4-1fa2-4fec-a6da-76c62dcc9a6d" (UID: "c421b3c4-1fa2-4fec-a6da-76c62dcc9a6d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 14:41:50.313683 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:50.313661 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v5hlf" Jul 24 14:41:50.380174 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:50.380104 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e00157b4-a22f-48c2-9ab8-cbf6a8c91894-bundle\") pod \"e00157b4-a22f-48c2-9ab8-cbf6a8c91894\" (UID: \"e00157b4-a22f-48c2-9ab8-cbf6a8c91894\") " Jul 24 14:41:50.380174 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:50.380149 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-86mdb\" (UniqueName: \"kubernetes.io/projected/e00157b4-a22f-48c2-9ab8-cbf6a8c91894-kube-api-access-86mdb\") pod \"e00157b4-a22f-48c2-9ab8-cbf6a8c91894\" (UID: \"e00157b4-a22f-48c2-9ab8-cbf6a8c91894\") " Jul 24 14:41:50.380358 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:50.380180 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e00157b4-a22f-48c2-9ab8-cbf6a8c91894-util\") pod \"e00157b4-a22f-48c2-9ab8-cbf6a8c91894\" (UID: \"e00157b4-a22f-48c2-9ab8-cbf6a8c91894\") " Jul 24 14:41:50.380419 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:50.380367 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c421b3c4-1fa2-4fec-a6da-76c62dcc9a6d-bundle\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 14:41:50.380419 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:50.380379 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2j7sn\" (UniqueName: \"kubernetes.io/projected/c421b3c4-1fa2-4fec-a6da-76c62dcc9a6d-kube-api-access-2j7sn\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 14:41:50.380419 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:50.380391 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c421b3c4-1fa2-4fec-a6da-76c62dcc9a6d-util\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 14:41:50.380627 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:50.380603 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e00157b4-a22f-48c2-9ab8-cbf6a8c91894-bundle" (OuterVolumeSpecName: "bundle") pod "e00157b4-a22f-48c2-9ab8-cbf6a8c91894" (UID: "e00157b4-a22f-48c2-9ab8-cbf6a8c91894"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 14:41:50.382179 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:50.382156 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e00157b4-a22f-48c2-9ab8-cbf6a8c91894-kube-api-access-86mdb" (OuterVolumeSpecName: "kube-api-access-86mdb") pod "e00157b4-a22f-48c2-9ab8-cbf6a8c91894" (UID: "e00157b4-a22f-48c2-9ab8-cbf6a8c91894"). InnerVolumeSpecName "kube-api-access-86mdb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 14:41:50.385115 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:50.385090 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e00157b4-a22f-48c2-9ab8-cbf6a8c91894-util" (OuterVolumeSpecName: "util") pod "e00157b4-a22f-48c2-9ab8-cbf6a8c91894" (UID: "e00157b4-a22f-48c2-9ab8-cbf6a8c91894"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 14:41:50.481605 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:50.481583 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e00157b4-a22f-48c2-9ab8-cbf6a8c91894-bundle\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 14:41:50.481605 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:50.481603 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-86mdb\" (UniqueName: \"kubernetes.io/projected/e00157b4-a22f-48c2-9ab8-cbf6a8c91894-kube-api-access-86mdb\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 14:41:50.481770 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:50.481614 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e00157b4-a22f-48c2-9ab8-cbf6a8c91894-util\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 14:41:51.119333 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:51.119301 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v5hlf" event={"ID":"e00157b4-a22f-48c2-9ab8-cbf6a8c91894","Type":"ContainerDied","Data":"96bff7438e918eb5cb73d183362e6b263d95affafc33c4af753dd271b48f7096"} Jul 24 14:41:51.119724 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:51.119349 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="96bff7438e918eb5cb73d183362e6b263d95affafc33c4af753dd271b48f7096" Jul 24 14:41:51.119724 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:51.119310 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v5hlf" Jul 24 14:41:51.121382 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:51.121358 2565 generic.go:356] "Generic (PLEG): container finished" podID="3ff7fded-716e-401f-81a8-216d33dcc89d" containerID="81a59578a92b9e5a7d42554711bd5baa7f711c1adc3200d341a4f50aeeda798f" exitCode=0 Jul 24 14:41:51.121536 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:51.121442 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qndtl" event={"ID":"3ff7fded-716e-401f-81a8-216d33dcc89d","Type":"ContainerDied","Data":"81a59578a92b9e5a7d42554711bd5baa7f711c1adc3200d341a4f50aeeda798f"} Jul 24 14:41:51.123365 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:51.123346 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12665f" Jul 24 14:41:51.123481 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:51.123386 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12665f" event={"ID":"c421b3c4-1fa2-4fec-a6da-76c62dcc9a6d","Type":"ContainerDied","Data":"b5e0ac76dd9b9ba3a0d9302282df8b9f8c081e4765d4a3f61c4b6dee0fdf11c4"} Jul 24 14:41:51.123481 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:51.123428 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b5e0ac76dd9b9ba3a0d9302282df8b9f8c081e4765d4a3f61c4b6dee0fdf11c4" Jul 24 14:41:51.259889 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:51.259866 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6jkv" Jul 24 14:41:51.287889 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:51.287856 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4f627\" (UniqueName: \"kubernetes.io/projected/133c48eb-d517-4873-95f3-27c6d1f061fb-kube-api-access-4f627\") pod \"133c48eb-d517-4873-95f3-27c6d1f061fb\" (UID: \"133c48eb-d517-4873-95f3-27c6d1f061fb\") " Jul 24 14:41:51.288038 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:51.287905 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/133c48eb-d517-4873-95f3-27c6d1f061fb-bundle\") pod \"133c48eb-d517-4873-95f3-27c6d1f061fb\" (UID: \"133c48eb-d517-4873-95f3-27c6d1f061fb\") " Jul 24 14:41:51.288038 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:51.287937 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/133c48eb-d517-4873-95f3-27c6d1f061fb-util\") pod \"133c48eb-d517-4873-95f3-27c6d1f061fb\" (UID: \"133c48eb-d517-4873-95f3-27c6d1f061fb\") " Jul 24 14:41:51.288578 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:51.288521 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/133c48eb-d517-4873-95f3-27c6d1f061fb-bundle" (OuterVolumeSpecName: "bundle") pod "133c48eb-d517-4873-95f3-27c6d1f061fb" (UID: "133c48eb-d517-4873-95f3-27c6d1f061fb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 14:41:51.290042 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:51.290023 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/133c48eb-d517-4873-95f3-27c6d1f061fb-kube-api-access-4f627" (OuterVolumeSpecName: "kube-api-access-4f627") pod "133c48eb-d517-4873-95f3-27c6d1f061fb" (UID: "133c48eb-d517-4873-95f3-27c6d1f061fb"). InnerVolumeSpecName "kube-api-access-4f627". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 14:41:51.293492 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:51.293446 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/133c48eb-d517-4873-95f3-27c6d1f061fb-util" (OuterVolumeSpecName: "util") pod "133c48eb-d517-4873-95f3-27c6d1f061fb" (UID: "133c48eb-d517-4873-95f3-27c6d1f061fb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 14:41:51.389204 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:51.389127 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4f627\" (UniqueName: \"kubernetes.io/projected/133c48eb-d517-4873-95f3-27c6d1f061fb-kube-api-access-4f627\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 14:41:51.389204 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:51.389153 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/133c48eb-d517-4873-95f3-27c6d1f061fb-bundle\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 14:41:51.389204 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:51.389162 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/133c48eb-d517-4873-95f3-27c6d1f061fb-util\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 14:41:51.568843 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:51.568808 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:41:52.130175 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:52.130146 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6jkv" Jul 24 14:41:52.130175 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:52.130169 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6jkv" event={"ID":"133c48eb-d517-4873-95f3-27c6d1f061fb","Type":"ContainerDied","Data":"d40d84d22257092f5849679490f409176b8f628b21c915b26cbc0878825f4513"} Jul 24 14:41:52.130736 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:52.130217 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d40d84d22257092f5849679490f409176b8f628b21c915b26cbc0878825f4513" Jul 24 14:41:52.258518 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:52.258463 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qndtl" Jul 24 14:41:52.295878 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:52.295854 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3ff7fded-716e-401f-81a8-216d33dcc89d-util\") pod \"3ff7fded-716e-401f-81a8-216d33dcc89d\" (UID: \"3ff7fded-716e-401f-81a8-216d33dcc89d\") " Jul 24 14:41:52.296021 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:52.295888 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mp2nt\" (UniqueName: \"kubernetes.io/projected/3ff7fded-716e-401f-81a8-216d33dcc89d-kube-api-access-mp2nt\") pod \"3ff7fded-716e-401f-81a8-216d33dcc89d\" (UID: \"3ff7fded-716e-401f-81a8-216d33dcc89d\") " Jul 24 14:41:52.296021 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:52.295943 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3ff7fded-716e-401f-81a8-216d33dcc89d-bundle\") pod \"3ff7fded-716e-401f-81a8-216d33dcc89d\" (UID: \"3ff7fded-716e-401f-81a8-216d33dcc89d\") " Jul 24 14:41:52.296440 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:52.296416 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ff7fded-716e-401f-81a8-216d33dcc89d-bundle" (OuterVolumeSpecName: "bundle") pod "3ff7fded-716e-401f-81a8-216d33dcc89d" (UID: "3ff7fded-716e-401f-81a8-216d33dcc89d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 14:41:52.298015 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:52.297997 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ff7fded-716e-401f-81a8-216d33dcc89d-kube-api-access-mp2nt" (OuterVolumeSpecName: "kube-api-access-mp2nt") pod "3ff7fded-716e-401f-81a8-216d33dcc89d" (UID: "3ff7fded-716e-401f-81a8-216d33dcc89d"). InnerVolumeSpecName "kube-api-access-mp2nt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 14:41:52.305089 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:52.305059 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ff7fded-716e-401f-81a8-216d33dcc89d-util" (OuterVolumeSpecName: "util") pod "3ff7fded-716e-401f-81a8-216d33dcc89d" (UID: "3ff7fded-716e-401f-81a8-216d33dcc89d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 14:41:52.397026 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:52.396944 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3ff7fded-716e-401f-81a8-216d33dcc89d-bundle\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 14:41:52.397026 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:52.396972 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3ff7fded-716e-401f-81a8-216d33dcc89d-util\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 14:41:52.397026 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:52.396981 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mp2nt\" (UniqueName: \"kubernetes.io/projected/3ff7fded-716e-401f-81a8-216d33dcc89d-kube-api-access-mp2nt\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 14:41:53.137436 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:53.137406 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qndtl" Jul 24 14:41:53.137804 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:53.137405 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qndtl" event={"ID":"3ff7fded-716e-401f-81a8-216d33dcc89d","Type":"ContainerDied","Data":"b09c8fa03a6bb074b381f9bc483406328fd86f52ca55902cd6d689de1bd57712"} Jul 24 14:41:53.137804 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:53.137517 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b09c8fa03a6bb074b381f9bc483406328fd86f52ca55902cd6d689de1bd57712" Jul 24 14:41:59.500269 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:41:59.500230 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:42:01.761298 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:01.761230 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qbc6f"] Jul 24 14:42:01.762106 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:01.762076 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e00157b4-a22f-48c2-9ab8-cbf6a8c91894" containerName="util" Jul 24 14:42:01.762202 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:01.762109 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e00157b4-a22f-48c2-9ab8-cbf6a8c91894" containerName="util" Jul 24 14:42:01.762202 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:01.762130 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c421b3c4-1fa2-4fec-a6da-76c62dcc9a6d" containerName="pull" Jul 24 14:42:01.762202 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:01.762138 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c421b3c4-1fa2-4fec-a6da-76c62dcc9a6d" containerName="pull" Jul 24 14:42:01.762202 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:01.762147 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e00157b4-a22f-48c2-9ab8-cbf6a8c91894" containerName="pull" Jul 24 14:42:01.762202 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:01.762156 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e00157b4-a22f-48c2-9ab8-cbf6a8c91894" containerName="pull" Jul 24 14:42:01.762202 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:01.762175 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="133c48eb-d517-4873-95f3-27c6d1f061fb" containerName="extract" Jul 24 14:42:01.762202 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:01.762183 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="133c48eb-d517-4873-95f3-27c6d1f061fb" containerName="extract" Jul 24 14:42:01.762634 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:01.762207 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ff7fded-716e-401f-81a8-216d33dcc89d" containerName="util" Jul 24 14:42:01.762634 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:01.762220 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ff7fded-716e-401f-81a8-216d33dcc89d" containerName="util" Jul 24 14:42:01.762634 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:01.762229 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="133c48eb-d517-4873-95f3-27c6d1f061fb" containerName="pull" Jul 24 14:42:01.762634 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:01.762237 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="133c48eb-d517-4873-95f3-27c6d1f061fb" containerName="pull" Jul 24 14:42:01.762634 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:01.762255 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="133c48eb-d517-4873-95f3-27c6d1f061fb" containerName="util" Jul 24 14:42:01.762634 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:01.762263 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="133c48eb-d517-4873-95f3-27c6d1f061fb" containerName="util" Jul 24 14:42:01.762634 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:01.762273 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ff7fded-716e-401f-81a8-216d33dcc89d" containerName="pull" Jul 24 14:42:01.762634 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:01.762280 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ff7fded-716e-401f-81a8-216d33dcc89d" containerName="pull" Jul 24 14:42:01.762634 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:01.762298 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c421b3c4-1fa2-4fec-a6da-76c62dcc9a6d" containerName="extract" Jul 24 14:42:01.762634 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:01.762305 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c421b3c4-1fa2-4fec-a6da-76c62dcc9a6d" containerName="extract" Jul 24 14:42:01.762634 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:01.762325 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c421b3c4-1fa2-4fec-a6da-76c62dcc9a6d" containerName="util" Jul 24 14:42:01.762634 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:01.762332 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c421b3c4-1fa2-4fec-a6da-76c62dcc9a6d" containerName="util" Jul 24 14:42:01.762634 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:01.762356 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e00157b4-a22f-48c2-9ab8-cbf6a8c91894" containerName="extract" Jul 24 14:42:01.762634 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:01.762363 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e00157b4-a22f-48c2-9ab8-cbf6a8c91894" containerName="extract" Jul 24 14:42:01.762634 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:01.762377 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ff7fded-716e-401f-81a8-216d33dcc89d" containerName="extract" Jul 24 14:42:01.762634 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:01.762385 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ff7fded-716e-401f-81a8-216d33dcc89d" containerName="extract" Jul 24 14:42:01.762634 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:01.762560 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c421b3c4-1fa2-4fec-a6da-76c62dcc9a6d" containerName="extract" Jul 24 14:42:01.762634 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:01.762583 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e00157b4-a22f-48c2-9ab8-cbf6a8c91894" containerName="extract" Jul 24 14:42:01.762634 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:01.762598 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="133c48eb-d517-4873-95f3-27c6d1f061fb" containerName="extract" Jul 24 14:42:01.762634 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:01.762608 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ff7fded-716e-401f-81a8-216d33dcc89d" containerName="extract" Jul 24 14:42:01.767339 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:01.767301 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qbc6f" Jul 24 14:42:01.769930 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:01.769900 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-qcqwq\"" Jul 24 14:42:01.770067 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:01.769997 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 24 14:42:01.770619 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:01.770602 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 24 14:42:01.771449 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:01.771424 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qbc6f"] Jul 24 14:42:01.871071 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:01.871038 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkrng\" (UniqueName: \"kubernetes.io/projected/1f4726cc-7f24-4ef9-b147-8fa4777aedbd-kube-api-access-kkrng\") pod \"limitador-operator-controller-manager-859d7b78bd-qbc6f\" (UID: \"1f4726cc-7f24-4ef9-b147-8fa4777aedbd\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qbc6f" Jul 24 14:42:01.972238 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:01.972200 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkrng\" (UniqueName: \"kubernetes.io/projected/1f4726cc-7f24-4ef9-b147-8fa4777aedbd-kube-api-access-kkrng\") pod \"limitador-operator-controller-manager-859d7b78bd-qbc6f\" (UID: \"1f4726cc-7f24-4ef9-b147-8fa4777aedbd\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qbc6f" Jul 24 14:42:01.995574 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:01.995544 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkrng\" (UniqueName: \"kubernetes.io/projected/1f4726cc-7f24-4ef9-b147-8fa4777aedbd-kube-api-access-kkrng\") pod \"limitador-operator-controller-manager-859d7b78bd-qbc6f\" (UID: \"1f4726cc-7f24-4ef9-b147-8fa4777aedbd\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qbc6f" Jul 24 14:42:02.079007 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:02.078973 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qbc6f" Jul 24 14:42:02.249629 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:02.249603 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qbc6f"] Jul 24 14:42:02.251707 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:42:02.251677 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f4726cc_7f24_4ef9_b147_8fa4777aedbd.slice/crio-a4a42b6ed684a465b5b528ba86bd1f87ffacf834119305e1d92c4e9ee2bbebda WatchSource:0}: Error finding container a4a42b6ed684a465b5b528ba86bd1f87ffacf834119305e1d92c4e9ee2bbebda: Status 404 returned error can't find the container with id a4a42b6ed684a465b5b528ba86bd1f87ffacf834119305e1d92c4e9ee2bbebda Jul 24 14:42:03.194380 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:03.194344 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qbc6f" event={"ID":"1f4726cc-7f24-4ef9-b147-8fa4777aedbd","Type":"ContainerStarted","Data":"a4a42b6ed684a465b5b528ba86bd1f87ffacf834119305e1d92c4e9ee2bbebda"} Jul 24 14:42:04.201433 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:04.201380 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qbc6f" event={"ID":"1f4726cc-7f24-4ef9-b147-8fa4777aedbd","Type":"ContainerStarted","Data":"96001b83c1dea7690bcea5b8c4e551034ce1634d1109ee97e5ca2b8264a6efb9"} Jul 24 14:42:04.201815 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:04.201457 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qbc6f" Jul 24 14:42:04.228871 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:04.228816 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qbc6f" podStartSLOduration=1.461927078 podStartE2EDuration="3.2287987s" totalImagesPullingTime="1.766871622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:42:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:42:04.227413986 +0000 UTC m=+437.508803568" watchObservedRunningTime="2026-07-24 14:42:04.2287987 +0000 UTC m=+437.510188281" Jul 24 14:42:05.318614 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:05.318581 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:42:07.710849 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:07.710809 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:42:08.222912 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:08.222867 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:42:08.391702 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:08.391669 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:42:10.034525 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:10.034430 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:42:12.130782 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:12.130744 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:42:12.567183 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:12.567147 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:42:12.674897 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:12.674862 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:42:14.423835 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:14.423800 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-7v66h"] Jul 24 14:42:14.427243 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:14.427217 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7v66h" Jul 24 14:42:14.429876 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:14.429854 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-4hg4l\"" Jul 24 14:42:14.429982 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:14.429854 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 24 14:42:14.437113 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:14.437090 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-7v66h"] Jul 24 14:42:14.482997 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:14.482958 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nhz5\" (UniqueName: \"kubernetes.io/projected/cc107d36-1dbd-47a8-82e2-67b7485a8867-kube-api-access-9nhz5\") pod \"dns-operator-controller-manager-864dd78c4c-7v66h\" (UID: \"cc107d36-1dbd-47a8-82e2-67b7485a8867\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7v66h" Jul 24 14:42:14.544251 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:14.544216 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:42:14.583795 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:14.583756 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nhz5\" (UniqueName: \"kubernetes.io/projected/cc107d36-1dbd-47a8-82e2-67b7485a8867-kube-api-access-9nhz5\") pod \"dns-operator-controller-manager-864dd78c4c-7v66h\" (UID: \"cc107d36-1dbd-47a8-82e2-67b7485a8867\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7v66h" Jul 24 14:42:14.593545 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:14.593513 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nhz5\" (UniqueName: \"kubernetes.io/projected/cc107d36-1dbd-47a8-82e2-67b7485a8867-kube-api-access-9nhz5\") pod \"dns-operator-controller-manager-864dd78c4c-7v66h\" (UID: \"cc107d36-1dbd-47a8-82e2-67b7485a8867\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7v66h" Jul 24 14:42:14.739087 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:14.738983 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7v66h" Jul 24 14:42:14.883921 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:14.883893 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-7v66h"] Jul 24 14:42:14.887224 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:42:14.887198 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc107d36_1dbd_47a8_82e2_67b7485a8867.slice/crio-4191e0f7ac83af824ab3322139cc33127ed886f13083fb3103bca7ca7d9a70e9 WatchSource:0}: Error finding container 4191e0f7ac83af824ab3322139cc33127ed886f13083fb3103bca7ca7d9a70e9: Status 404 returned error can't find the container with id 4191e0f7ac83af824ab3322139cc33127ed886f13083fb3103bca7ca7d9a70e9 Jul 24 14:42:15.012634 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:15.012533 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:42:15.210454 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:15.210425 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qbc6f" Jul 24 14:42:15.261346 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:15.261316 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:42:15.261872 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:15.261850 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7v66h" event={"ID":"cc107d36-1dbd-47a8-82e2-67b7485a8867","Type":"ContainerStarted","Data":"4191e0f7ac83af824ab3322139cc33127ed886f13083fb3103bca7ca7d9a70e9"} Jul 24 14:42:16.323768 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:16.323738 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:42:16.451799 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:16.451756 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:42:17.274404 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:17.274365 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7v66h" event={"ID":"cc107d36-1dbd-47a8-82e2-67b7485a8867","Type":"ContainerStarted","Data":"99f529cd99855939e54fe948f238442b2293b6d8b6e1f93be1f8e85f3ad5ad7b"} Jul 24 14:42:17.274607 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:17.274508 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7v66h" Jul 24 14:42:17.299102 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:17.299049 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7v66h" podStartSLOduration=1.423129077 podStartE2EDuration="3.299035163s" totalImagesPullingTime="1.875906086s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:42:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:42:17.296554292 +0000 UTC m=+450.577943873" watchObservedRunningTime="2026-07-24 14:42:17.299035163 +0000 UTC m=+450.580424799" Jul 24 14:42:22.326994 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:22.326956 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:42:22.427020 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:22.426986 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:42:25.738269 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:25.738228 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:42:25.879226 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:25.879183 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:42:25.902039 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:25.902007 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qbc6f"] Jul 24 14:42:25.902315 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:25.902251 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qbc6f" podUID="1f4726cc-7f24-4ef9-b147-8fa4777aedbd" containerName="manager" containerID="cri-o://96001b83c1dea7690bcea5b8c4e551034ce1634d1109ee97e5ca2b8264a6efb9" gracePeriod=2 Jul 24 14:42:25.908308 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:25.908267 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qbc6f"] Jul 24 14:42:25.965120 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:25.965088 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b8sq2"] Jul 24 14:42:25.966116 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:25.966090 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f4726cc-7f24-4ef9-b147-8fa4777aedbd" containerName="manager" Jul 24 14:42:25.966116 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:25.966114 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f4726cc-7f24-4ef9-b147-8fa4777aedbd" containerName="manager" Jul 24 14:42:25.966339 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:25.966185 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f4726cc-7f24-4ef9-b147-8fa4777aedbd" containerName="manager" Jul 24 14:42:25.969397 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:25.969378 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b8sq2" Jul 24 14:42:25.972201 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:42:25.972162 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-qbc6f\" is forbidden: User \"system:node:ip-10-0-129-87.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-87.ec2.internal' and this object" podUID="1f4726cc-7f24-4ef9-b147-8fa4777aedbd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qbc6f" Jul 24 14:42:25.991508 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:25.991426 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b8sq2"] Jul 24 14:42:26.088841 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:26.088810 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdpp9\" (UniqueName: \"kubernetes.io/projected/8ff74267-071e-4e8b-88d3-d5d4a8f6728c-kube-api-access-fdpp9\") pod \"limitador-operator-controller-manager-859d7b78bd-b8sq2\" (UID: \"8ff74267-071e-4e8b-88d3-d5d4a8f6728c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b8sq2" Jul 24 14:42:26.149724 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:26.149699 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qbc6f" Jul 24 14:42:26.152551 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:42:26.152524 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-qbc6f\" is forbidden: User \"system:node:ip-10-0-129-87.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-87.ec2.internal' and this object" podUID="1f4726cc-7f24-4ef9-b147-8fa4777aedbd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qbc6f" Jul 24 14:42:26.190080 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:26.190048 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdpp9\" (UniqueName: \"kubernetes.io/projected/8ff74267-071e-4e8b-88d3-d5d4a8f6728c-kube-api-access-fdpp9\") pod \"limitador-operator-controller-manager-859d7b78bd-b8sq2\" (UID: \"8ff74267-071e-4e8b-88d3-d5d4a8f6728c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b8sq2" Jul 24 14:42:26.202133 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:26.202109 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdpp9\" (UniqueName: \"kubernetes.io/projected/8ff74267-071e-4e8b-88d3-d5d4a8f6728c-kube-api-access-fdpp9\") pod \"limitador-operator-controller-manager-859d7b78bd-b8sq2\" (UID: \"8ff74267-071e-4e8b-88d3-d5d4a8f6728c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b8sq2" Jul 24 14:42:26.286858 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:26.286772 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b8sq2" Jul 24 14:42:26.290734 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:26.290717 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kkrng\" (UniqueName: \"kubernetes.io/projected/1f4726cc-7f24-4ef9-b147-8fa4777aedbd-kube-api-access-kkrng\") pod \"1f4726cc-7f24-4ef9-b147-8fa4777aedbd\" (UID: \"1f4726cc-7f24-4ef9-b147-8fa4777aedbd\") " Jul 24 14:42:26.292857 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:26.292829 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f4726cc-7f24-4ef9-b147-8fa4777aedbd-kube-api-access-kkrng" (OuterVolumeSpecName: "kube-api-access-kkrng") pod "1f4726cc-7f24-4ef9-b147-8fa4777aedbd" (UID: "1f4726cc-7f24-4ef9-b147-8fa4777aedbd"). InnerVolumeSpecName "kube-api-access-kkrng". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 14:42:26.323282 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:26.323247 2565 generic.go:356] "Generic (PLEG): container finished" podID="1f4726cc-7f24-4ef9-b147-8fa4777aedbd" containerID="96001b83c1dea7690bcea5b8c4e551034ce1634d1109ee97e5ca2b8264a6efb9" exitCode=0 Jul 24 14:42:26.323456 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:26.323304 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qbc6f" Jul 24 14:42:26.323456 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:26.323342 2565 scope.go:117] "RemoveContainer" containerID="96001b83c1dea7690bcea5b8c4e551034ce1634d1109ee97e5ca2b8264a6efb9" Jul 24 14:42:26.327616 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:42:26.327576 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-qbc6f\" is forbidden: User \"system:node:ip-10-0-129-87.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-87.ec2.internal' and this object" podUID="1f4726cc-7f24-4ef9-b147-8fa4777aedbd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qbc6f" Jul 24 14:42:26.334189 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:26.334171 2565 scope.go:117] "RemoveContainer" containerID="96001b83c1dea7690bcea5b8c4e551034ce1634d1109ee97e5ca2b8264a6efb9" Jul 24 14:42:26.334536 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:42:26.334514 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96001b83c1dea7690bcea5b8c4e551034ce1634d1109ee97e5ca2b8264a6efb9\": container with ID starting with 96001b83c1dea7690bcea5b8c4e551034ce1634d1109ee97e5ca2b8264a6efb9 not found: ID does not exist" containerID="96001b83c1dea7690bcea5b8c4e551034ce1634d1109ee97e5ca2b8264a6efb9" Jul 24 14:42:26.334590 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:26.334546 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96001b83c1dea7690bcea5b8c4e551034ce1634d1109ee97e5ca2b8264a6efb9"} err="failed to get container status \"96001b83c1dea7690bcea5b8c4e551034ce1634d1109ee97e5ca2b8264a6efb9\": rpc error: code = NotFound desc = could not find container \"96001b83c1dea7690bcea5b8c4e551034ce1634d1109ee97e5ca2b8264a6efb9\": container with ID starting with 96001b83c1dea7690bcea5b8c4e551034ce1634d1109ee97e5ca2b8264a6efb9 not found: ID does not exist" Jul 24 14:42:26.336010 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:42:26.335986 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-qbc6f\" is forbidden: User \"system:node:ip-10-0-129-87.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-87.ec2.internal' and this object" podUID="1f4726cc-7f24-4ef9-b147-8fa4777aedbd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qbc6f" Jul 24 14:42:26.394492 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:26.392108 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kkrng\" (UniqueName: \"kubernetes.io/projected/1f4726cc-7f24-4ef9-b147-8fa4777aedbd-kube-api-access-kkrng\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 14:42:26.444913 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:26.444884 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b8sq2"] Jul 24 14:42:26.446061 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:42:26.446039 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ff74267_071e_4e8b_88d3_d5d4a8f6728c.slice/crio-7543a7f2fe7f6245cf319ffc1cfb024a08cb9297deca9e47054cf503a0d5ac36 WatchSource:0}: Error finding container 7543a7f2fe7f6245cf319ffc1cfb024a08cb9297deca9e47054cf503a0d5ac36: Status 404 returned error can't find the container with id 7543a7f2fe7f6245cf319ffc1cfb024a08cb9297deca9e47054cf503a0d5ac36 Jul 24 14:42:27.169886 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:42:27.169842 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-qbc6f\" is forbidden: User \"system:node:ip-10-0-129-87.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-87.ec2.internal' and this object" podUID="1f4726cc-7f24-4ef9-b147-8fa4777aedbd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qbc6f" Jul 24 14:42:27.170938 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:27.170914 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f4726cc-7f24-4ef9-b147-8fa4777aedbd" path="/var/lib/kubelet/pods/1f4726cc-7f24-4ef9-b147-8fa4777aedbd/volumes" Jul 24 14:42:27.331273 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:27.331240 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b8sq2" event={"ID":"8ff74267-071e-4e8b-88d3-d5d4a8f6728c","Type":"ContainerStarted","Data":"63c26f60b00ee747a052c8f79df05b2d0d4f01733552b87c2e663b99da8112d5"} Jul 24 14:42:27.331484 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:27.331299 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b8sq2" event={"ID":"8ff74267-071e-4e8b-88d3-d5d4a8f6728c","Type":"ContainerStarted","Data":"7543a7f2fe7f6245cf319ffc1cfb024a08cb9297deca9e47054cf503a0d5ac36"} Jul 24 14:42:27.331484 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:27.331328 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b8sq2" Jul 24 14:42:27.370302 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:27.370253 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b8sq2" podStartSLOduration=2.370237378 podStartE2EDuration="2.370237378s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:42:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:42:27.36895901 +0000 UTC m=+460.650348593" watchObservedRunningTime="2026-07-24 14:42:27.370237378 +0000 UTC m=+460.651626958" Jul 24 14:42:28.170419 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:28.170388 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:42:28.282626 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:28.282587 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7v66h" Jul 24 14:42:28.305649 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:28.305620 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:42:28.413638 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:28.413599 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:42:28.614600 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:28.614568 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:42:28.777356 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:28.777290 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:42:30.621791 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:30.621750 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:42:30.725219 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:30.725185 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:42:35.259393 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:35.259333 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:42:35.356868 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:35.356837 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:42:37.722303 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:37.722266 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:42:37.837025 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:37.836993 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:42:38.340140 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:38.340104 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b8sq2" Jul 24 14:42:47.078213 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:47.078172 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:42:47.196705 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:47.196674 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:42:49.436587 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:49.436554 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:42:49.538211 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:42:49.538182 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:43:04.641753 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:04.641713 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:43:04.846817 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:04.846781 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:43:07.237666 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:07.237632 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-52dvp"] Jul 24 14:43:07.239559 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:07.239527 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:43:07.243660 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:07.243460 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-52dvp" Jul 24 14:43:07.246331 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:07.246310 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 24 14:43:07.246441 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:07.246311 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-k452s\"" Jul 24 14:43:07.250397 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:07.250373 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-52dvp"] Jul 24 14:43:07.334816 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:07.334778 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-52dvp"] Jul 24 14:43:07.347859 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:07.347834 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:43:07.357889 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:07.357860 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c41d0c75-b066-47bc-9b43-3e49a4c6c3d6-config-file\") pod \"limitador-limitador-64c94fd64f-52dvp\" (UID: \"c41d0c75-b066-47bc-9b43-3e49a4c6c3d6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-52dvp" Jul 24 14:43:07.358017 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:07.357924 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7rdd\" (UniqueName: \"kubernetes.io/projected/c41d0c75-b066-47bc-9b43-3e49a4c6c3d6-kube-api-access-w7rdd\") pod \"limitador-limitador-64c94fd64f-52dvp\" (UID: \"c41d0c75-b066-47bc-9b43-3e49a4c6c3d6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-52dvp" Jul 24 14:43:07.447934 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:07.447902 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:43:07.459092 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:07.459061 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7rdd\" (UniqueName: \"kubernetes.io/projected/c41d0c75-b066-47bc-9b43-3e49a4c6c3d6-kube-api-access-w7rdd\") pod \"limitador-limitador-64c94fd64f-52dvp\" (UID: \"c41d0c75-b066-47bc-9b43-3e49a4c6c3d6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-52dvp" Jul 24 14:43:07.459234 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:07.459116 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c41d0c75-b066-47bc-9b43-3e49a4c6c3d6-config-file\") pod \"limitador-limitador-64c94fd64f-52dvp\" (UID: \"c41d0c75-b066-47bc-9b43-3e49a4c6c3d6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-52dvp" Jul 24 14:43:07.459730 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:07.459711 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c41d0c75-b066-47bc-9b43-3e49a4c6c3d6-config-file\") pod \"limitador-limitador-64c94fd64f-52dvp\" (UID: \"c41d0c75-b066-47bc-9b43-3e49a4c6c3d6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-52dvp" Jul 24 14:43:07.467885 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:07.467861 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7rdd\" (UniqueName: \"kubernetes.io/projected/c41d0c75-b066-47bc-9b43-3e49a4c6c3d6-kube-api-access-w7rdd\") pod \"limitador-limitador-64c94fd64f-52dvp\" (UID: \"c41d0c75-b066-47bc-9b43-3e49a4c6c3d6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-52dvp" Jul 24 14:43:07.556315 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:07.556281 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-52dvp" Jul 24 14:43:07.694266 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:07.694239 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-52dvp"] Jul 24 14:43:07.695882 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:43:07.695855 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc41d0c75_b066_47bc_9b43_3e49a4c6c3d6.slice/crio-09160c440f6ed109fe87b849301cd54d05c0215ba847eba08960da769344aa88 WatchSource:0}: Error finding container 09160c440f6ed109fe87b849301cd54d05c0215ba847eba08960da769344aa88: Status 404 returned error can't find the container with id 09160c440f6ed109fe87b849301cd54d05c0215ba847eba08960da769344aa88 Jul 24 14:43:08.094650 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:08.094597 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:43:08.192341 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:08.192303 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:43:08.559038 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:08.559001 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-52dvp" event={"ID":"c41d0c75-b066-47bc-9b43-3e49a4c6c3d6","Type":"ContainerStarted","Data":"09160c440f6ed109fe87b849301cd54d05c0215ba847eba08960da769344aa88"} Jul 24 14:43:10.571890 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:10.571859 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-52dvp" event={"ID":"c41d0c75-b066-47bc-9b43-3e49a4c6c3d6","Type":"ContainerStarted","Data":"67eca25f06cec0081a5b5f11c4d69e12387a38e69c25b088502cd45faf211d51"} Jul 24 14:43:10.572381 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:10.572354 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-52dvp" Jul 24 14:43:10.591735 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:10.591680 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-52dvp" podStartSLOduration=0.917499652 podStartE2EDuration="3.591665737s" totalImagesPullingTime="2.674166085s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:43:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:43:10.589393493 +0000 UTC m=+503.870783078" watchObservedRunningTime="2026-07-24 14:43:10.591665737 +0000 UTC m=+503.873055317" Jul 24 14:43:21.579301 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:21.579270 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-52dvp" Jul 24 14:43:22.287010 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:22.286975 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-52dvp"] Jul 24 14:43:22.287182 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:22.287158 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-52dvp" podUID="c41d0c75-b066-47bc-9b43-3e49a4c6c3d6" containerName="limitador" containerID="cri-o://67eca25f06cec0081a5b5f11c4d69e12387a38e69c25b088502cd45faf211d51" gracePeriod=30 Jul 24 14:43:22.843062 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:22.843033 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-52dvp" Jul 24 14:43:22.991958 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:22.991864 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c41d0c75-b066-47bc-9b43-3e49a4c6c3d6-config-file\") pod \"c41d0c75-b066-47bc-9b43-3e49a4c6c3d6\" (UID: \"c41d0c75-b066-47bc-9b43-3e49a4c6c3d6\") " Jul 24 14:43:22.991958 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:22.991934 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w7rdd\" (UniqueName: \"kubernetes.io/projected/c41d0c75-b066-47bc-9b43-3e49a4c6c3d6-kube-api-access-w7rdd\") pod \"c41d0c75-b066-47bc-9b43-3e49a4c6c3d6\" (UID: \"c41d0c75-b066-47bc-9b43-3e49a4c6c3d6\") " Jul 24 14:43:22.992240 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:22.992217 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c41d0c75-b066-47bc-9b43-3e49a4c6c3d6-config-file" (OuterVolumeSpecName: "config-file") pod "c41d0c75-b066-47bc-9b43-3e49a4c6c3d6" (UID: "c41d0c75-b066-47bc-9b43-3e49a4c6c3d6"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 14:43:22.993924 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:22.993900 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c41d0c75-b066-47bc-9b43-3e49a4c6c3d6-kube-api-access-w7rdd" (OuterVolumeSpecName: "kube-api-access-w7rdd") pod "c41d0c75-b066-47bc-9b43-3e49a4c6c3d6" (UID: "c41d0c75-b066-47bc-9b43-3e49a4c6c3d6"). InnerVolumeSpecName "kube-api-access-w7rdd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 14:43:23.093386 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:23.093347 2565 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c41d0c75-b066-47bc-9b43-3e49a4c6c3d6-config-file\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 14:43:23.093386 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:23.093382 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w7rdd\" (UniqueName: \"kubernetes.io/projected/c41d0c75-b066-47bc-9b43-3e49a4c6c3d6-kube-api-access-w7rdd\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 14:43:23.443694 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:23.443658 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:43:23.540935 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:23.540893 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:43:23.642216 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:23.642179 2565 generic.go:356] "Generic (PLEG): container finished" podID="c41d0c75-b066-47bc-9b43-3e49a4c6c3d6" containerID="67eca25f06cec0081a5b5f11c4d69e12387a38e69c25b088502cd45faf211d51" exitCode=0 Jul 24 14:43:23.642388 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:23.642236 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-52dvp" Jul 24 14:43:23.642388 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:23.642246 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-52dvp" event={"ID":"c41d0c75-b066-47bc-9b43-3e49a4c6c3d6","Type":"ContainerDied","Data":"67eca25f06cec0081a5b5f11c4d69e12387a38e69c25b088502cd45faf211d51"} Jul 24 14:43:23.642388 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:23.642292 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-52dvp" event={"ID":"c41d0c75-b066-47bc-9b43-3e49a4c6c3d6","Type":"ContainerDied","Data":"09160c440f6ed109fe87b849301cd54d05c0215ba847eba08960da769344aa88"} Jul 24 14:43:23.642388 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:23.642314 2565 scope.go:117] "RemoveContainer" containerID="67eca25f06cec0081a5b5f11c4d69e12387a38e69c25b088502cd45faf211d51" Jul 24 14:43:23.651226 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:23.651209 2565 scope.go:117] "RemoveContainer" containerID="67eca25f06cec0081a5b5f11c4d69e12387a38e69c25b088502cd45faf211d51" Jul 24 14:43:23.651457 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:43:23.651440 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67eca25f06cec0081a5b5f11c4d69e12387a38e69c25b088502cd45faf211d51\": container with ID starting with 67eca25f06cec0081a5b5f11c4d69e12387a38e69c25b088502cd45faf211d51 not found: ID does not exist" containerID="67eca25f06cec0081a5b5f11c4d69e12387a38e69c25b088502cd45faf211d51" Jul 24 14:43:23.651524 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:23.651465 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67eca25f06cec0081a5b5f11c4d69e12387a38e69c25b088502cd45faf211d51"} err="failed to get container status \"67eca25f06cec0081a5b5f11c4d69e12387a38e69c25b088502cd45faf211d51\": rpc error: code = NotFound desc = could not find container \"67eca25f06cec0081a5b5f11c4d69e12387a38e69c25b088502cd45faf211d51\": container with ID starting with 67eca25f06cec0081a5b5f11c4d69e12387a38e69c25b088502cd45faf211d51 not found: ID does not exist" Jul 24 14:43:23.659983 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:23.659960 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-52dvp"] Jul 24 14:43:23.666218 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:23.666196 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-52dvp"] Jul 24 14:43:23.908486 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:23.908440 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-5ffkf"] Jul 24 14:43:23.908840 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:23.908816 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c41d0c75-b066-47bc-9b43-3e49a4c6c3d6" containerName="limitador" Jul 24 14:43:23.908840 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:23.908827 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c41d0c75-b066-47bc-9b43-3e49a4c6c3d6" containerName="limitador" Jul 24 14:43:23.908958 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:23.908891 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c41d0c75-b066-47bc-9b43-3e49a4c6c3d6" containerName="limitador" Jul 24 14:43:23.913230 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:23.913209 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5ffkf" Jul 24 14:43:23.915791 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:23.915765 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 24 14:43:23.915891 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:23.915820 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-k7jh5\"" Jul 24 14:43:23.915932 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:23.915821 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 24 14:43:23.915932 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:23.915779 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 24 14:43:23.921159 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:23.921137 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-5ffkf"] Jul 24 14:43:23.944768 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:23.944742 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:43:24.001215 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:24.001181 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/16184304-6e63-477e-8af9-d2c9b5d766a4-data\") pod \"postgres-69fb4594cf-5ffkf\" (UID: \"16184304-6e63-477e-8af9-d2c9b5d766a4\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-5ffkf" Jul 24 14:43:24.001359 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:24.001243 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84dn2\" (UniqueName: \"kubernetes.io/projected/16184304-6e63-477e-8af9-d2c9b5d766a4-kube-api-access-84dn2\") pod \"postgres-69fb4594cf-5ffkf\" (UID: \"16184304-6e63-477e-8af9-d2c9b5d766a4\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-5ffkf" Jul 24 14:43:24.101923 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:24.101890 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84dn2\" (UniqueName: \"kubernetes.io/projected/16184304-6e63-477e-8af9-d2c9b5d766a4-kube-api-access-84dn2\") pod \"postgres-69fb4594cf-5ffkf\" (UID: \"16184304-6e63-477e-8af9-d2c9b5d766a4\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-5ffkf" Jul 24 14:43:24.102108 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:24.101957 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/16184304-6e63-477e-8af9-d2c9b5d766a4-data\") pod \"postgres-69fb4594cf-5ffkf\" (UID: \"16184304-6e63-477e-8af9-d2c9b5d766a4\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-5ffkf" Jul 24 14:43:24.102342 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:24.102319 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/16184304-6e63-477e-8af9-d2c9b5d766a4-data\") pod \"postgres-69fb4594cf-5ffkf\" (UID: \"16184304-6e63-477e-8af9-d2c9b5d766a4\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-5ffkf" Jul 24 14:43:24.111688 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:24.111663 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84dn2\" (UniqueName: \"kubernetes.io/projected/16184304-6e63-477e-8af9-d2c9b5d766a4-kube-api-access-84dn2\") pod \"postgres-69fb4594cf-5ffkf\" (UID: \"16184304-6e63-477e-8af9-d2c9b5d766a4\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-5ffkf" Jul 24 14:43:24.224510 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:24.224392 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5ffkf" Jul 24 14:43:24.359125 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:24.359099 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-5ffkf"] Jul 24 14:43:24.360503 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:43:24.360459 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16184304_6e63_477e_8af9_d2c9b5d766a4.slice/crio-ef3c4b012421d142a8700df26bd759296cdcad28a14776ae62c66589a101de6b WatchSource:0}: Error finding container ef3c4b012421d142a8700df26bd759296cdcad28a14776ae62c66589a101de6b: Status 404 returned error can't find the container with id ef3c4b012421d142a8700df26bd759296cdcad28a14776ae62c66589a101de6b Jul 24 14:43:24.648948 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:24.648909 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5ffkf" event={"ID":"16184304-6e63-477e-8af9-d2c9b5d766a4","Type":"ContainerStarted","Data":"ef3c4b012421d142a8700df26bd759296cdcad28a14776ae62c66589a101de6b"} Jul 24 14:43:25.175513 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:25.175123 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c41d0c75-b066-47bc-9b43-3e49a4c6c3d6" path="/var/lib/kubelet/pods/c41d0c75-b066-47bc-9b43-3e49a4c6c3d6/volumes" Jul 24 14:43:29.687732 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:29.687693 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5ffkf" event={"ID":"16184304-6e63-477e-8af9-d2c9b5d766a4","Type":"ContainerStarted","Data":"9530a9ccf1774b8d5509024eade250d798752cab7657f2c307f8313a71c28969"} Jul 24 14:43:29.688210 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:29.687824 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5ffkf" Jul 24 14:43:29.705950 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:29.705896 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5ffkf" podStartSLOduration=1.872422434 podStartE2EDuration="6.705879731s" totalImagesPullingTime="4.833457297s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:43:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:43:29.704706365 +0000 UTC m=+522.986095959" watchObservedRunningTime="2026-07-24 14:43:29.705879731 +0000 UTC m=+522.987269312" Jul 24 14:43:35.721989 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:35.721961 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5ffkf" Jul 24 14:43:36.046508 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:36.046399 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:43:36.179750 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:36.179713 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:43:43.228834 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:43.228732 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:43:43.236697 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:43.236655 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-8959b874c-r22tx"] Jul 24 14:43:43.246308 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:43.246283 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8959b874c-r22tx" Jul 24 14:43:43.249166 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:43.249139 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 24 14:43:43.249335 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:43.249317 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-qh6c8\"" Jul 24 14:43:43.249406 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:43.249370 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 24 14:43:43.251397 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:43.251375 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8959b874c-r22tx"] Jul 24 14:43:43.267846 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:43.267817 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shd2v\" (UniqueName: \"kubernetes.io/projected/3620dccf-d266-4f7f-81da-db8d2966a4cb-kube-api-access-shd2v\") pod \"maas-controller-8959b874c-r22tx\" (UID: \"3620dccf-d266-4f7f-81da-db8d2966a4cb\") " pod="opendatahub/maas-controller-8959b874c-r22tx" Jul 24 14:43:43.268007 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:43.267980 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3620dccf-d266-4f7f-81da-db8d2966a4cb-webhook-cert\") pod \"maas-controller-8959b874c-r22tx\" (UID: \"3620dccf-d266-4f7f-81da-db8d2966a4cb\") " pod="opendatahub/maas-controller-8959b874c-r22tx" Jul 24 14:43:43.325620 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:43.325597 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:43:43.369273 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:43.369252 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shd2v\" (UniqueName: \"kubernetes.io/projected/3620dccf-d266-4f7f-81da-db8d2966a4cb-kube-api-access-shd2v\") pod \"maas-controller-8959b874c-r22tx\" (UID: \"3620dccf-d266-4f7f-81da-db8d2966a4cb\") " pod="opendatahub/maas-controller-8959b874c-r22tx" Jul 24 14:43:43.369370 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:43.369305 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3620dccf-d266-4f7f-81da-db8d2966a4cb-webhook-cert\") pod \"maas-controller-8959b874c-r22tx\" (UID: \"3620dccf-d266-4f7f-81da-db8d2966a4cb\") " pod="opendatahub/maas-controller-8959b874c-r22tx" Jul 24 14:43:43.371804 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:43.371783 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3620dccf-d266-4f7f-81da-db8d2966a4cb-webhook-cert\") pod \"maas-controller-8959b874c-r22tx\" (UID: \"3620dccf-d266-4f7f-81da-db8d2966a4cb\") " pod="opendatahub/maas-controller-8959b874c-r22tx" Jul 24 14:43:43.377858 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:43.377832 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shd2v\" (UniqueName: \"kubernetes.io/projected/3620dccf-d266-4f7f-81da-db8d2966a4cb-kube-api-access-shd2v\") pod \"maas-controller-8959b874c-r22tx\" (UID: \"3620dccf-d266-4f7f-81da-db8d2966a4cb\") " pod="opendatahub/maas-controller-8959b874c-r22tx" Jul 24 14:43:43.384795 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:43.384767 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:43:43.422303 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:43.422275 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7fcc68fb76-4bwdl"] Jul 24 14:43:43.425620 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:43.425603 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7fcc68fb76-4bwdl" Jul 24 14:43:43.437091 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:43.437067 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7fcc68fb76-4bwdl"] Jul 24 14:43:43.470571 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:43.470545 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/de53d8e2-e773-4aa3-be0d-cecb00f9705b-webhook-cert\") pod \"maas-controller-7fcc68fb76-4bwdl\" (UID: \"de53d8e2-e773-4aa3-be0d-cecb00f9705b\") " pod="opendatahub/maas-controller-7fcc68fb76-4bwdl" Jul 24 14:43:43.470721 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:43.470575 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfskh\" (UniqueName: \"kubernetes.io/projected/de53d8e2-e773-4aa3-be0d-cecb00f9705b-kube-api-access-zfskh\") pod \"maas-controller-7fcc68fb76-4bwdl\" (UID: \"de53d8e2-e773-4aa3-be0d-cecb00f9705b\") " pod="opendatahub/maas-controller-7fcc68fb76-4bwdl" Jul 24 14:43:43.559520 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:43.559449 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8959b874c-r22tx" Jul 24 14:43:43.571561 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:43.571536 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/de53d8e2-e773-4aa3-be0d-cecb00f9705b-webhook-cert\") pod \"maas-controller-7fcc68fb76-4bwdl\" (UID: \"de53d8e2-e773-4aa3-be0d-cecb00f9705b\") " pod="opendatahub/maas-controller-7fcc68fb76-4bwdl" Jul 24 14:43:43.571640 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:43.571579 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfskh\" (UniqueName: \"kubernetes.io/projected/de53d8e2-e773-4aa3-be0d-cecb00f9705b-kube-api-access-zfskh\") pod \"maas-controller-7fcc68fb76-4bwdl\" (UID: \"de53d8e2-e773-4aa3-be0d-cecb00f9705b\") " pod="opendatahub/maas-controller-7fcc68fb76-4bwdl" Jul 24 14:43:43.574133 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:43.574106 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/de53d8e2-e773-4aa3-be0d-cecb00f9705b-webhook-cert\") pod \"maas-controller-7fcc68fb76-4bwdl\" (UID: \"de53d8e2-e773-4aa3-be0d-cecb00f9705b\") " pod="opendatahub/maas-controller-7fcc68fb76-4bwdl" Jul 24 14:43:43.580550 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:43.580524 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfskh\" (UniqueName: \"kubernetes.io/projected/de53d8e2-e773-4aa3-be0d-cecb00f9705b-kube-api-access-zfskh\") pod \"maas-controller-7fcc68fb76-4bwdl\" (UID: \"de53d8e2-e773-4aa3-be0d-cecb00f9705b\") " pod="opendatahub/maas-controller-7fcc68fb76-4bwdl" Jul 24 14:43:43.692950 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:43.692920 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8959b874c-r22tx"] Jul 24 14:43:43.694310 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:43:43.694285 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3620dccf_d266_4f7f_81da_db8d2966a4cb.slice/crio-963a9db645b0f003469aa479734b0076eef0a2306895eb1ea6a109e6984de263 WatchSource:0}: Error finding container 963a9db645b0f003469aa479734b0076eef0a2306895eb1ea6a109e6984de263: Status 404 returned error can't find the container with id 963a9db645b0f003469aa479734b0076eef0a2306895eb1ea6a109e6984de263 Jul 24 14:43:43.736848 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:43.736809 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7fcc68fb76-4bwdl" Jul 24 14:43:43.768743 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:43.768716 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8959b874c-r22tx" event={"ID":"3620dccf-d266-4f7f-81da-db8d2966a4cb","Type":"ContainerStarted","Data":"963a9db645b0f003469aa479734b0076eef0a2306895eb1ea6a109e6984de263"} Jul 24 14:43:43.867261 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:43.867237 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7fcc68fb76-4bwdl"] Jul 24 14:43:43.868789 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:43:43.868759 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde53d8e2_e773_4aa3_be0d_cecb00f9705b.slice/crio-8e92e7a2c0e37cccf3fa1338d446d77b559fb61bfce5b235aec773985fec5afc WatchSource:0}: Error finding container 8e92e7a2c0e37cccf3fa1338d446d77b559fb61bfce5b235aec773985fec5afc: Status 404 returned error can't find the container with id 8e92e7a2c0e37cccf3fa1338d446d77b559fb61bfce5b235aec773985fec5afc Jul 24 14:43:44.779136 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:44.779054 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7fcc68fb76-4bwdl" event={"ID":"de53d8e2-e773-4aa3-be0d-cecb00f9705b","Type":"ContainerStarted","Data":"8e92e7a2c0e37cccf3fa1338d446d77b559fb61bfce5b235aec773985fec5afc"} Jul 24 14:43:46.339592 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:46.339552 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:43:46.445576 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:46.445492 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:43:46.791606 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:46.791506 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8959b874c-r22tx" event={"ID":"3620dccf-d266-4f7f-81da-db8d2966a4cb","Type":"ContainerStarted","Data":"5a951927d2faa69ad3c7643d7be87c76516ee8c3f716ac0c2010fc7b6670b782"} Jul 24 14:43:46.791777 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:46.791640 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-8959b874c-r22tx" Jul 24 14:43:46.792957 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:46.792932 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7fcc68fb76-4bwdl" event={"ID":"de53d8e2-e773-4aa3-be0d-cecb00f9705b","Type":"ContainerStarted","Data":"9c37e6c19cc0c10c5f832c7c2b631d8cb8c58893967292f876ea8d59506463fc"} Jul 24 14:43:46.793072 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:46.792983 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7fcc68fb76-4bwdl" Jul 24 14:43:46.810634 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:46.810595 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-8959b874c-r22tx" podStartSLOduration=1.344089772 podStartE2EDuration="3.810582836s" totalImagesPullingTime="2.466493064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:43:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:43:46.80902169 +0000 UTC m=+540.090411272" watchObservedRunningTime="2026-07-24 14:43:46.810582836 +0000 UTC m=+540.091972425" Jul 24 14:43:46.825840 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:46.825799 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7fcc68fb76-4bwdl" podStartSLOduration=1.527320326 podStartE2EDuration="3.825783234s" totalImagesPullingTime="2.298462908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:43:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:43:46.825686077 +0000 UTC m=+540.107075657" watchObservedRunningTime="2026-07-24 14:43:46.825783234 +0000 UTC m=+540.107172815" Jul 24 14:43:57.800188 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:57.800149 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7fcc68fb76-4bwdl" Jul 24 14:43:57.800600 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:57.800233 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-8959b874c-r22tx" Jul 24 14:43:57.872424 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:57.872388 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8959b874c-r22tx"] Jul 24 14:43:57.872624 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:57.872601 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-8959b874c-r22tx" podUID="3620dccf-d266-4f7f-81da-db8d2966a4cb" containerName="manager" containerID="cri-o://5a951927d2faa69ad3c7643d7be87c76516ee8c3f716ac0c2010fc7b6670b782" gracePeriod=30 Jul 24 14:43:58.122881 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:58.122857 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8959b874c-r22tx" Jul 24 14:43:58.204234 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:58.204202 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3620dccf-d266-4f7f-81da-db8d2966a4cb-webhook-cert\") pod \"3620dccf-d266-4f7f-81da-db8d2966a4cb\" (UID: \"3620dccf-d266-4f7f-81da-db8d2966a4cb\") " Jul 24 14:43:58.204404 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:58.204302 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-shd2v\" (UniqueName: \"kubernetes.io/projected/3620dccf-d266-4f7f-81da-db8d2966a4cb-kube-api-access-shd2v\") pod \"3620dccf-d266-4f7f-81da-db8d2966a4cb\" (UID: \"3620dccf-d266-4f7f-81da-db8d2966a4cb\") " Jul 24 14:43:58.206435 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:58.206404 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3620dccf-d266-4f7f-81da-db8d2966a4cb-kube-api-access-shd2v" (OuterVolumeSpecName: "kube-api-access-shd2v") pod "3620dccf-d266-4f7f-81da-db8d2966a4cb" (UID: "3620dccf-d266-4f7f-81da-db8d2966a4cb"). InnerVolumeSpecName "kube-api-access-shd2v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 14:43:58.206435 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:58.206403 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3620dccf-d266-4f7f-81da-db8d2966a4cb-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "3620dccf-d266-4f7f-81da-db8d2966a4cb" (UID: "3620dccf-d266-4f7f-81da-db8d2966a4cb"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 14:43:58.305861 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:58.305826 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-shd2v\" (UniqueName: \"kubernetes.io/projected/3620dccf-d266-4f7f-81da-db8d2966a4cb-kube-api-access-shd2v\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 14:43:58.305861 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:58.305854 2565 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3620dccf-d266-4f7f-81da-db8d2966a4cb-webhook-cert\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 14:43:58.858181 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:58.858150 2565 generic.go:356] "Generic (PLEG): container finished" podID="3620dccf-d266-4f7f-81da-db8d2966a4cb" containerID="5a951927d2faa69ad3c7643d7be87c76516ee8c3f716ac0c2010fc7b6670b782" exitCode=0 Jul 24 14:43:58.858181 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:58.858186 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8959b874c-r22tx" event={"ID":"3620dccf-d266-4f7f-81da-db8d2966a4cb","Type":"ContainerDied","Data":"5a951927d2faa69ad3c7643d7be87c76516ee8c3f716ac0c2010fc7b6670b782"} Jul 24 14:43:58.858737 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:58.858200 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8959b874c-r22tx" Jul 24 14:43:58.858737 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:58.858223 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8959b874c-r22tx" event={"ID":"3620dccf-d266-4f7f-81da-db8d2966a4cb","Type":"ContainerDied","Data":"963a9db645b0f003469aa479734b0076eef0a2306895eb1ea6a109e6984de263"} Jul 24 14:43:58.858737 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:58.858246 2565 scope.go:117] "RemoveContainer" containerID="5a951927d2faa69ad3c7643d7be87c76516ee8c3f716ac0c2010fc7b6670b782" Jul 24 14:43:58.868020 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:58.868003 2565 scope.go:117] "RemoveContainer" containerID="5a951927d2faa69ad3c7643d7be87c76516ee8c3f716ac0c2010fc7b6670b782" Jul 24 14:43:58.868275 ip-10-0-129-87 kubenswrapper[2565]: E0724 14:43:58.868256 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a951927d2faa69ad3c7643d7be87c76516ee8c3f716ac0c2010fc7b6670b782\": container with ID starting with 5a951927d2faa69ad3c7643d7be87c76516ee8c3f716ac0c2010fc7b6670b782 not found: ID does not exist" containerID="5a951927d2faa69ad3c7643d7be87c76516ee8c3f716ac0c2010fc7b6670b782" Jul 24 14:43:58.868321 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:58.868283 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a951927d2faa69ad3c7643d7be87c76516ee8c3f716ac0c2010fc7b6670b782"} err="failed to get container status \"5a951927d2faa69ad3c7643d7be87c76516ee8c3f716ac0c2010fc7b6670b782\": rpc error: code = NotFound desc = could not find container \"5a951927d2faa69ad3c7643d7be87c76516ee8c3f716ac0c2010fc7b6670b782\": container with ID starting with 5a951927d2faa69ad3c7643d7be87c76516ee8c3f716ac0c2010fc7b6670b782 not found: ID does not exist" Jul 24 14:43:58.880190 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:58.880163 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8959b874c-r22tx"] Jul 24 14:43:58.886443 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:58.886422 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-8959b874c-r22tx"] Jul 24 14:43:59.170337 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:43:59.170255 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3620dccf-d266-4f7f-81da-db8d2966a4cb" path="/var/lib/kubelet/pods/3620dccf-d266-4f7f-81da-db8d2966a4cb/volumes" Jul 24 14:44:20.423428 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:20.423393 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:44:20.522935 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:20.522901 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:44:21.147188 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:21.147147 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:44:21.345712 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:21.345676 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-55c59f9594-r86w6"] Jul 24 14:44:21.346142 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:21.346124 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3620dccf-d266-4f7f-81da-db8d2966a4cb" containerName="manager" Jul 24 14:44:21.346233 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:21.346145 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3620dccf-d266-4f7f-81da-db8d2966a4cb" containerName="manager" Jul 24 14:44:21.346295 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:21.346240 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3620dccf-d266-4f7f-81da-db8d2966a4cb" containerName="manager" Jul 24 14:44:21.358997 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:21.358965 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-55c59f9594-r86w6" Jul 24 14:44:21.362585 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:21.362534 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 24 14:44:21.362738 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:21.362591 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-q7xmh\"" Jul 24 14:44:21.363397 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:21.363365 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-55c59f9594-r86w6"] Jul 24 14:44:21.366050 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:21.366025 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:44:21.511677 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:21.511599 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69de0b22-1cc1-4148-b1c5-d769ca29b774-maas-api-tls\") pod \"maas-api-55c59f9594-r86w6\" (UID: \"69de0b22-1cc1-4148-b1c5-d769ca29b774\") " pod="odh-ai-gateway-infra/maas-api-55c59f9594-r86w6" Jul 24 14:44:21.512031 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:21.511674 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69de0b22-1cc1-4148-b1c5-d769ca29b774-openshift-service-ca\") pod \"maas-api-55c59f9594-r86w6\" (UID: \"69de0b22-1cc1-4148-b1c5-d769ca29b774\") " pod="odh-ai-gateway-infra/maas-api-55c59f9594-r86w6" Jul 24 14:44:21.512031 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:21.511754 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gg8ll\" (UniqueName: \"kubernetes.io/projected/69de0b22-1cc1-4148-b1c5-d769ca29b774-kube-api-access-gg8ll\") pod \"maas-api-55c59f9594-r86w6\" (UID: \"69de0b22-1cc1-4148-b1c5-d769ca29b774\") " pod="odh-ai-gateway-infra/maas-api-55c59f9594-r86w6" Jul 24 14:44:21.613075 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:21.613039 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gg8ll\" (UniqueName: \"kubernetes.io/projected/69de0b22-1cc1-4148-b1c5-d769ca29b774-kube-api-access-gg8ll\") pod \"maas-api-55c59f9594-r86w6\" (UID: \"69de0b22-1cc1-4148-b1c5-d769ca29b774\") " pod="odh-ai-gateway-infra/maas-api-55c59f9594-r86w6" Jul 24 14:44:21.613234 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:21.613084 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69de0b22-1cc1-4148-b1c5-d769ca29b774-maas-api-tls\") pod \"maas-api-55c59f9594-r86w6\" (UID: \"69de0b22-1cc1-4148-b1c5-d769ca29b774\") " pod="odh-ai-gateway-infra/maas-api-55c59f9594-r86w6" Jul 24 14:44:21.613234 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:21.613140 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69de0b22-1cc1-4148-b1c5-d769ca29b774-openshift-service-ca\") pod \"maas-api-55c59f9594-r86w6\" (UID: \"69de0b22-1cc1-4148-b1c5-d769ca29b774\") " pod="odh-ai-gateway-infra/maas-api-55c59f9594-r86w6" Jul 24 14:44:21.613834 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:21.613812 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69de0b22-1cc1-4148-b1c5-d769ca29b774-openshift-service-ca\") pod \"maas-api-55c59f9594-r86w6\" (UID: \"69de0b22-1cc1-4148-b1c5-d769ca29b774\") " pod="odh-ai-gateway-infra/maas-api-55c59f9594-r86w6" Jul 24 14:44:21.615661 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:21.615596 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69de0b22-1cc1-4148-b1c5-d769ca29b774-maas-api-tls\") pod \"maas-api-55c59f9594-r86w6\" (UID: \"69de0b22-1cc1-4148-b1c5-d769ca29b774\") " pod="odh-ai-gateway-infra/maas-api-55c59f9594-r86w6" Jul 24 14:44:21.623940 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:21.623918 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gg8ll\" (UniqueName: \"kubernetes.io/projected/69de0b22-1cc1-4148-b1c5-d769ca29b774-kube-api-access-gg8ll\") pod \"maas-api-55c59f9594-r86w6\" (UID: \"69de0b22-1cc1-4148-b1c5-d769ca29b774\") " pod="odh-ai-gateway-infra/maas-api-55c59f9594-r86w6" Jul 24 14:44:21.671636 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:21.671609 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-55c59f9594-r86w6" Jul 24 14:44:21.736073 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:21.736030 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:44:21.816553 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:21.816523 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-55c59f9594-r86w6"] Jul 24 14:44:21.817933 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:44:21.817907 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69de0b22_1cc1_4148_b1c5_d769ca29b774.slice/crio-3d1d5170c62ebf307c1846984d01a23d70a3f908dbd05e2548f32cc187ad9e29 WatchSource:0}: Error finding container 3d1d5170c62ebf307c1846984d01a23d70a3f908dbd05e2548f32cc187ad9e29: Status 404 returned error can't find the container with id 3d1d5170c62ebf307c1846984d01a23d70a3f908dbd05e2548f32cc187ad9e29 Jul 24 14:44:21.818650 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:21.818613 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:44:21.841815 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:21.841792 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-7wk5f"] Jul 24 14:44:21.846957 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:21.846923 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-7wk5f" Jul 24 14:44:21.849369 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:21.849350 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 24 14:44:21.858875 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:21.858852 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-7wk5f"] Jul 24 14:44:21.869660 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:21.869629 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-b2nvz"] Jul 24 14:44:21.873871 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:21.873850 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-b2nvz" Jul 24 14:44:21.876163 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:21.876145 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-76b8f\"" Jul 24 14:44:21.882157 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:21.882093 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-b2nvz"] Jul 24 14:44:21.983326 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:21.983280 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-55c59f9594-r86w6" event={"ID":"69de0b22-1cc1-4148-b1c5-d769ca29b774","Type":"ContainerStarted","Data":"3d1d5170c62ebf307c1846984d01a23d70a3f908dbd05e2548f32cc187ad9e29"} Jul 24 14:44:22.015963 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:22.015880 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbwmh\" (UniqueName: \"kubernetes.io/projected/3fa20a2a-3b9c-4c66-b2d8-eae72e38cf21-kube-api-access-lbwmh\") pod \"payload-pre-processing-7677b774bb-7wk5f\" (UID: \"3fa20a2a-3b9c-4c66-b2d8-eae72e38cf21\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-7wk5f" Jul 24 14:44:22.015963 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:22.015925 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3fa20a2a-3b9c-4c66-b2d8-eae72e38cf21-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-7wk5f\" (UID: \"3fa20a2a-3b9c-4c66-b2d8-eae72e38cf21\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-7wk5f" Jul 24 14:44:22.015963 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:22.015952 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xl5xq\" (UniqueName: \"kubernetes.io/projected/f801f2be-534d-444d-b391-913a092075d9-kube-api-access-xl5xq\") pod \"payload-processing-5bf47cd988-b2nvz\" (UID: \"f801f2be-534d-444d-b391-913a092075d9\") " pod="openshift-ingress/payload-processing-5bf47cd988-b2nvz" Jul 24 14:44:22.016181 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:22.016100 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f801f2be-534d-444d-b391-913a092075d9-plugins-config-volume\") pod \"payload-processing-5bf47cd988-b2nvz\" (UID: \"f801f2be-534d-444d-b391-913a092075d9\") " pod="openshift-ingress/payload-processing-5bf47cd988-b2nvz" Jul 24 14:44:22.116710 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:22.116676 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbwmh\" (UniqueName: \"kubernetes.io/projected/3fa20a2a-3b9c-4c66-b2d8-eae72e38cf21-kube-api-access-lbwmh\") pod \"payload-pre-processing-7677b774bb-7wk5f\" (UID: \"3fa20a2a-3b9c-4c66-b2d8-eae72e38cf21\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-7wk5f" Jul 24 14:44:22.116900 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:22.116721 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3fa20a2a-3b9c-4c66-b2d8-eae72e38cf21-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-7wk5f\" (UID: \"3fa20a2a-3b9c-4c66-b2d8-eae72e38cf21\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-7wk5f" Jul 24 14:44:22.116900 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:22.116749 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xl5xq\" (UniqueName: \"kubernetes.io/projected/f801f2be-534d-444d-b391-913a092075d9-kube-api-access-xl5xq\") pod \"payload-processing-5bf47cd988-b2nvz\" (UID: \"f801f2be-534d-444d-b391-913a092075d9\") " pod="openshift-ingress/payload-processing-5bf47cd988-b2nvz" Jul 24 14:44:22.116900 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:22.116802 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f801f2be-534d-444d-b391-913a092075d9-plugins-config-volume\") pod \"payload-processing-5bf47cd988-b2nvz\" (UID: \"f801f2be-534d-444d-b391-913a092075d9\") " pod="openshift-ingress/payload-processing-5bf47cd988-b2nvz" Jul 24 14:44:22.117706 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:22.117676 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f801f2be-534d-444d-b391-913a092075d9-plugins-config-volume\") pod \"payload-processing-5bf47cd988-b2nvz\" (UID: \"f801f2be-534d-444d-b391-913a092075d9\") " pod="openshift-ingress/payload-processing-5bf47cd988-b2nvz" Jul 24 14:44:22.117845 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:22.117676 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3fa20a2a-3b9c-4c66-b2d8-eae72e38cf21-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-7wk5f\" (UID: \"3fa20a2a-3b9c-4c66-b2d8-eae72e38cf21\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-7wk5f" Jul 24 14:44:22.125040 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:22.125018 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbwmh\" (UniqueName: \"kubernetes.io/projected/3fa20a2a-3b9c-4c66-b2d8-eae72e38cf21-kube-api-access-lbwmh\") pod \"payload-pre-processing-7677b774bb-7wk5f\" (UID: \"3fa20a2a-3b9c-4c66-b2d8-eae72e38cf21\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-7wk5f" Jul 24 14:44:22.125134 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:22.125028 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xl5xq\" (UniqueName: \"kubernetes.io/projected/f801f2be-534d-444d-b391-913a092075d9-kube-api-access-xl5xq\") pod \"payload-processing-5bf47cd988-b2nvz\" (UID: \"f801f2be-534d-444d-b391-913a092075d9\") " pod="openshift-ingress/payload-processing-5bf47cd988-b2nvz" Jul 24 14:44:22.158815 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:22.158789 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-7wk5f" Jul 24 14:44:22.186402 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:22.186377 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-b2nvz" Jul 24 14:44:22.309422 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:22.309381 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-7wk5f"] Jul 24 14:44:22.309783 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:44:22.309756 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fa20a2a_3b9c_4c66_b2d8_eae72e38cf21.slice/crio-ead081a1ffa7f9cfe82daa0bc31ddef7a1f4a985fabc9196de3b75be8ba3a220 WatchSource:0}: Error finding container ead081a1ffa7f9cfe82daa0bc31ddef7a1f4a985fabc9196de3b75be8ba3a220: Status 404 returned error can't find the container with id ead081a1ffa7f9cfe82daa0bc31ddef7a1f4a985fabc9196de3b75be8ba3a220 Jul 24 14:44:22.333305 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:22.333284 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-b2nvz"] Jul 24 14:44:22.334654 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:44:22.334633 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf801f2be_534d_444d_b391_913a092075d9.slice/crio-fb4763e6a6f90cd03c586c540e0b94c86996aa267bafe6f989188a2d69f03111 WatchSource:0}: Error finding container fb4763e6a6f90cd03c586c540e0b94c86996aa267bafe6f989188a2d69f03111: Status 404 returned error can't find the container with id fb4763e6a6f90cd03c586c540e0b94c86996aa267bafe6f989188a2d69f03111 Jul 24 14:44:22.995429 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:22.995390 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-7wk5f" event={"ID":"3fa20a2a-3b9c-4c66-b2d8-eae72e38cf21","Type":"ContainerStarted","Data":"ead081a1ffa7f9cfe82daa0bc31ddef7a1f4a985fabc9196de3b75be8ba3a220"} Jul 24 14:44:22.997058 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:22.997027 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-b2nvz" event={"ID":"f801f2be-534d-444d-b391-913a092075d9","Type":"ContainerStarted","Data":"fb4763e6a6f90cd03c586c540e0b94c86996aa267bafe6f989188a2d69f03111"} Jul 24 14:44:24.004229 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:24.004156 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-55c59f9594-r86w6" event={"ID":"69de0b22-1cc1-4148-b1c5-d769ca29b774","Type":"ContainerStarted","Data":"5241bd5d89c8146879400ff97a883d3b949fe46da1e325bb189c045dcf6593a4"} Jul 24 14:44:24.004592 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:24.004306 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-55c59f9594-r86w6" Jul 24 14:44:24.021848 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:24.021797 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-55c59f9594-r86w6" podStartSLOduration=1.229270215 podStartE2EDuration="3.021777863s" totalImagesPullingTime="1.792507648s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:44:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:44:24.020024771 +0000 UTC m=+577.301414353" watchObservedRunningTime="2026-07-24 14:44:24.021777863 +0000 UTC m=+577.303167445" Jul 24 14:44:25.012013 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:25.011972 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-7wk5f" event={"ID":"3fa20a2a-3b9c-4c66-b2d8-eae72e38cf21","Type":"ContainerStarted","Data":"3532de866231b65ff69b1656281acce0ad80d3d6d3d266bd8298aba27d017e72"} Jul 24 14:44:25.012499 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:25.012083 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-7wk5f" Jul 24 14:44:25.013673 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:25.013645 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-b2nvz" event={"ID":"f801f2be-534d-444d-b391-913a092075d9","Type":"ContainerStarted","Data":"6284a847ce82ab0a655f96c9f2aa390b7bee252df724a0953043540df7c8a71f"} Jul 24 14:44:25.013884 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:25.013865 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-b2nvz" Jul 24 14:44:25.031946 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:25.031899 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-7wk5f" podStartSLOduration=2.313075826 podStartE2EDuration="4.03188531s" totalImagesPullingTime="1.718809484s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:44:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:44:25.029400103 +0000 UTC m=+578.310789684" watchObservedRunningTime="2026-07-24 14:44:25.03188531 +0000 UTC m=+578.313274891" Jul 24 14:44:25.047120 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:25.047076 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-b2nvz" podStartSLOduration=2.353452672 podStartE2EDuration="4.047064145s" totalImagesPullingTime="1.693611473s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:44:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:44:25.045505336 +0000 UTC m=+578.326894919" watchObservedRunningTime="2026-07-24 14:44:25.047064145 +0000 UTC m=+578.328453725" Jul 24 14:44:26.998946 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:26.998912 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:44:28.721828 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:28.721794 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:44:28.782635 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:28.782607 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:44:30.020248 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:30.020213 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-55c59f9594-r86w6" Jul 24 14:44:31.058205 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:31.058172 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:44:31.150936 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:31.150902 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:44:35.154131 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:35.154082 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:44:35.255050 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:35.255017 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:44:36.022644 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:36.022612 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-b2nvz" Jul 24 14:44:36.022853 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:36.022837 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-7wk5f" Jul 24 14:44:39.620038 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:39.620007 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-s6fbp_7c9f6bc5-a512-4d71-9cf2-a91f839f5445/manager/0.log" Jul 24 14:44:39.739859 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:39.739825 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-62rcl_96effeca-20b1-40c0-bdc0-c5ecc3eafc29/manager/0.log" Jul 24 14:44:39.860111 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:39.860057 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7fcc68fb76-4bwdl_de53d8e2-e773-4aa3-be0d-cecb00f9705b/manager/0.log" Jul 24 14:44:40.157733 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:40.157704 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-4bw72_d415d1d7-5297-45b0-8d34-ed61dd7afc88/manager/0.log" Jul 24 14:44:40.287718 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:40.287685 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78954f66f5-8jqsf_0f8a5e8c-3d07-4b71-bd50-33842caf8bf3/copy-manifests/0.log" Jul 24 14:44:40.294248 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:40.294221 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78954f66f5-8jqsf_0f8a5e8c-3d07-4b71-bd50-33842caf8bf3/manager/0.log" Jul 24 14:44:40.905268 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:40.905241 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-55c59f9594-r86w6_69de0b22-1cc1-4148-b1c5-d769ca29b774/maas-api/0.log" Jul 24 14:44:40.976273 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:40.976237 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q4b2k"] Jul 24 14:44:40.979867 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:40.979850 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q4b2k" Jul 24 14:44:40.982424 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:40.982392 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 24 14:44:40.982560 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:40.982444 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 24 14:44:40.983346 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:40.983332 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-dpbcm\"" Jul 24 14:44:40.983433 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:40.983361 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 24 14:44:40.988999 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:40.988977 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q4b2k"] Jul 24 14:44:41.001924 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:41.001892 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:44:41.027846 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:41.027815 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-5ffkf_16184304-6e63-477e-8af9-d2c9b5d766a4/postgres/0.log" Jul 24 14:44:41.069498 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:41.069436 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/032bdfbb-8235-4ad6-9aa2-d2d6e656d629-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q4b2k\" (UID: \"032bdfbb-8235-4ad6-9aa2-d2d6e656d629\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q4b2k" Jul 24 14:44:41.069673 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:41.069512 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwgkd\" (UniqueName: \"kubernetes.io/projected/032bdfbb-8235-4ad6-9aa2-d2d6e656d629-kube-api-access-wwgkd\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q4b2k\" (UID: \"032bdfbb-8235-4ad6-9aa2-d2d6e656d629\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q4b2k" Jul 24 14:44:41.069673 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:41.069556 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/032bdfbb-8235-4ad6-9aa2-d2d6e656d629-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q4b2k\" (UID: \"032bdfbb-8235-4ad6-9aa2-d2d6e656d629\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q4b2k" Jul 24 14:44:41.069673 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:41.069642 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/032bdfbb-8235-4ad6-9aa2-d2d6e656d629-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q4b2k\" (UID: \"032bdfbb-8235-4ad6-9aa2-d2d6e656d629\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q4b2k" Jul 24 14:44:41.069784 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:41.069681 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/032bdfbb-8235-4ad6-9aa2-d2d6e656d629-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q4b2k\" (UID: \"032bdfbb-8235-4ad6-9aa2-d2d6e656d629\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q4b2k" Jul 24 14:44:41.069784 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:41.069717 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/032bdfbb-8235-4ad6-9aa2-d2d6e656d629-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q4b2k\" (UID: \"032bdfbb-8235-4ad6-9aa2-d2d6e656d629\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q4b2k" Jul 24 14:44:41.170807 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:41.170731 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/032bdfbb-8235-4ad6-9aa2-d2d6e656d629-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q4b2k\" (UID: \"032bdfbb-8235-4ad6-9aa2-d2d6e656d629\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q4b2k" Jul 24 14:44:41.170807 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:41.170766 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/032bdfbb-8235-4ad6-9aa2-d2d6e656d629-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q4b2k\" (UID: \"032bdfbb-8235-4ad6-9aa2-d2d6e656d629\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q4b2k" Jul 24 14:44:41.171041 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:41.170808 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/032bdfbb-8235-4ad6-9aa2-d2d6e656d629-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q4b2k\" (UID: \"032bdfbb-8235-4ad6-9aa2-d2d6e656d629\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q4b2k" Jul 24 14:44:41.171041 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:41.170848 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwgkd\" (UniqueName: \"kubernetes.io/projected/032bdfbb-8235-4ad6-9aa2-d2d6e656d629-kube-api-access-wwgkd\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q4b2k\" (UID: \"032bdfbb-8235-4ad6-9aa2-d2d6e656d629\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q4b2k" Jul 24 14:44:41.171041 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:41.170879 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/032bdfbb-8235-4ad6-9aa2-d2d6e656d629-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q4b2k\" (UID: \"032bdfbb-8235-4ad6-9aa2-d2d6e656d629\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q4b2k" Jul 24 14:44:41.171041 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:41.170939 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/032bdfbb-8235-4ad6-9aa2-d2d6e656d629-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q4b2k\" (UID: \"032bdfbb-8235-4ad6-9aa2-d2d6e656d629\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q4b2k" Jul 24 14:44:41.171254 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:41.171163 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/032bdfbb-8235-4ad6-9aa2-d2d6e656d629-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q4b2k\" (UID: \"032bdfbb-8235-4ad6-9aa2-d2d6e656d629\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q4b2k" Jul 24 14:44:41.171254 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:41.171225 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/032bdfbb-8235-4ad6-9aa2-d2d6e656d629-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q4b2k\" (UID: \"032bdfbb-8235-4ad6-9aa2-d2d6e656d629\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q4b2k" Jul 24 14:44:41.171343 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:41.171270 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/032bdfbb-8235-4ad6-9aa2-d2d6e656d629-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q4b2k\" (UID: \"032bdfbb-8235-4ad6-9aa2-d2d6e656d629\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q4b2k" Jul 24 14:44:41.173189 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:41.173171 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/032bdfbb-8235-4ad6-9aa2-d2d6e656d629-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q4b2k\" (UID: \"032bdfbb-8235-4ad6-9aa2-d2d6e656d629\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q4b2k" Jul 24 14:44:41.173366 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:41.173348 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/032bdfbb-8235-4ad6-9aa2-d2d6e656d629-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q4b2k\" (UID: \"032bdfbb-8235-4ad6-9aa2-d2d6e656d629\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q4b2k" Jul 24 14:44:41.180259 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:41.180236 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwgkd\" (UniqueName: \"kubernetes.io/projected/032bdfbb-8235-4ad6-9aa2-d2d6e656d629-kube-api-access-wwgkd\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q4b2k\" (UID: \"032bdfbb-8235-4ad6-9aa2-d2d6e656d629\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q4b2k" Jul 24 14:44:41.291626 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:41.291578 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q4b2k" Jul 24 14:44:41.432143 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:41.432114 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q4b2k"] Jul 24 14:44:41.433112 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:44:41.433089 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod032bdfbb_8235_4ad6_9aa2_d2d6e656d629.slice/crio-96d9580845f857dd8deaa5aad0e9867dd7f8b896b55c9447abe7a342117c325a WatchSource:0}: Error finding container 96d9580845f857dd8deaa5aad0e9867dd7f8b896b55c9447abe7a342117c325a: Status 404 returned error can't find the container with id 96d9580845f857dd8deaa5aad0e9867dd7f8b896b55c9447abe7a342117c325a Jul 24 14:44:41.839232 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:41.839204 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v5hlf_e00157b4-a22f-48c2-9ab8-cbf6a8c91894/util/0.log" Jul 24 14:44:41.846520 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:41.846465 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v5hlf_e00157b4-a22f-48c2-9ab8-cbf6a8c91894/pull/0.log" Jul 24 14:44:41.856058 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:41.856022 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v5hlf_e00157b4-a22f-48c2-9ab8-cbf6a8c91894/extract/0.log" Jul 24 14:44:41.970601 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:41.970565 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qndtl_3ff7fded-716e-401f-81a8-216d33dcc89d/pull/0.log" Jul 24 14:44:41.976936 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:41.976916 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qndtl_3ff7fded-716e-401f-81a8-216d33dcc89d/extract/0.log" Jul 24 14:44:41.982414 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:41.982399 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qndtl_3ff7fded-716e-401f-81a8-216d33dcc89d/util/0.log" Jul 24 14:44:42.103893 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:42.103816 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6jkv_133c48eb-d517-4873-95f3-27c6d1f061fb/util/0.log" Jul 24 14:44:42.110348 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:42.110326 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6jkv_133c48eb-d517-4873-95f3-27c6d1f061fb/pull/0.log" Jul 24 14:44:42.114011 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:42.113986 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q4b2k" event={"ID":"032bdfbb-8235-4ad6-9aa2-d2d6e656d629","Type":"ContainerStarted","Data":"96d9580845f857dd8deaa5aad0e9867dd7f8b896b55c9447abe7a342117c325a"} Jul 24 14:44:42.116920 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:42.116900 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6jkv_133c48eb-d517-4873-95f3-27c6d1f061fb/extract/0.log" Jul 24 14:44:42.235128 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:42.235088 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12665f_c421b3c4-1fa2-4fec-a6da-76c62dcc9a6d/util/0.log" Jul 24 14:44:42.240699 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:42.240679 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12665f_c421b3c4-1fa2-4fec-a6da-76c62dcc9a6d/pull/0.log" Jul 24 14:44:42.246510 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:42.246494 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12665f_c421b3c4-1fa2-4fec-a6da-76c62dcc9a6d/extract/0.log" Jul 24 14:44:42.629539 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:42.629512 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-7v66h_cc107d36-1dbd-47a8-82e2-67b7485a8867/manager/0.log" Jul 24 14:44:43.245384 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:43.245353 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-b8sq2_8ff74267-071e-4e8b-88d3-d5d4a8f6728c/manager/0.log" Jul 24 14:44:43.741823 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:43.741788 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-b97j4_0159436c-f13e-4554-964b-fc81765f9e3c/discovery/0.log" Jul 24 14:44:43.867693 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:43.867614 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-64476444cd-964t4_f9c336e7-a868-4c30-afb8-81659246dd44/kube-auth-proxy/0.log" Jul 24 14:44:44.127363 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:44.127251 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q4b2k" event={"ID":"032bdfbb-8235-4ad6-9aa2-d2d6e656d629","Type":"ContainerStarted","Data":"9c03c0a342e7cd91e3c06ddf313fae8a71367b0da8f8250ae28e831c3f08326d"} Jul 24 14:44:44.157800 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:44.157746 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q4b2k" podStartSLOduration=1.99490571 podStartE2EDuration="4.157730494s" totalImagesPullingTime="2.162824784s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:44:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:44:44.157361246 +0000 UTC m=+597.438750826" watchObservedRunningTime="2026-07-24 14:44:44.157730494 +0000 UTC m=+597.439120075" Jul 24 14:44:44.244284 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:44.244250 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-7wk5f_3fa20a2a-3b9c-4c66-b2d8-eae72e38cf21/payload-pre-processing/0.log" Jul 24 14:44:44.361192 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:44.361159 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-b2nvz_f801f2be-534d-444d-b391-913a092075d9/payload-processing/0.log" Jul 24 14:44:44.489312 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:44.489220 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-675bf47bbf-4s7tz_07b08f83-bc4e-41b0-a34c-a91ec906b950/router/0.log" Jul 24 14:44:44.839593 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:44.839566 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-q4b2k_032bdfbb-8235-4ad6-9aa2-d2d6e656d629/main/0.log" Jul 24 14:44:50.357813 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:50.357777 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:44:50.458689 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:50.458648 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:44:51.292404 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:51.292369 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q4b2k" Jul 24 14:44:51.292734 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:51.292444 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q4b2k" Jul 24 14:44:51.304921 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:51.304890 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q4b2k" Jul 24 14:44:52.185040 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:52.185010 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q4b2k" Jul 24 14:44:53.391527 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:53.391491 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-v7jqr_f269d799-9553-4954-8bdf-4a76fafcdc06/global-pull-secret-syncer/0.log" Jul 24 14:44:53.439092 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:53.439067 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" Jul 24 14:44:53.522226 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:53.522199 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-87.ec2.internal_a4818398c4598e46d283eeb2e2a1a7ab/haproxy/0.log" Jul 24 14:44:55.944579 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:55.944540 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:44:56.182213 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:56.182175 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-5t5js"] Jul 24 14:44:56.188912 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:56.188895 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5t5js" Jul 24 14:44:56.192433 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:56.192403 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 24 14:44:56.195485 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:56.195401 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-5t5js"] Jul 24 14:44:56.298776 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:56.298736 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52a7f3bc-7df5-4b72-8101-6a3e4d29ba30-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5t5js\" (UID: \"52a7f3bc-7df5-4b72-8101-6a3e4d29ba30\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5t5js" Jul 24 14:44:56.298776 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:56.298773 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52a7f3bc-7df5-4b72-8101-6a3e4d29ba30-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5t5js\" (UID: \"52a7f3bc-7df5-4b72-8101-6a3e4d29ba30\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5t5js" Jul 24 14:44:56.298989 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:56.298863 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/52a7f3bc-7df5-4b72-8101-6a3e4d29ba30-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5t5js\" (UID: \"52a7f3bc-7df5-4b72-8101-6a3e4d29ba30\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5t5js" Jul 24 14:44:56.298989 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:56.298892 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/52a7f3bc-7df5-4b72-8101-6a3e4d29ba30-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5t5js\" (UID: \"52a7f3bc-7df5-4b72-8101-6a3e4d29ba30\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5t5js" Jul 24 14:44:56.298989 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:56.298914 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sn4fc\" (UniqueName: \"kubernetes.io/projected/52a7f3bc-7df5-4b72-8101-6a3e4d29ba30-kube-api-access-sn4fc\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5t5js\" (UID: \"52a7f3bc-7df5-4b72-8101-6a3e4d29ba30\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5t5js" Jul 24 14:44:56.299091 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:56.299005 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/52a7f3bc-7df5-4b72-8101-6a3e4d29ba30-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5t5js\" (UID: \"52a7f3bc-7df5-4b72-8101-6a3e4d29ba30\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5t5js" Jul 24 14:44:56.326778 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:56.326738 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q5258_c5686d40-c284-4232-acfe-b583a06627d6/konnectivity-agent/0.log" limit=1024 Jul 24 14:44:56.399971 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:56.399932 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/52a7f3bc-7df5-4b72-8101-6a3e4d29ba30-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5t5js\" (UID: \"52a7f3bc-7df5-4b72-8101-6a3e4d29ba30\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5t5js" Jul 24 14:44:56.399971 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:56.399973 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sn4fc\" (UniqueName: \"kubernetes.io/projected/52a7f3bc-7df5-4b72-8101-6a3e4d29ba30-kube-api-access-sn4fc\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5t5js\" (UID: \"52a7f3bc-7df5-4b72-8101-6a3e4d29ba30\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5t5js" Jul 24 14:44:56.400208 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:56.400014 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/52a7f3bc-7df5-4b72-8101-6a3e4d29ba30-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5t5js\" (UID: \"52a7f3bc-7df5-4b72-8101-6a3e4d29ba30\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5t5js" Jul 24 14:44:56.400208 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:56.400065 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52a7f3bc-7df5-4b72-8101-6a3e4d29ba30-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5t5js\" (UID: \"52a7f3bc-7df5-4b72-8101-6a3e4d29ba30\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5t5js" Jul 24 14:44:56.400208 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:56.400094 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52a7f3bc-7df5-4b72-8101-6a3e4d29ba30-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5t5js\" (UID: \"52a7f3bc-7df5-4b72-8101-6a3e4d29ba30\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5t5js" Jul 24 14:44:56.400208 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:56.400147 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/52a7f3bc-7df5-4b72-8101-6a3e4d29ba30-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5t5js\" (UID: \"52a7f3bc-7df5-4b72-8101-6a3e4d29ba30\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5t5js" Jul 24 14:44:56.400443 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:56.400418 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/52a7f3bc-7df5-4b72-8101-6a3e4d29ba30-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5t5js\" (UID: \"52a7f3bc-7df5-4b72-8101-6a3e4d29ba30\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5t5js" Jul 24 14:44:56.400536 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:56.400453 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52a7f3bc-7df5-4b72-8101-6a3e4d29ba30-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5t5js\" (UID: \"52a7f3bc-7df5-4b72-8101-6a3e4d29ba30\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5t5js" Jul 24 14:44:56.400583 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:56.400538 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/52a7f3bc-7df5-4b72-8101-6a3e4d29ba30-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5t5js\" (UID: \"52a7f3bc-7df5-4b72-8101-6a3e4d29ba30\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5t5js" Jul 24 14:44:56.402395 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:56.402370 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/52a7f3bc-7df5-4b72-8101-6a3e4d29ba30-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5t5js\" (UID: \"52a7f3bc-7df5-4b72-8101-6a3e4d29ba30\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5t5js" Jul 24 14:44:56.402660 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:56.402639 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52a7f3bc-7df5-4b72-8101-6a3e4d29ba30-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5t5js\" (UID: \"52a7f3bc-7df5-4b72-8101-6a3e4d29ba30\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5t5js" Jul 24 14:44:56.410465 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:56.410429 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sn4fc\" (UniqueName: \"kubernetes.io/projected/52a7f3bc-7df5-4b72-8101-6a3e4d29ba30-kube-api-access-sn4fc\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5t5js\" (UID: \"52a7f3bc-7df5-4b72-8101-6a3e4d29ba30\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5t5js" Jul 24 14:44:56.501903 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:56.501815 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5t5js" Jul 24 14:44:56.637417 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:56.637393 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-5t5js"] Jul 24 14:44:56.638832 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:44:56.638801 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52a7f3bc_7df5_4b72_8101_6a3e4d29ba30.slice/crio-9f3c8c4cf26ecd1e30c43f120635be4365d64add34210f0b6b925f59e09c0787 WatchSource:0}: Error finding container 9f3c8c4cf26ecd1e30c43f120635be4365d64add34210f0b6b925f59e09c0787: Status 404 returned error can't find the container with id 9f3c8c4cf26ecd1e30c43f120635be4365d64add34210f0b6b925f59e09c0787 Jul 24 14:44:56.640214 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:56.640196 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 24 14:44:57.209046 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:57.208928 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5t5js" event={"ID":"52a7f3bc-7df5-4b72-8101-6a3e4d29ba30","Type":"ContainerStarted","Data":"bed96a15f8a8d9c401c5d5046e7096af01e0f92b69d48b0875f4bb6f9fc40c20"} Jul 24 14:44:57.209046 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:57.209014 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5t5js" event={"ID":"52a7f3bc-7df5-4b72-8101-6a3e4d29ba30","Type":"ContainerStarted","Data":"9f3c8c4cf26ecd1e30c43f120635be4365d64add34210f0b6b925f59e09c0787"} Jul 24 14:44:57.231060 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:57.231013 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5t5js" podStartSLOduration=1.037547538 podStartE2EDuration="1.230998673s" totalImagesPullingTime="193.451135ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:44:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:44:57.230177199 +0000 UTC m=+610.511566779" watchObservedRunningTime="2026-07-24 14:44:57.230998673 +0000 UTC m=+610.512388253" Jul 24 14:44:58.736822 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:58.736785 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v5hlf_e00157b4-a22f-48c2-9ab8-cbf6a8c91894/extract/0.log" Jul 24 14:44:58.763041 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:58.763003 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v5hlf_e00157b4-a22f-48c2-9ab8-cbf6a8c91894/util/0.log" Jul 24 14:44:58.787916 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:58.787891 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v5hlf_e00157b4-a22f-48c2-9ab8-cbf6a8c91894/pull/0.log" Jul 24 14:44:58.825139 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:58.825103 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qndtl_3ff7fded-716e-401f-81a8-216d33dcc89d/extract/0.log" Jul 24 14:44:58.850171 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:58.850150 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qndtl_3ff7fded-716e-401f-81a8-216d33dcc89d/util/0.log" Jul 24 14:44:58.888128 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:58.888105 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qndtl_3ff7fded-716e-401f-81a8-216d33dcc89d/pull/0.log" Jul 24 14:44:58.919320 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:58.919292 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6jkv_133c48eb-d517-4873-95f3-27c6d1f061fb/extract/0.log" Jul 24 14:44:58.943077 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:58.943060 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6jkv_133c48eb-d517-4873-95f3-27c6d1f061fb/util/0.log" Jul 24 14:44:58.969891 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:58.969865 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6jkv_133c48eb-d517-4873-95f3-27c6d1f061fb/pull/0.log" Jul 24 14:44:58.999792 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:58.999727 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12665f_c421b3c4-1fa2-4fec-a6da-76c62dcc9a6d/extract/0.log" Jul 24 14:44:59.032892 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:59.032869 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12665f_c421b3c4-1fa2-4fec-a6da-76c62dcc9a6d/util/0.log" Jul 24 14:44:59.057193 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:59.057170 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12665f_c421b3c4-1fa2-4fec-a6da-76c62dcc9a6d/pull/0.log" Jul 24 14:44:59.151166 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:59.151140 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-7v66h_cc107d36-1dbd-47a8-82e2-67b7485a8867/manager/0.log" Jul 24 14:44:59.304327 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:44:59.304242 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-b8sq2_8ff74267-071e-4e8b-88d3-d5d4a8f6728c/manager/0.log" Jul 24 14:45:01.167371 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:01.167335 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-qw4kn_854eb30d-5387-4733-bec3-abf1faee681e/kube-state-metrics/0.log" Jul 24 14:45:01.191293 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:01.191268 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-qw4kn_854eb30d-5387-4733-bec3-abf1faee681e/kube-rbac-proxy-main/0.log" Jul 24 14:45:01.214890 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:01.214860 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-qw4kn_854eb30d-5387-4733-bec3-abf1faee681e/kube-rbac-proxy-self/0.log" Jul 24 14:45:01.314231 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:01.314196 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-h4d82_af09bc92-6610-41b6-9722-164ee7d14f7c/node-exporter/0.log" Jul 24 14:45:01.337325 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:01.337295 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-h4d82_af09bc92-6610-41b6-9722-164ee7d14f7c/kube-rbac-proxy/0.log" Jul 24 14:45:01.359559 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:01.359534 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-h4d82_af09bc92-6610-41b6-9722-164ee7d14f7c/init-textfile/0.log" Jul 24 14:45:01.847343 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:01.847315 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-ld9dp_854346e2-5c61-49f2-9d0e-5661d26da305/prometheus-operator/0.log" Jul 24 14:45:01.870332 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:01.870304 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-ld9dp_854346e2-5c61-49f2-9d0e-5661d26da305/kube-rbac-proxy/0.log" Jul 24 14:45:01.902326 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:01.902298 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-mn8tw_7c7acad7-ecd4-4230-aa04-b8ec9d0470d2/prometheus-operator-admission-webhook/0.log" Jul 24 14:45:02.033104 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:02.033076 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6fbdd56d86-x96wc_5e49aa5d-709d-4c1d-9a82-6348f60cdc06/thanos-query/0.log" Jul 24 14:45:02.073864 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:02.073835 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6fbdd56d86-x96wc_5e49aa5d-709d-4c1d-9a82-6348f60cdc06/kube-rbac-proxy-web/0.log" Jul 24 14:45:02.100979 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:02.100915 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6fbdd56d86-x96wc_5e49aa5d-709d-4c1d-9a82-6348f60cdc06/kube-rbac-proxy/0.log" Jul 24 14:45:02.124692 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:02.124669 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6fbdd56d86-x96wc_5e49aa5d-709d-4c1d-9a82-6348f60cdc06/prom-label-proxy/0.log" Jul 24 14:45:02.149153 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:02.149129 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6fbdd56d86-x96wc_5e49aa5d-709d-4c1d-9a82-6348f60cdc06/kube-rbac-proxy-rules/0.log" Jul 24 14:45:02.180386 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:02.180363 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6fbdd56d86-x96wc_5e49aa5d-709d-4c1d-9a82-6348f60cdc06/kube-rbac-proxy-metrics/0.log" Jul 24 14:45:02.930495 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:02.930444 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2dsmp/perf-node-gather-daemonset-ptcxs"] Jul 24 14:45:02.934360 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:02.934339 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2dsmp/perf-node-gather-daemonset-ptcxs" Jul 24 14:45:02.937140 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:02.937114 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2dsmp\"/\"openshift-service-ca.crt\"" Jul 24 14:45:02.938005 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:02.937974 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2dsmp\"/\"default-dockercfg-k8shp\"" Jul 24 14:45:02.938005 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:02.938001 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2dsmp\"/\"kube-root-ca.crt\"" Jul 24 14:45:02.945340 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:02.945316 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2dsmp/perf-node-gather-daemonset-ptcxs"] Jul 24 14:45:03.059392 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:03.059354 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dab9cc29-013b-46e4-a612-4d06adf524cf-podres\") pod \"perf-node-gather-daemonset-ptcxs\" (UID: \"dab9cc29-013b-46e4-a612-4d06adf524cf\") " pod="openshift-must-gather-2dsmp/perf-node-gather-daemonset-ptcxs" Jul 24 14:45:03.059597 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:03.059450 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dab9cc29-013b-46e4-a612-4d06adf524cf-lib-modules\") pod \"perf-node-gather-daemonset-ptcxs\" (UID: \"dab9cc29-013b-46e4-a612-4d06adf524cf\") " pod="openshift-must-gather-2dsmp/perf-node-gather-daemonset-ptcxs" Jul 24 14:45:03.059597 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:03.059519 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlp8b\" (UniqueName: \"kubernetes.io/projected/dab9cc29-013b-46e4-a612-4d06adf524cf-kube-api-access-wlp8b\") pod \"perf-node-gather-daemonset-ptcxs\" (UID: \"dab9cc29-013b-46e4-a612-4d06adf524cf\") " pod="openshift-must-gather-2dsmp/perf-node-gather-daemonset-ptcxs" Jul 24 14:45:03.059597 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:03.059589 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dab9cc29-013b-46e4-a612-4d06adf524cf-proc\") pod \"perf-node-gather-daemonset-ptcxs\" (UID: \"dab9cc29-013b-46e4-a612-4d06adf524cf\") " pod="openshift-must-gather-2dsmp/perf-node-gather-daemonset-ptcxs" Jul 24 14:45:03.059713 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:03.059609 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dab9cc29-013b-46e4-a612-4d06adf524cf-sys\") pod \"perf-node-gather-daemonset-ptcxs\" (UID: \"dab9cc29-013b-46e4-a612-4d06adf524cf\") " pod="openshift-must-gather-2dsmp/perf-node-gather-daemonset-ptcxs" Jul 24 14:45:03.161080 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:03.161040 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dab9cc29-013b-46e4-a612-4d06adf524cf-podres\") pod \"perf-node-gather-daemonset-ptcxs\" (UID: \"dab9cc29-013b-46e4-a612-4d06adf524cf\") " pod="openshift-must-gather-2dsmp/perf-node-gather-daemonset-ptcxs" Jul 24 14:45:03.161254 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:03.161096 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dab9cc29-013b-46e4-a612-4d06adf524cf-lib-modules\") pod \"perf-node-gather-daemonset-ptcxs\" (UID: \"dab9cc29-013b-46e4-a612-4d06adf524cf\") " pod="openshift-must-gather-2dsmp/perf-node-gather-daemonset-ptcxs" Jul 24 14:45:03.161254 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:03.161125 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlp8b\" (UniqueName: \"kubernetes.io/projected/dab9cc29-013b-46e4-a612-4d06adf524cf-kube-api-access-wlp8b\") pod \"perf-node-gather-daemonset-ptcxs\" (UID: \"dab9cc29-013b-46e4-a612-4d06adf524cf\") " pod="openshift-must-gather-2dsmp/perf-node-gather-daemonset-ptcxs" Jul 24 14:45:03.161254 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:03.161172 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dab9cc29-013b-46e4-a612-4d06adf524cf-proc\") pod \"perf-node-gather-daemonset-ptcxs\" (UID: \"dab9cc29-013b-46e4-a612-4d06adf524cf\") " pod="openshift-must-gather-2dsmp/perf-node-gather-daemonset-ptcxs" Jul 24 14:45:03.161254 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:03.161195 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dab9cc29-013b-46e4-a612-4d06adf524cf-sys\") pod \"perf-node-gather-daemonset-ptcxs\" (UID: \"dab9cc29-013b-46e4-a612-4d06adf524cf\") " pod="openshift-must-gather-2dsmp/perf-node-gather-daemonset-ptcxs" Jul 24 14:45:03.161254 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:03.161228 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dab9cc29-013b-46e4-a612-4d06adf524cf-podres\") pod \"perf-node-gather-daemonset-ptcxs\" (UID: \"dab9cc29-013b-46e4-a612-4d06adf524cf\") " pod="openshift-must-gather-2dsmp/perf-node-gather-daemonset-ptcxs" Jul 24 14:45:03.161449 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:03.161283 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dab9cc29-013b-46e4-a612-4d06adf524cf-proc\") pod \"perf-node-gather-daemonset-ptcxs\" (UID: \"dab9cc29-013b-46e4-a612-4d06adf524cf\") " pod="openshift-must-gather-2dsmp/perf-node-gather-daemonset-ptcxs" Jul 24 14:45:03.161449 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:03.161298 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dab9cc29-013b-46e4-a612-4d06adf524cf-sys\") pod \"perf-node-gather-daemonset-ptcxs\" (UID: \"dab9cc29-013b-46e4-a612-4d06adf524cf\") " pod="openshift-must-gather-2dsmp/perf-node-gather-daemonset-ptcxs" Jul 24 14:45:03.161449 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:03.161290 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dab9cc29-013b-46e4-a612-4d06adf524cf-lib-modules\") pod \"perf-node-gather-daemonset-ptcxs\" (UID: \"dab9cc29-013b-46e4-a612-4d06adf524cf\") " pod="openshift-must-gather-2dsmp/perf-node-gather-daemonset-ptcxs" Jul 24 14:45:03.170498 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:03.170445 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlp8b\" (UniqueName: \"kubernetes.io/projected/dab9cc29-013b-46e4-a612-4d06adf524cf-kube-api-access-wlp8b\") pod \"perf-node-gather-daemonset-ptcxs\" (UID: \"dab9cc29-013b-46e4-a612-4d06adf524cf\") " pod="openshift-must-gather-2dsmp/perf-node-gather-daemonset-ptcxs" Jul 24 14:45:03.246382 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:03.246285 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2dsmp/perf-node-gather-daemonset-ptcxs" Jul 24 14:45:03.371578 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:03.371542 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-42ntb_b9b98d06-1186-4c51-b03a-57b92347ed7f/networking-console-plugin/0.log" Jul 24 14:45:03.386783 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:03.386753 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2dsmp/perf-node-gather-daemonset-ptcxs"] Jul 24 14:45:03.387953 ip-10-0-129-87 kubenswrapper[2565]: W0724 14:45:03.387919 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poddab9cc29_013b_46e4_a612_4d06adf524cf.slice/crio-e7fbd0b8afbd5d719b0c15850ac24aec3e8d8407c42fb451cda17208d80e0284 WatchSource:0}: Error finding container e7fbd0b8afbd5d719b0c15850ac24aec3e8d8407c42fb451cda17208d80e0284: Status 404 returned error can't find the container with id e7fbd0b8afbd5d719b0c15850ac24aec3e8d8407c42fb451cda17208d80e0284 Jul 24 14:45:04.255553 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:04.255512 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2dsmp/perf-node-gather-daemonset-ptcxs" event={"ID":"dab9cc29-013b-46e4-a612-4d06adf524cf","Type":"ContainerStarted","Data":"551fdbbd30db204b92ebf1a8303c04b75e9328be340cd37250f5735c59b57103"} Jul 24 14:45:04.255944 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:04.255579 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2dsmp/perf-node-gather-daemonset-ptcxs" event={"ID":"dab9cc29-013b-46e4-a612-4d06adf524cf","Type":"ContainerStarted","Data":"e7fbd0b8afbd5d719b0c15850ac24aec3e8d8407c42fb451cda17208d80e0284"} Jul 24 14:45:04.255944 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:04.255698 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-2dsmp/perf-node-gather-daemonset-ptcxs" Jul 24 14:45:04.274992 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:04.274941 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2dsmp/perf-node-gather-daemonset-ptcxs" podStartSLOduration=2.274926855 podStartE2EDuration="2.274926855s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:45:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:45:04.2732062 +0000 UTC m=+617.554595785" watchObservedRunningTime="2026-07-24 14:45:04.274926855 +0000 UTC m=+617.556316453" Jul 24 14:45:04.466820 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:04.466793 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-77c9cfbdff-m8842_900a38b5-5a75-4770-afb9-9a21279633cf/console/0.log" Jul 24 14:45:04.493461 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:04.493435 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-phm58_c3bb914e-61ec-4d87-a7b1-5ca7c30b94ce/download-server/0.log" Jul 24 14:45:06.133889 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:06.133859 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xz4zn_03a80cf6-686d-4e98-bb23-e31b95c3e823/dns/0.log" Jul 24 14:45:06.154977 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:06.154953 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xz4zn_03a80cf6-686d-4e98-bb23-e31b95c3e823/kube-rbac-proxy/0.log" Jul 24 14:45:06.224564 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:06.224537 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2w5hp_09a04909-4f60-48c8-8077-06b6dccf3df8/dns-node-resolver/0.log" Jul 24 14:45:06.502948 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:06.502860 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5t5js" Jul 24 14:45:06.502948 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:06.502928 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5t5js" Jul 24 14:45:06.519490 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:06.519441 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5t5js" Jul 24 14:45:06.894440 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:06.894409 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kt54d_4a748576-5432-4fcf-b10f-5c488963ba3d/node-ca/0.log" Jul 24 14:45:07.283825 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:07.283735 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5t5js" Jul 24 14:45:07.936418 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:07.936392 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-b97j4_0159436c-f13e-4554-964b-fc81765f9e3c/discovery/0.log" Jul 24 14:45:07.959001 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:07.958974 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-64476444cd-964t4_f9c336e7-a868-4c30-afb8-81659246dd44/kube-auth-proxy/0.log" Jul 24 14:45:08.037020 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:08.036996 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-7wk5f_3fa20a2a-3b9c-4c66-b2d8-eae72e38cf21/payload-pre-processing/0.log" Jul 24 14:45:08.062358 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:08.062332 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-b2nvz_f801f2be-534d-444d-b391-913a092075d9/payload-processing/0.log" Jul 24 14:45:08.089664 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:08.089646 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-675bf47bbf-4s7tz_07b08f83-bc4e-41b0-a34c-a91ec906b950/router/0.log" Jul 24 14:45:08.777561 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:08.777528 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n8zfk_ee6a54e6-fe4a-461a-85cd-fb141a505fb5/serve-healthcheck-canary/0.log" Jul 24 14:45:09.304732 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:09.304706 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dvgnr_9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c/kube-rbac-proxy/0.log" Jul 24 14:45:09.325621 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:09.325598 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dvgnr_9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c/exporter/0.log" Jul 24 14:45:09.347810 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:09.347788 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dvgnr_9c04eca5-ac13-4d0e-97d4-7de0e3bf2d4c/extractor/0.log" Jul 24 14:45:10.271447 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:10.271373 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-2dsmp/perf-node-gather-daemonset-ptcxs" Jul 24 14:45:11.791811 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:11.791785 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-s6fbp_7c9f6bc5-a512-4d71-9cf2-a91f839f5445/manager/0.log" Jul 24 14:45:11.823077 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:11.823049 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-62rcl_96effeca-20b1-40c0-bdc0-c5ecc3eafc29/manager/0.log" Jul 24 14:45:11.849617 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:11.849584 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7fcc68fb76-4bwdl_de53d8e2-e773-4aa3-be0d-cecb00f9705b/manager/0.log" Jul 24 14:45:11.929041 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:11.929011 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-4bw72_d415d1d7-5297-45b0-8d34-ed61dd7afc88/manager/0.log" Jul 24 14:45:11.959490 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:11.959451 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78954f66f5-8jqsf_0f8a5e8c-3d07-4b71-bd50-33842caf8bf3/manager/0.log" Jul 24 14:45:12.008709 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:12.008681 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78954f66f5-8jqsf_0f8a5e8c-3d07-4b71-bd50-33842caf8bf3/copy-manifests/0.log" Jul 24 14:45:13.557583 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:13.557552 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-9jkq8_fb9b5749-8215-4ada-b846-d96b2521b149/openshift-lws-operator/0.log" Jul 24 14:45:13.673495 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:13.673449 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-b97j4_0159436c-f13e-4554-964b-fc81765f9e3c/discovery/0.log" Jul 24 14:45:13.686146 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:13.686122 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-64476444cd-964t4_f9c336e7-a868-4c30-afb8-81659246dd44/kube-auth-proxy/0.log" Jul 24 14:45:13.734936 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:13.734912 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-7wk5f_3fa20a2a-3b9c-4c66-b2d8-eae72e38cf21/payload-pre-processing/0.log" Jul 24 14:45:13.751028 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:13.751005 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-b2nvz_f801f2be-534d-444d-b391-913a092075d9/payload-processing/0.log" Jul 24 14:45:13.776666 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:13.776647 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-675bf47bbf-4s7tz_07b08f83-bc4e-41b0-a34c-a91ec906b950/router/0.log" Jul 24 14:45:14.978553 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:14.978466 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-b97j4_0159436c-f13e-4554-964b-fc81765f9e3c/discovery/0.log" Jul 24 14:45:14.989323 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:14.989298 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-64476444cd-964t4_f9c336e7-a868-4c30-afb8-81659246dd44/kube-auth-proxy/0.log" Jul 24 14:45:15.035282 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:15.035258 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-7wk5f_3fa20a2a-3b9c-4c66-b2d8-eae72e38cf21/payload-pre-processing/0.log" Jul 24 14:45:15.049342 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:15.049318 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-b2nvz_f801f2be-534d-444d-b391-913a092075d9/payload-processing/0.log" Jul 24 14:45:15.067186 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:15.067169 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-675bf47bbf-4s7tz_07b08f83-bc4e-41b0-a34c-a91ec906b950/router/0.log" Jul 24 14:45:19.104514 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:19.104461 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-hcs97_ae7f7131-970f-4dfb-b418-13eeb937222e/kube-storage-version-migrator-operator/1.log" Jul 24 14:45:19.105267 ip-10-0-129-87 kubenswrapper[2565]: I0724 14:45:19.105251 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-hcs97_ae7f7131-970f-4dfb-b418-13eeb937222e/kube-storage-version-migrator-operator/0.log"