Jul 15 21:06:31.616997 ip-10-0-143-46 systemd[1]: Starting Kubernetes Kubelet... Jul 15 21:06:32.059218 ip-10-0-143-46 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 21:06:32.059218 ip-10-0-143-46 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 15 21:06:32.059218 ip-10-0-143-46 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 21:06:32.059218 ip-10-0-143-46 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 15 21:06:32.059218 ip-10-0-143-46 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 21:06:32.059218 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.028801 2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 15 21:06:32.059218 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032426 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 21:06:32.059218 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032436 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 21:06:32.059218 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032439 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 21:06:32.059218 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032442 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 21:06:32.059218 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032445 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 21:06:32.059218 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032448 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 21:06:32.059218 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032450 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 21:06:32.059218 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032453 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 21:06:32.060183 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032456 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 21:06:32.060183 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032460 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 21:06:32.060183 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032464 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 21:06:32.060183 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032467 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 21:06:32.060183 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032470 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 21:06:32.060183 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032473 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 21:06:32.060183 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032476 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 21:06:32.060183 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032479 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 21:06:32.060183 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032482 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 21:06:32.060183 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032484 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 21:06:32.060183 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032487 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 21:06:32.060183 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032489 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 21:06:32.060183 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032491 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 21:06:32.060183 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032494 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 21:06:32.060183 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032496 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 21:06:32.060183 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032499 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 21:06:32.060183 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032501 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 21:06:32.060183 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032504 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 21:06:32.060183 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032507 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 21:06:32.060769 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032511 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 21:06:32.060769 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032514 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 21:06:32.060769 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032517 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 21:06:32.060769 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032520 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 21:06:32.060769 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032523 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 21:06:32.060769 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032526 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 21:06:32.060769 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032529 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 21:06:32.060769 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032532 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 21:06:32.060769 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032535 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 21:06:32.060769 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032538 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 21:06:32.060769 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032540 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 21:06:32.060769 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032543 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 21:06:32.060769 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032545 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 21:06:32.060769 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032547 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 21:06:32.060769 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032550 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 21:06:32.060769 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032553 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 21:06:32.060769 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032555 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 21:06:32.060769 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032558 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 21:06:32.060769 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032561 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 21:06:32.060769 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032563 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 21:06:32.061281 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032566 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 21:06:32.061281 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032568 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 21:06:32.061281 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032571 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 21:06:32.061281 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032573 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 21:06:32.061281 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032576 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 21:06:32.061281 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032578 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 21:06:32.061281 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032581 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 21:06:32.061281 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032583 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 21:06:32.061281 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032586 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 21:06:32.061281 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032588 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 21:06:32.061281 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032591 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 21:06:32.061281 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032594 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 21:06:32.061281 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032596 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 21:06:32.061281 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032599 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 21:06:32.061281 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032601 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 21:06:32.061281 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032604 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 15 21:06:32.061281 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032607 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 21:06:32.061281 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032610 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 21:06:32.061281 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032612 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 21:06:32.061281 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032615 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 21:06:32.061846 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032617 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 21:06:32.061846 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032619 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 21:06:32.061846 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032623 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 21:06:32.061846 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032627 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 21:06:32.061846 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032631 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 21:06:32.061846 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032634 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 21:06:32.061846 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032637 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 21:06:32.061846 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032640 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 21:06:32.061846 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032642 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 21:06:32.061846 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032644 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 21:06:32.061846 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032647 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 21:06:32.061846 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032650 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 21:06:32.061846 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032653 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 21:06:32.061846 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032656 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 21:06:32.061846 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032659 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 21:06:32.061846 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032661 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 21:06:32.061846 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032665 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 21:06:32.061846 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032668 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 21:06:32.061846 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032670 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 21:06:32.062338 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032673 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 21:06:32.062338 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032675 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 21:06:32.062338 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032678 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 21:06:32.062338 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032680 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 21:06:32.062338 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032683 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 21:06:32.062338 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032685 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 21:06:32.062338 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032688 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 21:06:32.062338 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032690 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 21:06:32.062338 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032693 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 21:06:32.062338 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032696 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 21:06:32.062338 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032699 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 21:06:32.062338 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032701 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 21:06:32.062338 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.032704 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 21:06:32.062338 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.034909 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 21:06:32.062338 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.034918 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 21:06:32.062338 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.034921 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 21:06:32.062338 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.034925 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 21:06:32.062338 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.034928 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 21:06:32.062338 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.034930 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 21:06:32.062895 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.034933 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 21:06:32.062895 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.034936 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 21:06:32.062895 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.034941 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 21:06:32.062895 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.034945 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 21:06:32.062895 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.034948 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 21:06:32.062895 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.034951 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 21:06:32.062895 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.034954 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 21:06:32.062895 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.034958 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 21:06:32.062895 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.034960 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 21:06:32.062895 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.034963 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 21:06:32.062895 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.034967 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 21:06:32.062895 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.034969 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 21:06:32.062895 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.034972 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 21:06:32.062895 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.034975 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 21:06:32.062895 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.034977 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 21:06:32.062895 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.034980 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 21:06:32.062895 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.034983 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 21:06:32.062895 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.034985 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 21:06:32.062895 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.034988 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 21:06:32.062895 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.034990 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 21:06:32.063458 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.034993 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 21:06:32.063458 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.034996 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 21:06:32.063458 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.034998 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 21:06:32.063458 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035000 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 21:06:32.063458 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035003 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 21:06:32.063458 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035006 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 21:06:32.063458 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035009 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 21:06:32.063458 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035012 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 21:06:32.063458 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035014 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 21:06:32.063458 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035019 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 21:06:32.063458 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035023 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 21:06:32.063458 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035026 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 21:06:32.063458 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035028 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 21:06:32.063458 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035031 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 21:06:32.063458 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035033 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 21:06:32.063458 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035036 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 21:06:32.063458 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035039 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 21:06:32.063458 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035043 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 21:06:32.063458 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035046 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 21:06:32.064022 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035049 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 21:06:32.064022 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035051 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 21:06:32.064022 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035054 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 21:06:32.064022 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035057 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 21:06:32.064022 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035060 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 21:06:32.064022 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035062 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 21:06:32.064022 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035065 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 21:06:32.064022 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035067 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 21:06:32.064022 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035070 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 21:06:32.064022 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035072 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 21:06:32.064022 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035075 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 21:06:32.064022 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035077 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 21:06:32.064022 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035079 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 21:06:32.064022 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035082 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 21:06:32.064022 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035085 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 21:06:32.064022 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035087 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 21:06:32.064022 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035090 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 21:06:32.064022 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035092 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 21:06:32.064022 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035095 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 21:06:32.064022 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035098 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 21:06:32.064611 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035101 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 21:06:32.064611 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035103 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 21:06:32.064611 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035106 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 21:06:32.064611 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035109 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 21:06:32.064611 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035111 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 21:06:32.064611 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035114 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 21:06:32.064611 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035116 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 21:06:32.064611 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035119 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 21:06:32.064611 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035121 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 21:06:32.064611 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035123 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 21:06:32.064611 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035127 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 21:06:32.064611 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035130 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 21:06:32.064611 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035132 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 15 21:06:32.064611 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035142 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 21:06:32.064611 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035146 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 21:06:32.064611 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035150 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 21:06:32.064611 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035154 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 21:06:32.064611 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035158 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 21:06:32.064611 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035162 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 21:06:32.064611 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035166 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 21:06:32.065234 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035170 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 21:06:32.065234 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035174 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 21:06:32.065234 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035177 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 21:06:32.065234 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035179 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 21:06:32.065234 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035183 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 21:06:32.065234 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035187 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 21:06:32.065234 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035191 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 21:06:32.065234 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035194 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 21:06:32.065234 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035198 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 21:06:32.065234 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035203 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 21:06:32.065234 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035207 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 21:06:32.065234 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035212 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 21:06:32.065234 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035216 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 21:06:32.065234 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035220 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 21:06:32.065234 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035712 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 21:06:32.065234 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035719 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 21:06:32.065234 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035739 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 21:06:32.065234 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035743 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 21:06:32.065234 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035747 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 21:06:32.065751 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035751 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 21:06:32.065751 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035759 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 21:06:32.065751 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035763 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 21:06:32.065751 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035767 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 21:06:32.065751 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035770 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 21:06:32.065751 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035774 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 21:06:32.065751 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035778 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 21:06:32.065751 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035781 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 21:06:32.065751 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035785 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 21:06:32.065751 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035789 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 21:06:32.065751 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035792 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 21:06:32.065751 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035795 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 21:06:32.065751 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035799 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 21:06:32.065751 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035803 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 21:06:32.065751 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035806 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 21:06:32.065751 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035810 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 21:06:32.065751 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035816 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 21:06:32.065751 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035822 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 21:06:32.065751 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035825 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 21:06:32.065751 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035828 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 21:06:32.066307 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035832 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 21:06:32.066307 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035836 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 21:06:32.066307 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035840 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 21:06:32.066307 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035844 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 21:06:32.066307 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035849 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 21:06:32.066307 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035852 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 21:06:32.066307 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035856 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 21:06:32.066307 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035860 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 21:06:32.066307 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035863 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 21:06:32.066307 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035867 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 21:06:32.066307 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035871 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 21:06:32.066307 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035875 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 21:06:32.066307 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035879 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 21:06:32.066307 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035885 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 21:06:32.066307 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035890 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 21:06:32.066307 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035895 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 21:06:32.066307 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035899 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 21:06:32.066307 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035907 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 21:06:32.066307 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035912 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 21:06:32.066851 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035915 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 21:06:32.066851 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035919 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 21:06:32.066851 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035924 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 21:06:32.066851 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035927 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 21:06:32.066851 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035931 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 21:06:32.066851 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035935 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 21:06:32.066851 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035938 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 21:06:32.066851 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035942 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 21:06:32.066851 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035946 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 21:06:32.066851 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035949 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 21:06:32.066851 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035953 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 21:06:32.066851 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035956 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 21:06:32.066851 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035960 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 21:06:32.066851 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035963 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 21:06:32.066851 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035969 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 21:06:32.066851 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035974 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 21:06:32.066851 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035978 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 21:06:32.066851 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035982 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 21:06:32.066851 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035986 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 21:06:32.067679 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035990 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 21:06:32.067679 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035994 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 21:06:32.067679 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.035998 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 21:06:32.067679 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.036002 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 21:06:32.067679 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.036006 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 21:06:32.067679 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.036010 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 21:06:32.067679 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.036014 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 15 21:06:32.067679 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.036020 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 21:06:32.067679 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.036024 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 21:06:32.067679 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.036027 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 21:06:32.067679 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.036031 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 21:06:32.067679 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.036038 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 21:06:32.067679 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.036041 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 21:06:32.067679 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.036043 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 21:06:32.067679 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.036046 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 21:06:32.067679 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.036049 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 21:06:32.067679 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.036053 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 21:06:32.067679 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.036057 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 21:06:32.067679 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.036064 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 21:06:32.067679 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.036067 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 21:06:32.068577 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.036071 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 21:06:32.068577 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.036075 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 21:06:32.068577 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.036079 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 21:06:32.068577 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.036083 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 21:06:32.068577 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.036086 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 21:06:32.068577 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.036091 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 21:06:32.068577 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.036094 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 21:06:32.068577 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.036098 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 21:06:32.068577 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.036102 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 21:06:32.068577 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.036106 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 21:06:32.068577 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.036109 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 21:06:32.068577 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.036113 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 21:06:32.068577 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.036117 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 21:06:32.068577 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.036121 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 21:06:32.068577 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.036125 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 21:06:32.068577 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.036128 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 21:06:32.068577 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036212 2577 flags.go:64] FLAG: --address="0.0.0.0" Jul 15 21:06:32.068577 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036221 2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 15 21:06:32.068577 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036229 2577 flags.go:64] FLAG: --anonymous-auth="true" Jul 15 21:06:32.068577 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036236 2577 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 15 21:06:32.068577 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036241 2577 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 15 21:06:32.069475 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036245 2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 15 21:06:32.069475 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036251 2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 15 21:06:32.069475 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036259 2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 15 21:06:32.069475 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036263 2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 15 21:06:32.069475 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036266 2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 15 21:06:32.069475 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036270 2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 15 21:06:32.069475 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036275 2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 15 21:06:32.069475 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036279 2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 15 21:06:32.069475 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036284 2577 flags.go:64] FLAG: --cgroup-root="" Jul 15 21:06:32.069475 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036288 2577 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 15 21:06:32.069475 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036293 2577 flags.go:64] FLAG: --client-ca-file="" Jul 15 21:06:32.069475 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036297 2577 flags.go:64] FLAG: --cloud-provider="external" Jul 15 21:06:32.069475 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036302 2577 flags.go:64] FLAG: --cluster-dns="[]" Jul 15 21:06:32.069475 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036308 2577 flags.go:64] FLAG: --cluster-domain="" Jul 15 21:06:32.069475 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036312 2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 15 21:06:32.069475 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036316 2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 15 21:06:32.069475 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036320 2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 15 21:06:32.069475 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036325 2577 flags.go:64] FLAG: --container-log-max-files="5" Jul 15 21:06:32.069475 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036331 2577 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 15 21:06:32.069475 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036334 2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 15 21:06:32.069475 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036338 2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 15 21:06:32.069475 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036344 2577 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 15 21:06:32.069475 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036349 2577 flags.go:64] FLAG: --contention-profiling="false" Jul 15 21:06:32.069475 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036352 2577 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 15 21:06:32.070567 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036357 2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 15 21:06:32.070567 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036362 2577 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 15 21:06:32.070567 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036366 2577 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 15 21:06:32.070567 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036371 2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 15 21:06:32.070567 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036376 2577 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 15 21:06:32.070567 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036380 2577 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 15 21:06:32.070567 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036386 2577 flags.go:64] FLAG: --enable-load-reader="false" Jul 15 21:06:32.070567 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036390 2577 flags.go:64] FLAG: --enable-server="true" Jul 15 21:06:32.070567 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036394 2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 15 21:06:32.070567 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036400 2577 flags.go:64] FLAG: --event-burst="100" Jul 15 21:06:32.070567 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036406 2577 flags.go:64] FLAG: --event-qps="50" Jul 15 21:06:32.070567 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036411 2577 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 15 21:06:32.070567 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036415 2577 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 15 21:06:32.070567 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036420 2577 flags.go:64] FLAG: --eviction-hard="" Jul 15 21:06:32.070567 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036425 2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 15 21:06:32.070567 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036429 2577 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 15 21:06:32.070567 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036433 2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 15 21:06:32.070567 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036437 2577 flags.go:64] FLAG: --eviction-soft="" Jul 15 21:06:32.070567 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036442 2577 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 15 21:06:32.070567 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036447 2577 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 15 21:06:32.070567 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036451 2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 15 21:06:32.070567 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036455 2577 flags.go:64] FLAG: --experimental-mounter-path="" Jul 15 21:06:32.070567 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036459 2577 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 15 21:06:32.070567 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036463 2577 flags.go:64] FLAG: --fail-swap-on="true" Jul 15 21:06:32.070567 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036467 2577 flags.go:64] FLAG: --feature-gates="" Jul 15 21:06:32.071673 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036473 2577 flags.go:64] FLAG: --file-check-frequency="20s" Jul 15 21:06:32.071673 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036477 2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 15 21:06:32.071673 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036481 2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 15 21:06:32.071673 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036484 2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 15 21:06:32.071673 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036488 2577 flags.go:64] FLAG: --healthz-port="10248" Jul 15 21:06:32.071673 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036492 2577 flags.go:64] FLAG: --help="false" Jul 15 21:06:32.071673 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036496 2577 flags.go:64] FLAG: --hostname-override="ip-10-0-143-46.ec2.internal" Jul 15 21:06:32.071673 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036500 2577 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 15 21:06:32.071673 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036505 2577 flags.go:64] FLAG: --http-check-frequency="20s" Jul 15 21:06:32.071673 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036510 2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 15 21:06:32.071673 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036515 2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 15 21:06:32.071673 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036519 2577 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 15 21:06:32.071673 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036523 2577 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 15 21:06:32.071673 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036529 2577 flags.go:64] FLAG: --image-service-endpoint="" Jul 15 21:06:32.071673 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036532 2577 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 15 21:06:32.071673 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036536 2577 flags.go:64] FLAG: --kube-api-burst="100" Jul 15 21:06:32.071673 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036541 2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 15 21:06:32.071673 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036546 2577 flags.go:64] FLAG: --kube-api-qps="50" Jul 15 21:06:32.071673 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036551 2577 flags.go:64] FLAG: --kube-reserved="" Jul 15 21:06:32.071673 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036555 2577 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 15 21:06:32.071673 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036559 2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 15 21:06:32.071673 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036564 2577 flags.go:64] FLAG: --kubelet-cgroups="" Jul 15 21:06:32.071673 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036568 2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 15 21:06:32.071673 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036572 2577 flags.go:64] FLAG: --lock-file="" Jul 15 21:06:32.188057 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036577 2577 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 15 21:06:32.188057 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036581 2577 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 15 21:06:32.188057 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036585 2577 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 15 21:06:32.188057 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036592 2577 flags.go:64] FLAG: --log-json-split-stream="false" Jul 15 21:06:32.188057 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036597 2577 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 15 21:06:32.188057 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036601 2577 flags.go:64] FLAG: --log-text-split-stream="false" Jul 15 21:06:32.188057 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036604 2577 flags.go:64] FLAG: --logging-format="text" Jul 15 21:06:32.188057 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036608 2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 15 21:06:32.188057 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036613 2577 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 15 21:06:32.188057 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036616 2577 flags.go:64] FLAG: --manifest-url="" Jul 15 21:06:32.188057 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036620 2577 flags.go:64] FLAG: --manifest-url-header="" Jul 15 21:06:32.188057 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036626 2577 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 15 21:06:32.188057 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036630 2577 flags.go:64] FLAG: --max-open-files="1000000" Jul 15 21:06:32.188057 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036636 2577 flags.go:64] FLAG: --max-pods="110" Jul 15 21:06:32.188057 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036639 2577 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 15 21:06:32.188057 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036644 2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 15 21:06:32.188057 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036648 2577 flags.go:64] FLAG: --memory-manager-policy="None" Jul 15 21:06:32.188057 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036653 2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 15 21:06:32.188057 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036657 2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 15 21:06:32.188057 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036661 2577 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 15 21:06:32.188057 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036665 2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 15 21:06:32.188057 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036676 2577 flags.go:64] FLAG: --node-status-max-images="50" Jul 15 21:06:32.188057 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036681 2577 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 15 21:06:32.188057 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036685 2577 flags.go:64] FLAG: --oom-score-adj="-999" Jul 15 21:06:32.188057 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036690 2577 flags.go:64] FLAG: --pod-cidr="" Jul 15 21:06:32.109699 ip-10-0-143-46 systemd[1]: Started Kubernetes Kubelet. Jul 15 21:06:32.189667 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036694 2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 15 21:06:32.189667 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036701 2577 flags.go:64] FLAG: --pod-manifest-path="" Jul 15 21:06:32.189667 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036706 2577 flags.go:64] FLAG: --pod-max-pids="-1" Jul 15 21:06:32.189667 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036711 2577 flags.go:64] FLAG: --pods-per-core="0" Jul 15 21:06:32.189667 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036715 2577 flags.go:64] FLAG: --port="10250" Jul 15 21:06:32.189667 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036719 2577 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 15 21:06:32.189667 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036738 2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-05815b0f265df7af6" Jul 15 21:06:32.189667 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036744 2577 flags.go:64] FLAG: --qos-reserved="" Jul 15 21:06:32.189667 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036748 2577 flags.go:64] FLAG: --read-only-port="10255" Jul 15 21:06:32.189667 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036753 2577 flags.go:64] FLAG: --register-node="true" Jul 15 21:06:32.189667 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036757 2577 flags.go:64] FLAG: --register-with-taints="" Jul 15 21:06:32.189667 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036762 2577 flags.go:64] FLAG: --registry-burst="10" Jul 15 21:06:32.189667 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036766 2577 flags.go:64] FLAG: --registry-qps="5" Jul 15 21:06:32.189667 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036770 2577 flags.go:64] FLAG: --reserved-cpus="" Jul 15 21:06:32.189667 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036774 2577 flags.go:64] FLAG: --reserved-memory="" Jul 15 21:06:32.189667 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036780 2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 15 21:06:32.189667 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036785 2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 15 21:06:32.189667 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036789 2577 flags.go:64] FLAG: --rotate-certificates="false" Jul 15 21:06:32.189667 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036793 2577 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 15 21:06:32.189667 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036797 2577 flags.go:64] FLAG: --runonce="false" Jul 15 21:06:32.189667 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036801 2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 15 21:06:32.189667 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036805 2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 15 21:06:32.189667 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036809 2577 flags.go:64] FLAG: --seccomp-default="false" Jul 15 21:06:32.189667 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036813 2577 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 15 21:06:32.189667 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036817 2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 15 21:06:32.194984 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036822 2577 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 15 21:06:32.194984 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036826 2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 15 21:06:32.194984 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036830 2577 flags.go:64] FLAG: --storage-driver-password="root" Jul 15 21:06:32.194984 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036834 2577 flags.go:64] FLAG: --storage-driver-secure="false" Jul 15 21:06:32.194984 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036841 2577 flags.go:64] FLAG: --storage-driver-table="stats" Jul 15 21:06:32.194984 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036845 2577 flags.go:64] FLAG: --storage-driver-user="root" Jul 15 21:06:32.194984 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036849 2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 15 21:06:32.194984 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036855 2577 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 15 21:06:32.194984 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036859 2577 flags.go:64] FLAG: --system-cgroups="" Jul 15 21:06:32.194984 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036863 2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 15 21:06:32.194984 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036871 2577 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 15 21:06:32.194984 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036875 2577 flags.go:64] FLAG: --tls-cert-file="" Jul 15 21:06:32.194984 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036879 2577 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 15 21:06:32.194984 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036886 2577 flags.go:64] FLAG: --tls-min-version="" Jul 15 21:06:32.194984 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036890 2577 flags.go:64] FLAG: --tls-private-key-file="" Jul 15 21:06:32.194984 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036894 2577 flags.go:64] FLAG: --topology-manager-policy="none" Jul 15 21:06:32.194984 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036898 2577 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 15 21:06:32.194984 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036901 2577 flags.go:64] FLAG: --topology-manager-scope="container" Jul 15 21:06:32.194984 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036904 2577 flags.go:64] FLAG: --v="2" Jul 15 21:06:32.194984 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036909 2577 flags.go:64] FLAG: --version="false" Jul 15 21:06:32.194984 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036915 2577 flags.go:64] FLAG: --vmodule="" Jul 15 21:06:32.194984 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036920 2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 15 21:06:32.194984 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.036925 2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 15 21:06:32.194984 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037078 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 21:06:32.194984 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037083 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 21:06:32.195786 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037088 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 21:06:32.195786 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037092 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 21:06:32.195786 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037097 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 21:06:32.195786 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037102 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 21:06:32.195786 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037107 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 21:06:32.195786 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037111 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 21:06:32.195786 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037114 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 21:06:32.195786 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037116 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 15 21:06:32.195786 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037121 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 21:06:32.195786 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037125 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 21:06:32.195786 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037127 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 21:06:32.195786 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037131 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 21:06:32.195786 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037134 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 21:06:32.195786 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037136 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 21:06:32.195786 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037140 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 21:06:32.195786 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037143 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 21:06:32.195786 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037145 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 21:06:32.195786 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037148 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 21:06:32.195786 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037151 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 21:06:32.196353 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037153 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 21:06:32.196353 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037156 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 21:06:32.196353 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037158 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 21:06:32.196353 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037161 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 21:06:32.196353 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037163 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 21:06:32.196353 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037166 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 21:06:32.196353 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037168 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 21:06:32.196353 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037171 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 21:06:32.196353 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037173 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 21:06:32.196353 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037176 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 21:06:32.196353 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037178 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 21:06:32.196353 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037181 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 21:06:32.196353 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037183 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 21:06:32.196353 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037186 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 21:06:32.196353 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037188 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 21:06:32.196353 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037191 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 21:06:32.196353 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037193 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 21:06:32.196353 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037196 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 21:06:32.196353 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037200 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 21:06:32.196968 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037203 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 21:06:32.196968 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037206 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 21:06:32.196968 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037208 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 21:06:32.196968 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037212 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 21:06:32.196968 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037215 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 21:06:32.196968 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037218 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 21:06:32.196968 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037222 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 21:06:32.196968 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037225 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 21:06:32.196968 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037230 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 21:06:32.196968 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037233 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 21:06:32.196968 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037236 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 21:06:32.196968 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037238 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 21:06:32.196968 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037241 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 21:06:32.196968 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037243 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 21:06:32.196968 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037246 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 21:06:32.196968 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037248 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 21:06:32.196968 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037251 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 21:06:32.196968 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037253 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 21:06:32.196968 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037256 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 21:06:32.197519 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037258 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 21:06:32.197519 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037261 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 21:06:32.197519 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037263 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 21:06:32.197519 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037266 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 21:06:32.197519 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037268 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 21:06:32.197519 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037271 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 21:06:32.197519 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037273 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 21:06:32.197519 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037282 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 21:06:32.197519 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037285 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 21:06:32.197519 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037288 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 21:06:32.197519 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037290 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 21:06:32.197519 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037293 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 21:06:32.197519 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037296 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 21:06:32.197519 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037298 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 21:06:32.197519 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037300 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 21:06:32.197519 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037303 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 21:06:32.197519 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037305 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 21:06:32.197519 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037309 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 21:06:32.197519 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037313 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 21:06:32.197519 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037316 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 21:06:32.198171 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037318 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 21:06:32.198171 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037322 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 21:06:32.198171 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037325 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 21:06:32.198171 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037328 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 21:06:32.198171 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037330 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 21:06:32.198171 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037333 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 21:06:32.198171 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037336 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 21:06:32.198171 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037338 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 21:06:32.198171 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037341 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 21:06:32.198171 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037344 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 21:06:32.198171 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037347 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 21:06:32.198171 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037349 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 21:06:32.198171 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037352 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 21:06:32.198171 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037354 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 21:06:32.198171 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037357 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 21:06:32.198171 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037360 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 21:06:32.198171 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037362 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 21:06:32.198171 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037365 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 21:06:32.198171 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037367 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 21:06:32.198171 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.037370 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 21:06:32.198718 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.038012 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 21:06:32.198718 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.046262 2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 15 21:06:32.198718 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.046277 2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 15 21:06:32.198718 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.046295 2577 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 15 21:06:32.198718 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.046301 2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 15 21:06:32.198718 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046359 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 21:06:32.198718 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046364 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 21:06:32.198718 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046368 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 21:06:32.198718 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046371 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 21:06:32.198718 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046374 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 21:06:32.198718 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046377 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 21:06:32.198718 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046380 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 21:06:32.198718 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046383 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 21:06:32.198718 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046386 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 21:06:32.198718 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046388 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 21:06:32.372415 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046391 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 21:06:32.372415 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046393 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 21:06:32.372415 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046396 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 21:06:32.372415 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046400 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 21:06:32.372415 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046404 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 21:06:32.372415 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046407 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 21:06:32.372415 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046410 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 21:06:32.372415 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046412 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 21:06:32.372415 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046415 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 21:06:32.372415 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046418 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 21:06:32.372415 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046420 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 21:06:32.372415 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046423 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 21:06:32.372415 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046425 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 21:06:32.372415 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046428 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 21:06:32.372415 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046430 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 21:06:32.372415 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046433 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 21:06:32.372415 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046437 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 21:06:32.372415 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046440 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 21:06:32.373567 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046452 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 21:06:32.373567 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046456 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 21:06:32.373567 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046459 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 21:06:32.373567 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046462 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 21:06:32.373567 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046465 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 21:06:32.373567 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046468 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 21:06:32.373567 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046471 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 21:06:32.373567 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046474 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 21:06:32.373567 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046477 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 21:06:32.373567 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046480 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 21:06:32.373567 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046482 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 21:06:32.373567 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046485 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 21:06:32.373567 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046488 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 21:06:32.373567 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046490 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 21:06:32.373567 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046493 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 21:06:32.373567 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046496 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 21:06:32.373567 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046498 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 21:06:32.373567 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046501 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 21:06:32.373567 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046504 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 21:06:32.373567 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046507 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 21:06:32.374727 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046509 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 21:06:32.374727 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046512 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 21:06:32.374727 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046515 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 21:06:32.374727 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046517 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 21:06:32.374727 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046520 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 21:06:32.374727 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046522 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 21:06:32.374727 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046524 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 21:06:32.374727 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046527 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 21:06:32.374727 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046530 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 21:06:32.374727 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046532 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 21:06:32.374727 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046535 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 21:06:32.374727 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046537 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 21:06:32.374727 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046543 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 21:06:32.374727 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046545 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 21:06:32.374727 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046548 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 21:06:32.374727 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046551 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 21:06:32.374727 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046553 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 21:06:32.374727 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046556 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 21:06:32.374727 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046559 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 21:06:32.374727 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046561 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 21:06:32.376202 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046564 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 21:06:32.376202 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046567 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 21:06:32.376202 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046569 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 21:06:32.376202 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046572 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 21:06:32.376202 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046574 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 21:06:32.376202 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046577 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 21:06:32.376202 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046579 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 21:06:32.376202 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046582 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 21:06:32.376202 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046585 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 21:06:32.376202 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046587 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 21:06:32.376202 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046590 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 21:06:32.376202 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046593 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 21:06:32.376202 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046595 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 21:06:32.376202 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046598 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 21:06:32.376202 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046600 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 21:06:32.376202 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046603 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 21:06:32.376202 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046605 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 21:06:32.376202 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046608 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 21:06:32.376202 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046610 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 21:06:32.376202 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046613 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 21:06:32.377280 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046615 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 21:06:32.377280 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046618 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 21:06:32.377280 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046620 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 15 21:06:32.377280 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046623 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 21:06:32.377280 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046628 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 21:06:32.377280 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046630 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 21:06:32.377280 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046633 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 21:06:32.377280 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046635 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 21:06:32.377280 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046638 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 21:06:32.377280 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046640 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 21:06:32.377280 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046643 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 21:06:32.377280 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.046648 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 21:06:32.377280 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046788 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 21:06:32.377280 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046795 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 21:06:32.377280 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046798 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 21:06:32.377987 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046801 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 21:06:32.377987 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046803 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 21:06:32.377987 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046806 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 21:06:32.377987 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046809 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 21:06:32.377987 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046811 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 21:06:32.377987 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046814 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 21:06:32.377987 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046816 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 21:06:32.377987 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046819 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 21:06:32.377987 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046822 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 21:06:32.377987 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046825 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 21:06:32.377987 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046828 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 21:06:32.377987 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046830 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 21:06:32.377987 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046833 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 21:06:32.377987 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046837 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 21:06:32.377987 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046841 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 21:06:32.377987 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046844 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 21:06:32.377987 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046847 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 21:06:32.377987 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046850 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 21:06:32.377987 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046852 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 21:06:32.378938 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046855 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 21:06:32.378938 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046857 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 21:06:32.378938 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046862 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 21:06:32.378938 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046865 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 21:06:32.378938 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046868 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 21:06:32.378938 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046870 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 21:06:32.378938 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046873 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 21:06:32.378938 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046875 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 21:06:32.378938 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046878 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 21:06:32.378938 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046881 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 21:06:32.378938 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046883 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 21:06:32.378938 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046886 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 21:06:32.378938 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046889 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 21:06:32.378938 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046891 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 21:06:32.378938 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046894 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 21:06:32.378938 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046896 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 21:06:32.378938 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046899 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 21:06:32.378938 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046901 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 21:06:32.378938 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046904 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 21:06:32.378938 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046907 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 21:06:32.380131 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046909 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 21:06:32.380131 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046911 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 21:06:32.380131 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046914 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 21:06:32.380131 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046921 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 21:06:32.380131 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046923 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 21:06:32.380131 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046926 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 21:06:32.380131 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046928 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 21:06:32.380131 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046931 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 21:06:32.380131 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046933 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 21:06:32.380131 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046936 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 21:06:32.380131 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046939 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 21:06:32.380131 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046941 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 21:06:32.380131 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046944 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 21:06:32.380131 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046946 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 21:06:32.380131 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046950 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 21:06:32.380131 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046955 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 21:06:32.380131 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046957 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 21:06:32.380131 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046960 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 21:06:32.380131 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046963 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 21:06:32.380131 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046965 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 21:06:32.381324 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046968 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 21:06:32.381324 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046970 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 21:06:32.381324 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046973 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 21:06:32.381324 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046976 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 21:06:32.381324 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046980 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 21:06:32.381324 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046982 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 21:06:32.381324 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046985 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 21:06:32.381324 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046987 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 21:06:32.381324 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046990 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 21:06:32.381324 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046992 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 21:06:32.381324 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046995 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 21:06:32.381324 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.046997 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 15 21:06:32.381324 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.047000 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 21:06:32.381324 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.047003 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 21:06:32.381324 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.047005 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 21:06:32.381324 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.047008 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 21:06:32.381324 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.047011 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 21:06:32.381324 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.047013 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 21:06:32.381324 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.047016 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 21:06:32.381324 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.047018 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 21:06:32.382291 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.047021 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 21:06:32.382291 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.047023 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 21:06:32.382291 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.047026 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 21:06:32.382291 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.047029 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 21:06:32.382291 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.047032 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 21:06:32.382291 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.047035 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 21:06:32.382291 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.047040 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 21:06:32.382291 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.047044 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 21:06:32.382291 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.047047 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 21:06:32.382291 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.047050 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 21:06:32.382291 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.047052 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 21:06:32.382291 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.047055 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 21:06:32.382291 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.047057 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 21:06:32.382291 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.047060 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 21:06:32.382291 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.047062 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 21:06:32.382291 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.047065 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 21:06:32.382291 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:32.047067 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 21:06:32.383248 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.047072 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 21:06:32.383248 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.047191 2577 server.go:962] "Client rotation is on, will bootstrap in background" Jul 15 21:06:32.383248 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.050629 2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 15 21:06:32.383248 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.051929 2577 server.go:1019] "Starting client certificate rotation" Jul 15 21:06:32.383248 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.052034 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 15 21:06:32.383248 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.052078 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 15 21:06:32.383248 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.054638 2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 15 21:06:32.383248 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.056131 2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 15 21:06:32.383248 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.069772 2577 log.go:25] "Validated CRI v1 runtime API" Jul 15 21:06:32.383248 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.079344 2577 log.go:25] "Validated CRI v1 image API" Jul 15 21:06:32.383248 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.080969 2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 15 21:06:32.383248 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.085438 2577 fs.go:135] Filesystem UUIDs: map[349c4d3e-bac4-435f-a39c-16d895060ab6:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 9c6552c5-897c-41fa-9938-1b3c91486c6d:/dev/nvme0n1p3] Jul 15 21:06:32.384200 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.085460 2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 15 21:06:32.384451 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.090652 2577 manager.go:216] Machine: {Timestamp:2026-07-15 21:06:32.089195634 +0000 UTC m=+0.339620757 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3160103 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2bf49c7754f9d082c0b63895397a74 SystemUUID:ec2bf49c-7754-f9d0-82c0-b63895397a74 BootID:19e03c5b-624d-4e36-a1a4-a3e93bbfe5cd Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:45:07:7e:77:07 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:45:07:7e:77:07 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a6:a2:1f:a4:f3:08 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 15 21:06:32.384451 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.090792 2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 15 21:06:32.384451 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.090905 2577 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 15 21:06:32.384451 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.093762 2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 15 21:06:32.384451 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.093784 2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-46.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 15 21:06:32.384451 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.094271 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 15 21:06:32.384451 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.094668 2577 topology_manager.go:138] "Creating topology manager with none policy" Jul 15 21:06:32.387216 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.094680 2577 container_manager_linux.go:309] "Creating device plugin manager" Jul 15 21:06:32.387216 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.094687 2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 15 21:06:32.387216 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.095354 2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 15 21:06:32.387216 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.096535 2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 15 21:06:32.387216 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.099262 2577 state_mem.go:36] "Initialized new in-memory state store" Jul 15 21:06:32.387216 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.099426 2577 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 15 21:06:32.387216 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.099533 2577 kubelet.go:486] "Attempting to sync node with API server" Jul 15 21:06:32.387216 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.099558 2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 15 21:06:32.387216 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.099579 2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 15 21:06:32.387216 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.099600 2577 kubelet.go:398] "Adding apiserver pod source" Jul 15 21:06:32.387216 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.099613 2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 15 21:06:32.387216 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.100198 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 15 21:06:32.387216 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.100221 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 15 21:06:32.387216 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.102540 2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 15 21:06:32.387216 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.104337 2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 15 21:06:32.387216 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.104366 2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 15 21:06:32.387216 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.105133 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 15 21:06:32.387216 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.105171 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 15 21:06:32.387216 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.105178 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 15 21:06:32.387216 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.105183 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 15 21:06:32.387216 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.105192 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 15 21:06:32.387216 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.105198 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 15 21:06:32.387216 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.105207 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 15 21:06:32.387216 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.105212 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 15 21:06:32.387216 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.105218 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 15 21:06:32.387216 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.105224 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 15 21:06:32.387216 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.105232 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 15 21:06:32.387216 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.105238 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 15 21:06:32.387216 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.105925 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 15 21:06:32.387216 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.105931 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 15 21:06:32.387216 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.108980 2577 server.go:1268] "Started kubelet" Jul 15 21:06:32.387216 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.109061 2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 15 21:06:32.387216 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.109152 2577 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 15 21:06:32.387216 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.109756 2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 15 21:06:32.387216 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.110222 2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 15 21:06:32.387216 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.112601 2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-46.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 15 21:06:32.387216 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:32.112597 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-46.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 15 21:06:32.387216 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:32.112627 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 15 21:06:32.387216 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.114288 2577 server.go:310] "Adding debug handlers to kubelet server" Jul 15 21:06:32.387216 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.115669 2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 15 21:06:32.389110 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:32.115792 2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 15 21:06:32.389110 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.115889 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 15 21:06:32.389110 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:32.117619 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-46.ec2.internal\" not found" Jul 15 21:06:32.389110 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.118223 2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 15 21:06:32.389110 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.118226 2577 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 15 21:06:32.389110 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.118246 2577 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 15 21:06:32.389110 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.118355 2577 reconstruct.go:97] "Volume reconstruction finished" Jul 15 21:06:32.389110 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.118361 2577 reconciler.go:29] "Reconciler: start to sync state" Jul 15 21:06:32.389110 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.118632 2577 factory.go:55] Registering systemd factory Jul 15 21:06:32.389110 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.118643 2577 factory.go:223] Registration of the systemd container factory successfully Jul 15 21:06:32.389110 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:32.117711 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-46.ec2.internal.18c29299e7cff303 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-46.ec2.internal,UID:ip-10-0-143-46.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-46.ec2.internal,},FirstTimestamp:2026-07-15 21:06:32.108954371 +0000 UTC m=+0.359379494,LastTimestamp:2026-07-15 21:06:32.108954371 +0000 UTC m=+0.359379494,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-46.ec2.internal,}" Jul 15 21:06:32.389110 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.118910 2577 factory.go:153] Registering CRI-O factory Jul 15 21:06:32.389110 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.118922 2577 factory.go:223] Registration of the crio container factory successfully Jul 15 21:06:32.389110 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.118965 2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 15 21:06:32.389110 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.118989 2577 factory.go:103] Registering Raw factory Jul 15 21:06:32.389110 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.119006 2577 manager.go:1196] Started watching for new ooms in manager Jul 15 21:06:32.389110 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.119338 2577 manager.go:349] Starting recovery of all containers Jul 15 21:06:32.389110 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.123281 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vwkhf" Jul 15 21:06:32.389110 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:32.124095 2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-46.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 15 21:06:32.389110 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:32.124176 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 15 21:06:32.389110 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.132996 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vwkhf" Jul 15 21:06:32.389110 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.134297 2577 manager.go:354] Recovery completed Jul 15 21:06:32.389110 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.144094 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 21:06:32.389110 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.146305 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-46.ec2.internal" event="NodeHasSufficientMemory" Jul 15 21:06:32.389110 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.146333 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-46.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 21:06:32.389110 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.146346 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-46.ec2.internal" event="NodeHasSufficientPID" Jul 15 21:06:32.389110 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.146781 2577 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 15 21:06:32.389110 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.146787 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 21:06:32.389110 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.146793 2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 15 21:06:32.389110 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.146810 2577 state_mem.go:36] "Initialized new in-memory state store" Jul 15 21:06:32.389110 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.147465 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-46.ec2.internal" event="NodeHasSufficientMemory" Jul 15 21:06:32.389110 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.147481 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-46.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 21:06:32.397293 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.147492 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-46.ec2.internal" event="NodeHasSufficientPID" Jul 15 21:06:32.397293 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:32.148066 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-46.ec2.internal.18c29299ea0a118b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-46.ec2.internal,UID:ip-10-0-143-46.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-46.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-46.ec2.internal,},FirstTimestamp:2026-07-15 21:06:32.146317707 +0000 UTC m=+0.396742833,LastTimestamp:2026-07-15 21:06:32.146317707 +0000 UTC m=+0.396742833,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-46.ec2.internal,}" Jul 15 21:06:32.397293 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.148203 2577 policy_none.go:49] "None policy: Start" Jul 15 21:06:32.397293 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.148216 2577 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 15 21:06:32.397293 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.148226 2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 15 21:06:32.397293 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.149146 2577 policy_none.go:47] "Start" Jul 15 21:06:32.397293 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.201313 2577 manager.go:337] "Starting Device Plugin manager" Jul 15 21:06:32.397293 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:32.201343 2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 15 21:06:32.397293 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.201353 2577 server.go:87] "Starting device plugin registration server" Jul 15 21:06:32.397293 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.201547 2577 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 15 21:06:32.397293 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.201556 2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 15 21:06:32.397293 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.201877 2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 15 21:06:32.397293 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.201948 2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 15 21:06:32.397293 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.201955 2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 15 21:06:32.397293 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:32.202529 2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 15 21:06:32.397293 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:32.202576 2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-46.ec2.internal\" not found" Jul 15 21:06:32.397293 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.302086 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 21:06:32.397293 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.303255 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-46.ec2.internal" event="NodeHasSufficientMemory" Jul 15 21:06:32.397293 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.303289 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-46.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 21:06:32.397293 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.303311 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-46.ec2.internal" event="NodeHasSufficientPID" Jul 15 21:06:32.397293 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.303341 2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-46.ec2.internal" Jul 15 21:06:32.397293 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.313010 2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-46.ec2.internal" Jul 15 21:06:32.397293 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:32.313030 2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-46.ec2.internal\": node \"ip-10-0-143-46.ec2.internal\" not found" Jul 15 21:06:32.397293 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:32.331397 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-46.ec2.internal\" not found" Jul 15 21:06:32.397293 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.332699 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 15 21:06:32.397293 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.333955 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 15 21:06:32.397293 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.333985 2577 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 15 21:06:32.397293 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.334006 2577 kubelet.go:2448] "Starting kubelet main sync loop" Jul 15 21:06:32.397293 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:32.334040 2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 15 21:06:32.397293 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.336333 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 21:06:32.590824 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:32.431565 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-46.ec2.internal\" not found" Jul 15 21:06:32.590824 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.434961 2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-46.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-46.ec2.internal"] Jul 15 21:06:32.590824 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.435023 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 21:06:32.590824 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.436563 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-46.ec2.internal" event="NodeHasSufficientMemory" Jul 15 21:06:32.590824 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.436593 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-46.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 21:06:32.590824 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.436607 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-46.ec2.internal" event="NodeHasSufficientPID" Jul 15 21:06:32.590824 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.437955 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 21:06:32.590824 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.438071 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-46.ec2.internal" Jul 15 21:06:32.590824 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.438099 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 21:06:32.590824 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.438714 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-46.ec2.internal" event="NodeHasSufficientMemory" Jul 15 21:06:32.590824 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.438754 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-46.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 21:06:32.590824 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.438770 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-46.ec2.internal" event="NodeHasSufficientPID" Jul 15 21:06:32.590824 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.438771 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-46.ec2.internal" event="NodeHasSufficientMemory" Jul 15 21:06:32.590824 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.438799 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-46.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 21:06:32.590824 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.438814 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-46.ec2.internal" event="NodeHasSufficientPID" Jul 15 21:06:32.590824 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.439846 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-46.ec2.internal" Jul 15 21:06:32.590824 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.439867 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 21:06:32.590824 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.440586 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-46.ec2.internal" event="NodeHasSufficientMemory" Jul 15 21:06:32.590824 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.440615 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-46.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 21:06:32.590824 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.440628 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-46.ec2.internal" event="NodeHasSufficientPID" Jul 15 21:06:32.590824 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:32.463490 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-46.ec2.internal\" not found" node="ip-10-0-143-46.ec2.internal" Jul 15 21:06:32.590824 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:32.468909 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-46.ec2.internal\" not found" node="ip-10-0-143-46.ec2.internal" Jul 15 21:06:32.590824 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.520574 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/62c84c35e765c98395b0bedc3e26a159-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-46.ec2.internal\" (UID: \"62c84c35e765c98395b0bedc3e26a159\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-46.ec2.internal" Jul 15 21:06:32.590824 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.520598 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/62c84c35e765c98395b0bedc3e26a159-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-46.ec2.internal\" (UID: \"62c84c35e765c98395b0bedc3e26a159\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-46.ec2.internal" Jul 15 21:06:32.590824 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.520616 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b1f0b417ff2ce60419276782687d4a52-config\") pod \"kube-apiserver-proxy-ip-10-0-143-46.ec2.internal\" (UID: \"b1f0b417ff2ce60419276782687d4a52\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-46.ec2.internal" Jul 15 21:06:32.590824 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:32.531713 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-46.ec2.internal\" not found" Jul 15 21:06:32.783594 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.621323 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/62c84c35e765c98395b0bedc3e26a159-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-46.ec2.internal\" (UID: \"62c84c35e765c98395b0bedc3e26a159\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-46.ec2.internal" Jul 15 21:06:32.783594 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.621348 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/62c84c35e765c98395b0bedc3e26a159-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-46.ec2.internal\" (UID: \"62c84c35e765c98395b0bedc3e26a159\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-46.ec2.internal" Jul 15 21:06:32.783594 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.621370 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b1f0b417ff2ce60419276782687d4a52-config\") pod \"kube-apiserver-proxy-ip-10-0-143-46.ec2.internal\" (UID: \"b1f0b417ff2ce60419276782687d4a52\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-46.ec2.internal" Jul 15 21:06:32.783594 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.621418 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/62c84c35e765c98395b0bedc3e26a159-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-46.ec2.internal\" (UID: \"62c84c35e765c98395b0bedc3e26a159\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-46.ec2.internal" Jul 15 21:06:32.783594 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.621423 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/62c84c35e765c98395b0bedc3e26a159-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-46.ec2.internal\" (UID: \"62c84c35e765c98395b0bedc3e26a159\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-46.ec2.internal" Jul 15 21:06:32.783594 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.621502 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b1f0b417ff2ce60419276782687d4a52-config\") pod \"kube-apiserver-proxy-ip-10-0-143-46.ec2.internal\" (UID: \"b1f0b417ff2ce60419276782687d4a52\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-46.ec2.internal" Jul 15 21:06:32.783594 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:32.631755 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-46.ec2.internal\" not found" Jul 15 21:06:32.783594 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:32.732797 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-46.ec2.internal\" not found" Jul 15 21:06:32.783594 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.765664 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-46.ec2.internal" Jul 15 21:06:32.783594 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.770959 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-46.ec2.internal" Jul 15 21:06:33.027828 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:32.833616 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-46.ec2.internal\" not found" Jul 15 21:06:33.027828 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:32.934653 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-46.ec2.internal\" not found" Jul 15 21:06:33.027828 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:32.951085 2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 21:06:33.234279 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:33.034919 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-46.ec2.internal\" not found" Jul 15 21:06:33.234279 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:33.051578 2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 15 21:06:33.234279 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:33.051756 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 15 21:06:33.234279 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:33.051763 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 15 21:06:33.234279 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:33.135012 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-46.ec2.internal\" not found" Jul 15 21:06:33.234279 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:33.144167 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 21:01:32 +0000 UTC" deadline="2028-03-24 13:42:54.54091991 +0000 UTC" Jul 15 21:06:33.234279 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:33.144194 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14824h36m21.3967295s" Jul 15 21:06:33.236578 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:33.235102 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-46.ec2.internal\" not found" Jul 15 21:06:33.419210 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:33.335963 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-46.ec2.internal\" not found" Jul 15 21:06:33.419210 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:33.401851 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62c84c35e765c98395b0bedc3e26a159.slice/crio-cbd20acf3ba2ca6424bb682f42ca42b95dd6f78648e91ef3cf56b1f039f21cb4 WatchSource:0}: Error finding container cbd20acf3ba2ca6424bb682f42ca42b95dd6f78648e91ef3cf56b1f039f21cb4: Status 404 returned error can't find the container with id cbd20acf3ba2ca6424bb682f42ca42b95dd6f78648e91ef3cf56b1f039f21cb4 Jul 15 21:06:33.419210 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:33.402290 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1f0b417ff2ce60419276782687d4a52.slice/crio-09e54c71eda08ba1c49c35bed694d85563bb6f7124fabc2076f960a62052ff80 WatchSource:0}: Error finding container 09e54c71eda08ba1c49c35bed694d85563bb6f7124fabc2076f960a62052ff80: Status 404 returned error can't find the container with id 09e54c71eda08ba1c49c35bed694d85563bb6f7124fabc2076f960a62052ff80 Jul 15 21:06:33.419210 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:33.406021 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 21:06:33.632295 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:33.427018 2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 21:06:33.632295 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:33.436707 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-46.ec2.internal\" not found" Jul 15 21:06:33.632295 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:33.495414 2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 21:06:33.632295 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:33.518556 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-46.ec2.internal" Jul 15 21:06:33.632295 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:33.533324 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 15 21:06:33.632295 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:33.534334 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-46.ec2.internal" Jul 15 21:06:33.632295 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:33.550370 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 15 21:06:34.166752 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.102491 2577 apiserver.go:52] "Watching apiserver" Jul 15 21:06:34.166752 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.111002 2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 15 21:06:34.166752 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.111452 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-rq7ns","kube-system/global-pull-secret-syncer-6n6hw","kube-system/konnectivity-agent-tsgc7","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsgwz","openshift-dns/node-resolver-dggdr","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-46.ec2.internal","openshift-multus/multus-additional-cni-plugins-7plx5","openshift-multus/multus-cz97m","openshift-ovn-kubernetes/ovnkube-node-qm2hk","kube-system/kube-apiserver-proxy-ip-10-0-143-46.ec2.internal","openshift-cluster-node-tuning-operator/tuned-hz4sl","openshift-image-registry/node-ca-lr7lm","openshift-multus/network-metrics-daemon-4bt89","openshift-network-diagnostics/network-check-target-zzmkh"] Jul 15 21:06:34.166752 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.113568 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7plx5" Jul 15 21:06:34.166752 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.114755 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bt89" Jul 15 21:06:34.166752 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:34.114828 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bt89" podUID="cb2ca919-f019-4882-af3c-a6f2c6544aef" Jul 15 21:06:34.166752 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.116626 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 15 21:06:34.166752 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.116697 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 15 21:06:34.166752 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.116786 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 15 21:06:34.166752 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.116899 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 15 21:06:34.166752 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.116947 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pl8bk\"" Jul 15 21:06:34.166752 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.117020 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 15 21:06:34.166752 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.117177 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tsgc7" Jul 15 21:06:34.166752 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.117888 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 15 21:06:34.166752 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.119186 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsgwz" Jul 15 21:06:34.166752 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.119853 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 15 21:06:34.166752 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.119953 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-52kq7\"" Jul 15 21:06:34.166752 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.120036 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 15 21:06:34.166752 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.121184 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dggdr" Jul 15 21:06:34.166752 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.121893 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 15 21:06:34.166752 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.121966 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 15 21:06:34.166752 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.122001 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-fwwg6\"" Jul 15 21:06:34.166752 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.121896 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 15 21:06:34.166752 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.123011 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzmkh" Jul 15 21:06:34.166752 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:34.123073 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzmkh" podUID="5a785f71-60da-4c64-b6bb-6c2abb587a4f" Jul 15 21:06:34.166752 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.123696 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-29sb8\"" Jul 15 21:06:34.168321 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.123988 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 15 21:06:34.168321 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.124005 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 15 21:06:34.168321 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.125364 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:06:34.168321 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.127287 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rq7ns" Jul 15 21:06:34.168321 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.128317 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 15 21:06:34.168321 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.129649 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 15 21:06:34.168321 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.129948 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 15 21:06:34.168321 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.129989 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 15 21:06:34.168321 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.130151 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 15 21:06:34.168321 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.130180 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-djw8k\"" Jul 15 21:06:34.168321 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.130232 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 15 21:06:34.168321 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.130499 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 15 21:06:34.168321 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.130514 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6n6hw" Jul 15 21:06:34.168321 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:34.130595 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6n6hw" podUID="f12efede-b144-4c22-9e44-0990b6bb00af" Jul 15 21:06:34.168321 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.130611 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 15 21:06:34.168321 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.131486 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 15 21:06:34.168321 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.132066 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2e956ca6-aae2-482a-a1d6-6b904a4e0551-cnibin\") pod \"multus-additional-cni-plugins-7plx5\" (UID: \"2e956ca6-aae2-482a-a1d6-6b904a4e0551\") " pod="openshift-multus/multus-additional-cni-plugins-7plx5" Jul 15 21:06:34.168321 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.132224 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cz97m" Jul 15 21:06:34.168321 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.132259 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpq85\" (UniqueName: \"kubernetes.io/projected/2e956ca6-aae2-482a-a1d6-6b904a4e0551-kube-api-access-gpq85\") pod \"multus-additional-cni-plugins-7plx5\" (UID: \"2e956ca6-aae2-482a-a1d6-6b904a4e0551\") " pod="openshift-multus/multus-additional-cni-plugins-7plx5" Jul 15 21:06:34.168321 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.132306 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hftrd\" (UniqueName: \"kubernetes.io/projected/cb2ca919-f019-4882-af3c-a6f2c6544aef-kube-api-access-hftrd\") pod \"network-metrics-daemon-4bt89\" (UID: \"cb2ca919-f019-4882-af3c-a6f2c6544aef\") " pod="openshift-multus/network-metrics-daemon-4bt89" Jul 15 21:06:34.168321 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.132397 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/99025321-ebf4-4a9b-8a53-f7aa16cf9d3d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dsgwz\" (UID: \"99025321-ebf4-4a9b-8a53-f7aa16cf9d3d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsgwz" Jul 15 21:06:34.168321 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.132446 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/99025321-ebf4-4a9b-8a53-f7aa16cf9d3d-device-dir\") pod \"aws-ebs-csi-driver-node-dsgwz\" (UID: \"99025321-ebf4-4a9b-8a53-f7aa16cf9d3d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsgwz" Jul 15 21:06:34.171584 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.132595 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/99025321-ebf4-4a9b-8a53-f7aa16cf9d3d-etc-selinux\") pod \"aws-ebs-csi-driver-node-dsgwz\" (UID: \"99025321-ebf4-4a9b-8a53-f7aa16cf9d3d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsgwz" Jul 15 21:06:34.171584 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.132645 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/99025321-ebf4-4a9b-8a53-f7aa16cf9d3d-sys-fs\") pod \"aws-ebs-csi-driver-node-dsgwz\" (UID: \"99025321-ebf4-4a9b-8a53-f7aa16cf9d3d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsgwz" Jul 15 21:06:34.171584 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.132686 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb2ca919-f019-4882-af3c-a6f2c6544aef-metrics-certs\") pod \"network-metrics-daemon-4bt89\" (UID: \"cb2ca919-f019-4882-af3c-a6f2c6544aef\") " pod="openshift-multus/network-metrics-daemon-4bt89" Jul 15 21:06:34.171584 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.132728 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfhd9\" (UniqueName: \"kubernetes.io/projected/99025321-ebf4-4a9b-8a53-f7aa16cf9d3d-kube-api-access-gfhd9\") pod \"aws-ebs-csi-driver-node-dsgwz\" (UID: \"99025321-ebf4-4a9b-8a53-f7aa16cf9d3d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsgwz" Jul 15 21:06:34.171584 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.132757 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e956ca6-aae2-482a-a1d6-6b904a4e0551-system-cni-dir\") pod \"multus-additional-cni-plugins-7plx5\" (UID: \"2e956ca6-aae2-482a-a1d6-6b904a4e0551\") " pod="openshift-multus/multus-additional-cni-plugins-7plx5" Jul 15 21:06:34.171584 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.132795 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2e956ca6-aae2-482a-a1d6-6b904a4e0551-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7plx5\" (UID: \"2e956ca6-aae2-482a-a1d6-6b904a4e0551\") " pod="openshift-multus/multus-additional-cni-plugins-7plx5" Jul 15 21:06:34.171584 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.132898 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8e4f36da-9604-422b-a4b8-35e40e711b19-agent-certs\") pod \"konnectivity-agent-tsgc7\" (UID: \"8e4f36da-9604-422b-a4b8-35e40e711b19\") " pod="kube-system/konnectivity-agent-tsgc7" Jul 15 21:06:34.171584 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.132986 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8e4f36da-9604-422b-a4b8-35e40e711b19-konnectivity-ca\") pod \"konnectivity-agent-tsgc7\" (UID: \"8e4f36da-9604-422b-a4b8-35e40e711b19\") " pod="kube-system/konnectivity-agent-tsgc7" Jul 15 21:06:34.171584 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.133045 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/99025321-ebf4-4a9b-8a53-f7aa16cf9d3d-socket-dir\") pod \"aws-ebs-csi-driver-node-dsgwz\" (UID: \"99025321-ebf4-4a9b-8a53-f7aa16cf9d3d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsgwz" Jul 15 21:06:34.171584 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.133084 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2e956ca6-aae2-482a-a1d6-6b904a4e0551-os-release\") pod \"multus-additional-cni-plugins-7plx5\" (UID: \"2e956ca6-aae2-482a-a1d6-6b904a4e0551\") " pod="openshift-multus/multus-additional-cni-plugins-7plx5" Jul 15 21:06:34.171584 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.133140 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2e956ca6-aae2-482a-a1d6-6b904a4e0551-cni-binary-copy\") pod \"multus-additional-cni-plugins-7plx5\" (UID: \"2e956ca6-aae2-482a-a1d6-6b904a4e0551\") " pod="openshift-multus/multus-additional-cni-plugins-7plx5" Jul 15 21:06:34.171584 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.133173 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2e956ca6-aae2-482a-a1d6-6b904a4e0551-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7plx5\" (UID: \"2e956ca6-aae2-482a-a1d6-6b904a4e0551\") " pod="openshift-multus/multus-additional-cni-plugins-7plx5" Jul 15 21:06:34.171584 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.133206 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2e956ca6-aae2-482a-a1d6-6b904a4e0551-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7plx5\" (UID: \"2e956ca6-aae2-482a-a1d6-6b904a4e0551\") " pod="openshift-multus/multus-additional-cni-plugins-7plx5" Jul 15 21:06:34.172279 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.133251 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/99025321-ebf4-4a9b-8a53-f7aa16cf9d3d-registration-dir\") pod \"aws-ebs-csi-driver-node-dsgwz\" (UID: \"99025321-ebf4-4a9b-8a53-f7aa16cf9d3d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsgwz" Jul 15 21:06:34.172279 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.133261 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 15 21:06:34.172279 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.133516 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-zvl5s\"" Jul 15 21:06:34.172279 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.134818 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qfj9h\"" Jul 15 21:06:34.172279 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.134887 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 15 21:06:34.172279 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.135791 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hz4sl" Jul 15 21:06:34.172279 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.138030 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lr7lm" Jul 15 21:06:34.172279 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.138485 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7z6xl\"" Jul 15 21:06:34.172279 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.138820 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 15 21:06:34.172279 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.138820 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 15 21:06:34.172279 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.143164 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 15 21:06:34.172279 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.143333 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 15 21:06:34.172279 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.143725 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 15 21:06:34.172279 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.143923 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-lqgqh\"" Jul 15 21:06:34.172279 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.154400 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-4jlsb" Jul 15 21:06:34.172279 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.162627 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-4jlsb" Jul 15 21:06:34.262654 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.219636 2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 15 21:06:34.262654 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.233668 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e956ca6-aae2-482a-a1d6-6b904a4e0551-system-cni-dir\") pod \"multus-additional-cni-plugins-7plx5\" (UID: \"2e956ca6-aae2-482a-a1d6-6b904a4e0551\") " pod="openshift-multus/multus-additional-cni-plugins-7plx5" Jul 15 21:06:34.262654 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.233704 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8e4f36da-9604-422b-a4b8-35e40e711b19-agent-certs\") pod \"konnectivity-agent-tsgc7\" (UID: \"8e4f36da-9604-422b-a4b8-35e40e711b19\") " pod="kube-system/konnectivity-agent-tsgc7" Jul 15 21:06:34.262654 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.233751 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8e4f36da-9604-422b-a4b8-35e40e711b19-konnectivity-ca\") pod \"konnectivity-agent-tsgc7\" (UID: \"8e4f36da-9604-422b-a4b8-35e40e711b19\") " pod="kube-system/konnectivity-agent-tsgc7" Jul 15 21:06:34.262654 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.233781 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d657a4a7-22b8-4894-9ed2-89d76c9d3465-tmp-dir\") pod \"node-resolver-dggdr\" (UID: \"d657a4a7-22b8-4894-9ed2-89d76c9d3465\") " pod="openshift-dns/node-resolver-dggdr" Jul 15 21:06:34.262654 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.233807 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2e956ca6-aae2-482a-a1d6-6b904a4e0551-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7plx5\" (UID: \"2e956ca6-aae2-482a-a1d6-6b904a4e0551\") " pod="openshift-multus/multus-additional-cni-plugins-7plx5" Jul 15 21:06:34.262654 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.233836 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/790d9bc9-5d2c-4c27-b89e-78aaa7feb547-system-cni-dir\") pod \"multus-cz97m\" (UID: \"790d9bc9-5d2c-4c27-b89e-78aaa7feb547\") " pod="openshift-multus/multus-cz97m" Jul 15 21:06:34.262654 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.233860 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/790d9bc9-5d2c-4c27-b89e-78aaa7feb547-hostroot\") pod \"multus-cz97m\" (UID: \"790d9bc9-5d2c-4c27-b89e-78aaa7feb547\") " pod="openshift-multus/multus-cz97m" Jul 15 21:06:34.262654 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.233885 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqt8b\" (UniqueName: \"kubernetes.io/projected/27d65c91-f6b1-4e9f-bd7e-2f723aa38707-kube-api-access-gqt8b\") pod \"iptables-alerter-rq7ns\" (UID: \"27d65c91-f6b1-4e9f-bd7e-2f723aa38707\") " pod="openshift-network-operator/iptables-alerter-rq7ns" Jul 15 21:06:34.262654 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.233912 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9a3fc2a3-52d8-4ac3-99be-a76046969eaf-etc-modprobe-d\") pod \"tuned-hz4sl\" (UID: \"9a3fc2a3-52d8-4ac3-99be-a76046969eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-hz4sl" Jul 15 21:06:34.262654 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.233936 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/99025321-ebf4-4a9b-8a53-f7aa16cf9d3d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dsgwz\" (UID: \"99025321-ebf4-4a9b-8a53-f7aa16cf9d3d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsgwz" Jul 15 21:06:34.262654 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.233982 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/99025321-ebf4-4a9b-8a53-f7aa16cf9d3d-sys-fs\") pod \"aws-ebs-csi-driver-node-dsgwz\" (UID: \"99025321-ebf4-4a9b-8a53-f7aa16cf9d3d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsgwz" Jul 15 21:06:34.262654 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.234007 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/790d9bc9-5d2c-4c27-b89e-78aaa7feb547-cni-binary-copy\") pod \"multus-cz97m\" (UID: \"790d9bc9-5d2c-4c27-b89e-78aaa7feb547\") " pod="openshift-multus/multus-cz97m" Jul 15 21:06:34.262654 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.234038 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/790d9bc9-5d2c-4c27-b89e-78aaa7feb547-multus-conf-dir\") pod \"multus-cz97m\" (UID: \"790d9bc9-5d2c-4c27-b89e-78aaa7feb547\") " pod="openshift-multus/multus-cz97m" Jul 15 21:06:34.262654 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.234069 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8224ce90-3f8b-4562-b8ae-14f9d965f20f-ovnkube-config\") pod \"ovnkube-node-qm2hk\" (UID: \"8224ce90-3f8b-4562-b8ae-14f9d965f20f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:06:34.328430 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.234109 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/790d9bc9-5d2c-4c27-b89e-78aaa7feb547-multus-cni-dir\") pod \"multus-cz97m\" (UID: \"790d9bc9-5d2c-4c27-b89e-78aaa7feb547\") " pod="openshift-multus/multus-cz97m" Jul 15 21:06:34.328430 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.234134 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/790d9bc9-5d2c-4c27-b89e-78aaa7feb547-etc-kubernetes\") pod \"multus-cz97m\" (UID: \"790d9bc9-5d2c-4c27-b89e-78aaa7feb547\") " pod="openshift-multus/multus-cz97m" Jul 15 21:06:34.328430 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.234157 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8224ce90-3f8b-4562-b8ae-14f9d965f20f-host-run-ovn-kubernetes\") pod \"ovnkube-node-qm2hk\" (UID: \"8224ce90-3f8b-4562-b8ae-14f9d965f20f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:06:34.328430 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.234193 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2e956ca6-aae2-482a-a1d6-6b904a4e0551-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7plx5\" (UID: \"2e956ca6-aae2-482a-a1d6-6b904a4e0551\") " pod="openshift-multus/multus-additional-cni-plugins-7plx5" Jul 15 21:06:34.328430 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.234219 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8224ce90-3f8b-4562-b8ae-14f9d965f20f-systemd-units\") pod \"ovnkube-node-qm2hk\" (UID: \"8224ce90-3f8b-4562-b8ae-14f9d965f20f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:06:34.328430 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.234257 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8224ce90-3f8b-4562-b8ae-14f9d965f20f-run-systemd\") pod \"ovnkube-node-qm2hk\" (UID: \"8224ce90-3f8b-4562-b8ae-14f9d965f20f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:06:34.328430 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.234280 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8224ce90-3f8b-4562-b8ae-14f9d965f20f-node-log\") pod \"ovnkube-node-qm2hk\" (UID: \"8224ce90-3f8b-4562-b8ae-14f9d965f20f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:06:34.328430 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.234305 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/27d65c91-f6b1-4e9f-bd7e-2f723aa38707-iptables-alerter-script\") pod \"iptables-alerter-rq7ns\" (UID: \"27d65c91-f6b1-4e9f-bd7e-2f723aa38707\") " pod="openshift-network-operator/iptables-alerter-rq7ns" Jul 15 21:06:34.328430 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.234334 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9a3fc2a3-52d8-4ac3-99be-a76046969eaf-etc-sysctl-d\") pod \"tuned-hz4sl\" (UID: \"9a3fc2a3-52d8-4ac3-99be-a76046969eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-hz4sl" Jul 15 21:06:34.328430 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.234358 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9a3fc2a3-52d8-4ac3-99be-a76046969eaf-etc-sysctl-conf\") pod \"tuned-hz4sl\" (UID: \"9a3fc2a3-52d8-4ac3-99be-a76046969eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-hz4sl" Jul 15 21:06:34.328430 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.234382 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9a3fc2a3-52d8-4ac3-99be-a76046969eaf-lib-modules\") pod \"tuned-hz4sl\" (UID: \"9a3fc2a3-52d8-4ac3-99be-a76046969eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-hz4sl" Jul 15 21:06:34.328430 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.234411 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8e4f36da-9604-422b-a4b8-35e40e711b19-konnectivity-ca\") pod \"konnectivity-agent-tsgc7\" (UID: \"8e4f36da-9604-422b-a4b8-35e40e711b19\") " pod="kube-system/konnectivity-agent-tsgc7" Jul 15 21:06:34.328430 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.234415 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2e956ca6-aae2-482a-a1d6-6b904a4e0551-os-release\") pod \"multus-additional-cni-plugins-7plx5\" (UID: \"2e956ca6-aae2-482a-a1d6-6b904a4e0551\") " pod="openshift-multus/multus-additional-cni-plugins-7plx5" Jul 15 21:06:34.328430 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.234500 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2e956ca6-aae2-482a-a1d6-6b904a4e0551-os-release\") pod \"multus-additional-cni-plugins-7plx5\" (UID: \"2e956ca6-aae2-482a-a1d6-6b904a4e0551\") " pod="openshift-multus/multus-additional-cni-plugins-7plx5" Jul 15 21:06:34.329487 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.234515 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2e956ca6-aae2-482a-a1d6-6b904a4e0551-cni-binary-copy\") pod \"multus-additional-cni-plugins-7plx5\" (UID: \"2e956ca6-aae2-482a-a1d6-6b904a4e0551\") " pod="openshift-multus/multus-additional-cni-plugins-7plx5" Jul 15 21:06:34.329487 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.234564 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e956ca6-aae2-482a-a1d6-6b904a4e0551-system-cni-dir\") pod \"multus-additional-cni-plugins-7plx5\" (UID: \"2e956ca6-aae2-482a-a1d6-6b904a4e0551\") " pod="openshift-multus/multus-additional-cni-plugins-7plx5" Jul 15 21:06:34.329487 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.234870 2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 15 21:06:34.329487 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.235112 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2e956ca6-aae2-482a-a1d6-6b904a4e0551-cni-binary-copy\") pod \"multus-additional-cni-plugins-7plx5\" (UID: \"2e956ca6-aae2-482a-a1d6-6b904a4e0551\") " pod="openshift-multus/multus-additional-cni-plugins-7plx5" Jul 15 21:06:34.329487 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.235158 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/790d9bc9-5d2c-4c27-b89e-78aaa7feb547-os-release\") pod \"multus-cz97m\" (UID: \"790d9bc9-5d2c-4c27-b89e-78aaa7feb547\") " pod="openshift-multus/multus-cz97m" Jul 15 21:06:34.329487 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.235160 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/99025321-ebf4-4a9b-8a53-f7aa16cf9d3d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dsgwz\" (UID: \"99025321-ebf4-4a9b-8a53-f7aa16cf9d3d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsgwz" Jul 15 21:06:34.329487 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.235196 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2e956ca6-aae2-482a-a1d6-6b904a4e0551-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7plx5\" (UID: \"2e956ca6-aae2-482a-a1d6-6b904a4e0551\") " pod="openshift-multus/multus-additional-cni-plugins-7plx5" Jul 15 21:06:34.329487 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.235214 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f12efede-b144-4c22-9e44-0990b6bb00af-dbus\") pod \"global-pull-secret-syncer-6n6hw\" (UID: \"f12efede-b144-4c22-9e44-0990b6bb00af\") " pod="kube-system/global-pull-secret-syncer-6n6hw" Jul 15 21:06:34.329487 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.235239 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/99025321-ebf4-4a9b-8a53-f7aa16cf9d3d-sys-fs\") pod \"aws-ebs-csi-driver-node-dsgwz\" (UID: \"99025321-ebf4-4a9b-8a53-f7aa16cf9d3d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsgwz" Jul 15 21:06:34.329487 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.235261 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d657a4a7-22b8-4894-9ed2-89d76c9d3465-hosts-file\") pod \"node-resolver-dggdr\" (UID: \"d657a4a7-22b8-4894-9ed2-89d76c9d3465\") " pod="openshift-dns/node-resolver-dggdr" Jul 15 21:06:34.329487 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.235304 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpq85\" (UniqueName: \"kubernetes.io/projected/2e956ca6-aae2-482a-a1d6-6b904a4e0551-kube-api-access-gpq85\") pod \"multus-additional-cni-plugins-7plx5\" (UID: \"2e956ca6-aae2-482a-a1d6-6b904a4e0551\") " pod="openshift-multus/multus-additional-cni-plugins-7plx5" Jul 15 21:06:34.329487 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.235352 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/790d9bc9-5d2c-4c27-b89e-78aaa7feb547-host-var-lib-cni-bin\") pod \"multus-cz97m\" (UID: \"790d9bc9-5d2c-4c27-b89e-78aaa7feb547\") " pod="openshift-multus/multus-cz97m" Jul 15 21:06:34.329487 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.235437 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8224ce90-3f8b-4562-b8ae-14f9d965f20f-etc-openvswitch\") pod \"ovnkube-node-qm2hk\" (UID: \"8224ce90-3f8b-4562-b8ae-14f9d965f20f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:06:34.329487 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.235481 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8224ce90-3f8b-4562-b8ae-14f9d965f20f-host-cni-bin\") pod \"ovnkube-node-qm2hk\" (UID: \"8224ce90-3f8b-4562-b8ae-14f9d965f20f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:06:34.330889 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.235512 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8224ce90-3f8b-4562-b8ae-14f9d965f20f-ovnkube-script-lib\") pod \"ovnkube-node-qm2hk\" (UID: \"8224ce90-3f8b-4562-b8ae-14f9d965f20f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:06:34.330889 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.235541 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a3fc2a3-52d8-4ac3-99be-a76046969eaf-var-lib-kubelet\") pod \"tuned-hz4sl\" (UID: \"9a3fc2a3-52d8-4ac3-99be-a76046969eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-hz4sl" Jul 15 21:06:34.330889 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.235572 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb2ca919-f019-4882-af3c-a6f2c6544aef-metrics-certs\") pod \"network-metrics-daemon-4bt89\" (UID: \"cb2ca919-f019-4882-af3c-a6f2c6544aef\") " pod="openshift-multus/network-metrics-daemon-4bt89" Jul 15 21:06:34.330889 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.235590 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2e956ca6-aae2-482a-a1d6-6b904a4e0551-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7plx5\" (UID: \"2e956ca6-aae2-482a-a1d6-6b904a4e0551\") " pod="openshift-multus/multus-additional-cni-plugins-7plx5" Jul 15 21:06:34.330889 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.235611 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/790d9bc9-5d2c-4c27-b89e-78aaa7feb547-host-run-k8s-cni-cncf-io\") pod \"multus-cz97m\" (UID: \"790d9bc9-5d2c-4c27-b89e-78aaa7feb547\") " pod="openshift-multus/multus-cz97m" Jul 15 21:06:34.330889 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.235635 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/31546197-e89f-42c3-a787-577e1441d466-host\") pod \"node-ca-lr7lm\" (UID: \"31546197-e89f-42c3-a787-577e1441d466\") " pod="openshift-image-registry/node-ca-lr7lm" Jul 15 21:06:34.330889 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.235656 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8224ce90-3f8b-4562-b8ae-14f9d965f20f-host-slash\") pod \"ovnkube-node-qm2hk\" (UID: \"8224ce90-3f8b-4562-b8ae-14f9d965f20f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:06:34.330889 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.235682 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8224ce90-3f8b-4562-b8ae-14f9d965f20f-host-run-netns\") pod \"ovnkube-node-qm2hk\" (UID: \"8224ce90-3f8b-4562-b8ae-14f9d965f20f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:06:34.330889 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.235704 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/99025321-ebf4-4a9b-8a53-f7aa16cf9d3d-socket-dir\") pod \"aws-ebs-csi-driver-node-dsgwz\" (UID: \"99025321-ebf4-4a9b-8a53-f7aa16cf9d3d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsgwz" Jul 15 21:06:34.330889 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:34.235715 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:06:34.330889 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.235840 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/99025321-ebf4-4a9b-8a53-f7aa16cf9d3d-socket-dir\") pod \"aws-ebs-csi-driver-node-dsgwz\" (UID: \"99025321-ebf4-4a9b-8a53-f7aa16cf9d3d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsgwz" Jul 15 21:06:34.330889 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.235726 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8224ce90-3f8b-4562-b8ae-14f9d965f20f-var-lib-openvswitch\") pod \"ovnkube-node-qm2hk\" (UID: \"8224ce90-3f8b-4562-b8ae-14f9d965f20f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:06:34.330889 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:34.235930 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb2ca919-f019-4882-af3c-a6f2c6544aef-metrics-certs podName:cb2ca919-f019-4882-af3c-a6f2c6544aef nodeName:}" failed. No retries permitted until 2026-07-15 21:06:34.735892012 +0000 UTC m=+2.986317147 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb2ca919-f019-4882-af3c-a6f2c6544aef-metrics-certs") pod "network-metrics-daemon-4bt89" (UID: "cb2ca919-f019-4882-af3c-a6f2c6544aef") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:06:34.330889 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.235975 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prvc8\" (UniqueName: \"kubernetes.io/projected/8224ce90-3f8b-4562-b8ae-14f9d965f20f-kube-api-access-prvc8\") pod \"ovnkube-node-qm2hk\" (UID: \"8224ce90-3f8b-4562-b8ae-14f9d965f20f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:06:34.332322 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.236008 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f12efede-b144-4c22-9e44-0990b6bb00af-kubelet-config\") pod \"global-pull-secret-syncer-6n6hw\" (UID: \"f12efede-b144-4c22-9e44-0990b6bb00af\") " pod="kube-system/global-pull-secret-syncer-6n6hw" Jul 15 21:06:34.332322 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.236030 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9a3fc2a3-52d8-4ac3-99be-a76046969eaf-run\") pod \"tuned-hz4sl\" (UID: \"9a3fc2a3-52d8-4ac3-99be-a76046969eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-hz4sl" Jul 15 21:06:34.332322 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.236050 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9a3fc2a3-52d8-4ac3-99be-a76046969eaf-sys\") pod \"tuned-hz4sl\" (UID: \"9a3fc2a3-52d8-4ac3-99be-a76046969eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-hz4sl" Jul 15 21:06:34.332322 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.236069 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9a3fc2a3-52d8-4ac3-99be-a76046969eaf-host\") pod \"tuned-hz4sl\" (UID: \"9a3fc2a3-52d8-4ac3-99be-a76046969eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-hz4sl" Jul 15 21:06:34.332322 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.236098 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2e956ca6-aae2-482a-a1d6-6b904a4e0551-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7plx5\" (UID: \"2e956ca6-aae2-482a-a1d6-6b904a4e0551\") " pod="openshift-multus/multus-additional-cni-plugins-7plx5" Jul 15 21:06:34.332322 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.236154 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/99025321-ebf4-4a9b-8a53-f7aa16cf9d3d-registration-dir\") pod \"aws-ebs-csi-driver-node-dsgwz\" (UID: \"99025321-ebf4-4a9b-8a53-f7aa16cf9d3d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsgwz" Jul 15 21:06:34.332322 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.236180 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8224ce90-3f8b-4562-b8ae-14f9d965f20f-run-ovn\") pod \"ovnkube-node-qm2hk\" (UID: \"8224ce90-3f8b-4562-b8ae-14f9d965f20f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:06:34.332322 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.236211 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8224ce90-3f8b-4562-b8ae-14f9d965f20f-log-socket\") pod \"ovnkube-node-qm2hk\" (UID: \"8224ce90-3f8b-4562-b8ae-14f9d965f20f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:06:34.332322 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.236234 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9a3fc2a3-52d8-4ac3-99be-a76046969eaf-tmp\") pod \"tuned-hz4sl\" (UID: \"9a3fc2a3-52d8-4ac3-99be-a76046969eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-hz4sl" Jul 15 21:06:34.332322 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.236261 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/99025321-ebf4-4a9b-8a53-f7aa16cf9d3d-etc-selinux\") pod \"aws-ebs-csi-driver-node-dsgwz\" (UID: \"99025321-ebf4-4a9b-8a53-f7aa16cf9d3d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsgwz" Jul 15 21:06:34.332322 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.236286 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfhd9\" (UniqueName: \"kubernetes.io/projected/99025321-ebf4-4a9b-8a53-f7aa16cf9d3d-kube-api-access-gfhd9\") pod \"aws-ebs-csi-driver-node-dsgwz\" (UID: \"99025321-ebf4-4a9b-8a53-f7aa16cf9d3d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsgwz" Jul 15 21:06:34.332322 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.236313 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/790d9bc9-5d2c-4c27-b89e-78aaa7feb547-host-var-lib-cni-multus\") pod \"multus-cz97m\" (UID: \"790d9bc9-5d2c-4c27-b89e-78aaa7feb547\") " pod="openshift-multus/multus-cz97m" Jul 15 21:06:34.332322 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.236344 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8224ce90-3f8b-4562-b8ae-14f9d965f20f-host-kubelet\") pod \"ovnkube-node-qm2hk\" (UID: \"8224ce90-3f8b-4562-b8ae-14f9d965f20f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:06:34.332322 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.236404 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zxr4\" (UniqueName: \"kubernetes.io/projected/d657a4a7-22b8-4894-9ed2-89d76c9d3465-kube-api-access-6zxr4\") pod \"node-resolver-dggdr\" (UID: \"d657a4a7-22b8-4894-9ed2-89d76c9d3465\") " pod="openshift-dns/node-resolver-dggdr" Jul 15 21:06:34.333011 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.236428 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/99025321-ebf4-4a9b-8a53-f7aa16cf9d3d-registration-dir\") pod \"aws-ebs-csi-driver-node-dsgwz\" (UID: \"99025321-ebf4-4a9b-8a53-f7aa16cf9d3d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsgwz" Jul 15 21:06:34.333011 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.236432 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/790d9bc9-5d2c-4c27-b89e-78aaa7feb547-multus-socket-dir-parent\") pod \"multus-cz97m\" (UID: \"790d9bc9-5d2c-4c27-b89e-78aaa7feb547\") " pod="openshift-multus/multus-cz97m" Jul 15 21:06:34.333011 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.236465 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/790d9bc9-5d2c-4c27-b89e-78aaa7feb547-host-run-multus-certs\") pod \"multus-cz97m\" (UID: \"790d9bc9-5d2c-4c27-b89e-78aaa7feb547\") " pod="openshift-multus/multus-cz97m" Jul 15 21:06:34.333011 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.236543 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/99025321-ebf4-4a9b-8a53-f7aa16cf9d3d-etc-selinux\") pod \"aws-ebs-csi-driver-node-dsgwz\" (UID: \"99025321-ebf4-4a9b-8a53-f7aa16cf9d3d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsgwz" Jul 15 21:06:34.333011 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.236575 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/31546197-e89f-42c3-a787-577e1441d466-serviceca\") pod \"node-ca-lr7lm\" (UID: \"31546197-e89f-42c3-a787-577e1441d466\") " pod="openshift-image-registry/node-ca-lr7lm" Jul 15 21:06:34.333011 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.236632 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7d6nt\" (UniqueName: \"kubernetes.io/projected/31546197-e89f-42c3-a787-577e1441d466-kube-api-access-7d6nt\") pod \"node-ca-lr7lm\" (UID: \"31546197-e89f-42c3-a787-577e1441d466\") " pod="openshift-image-registry/node-ca-lr7lm" Jul 15 21:06:34.333011 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.236676 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvdw7\" (UniqueName: \"kubernetes.io/projected/5a785f71-60da-4c64-b6bb-6c2abb587a4f-kube-api-access-cvdw7\") pod \"network-check-target-zzmkh\" (UID: \"5a785f71-60da-4c64-b6bb-6c2abb587a4f\") " pod="openshift-network-diagnostics/network-check-target-zzmkh" Jul 15 21:06:34.333011 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.236747 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8224ce90-3f8b-4562-b8ae-14f9d965f20f-ovn-node-metrics-cert\") pod \"ovnkube-node-qm2hk\" (UID: \"8224ce90-3f8b-4562-b8ae-14f9d965f20f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:06:34.333011 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.236777 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9a3fc2a3-52d8-4ac3-99be-a76046969eaf-etc-sysconfig\") pod \"tuned-hz4sl\" (UID: \"9a3fc2a3-52d8-4ac3-99be-a76046969eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-hz4sl" Jul 15 21:06:34.333011 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.236817 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/790d9bc9-5d2c-4c27-b89e-78aaa7feb547-cnibin\") pod \"multus-cz97m\" (UID: \"790d9bc9-5d2c-4c27-b89e-78aaa7feb547\") " pod="openshift-multus/multus-cz97m" Jul 15 21:06:34.333011 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.236842 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8224ce90-3f8b-4562-b8ae-14f9d965f20f-run-openvswitch\") pod \"ovnkube-node-qm2hk\" (UID: \"8224ce90-3f8b-4562-b8ae-14f9d965f20f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:06:34.333011 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.236887 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9a3fc2a3-52d8-4ac3-99be-a76046969eaf-etc-systemd\") pod \"tuned-hz4sl\" (UID: \"9a3fc2a3-52d8-4ac3-99be-a76046969eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-hz4sl" Jul 15 21:06:34.333011 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.236919 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kz2z7\" (UniqueName: \"kubernetes.io/projected/9a3fc2a3-52d8-4ac3-99be-a76046969eaf-kube-api-access-kz2z7\") pod \"tuned-hz4sl\" (UID: \"9a3fc2a3-52d8-4ac3-99be-a76046969eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-hz4sl" Jul 15 21:06:34.333011 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.236958 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/790d9bc9-5d2c-4c27-b89e-78aaa7feb547-host-run-netns\") pod \"multus-cz97m\" (UID: \"790d9bc9-5d2c-4c27-b89e-78aaa7feb547\") " pod="openshift-multus/multus-cz97m" Jul 15 21:06:34.334192 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.236996 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/790d9bc9-5d2c-4c27-b89e-78aaa7feb547-host-var-lib-kubelet\") pod \"multus-cz97m\" (UID: \"790d9bc9-5d2c-4c27-b89e-78aaa7feb547\") " pod="openshift-multus/multus-cz97m" Jul 15 21:06:34.334192 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.237031 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8224ce90-3f8b-4562-b8ae-14f9d965f20f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qm2hk\" (UID: \"8224ce90-3f8b-4562-b8ae-14f9d965f20f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:06:34.334192 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.237044 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2e956ca6-aae2-482a-a1d6-6b904a4e0551-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7plx5\" (UID: \"2e956ca6-aae2-482a-a1d6-6b904a4e0551\") " pod="openshift-multus/multus-additional-cni-plugins-7plx5" Jul 15 21:06:34.334192 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.237067 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8224ce90-3f8b-4562-b8ae-14f9d965f20f-env-overrides\") pod \"ovnkube-node-qm2hk\" (UID: \"8224ce90-3f8b-4562-b8ae-14f9d965f20f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:06:34.334192 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.237092 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/27d65c91-f6b1-4e9f-bd7e-2f723aa38707-host-slash\") pod \"iptables-alerter-rq7ns\" (UID: \"27d65c91-f6b1-4e9f-bd7e-2f723aa38707\") " pod="openshift-network-operator/iptables-alerter-rq7ns" Jul 15 21:06:34.334192 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.237134 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f12efede-b144-4c22-9e44-0990b6bb00af-original-pull-secret\") pod \"global-pull-secret-syncer-6n6hw\" (UID: \"f12efede-b144-4c22-9e44-0990b6bb00af\") " pod="kube-system/global-pull-secret-syncer-6n6hw" Jul 15 21:06:34.334192 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.237185 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2e956ca6-aae2-482a-a1d6-6b904a4e0551-cnibin\") pod \"multus-additional-cni-plugins-7plx5\" (UID: \"2e956ca6-aae2-482a-a1d6-6b904a4e0551\") " pod="openshift-multus/multus-additional-cni-plugins-7plx5" Jul 15 21:06:34.334192 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.237219 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hftrd\" (UniqueName: \"kubernetes.io/projected/cb2ca919-f019-4882-af3c-a6f2c6544aef-kube-api-access-hftrd\") pod \"network-metrics-daemon-4bt89\" (UID: \"cb2ca919-f019-4882-af3c-a6f2c6544aef\") " pod="openshift-multus/network-metrics-daemon-4bt89" Jul 15 21:06:34.334192 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.237244 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/99025321-ebf4-4a9b-8a53-f7aa16cf9d3d-device-dir\") pod \"aws-ebs-csi-driver-node-dsgwz\" (UID: \"99025321-ebf4-4a9b-8a53-f7aa16cf9d3d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsgwz" Jul 15 21:06:34.334192 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.237280 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a3fc2a3-52d8-4ac3-99be-a76046969eaf-etc-kubernetes\") pod \"tuned-hz4sl\" (UID: \"9a3fc2a3-52d8-4ac3-99be-a76046969eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-hz4sl" Jul 15 21:06:34.334192 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.237295 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2e956ca6-aae2-482a-a1d6-6b904a4e0551-cnibin\") pod \"multus-additional-cni-plugins-7plx5\" (UID: \"2e956ca6-aae2-482a-a1d6-6b904a4e0551\") " pod="openshift-multus/multus-additional-cni-plugins-7plx5" Jul 15 21:06:34.334192 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.237316 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/790d9bc9-5d2c-4c27-b89e-78aaa7feb547-multus-daemon-config\") pod \"multus-cz97m\" (UID: \"790d9bc9-5d2c-4c27-b89e-78aaa7feb547\") " pod="openshift-multus/multus-cz97m" Jul 15 21:06:34.334192 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.237320 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/99025321-ebf4-4a9b-8a53-f7aa16cf9d3d-device-dir\") pod \"aws-ebs-csi-driver-node-dsgwz\" (UID: \"99025321-ebf4-4a9b-8a53-f7aa16cf9d3d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsgwz" Jul 15 21:06:34.334192 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.237350 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psbxl\" (UniqueName: \"kubernetes.io/projected/790d9bc9-5d2c-4c27-b89e-78aaa7feb547-kube-api-access-psbxl\") pod \"multus-cz97m\" (UID: \"790d9bc9-5d2c-4c27-b89e-78aaa7feb547\") " pod="openshift-multus/multus-cz97m" Jul 15 21:06:34.334926 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.237404 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8224ce90-3f8b-4562-b8ae-14f9d965f20f-host-cni-netd\") pod \"ovnkube-node-qm2hk\" (UID: \"8224ce90-3f8b-4562-b8ae-14f9d965f20f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:06:34.334926 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.237437 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9a3fc2a3-52d8-4ac3-99be-a76046969eaf-etc-tuned\") pod \"tuned-hz4sl\" (UID: \"9a3fc2a3-52d8-4ac3-99be-a76046969eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-hz4sl" Jul 15 21:06:34.334926 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.239108 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8e4f36da-9604-422b-a4b8-35e40e711b19-agent-certs\") pod \"konnectivity-agent-tsgc7\" (UID: \"8e4f36da-9604-422b-a4b8-35e40e711b19\") " pod="kube-system/konnectivity-agent-tsgc7" Jul 15 21:06:34.334926 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.245763 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpq85\" (UniqueName: \"kubernetes.io/projected/2e956ca6-aae2-482a-a1d6-6b904a4e0551-kube-api-access-gpq85\") pod \"multus-additional-cni-plugins-7plx5\" (UID: \"2e956ca6-aae2-482a-a1d6-6b904a4e0551\") " pod="openshift-multus/multus-additional-cni-plugins-7plx5" Jul 15 21:06:34.334926 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.247317 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfhd9\" (UniqueName: \"kubernetes.io/projected/99025321-ebf4-4a9b-8a53-f7aa16cf9d3d-kube-api-access-gfhd9\") pod \"aws-ebs-csi-driver-node-dsgwz\" (UID: \"99025321-ebf4-4a9b-8a53-f7aa16cf9d3d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsgwz" Jul 15 21:06:34.334926 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.247506 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hftrd\" (UniqueName: \"kubernetes.io/projected/cb2ca919-f019-4882-af3c-a6f2c6544aef-kube-api-access-hftrd\") pod \"network-metrics-daemon-4bt89\" (UID: \"cb2ca919-f019-4882-af3c-a6f2c6544aef\") " pod="openshift-multus/network-metrics-daemon-4bt89" Jul 15 21:06:34.339581 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.338456 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/790d9bc9-5d2c-4c27-b89e-78aaa7feb547-multus-socket-dir-parent\") pod \"multus-cz97m\" (UID: \"790d9bc9-5d2c-4c27-b89e-78aaa7feb547\") " pod="openshift-multus/multus-cz97m" Jul 15 21:06:34.339581 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.338501 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/790d9bc9-5d2c-4c27-b89e-78aaa7feb547-host-run-multus-certs\") pod \"multus-cz97m\" (UID: \"790d9bc9-5d2c-4c27-b89e-78aaa7feb547\") " pod="openshift-multus/multus-cz97m" Jul 15 21:06:34.339581 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.338524 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/31546197-e89f-42c3-a787-577e1441d466-serviceca\") pod \"node-ca-lr7lm\" (UID: \"31546197-e89f-42c3-a787-577e1441d466\") " pod="openshift-image-registry/node-ca-lr7lm" Jul 15 21:06:34.339581 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.338554 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7d6nt\" (UniqueName: \"kubernetes.io/projected/31546197-e89f-42c3-a787-577e1441d466-kube-api-access-7d6nt\") pod \"node-ca-lr7lm\" (UID: \"31546197-e89f-42c3-a787-577e1441d466\") " pod="openshift-image-registry/node-ca-lr7lm" Jul 15 21:06:34.339581 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.338580 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvdw7\" (UniqueName: \"kubernetes.io/projected/5a785f71-60da-4c64-b6bb-6c2abb587a4f-kube-api-access-cvdw7\") pod \"network-check-target-zzmkh\" (UID: \"5a785f71-60da-4c64-b6bb-6c2abb587a4f\") " pod="openshift-network-diagnostics/network-check-target-zzmkh" Jul 15 21:06:34.339581 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.338607 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8224ce90-3f8b-4562-b8ae-14f9d965f20f-ovn-node-metrics-cert\") pod \"ovnkube-node-qm2hk\" (UID: \"8224ce90-3f8b-4562-b8ae-14f9d965f20f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:06:34.339581 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.338630 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9a3fc2a3-52d8-4ac3-99be-a76046969eaf-etc-sysconfig\") pod \"tuned-hz4sl\" (UID: \"9a3fc2a3-52d8-4ac3-99be-a76046969eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-hz4sl" Jul 15 21:06:34.339581 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.338655 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/790d9bc9-5d2c-4c27-b89e-78aaa7feb547-cnibin\") pod \"multus-cz97m\" (UID: \"790d9bc9-5d2c-4c27-b89e-78aaa7feb547\") " pod="openshift-multus/multus-cz97m" Jul 15 21:06:34.339581 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.338679 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8224ce90-3f8b-4562-b8ae-14f9d965f20f-run-openvswitch\") pod \"ovnkube-node-qm2hk\" (UID: \"8224ce90-3f8b-4562-b8ae-14f9d965f20f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:06:34.339581 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.338705 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9a3fc2a3-52d8-4ac3-99be-a76046969eaf-etc-systemd\") pod \"tuned-hz4sl\" (UID: \"9a3fc2a3-52d8-4ac3-99be-a76046969eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-hz4sl" Jul 15 21:06:34.339581 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.338730 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kz2z7\" (UniqueName: \"kubernetes.io/projected/9a3fc2a3-52d8-4ac3-99be-a76046969eaf-kube-api-access-kz2z7\") pod \"tuned-hz4sl\" (UID: \"9a3fc2a3-52d8-4ac3-99be-a76046969eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-hz4sl" Jul 15 21:06:34.339581 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.338863 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/790d9bc9-5d2c-4c27-b89e-78aaa7feb547-cnibin\") pod \"multus-cz97m\" (UID: \"790d9bc9-5d2c-4c27-b89e-78aaa7feb547\") " pod="openshift-multus/multus-cz97m" Jul 15 21:06:34.339581 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.338988 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9a3fc2a3-52d8-4ac3-99be-a76046969eaf-etc-systemd\") pod \"tuned-hz4sl\" (UID: \"9a3fc2a3-52d8-4ac3-99be-a76046969eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-hz4sl" Jul 15 21:06:34.339581 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.339000 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9a3fc2a3-52d8-4ac3-99be-a76046969eaf-etc-sysconfig\") pod \"tuned-hz4sl\" (UID: \"9a3fc2a3-52d8-4ac3-99be-a76046969eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-hz4sl" Jul 15 21:06:34.339581 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.339041 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8224ce90-3f8b-4562-b8ae-14f9d965f20f-run-openvswitch\") pod \"ovnkube-node-qm2hk\" (UID: \"8224ce90-3f8b-4562-b8ae-14f9d965f20f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:06:34.340493 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.339047 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/790d9bc9-5d2c-4c27-b89e-78aaa7feb547-host-run-netns\") pod \"multus-cz97m\" (UID: \"790d9bc9-5d2c-4c27-b89e-78aaa7feb547\") " pod="openshift-multus/multus-cz97m" Jul 15 21:06:34.340493 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.339084 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/790d9bc9-5d2c-4c27-b89e-78aaa7feb547-host-var-lib-kubelet\") pod \"multus-cz97m\" (UID: \"790d9bc9-5d2c-4c27-b89e-78aaa7feb547\") " pod="openshift-multus/multus-cz97m" Jul 15 21:06:34.340493 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.339161 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8224ce90-3f8b-4562-b8ae-14f9d965f20f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qm2hk\" (UID: \"8224ce90-3f8b-4562-b8ae-14f9d965f20f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:06:34.340493 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.339224 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/790d9bc9-5d2c-4c27-b89e-78aaa7feb547-host-run-netns\") pod \"multus-cz97m\" (UID: \"790d9bc9-5d2c-4c27-b89e-78aaa7feb547\") " pod="openshift-multus/multus-cz97m" Jul 15 21:06:34.340493 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.339277 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/790d9bc9-5d2c-4c27-b89e-78aaa7feb547-host-var-lib-kubelet\") pod \"multus-cz97m\" (UID: \"790d9bc9-5d2c-4c27-b89e-78aaa7feb547\") " pod="openshift-multus/multus-cz97m" Jul 15 21:06:34.340493 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.339113 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8224ce90-3f8b-4562-b8ae-14f9d965f20f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qm2hk\" (UID: \"8224ce90-3f8b-4562-b8ae-14f9d965f20f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:06:34.340493 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.339331 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8224ce90-3f8b-4562-b8ae-14f9d965f20f-env-overrides\") pod \"ovnkube-node-qm2hk\" (UID: \"8224ce90-3f8b-4562-b8ae-14f9d965f20f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:06:34.340493 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.339364 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/27d65c91-f6b1-4e9f-bd7e-2f723aa38707-host-slash\") pod \"iptables-alerter-rq7ns\" (UID: \"27d65c91-f6b1-4e9f-bd7e-2f723aa38707\") " pod="openshift-network-operator/iptables-alerter-rq7ns" Jul 15 21:06:34.340493 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.339408 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f12efede-b144-4c22-9e44-0990b6bb00af-original-pull-secret\") pod \"global-pull-secret-syncer-6n6hw\" (UID: \"f12efede-b144-4c22-9e44-0990b6bb00af\") " pod="kube-system/global-pull-secret-syncer-6n6hw" Jul 15 21:06:34.340493 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.339445 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a3fc2a3-52d8-4ac3-99be-a76046969eaf-etc-kubernetes\") pod \"tuned-hz4sl\" (UID: \"9a3fc2a3-52d8-4ac3-99be-a76046969eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-hz4sl" Jul 15 21:06:34.340493 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.340074 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/27d65c91-f6b1-4e9f-bd7e-2f723aa38707-host-slash\") pod \"iptables-alerter-rq7ns\" (UID: \"27d65c91-f6b1-4e9f-bd7e-2f723aa38707\") " pod="openshift-network-operator/iptables-alerter-rq7ns" Jul 15 21:06:34.340493 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.340139 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/790d9bc9-5d2c-4c27-b89e-78aaa7feb547-multus-daemon-config\") pod \"multus-cz97m\" (UID: \"790d9bc9-5d2c-4c27-b89e-78aaa7feb547\") " pod="openshift-multus/multus-cz97m" Jul 15 21:06:34.340493 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:34.340177 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 21:06:34.340493 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.340246 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a3fc2a3-52d8-4ac3-99be-a76046969eaf-etc-kubernetes\") pod \"tuned-hz4sl\" (UID: \"9a3fc2a3-52d8-4ac3-99be-a76046969eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-hz4sl" Jul 15 21:06:34.341164 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.340780 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/790d9bc9-5d2c-4c27-b89e-78aaa7feb547-multus-daemon-config\") pod \"multus-cz97m\" (UID: \"790d9bc9-5d2c-4c27-b89e-78aaa7feb547\") " pod="openshift-multus/multus-cz97m" Jul 15 21:06:34.341164 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:34.340817 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f12efede-b144-4c22-9e44-0990b6bb00af-original-pull-secret podName:f12efede-b144-4c22-9e44-0990b6bb00af nodeName:}" failed. No retries permitted until 2026-07-15 21:06:34.840542055 +0000 UTC m=+3.090967182 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f12efede-b144-4c22-9e44-0990b6bb00af-original-pull-secret") pod "global-pull-secret-syncer-6n6hw" (UID: "f12efede-b144-4c22-9e44-0990b6bb00af") : object "kube-system"/"original-pull-secret" not registered Jul 15 21:06:34.341164 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.340854 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psbxl\" (UniqueName: \"kubernetes.io/projected/790d9bc9-5d2c-4c27-b89e-78aaa7feb547-kube-api-access-psbxl\") pod \"multus-cz97m\" (UID: \"790d9bc9-5d2c-4c27-b89e-78aaa7feb547\") " pod="openshift-multus/multus-cz97m" Jul 15 21:06:34.341164 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.340892 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8224ce90-3f8b-4562-b8ae-14f9d965f20f-host-cni-netd\") pod \"ovnkube-node-qm2hk\" (UID: \"8224ce90-3f8b-4562-b8ae-14f9d965f20f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:06:34.341164 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.341146 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/790d9bc9-5d2c-4c27-b89e-78aaa7feb547-multus-socket-dir-parent\") pod \"multus-cz97m\" (UID: \"790d9bc9-5d2c-4c27-b89e-78aaa7feb547\") " pod="openshift-multus/multus-cz97m" Jul 15 21:06:34.341445 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.341223 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/790d9bc9-5d2c-4c27-b89e-78aaa7feb547-host-run-multus-certs\") pod \"multus-cz97m\" (UID: \"790d9bc9-5d2c-4c27-b89e-78aaa7feb547\") " pod="openshift-multus/multus-cz97m" Jul 15 21:06:34.341445 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.341296 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9a3fc2a3-52d8-4ac3-99be-a76046969eaf-etc-tuned\") pod \"tuned-hz4sl\" (UID: \"9a3fc2a3-52d8-4ac3-99be-a76046969eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-hz4sl" Jul 15 21:06:34.341445 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.341338 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d657a4a7-22b8-4894-9ed2-89d76c9d3465-tmp-dir\") pod \"node-resolver-dggdr\" (UID: \"d657a4a7-22b8-4894-9ed2-89d76c9d3465\") " pod="openshift-dns/node-resolver-dggdr" Jul 15 21:06:34.341445 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.341389 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/790d9bc9-5d2c-4c27-b89e-78aaa7feb547-system-cni-dir\") pod \"multus-cz97m\" (UID: \"790d9bc9-5d2c-4c27-b89e-78aaa7feb547\") " pod="openshift-multus/multus-cz97m" Jul 15 21:06:34.341638 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.341456 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/790d9bc9-5d2c-4c27-b89e-78aaa7feb547-hostroot\") pod \"multus-cz97m\" (UID: \"790d9bc9-5d2c-4c27-b89e-78aaa7feb547\") " pod="openshift-multus/multus-cz97m" Jul 15 21:06:34.341638 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.341493 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqt8b\" (UniqueName: \"kubernetes.io/projected/27d65c91-f6b1-4e9f-bd7e-2f723aa38707-kube-api-access-gqt8b\") pod \"iptables-alerter-rq7ns\" (UID: \"27d65c91-f6b1-4e9f-bd7e-2f723aa38707\") " pod="openshift-network-operator/iptables-alerter-rq7ns" Jul 15 21:06:34.341638 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.341549 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9a3fc2a3-52d8-4ac3-99be-a76046969eaf-etc-modprobe-d\") pod \"tuned-hz4sl\" (UID: \"9a3fc2a3-52d8-4ac3-99be-a76046969eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-hz4sl" Jul 15 21:06:34.341638 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.341583 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/790d9bc9-5d2c-4c27-b89e-78aaa7feb547-cni-binary-copy\") pod \"multus-cz97m\" (UID: \"790d9bc9-5d2c-4c27-b89e-78aaa7feb547\") " pod="openshift-multus/multus-cz97m" Jul 15 21:06:34.341638 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.341618 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/790d9bc9-5d2c-4c27-b89e-78aaa7feb547-multus-conf-dir\") pod \"multus-cz97m\" (UID: \"790d9bc9-5d2c-4c27-b89e-78aaa7feb547\") " pod="openshift-multus/multus-cz97m" Jul 15 21:06:34.341890 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.341663 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/31546197-e89f-42c3-a787-577e1441d466-serviceca\") pod \"node-ca-lr7lm\" (UID: \"31546197-e89f-42c3-a787-577e1441d466\") " pod="openshift-image-registry/node-ca-lr7lm" Jul 15 21:06:34.341890 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.341669 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8224ce90-3f8b-4562-b8ae-14f9d965f20f-ovnkube-config\") pod \"ovnkube-node-qm2hk\" (UID: \"8224ce90-3f8b-4562-b8ae-14f9d965f20f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:06:34.341890 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.341740 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/790d9bc9-5d2c-4c27-b89e-78aaa7feb547-multus-cni-dir\") pod \"multus-cz97m\" (UID: \"790d9bc9-5d2c-4c27-b89e-78aaa7feb547\") " pod="openshift-multus/multus-cz97m" Jul 15 21:06:34.341890 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.341776 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/790d9bc9-5d2c-4c27-b89e-78aaa7feb547-etc-kubernetes\") pod \"multus-cz97m\" (UID: \"790d9bc9-5d2c-4c27-b89e-78aaa7feb547\") " pod="openshift-multus/multus-cz97m" Jul 15 21:06:34.341890 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.341831 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8224ce90-3f8b-4562-b8ae-14f9d965f20f-host-run-ovn-kubernetes\") pod \"ovnkube-node-qm2hk\" (UID: \"8224ce90-3f8b-4562-b8ae-14f9d965f20f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:06:34.341890 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.341843 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8224ce90-3f8b-4562-b8ae-14f9d965f20f-env-overrides\") pod \"ovnkube-node-qm2hk\" (UID: \"8224ce90-3f8b-4562-b8ae-14f9d965f20f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:06:34.341890 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.341871 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8224ce90-3f8b-4562-b8ae-14f9d965f20f-systemd-units\") pod \"ovnkube-node-qm2hk\" (UID: \"8224ce90-3f8b-4562-b8ae-14f9d965f20f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:06:34.342263 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.341908 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8224ce90-3f8b-4562-b8ae-14f9d965f20f-run-systemd\") pod \"ovnkube-node-qm2hk\" (UID: \"8224ce90-3f8b-4562-b8ae-14f9d965f20f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:06:34.342263 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.341940 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8224ce90-3f8b-4562-b8ae-14f9d965f20f-node-log\") pod \"ovnkube-node-qm2hk\" (UID: \"8224ce90-3f8b-4562-b8ae-14f9d965f20f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:06:34.342263 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.341994 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/27d65c91-f6b1-4e9f-bd7e-2f723aa38707-iptables-alerter-script\") pod \"iptables-alerter-rq7ns\" (UID: \"27d65c91-f6b1-4e9f-bd7e-2f723aa38707\") " pod="openshift-network-operator/iptables-alerter-rq7ns" Jul 15 21:06:34.342263 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.342035 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9a3fc2a3-52d8-4ac3-99be-a76046969eaf-etc-sysctl-d\") pod \"tuned-hz4sl\" (UID: \"9a3fc2a3-52d8-4ac3-99be-a76046969eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-hz4sl" Jul 15 21:06:34.342263 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.342073 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9a3fc2a3-52d8-4ac3-99be-a76046969eaf-etc-sysctl-conf\") pod \"tuned-hz4sl\" (UID: \"9a3fc2a3-52d8-4ac3-99be-a76046969eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-hz4sl" Jul 15 21:06:34.342263 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.342105 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9a3fc2a3-52d8-4ac3-99be-a76046969eaf-lib-modules\") pod \"tuned-hz4sl\" (UID: \"9a3fc2a3-52d8-4ac3-99be-a76046969eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-hz4sl" Jul 15 21:06:34.342263 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.342137 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/790d9bc9-5d2c-4c27-b89e-78aaa7feb547-os-release\") pod \"multus-cz97m\" (UID: \"790d9bc9-5d2c-4c27-b89e-78aaa7feb547\") " pod="openshift-multus/multus-cz97m" Jul 15 21:06:34.342263 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.342170 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f12efede-b144-4c22-9e44-0990b6bb00af-dbus\") pod \"global-pull-secret-syncer-6n6hw\" (UID: \"f12efede-b144-4c22-9e44-0990b6bb00af\") " pod="kube-system/global-pull-secret-syncer-6n6hw" Jul 15 21:06:34.342661 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.342278 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8224ce90-3f8b-4562-b8ae-14f9d965f20f-host-cni-netd\") pod \"ovnkube-node-qm2hk\" (UID: \"8224ce90-3f8b-4562-b8ae-14f9d965f20f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:06:34.342661 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.342285 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/790d9bc9-5d2c-4c27-b89e-78aaa7feb547-etc-kubernetes\") pod \"multus-cz97m\" (UID: \"790d9bc9-5d2c-4c27-b89e-78aaa7feb547\") " pod="openshift-multus/multus-cz97m" Jul 15 21:06:34.342661 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.342607 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9a3fc2a3-52d8-4ac3-99be-a76046969eaf-etc-sysctl-conf\") pod \"tuned-hz4sl\" (UID: \"9a3fc2a3-52d8-4ac3-99be-a76046969eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-hz4sl" Jul 15 21:06:34.342866 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.342737 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9a3fc2a3-52d8-4ac3-99be-a76046969eaf-etc-sysctl-d\") pod \"tuned-hz4sl\" (UID: \"9a3fc2a3-52d8-4ac3-99be-a76046969eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-hz4sl" Jul 15 21:06:34.342866 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.342825 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/790d9bc9-5d2c-4c27-b89e-78aaa7feb547-os-release\") pod \"multus-cz97m\" (UID: \"790d9bc9-5d2c-4c27-b89e-78aaa7feb547\") " pod="openshift-multus/multus-cz97m" Jul 15 21:06:34.343164 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.342872 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9a3fc2a3-52d8-4ac3-99be-a76046969eaf-lib-modules\") pod \"tuned-hz4sl\" (UID: \"9a3fc2a3-52d8-4ac3-99be-a76046969eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-hz4sl" Jul 15 21:06:34.343164 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.342943 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8224ce90-3f8b-4562-b8ae-14f9d965f20f-systemd-units\") pod \"ovnkube-node-qm2hk\" (UID: \"8224ce90-3f8b-4562-b8ae-14f9d965f20f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:06:34.343164 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.342882 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8224ce90-3f8b-4562-b8ae-14f9d965f20f-run-systemd\") pod \"ovnkube-node-qm2hk\" (UID: \"8224ce90-3f8b-4562-b8ae-14f9d965f20f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:06:34.343164 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.342955 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8224ce90-3f8b-4562-b8ae-14f9d965f20f-ovnkube-config\") pod \"ovnkube-node-qm2hk\" (UID: \"8224ce90-3f8b-4562-b8ae-14f9d965f20f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:06:34.343164 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.342947 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8224ce90-3f8b-4562-b8ae-14f9d965f20f-node-log\") pod \"ovnkube-node-qm2hk\" (UID: \"8224ce90-3f8b-4562-b8ae-14f9d965f20f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:06:34.343921 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.343581 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/790d9bc9-5d2c-4c27-b89e-78aaa7feb547-multus-conf-dir\") pod \"multus-cz97m\" (UID: \"790d9bc9-5d2c-4c27-b89e-78aaa7feb547\") " pod="openshift-multus/multus-cz97m" Jul 15 21:06:34.343921 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.343672 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9a3fc2a3-52d8-4ac3-99be-a76046969eaf-etc-modprobe-d\") pod \"tuned-hz4sl\" (UID: \"9a3fc2a3-52d8-4ac3-99be-a76046969eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-hz4sl" Jul 15 21:06:34.343921 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.343709 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/27d65c91-f6b1-4e9f-bd7e-2f723aa38707-iptables-alerter-script\") pod \"iptables-alerter-rq7ns\" (UID: \"27d65c91-f6b1-4e9f-bd7e-2f723aa38707\") " pod="openshift-network-operator/iptables-alerter-rq7ns" Jul 15 21:06:34.344164 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.344086 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8224ce90-3f8b-4562-b8ae-14f9d965f20f-host-run-ovn-kubernetes\") pod \"ovnkube-node-qm2hk\" (UID: \"8224ce90-3f8b-4562-b8ae-14f9d965f20f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:06:34.344164 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.344137 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/790d9bc9-5d2c-4c27-b89e-78aaa7feb547-multus-cni-dir\") pod \"multus-cz97m\" (UID: \"790d9bc9-5d2c-4c27-b89e-78aaa7feb547\") " pod="openshift-multus/multus-cz97m" Jul 15 21:06:34.344243 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.344176 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/790d9bc9-5d2c-4c27-b89e-78aaa7feb547-cni-binary-copy\") pod \"multus-cz97m\" (UID: \"790d9bc9-5d2c-4c27-b89e-78aaa7feb547\") " pod="openshift-multus/multus-cz97m" Jul 15 21:06:34.344243 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.344185 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f12efede-b144-4c22-9e44-0990b6bb00af-dbus\") pod \"global-pull-secret-syncer-6n6hw\" (UID: \"f12efede-b144-4c22-9e44-0990b6bb00af\") " pod="kube-system/global-pull-secret-syncer-6n6hw" Jul 15 21:06:34.344243 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.344205 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/790d9bc9-5d2c-4c27-b89e-78aaa7feb547-system-cni-dir\") pod \"multus-cz97m\" (UID: \"790d9bc9-5d2c-4c27-b89e-78aaa7feb547\") " pod="openshift-multus/multus-cz97m" Jul 15 21:06:34.344359 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.344245 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/790d9bc9-5d2c-4c27-b89e-78aaa7feb547-hostroot\") pod \"multus-cz97m\" (UID: \"790d9bc9-5d2c-4c27-b89e-78aaa7feb547\") " pod="openshift-multus/multus-cz97m" Jul 15 21:06:34.344359 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.344264 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d657a4a7-22b8-4894-9ed2-89d76c9d3465-hosts-file\") pod \"node-resolver-dggdr\" (UID: \"d657a4a7-22b8-4894-9ed2-89d76c9d3465\") " pod="openshift-dns/node-resolver-dggdr" Jul 15 21:06:34.344359 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.344302 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/790d9bc9-5d2c-4c27-b89e-78aaa7feb547-host-var-lib-cni-bin\") pod \"multus-cz97m\" (UID: \"790d9bc9-5d2c-4c27-b89e-78aaa7feb547\") " pod="openshift-multus/multus-cz97m" Jul 15 21:06:34.344939 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.344356 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/790d9bc9-5d2c-4c27-b89e-78aaa7feb547-host-var-lib-cni-bin\") pod \"multus-cz97m\" (UID: \"790d9bc9-5d2c-4c27-b89e-78aaa7feb547\") " pod="openshift-multus/multus-cz97m" Jul 15 21:06:34.344939 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.344356 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d657a4a7-22b8-4894-9ed2-89d76c9d3465-hosts-file\") pod \"node-resolver-dggdr\" (UID: \"d657a4a7-22b8-4894-9ed2-89d76c9d3465\") " pod="openshift-dns/node-resolver-dggdr" Jul 15 21:06:34.344939 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.344385 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8224ce90-3f8b-4562-b8ae-14f9d965f20f-etc-openvswitch\") pod \"ovnkube-node-qm2hk\" (UID: \"8224ce90-3f8b-4562-b8ae-14f9d965f20f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:06:34.344939 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.344415 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8224ce90-3f8b-4562-b8ae-14f9d965f20f-host-cni-bin\") pod \"ovnkube-node-qm2hk\" (UID: \"8224ce90-3f8b-4562-b8ae-14f9d965f20f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:06:34.344939 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.344434 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d657a4a7-22b8-4894-9ed2-89d76c9d3465-tmp-dir\") pod \"node-resolver-dggdr\" (UID: \"d657a4a7-22b8-4894-9ed2-89d76c9d3465\") " pod="openshift-dns/node-resolver-dggdr" Jul 15 21:06:34.344939 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.344444 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8224ce90-3f8b-4562-b8ae-14f9d965f20f-ovnkube-script-lib\") pod \"ovnkube-node-qm2hk\" (UID: \"8224ce90-3f8b-4562-b8ae-14f9d965f20f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:06:34.344939 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.344473 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a3fc2a3-52d8-4ac3-99be-a76046969eaf-var-lib-kubelet\") pod \"tuned-hz4sl\" (UID: \"9a3fc2a3-52d8-4ac3-99be-a76046969eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-hz4sl" Jul 15 21:06:34.344939 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.344508 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8224ce90-3f8b-4562-b8ae-14f9d965f20f-etc-openvswitch\") pod \"ovnkube-node-qm2hk\" (UID: \"8224ce90-3f8b-4562-b8ae-14f9d965f20f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:06:34.344939 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.344513 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/790d9bc9-5d2c-4c27-b89e-78aaa7feb547-host-run-k8s-cni-cncf-io\") pod \"multus-cz97m\" (UID: \"790d9bc9-5d2c-4c27-b89e-78aaa7feb547\") " pod="openshift-multus/multus-cz97m" Jul 15 21:06:34.344939 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.344520 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8224ce90-3f8b-4562-b8ae-14f9d965f20f-host-cni-bin\") pod \"ovnkube-node-qm2hk\" (UID: \"8224ce90-3f8b-4562-b8ae-14f9d965f20f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:06:34.344939 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.344548 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/790d9bc9-5d2c-4c27-b89e-78aaa7feb547-host-run-k8s-cni-cncf-io\") pod \"multus-cz97m\" (UID: \"790d9bc9-5d2c-4c27-b89e-78aaa7feb547\") " pod="openshift-multus/multus-cz97m" Jul 15 21:06:34.344939 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.344554 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/31546197-e89f-42c3-a787-577e1441d466-host\") pod \"node-ca-lr7lm\" (UID: \"31546197-e89f-42c3-a787-577e1441d466\") " pod="openshift-image-registry/node-ca-lr7lm" Jul 15 21:06:34.344939 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.344588 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8224ce90-3f8b-4562-b8ae-14f9d965f20f-host-slash\") pod \"ovnkube-node-qm2hk\" (UID: \"8224ce90-3f8b-4562-b8ae-14f9d965f20f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:06:34.344939 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.344602 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/31546197-e89f-42c3-a787-577e1441d466-host\") pod \"node-ca-lr7lm\" (UID: \"31546197-e89f-42c3-a787-577e1441d466\") " pod="openshift-image-registry/node-ca-lr7lm" Jul 15 21:06:34.344939 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.344636 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8224ce90-3f8b-4562-b8ae-14f9d965f20f-host-slash\") pod \"ovnkube-node-qm2hk\" (UID: \"8224ce90-3f8b-4562-b8ae-14f9d965f20f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:06:34.346116 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.344663 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a3fc2a3-52d8-4ac3-99be-a76046969eaf-var-lib-kubelet\") pod \"tuned-hz4sl\" (UID: \"9a3fc2a3-52d8-4ac3-99be-a76046969eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-hz4sl" Jul 15 21:06:34.346116 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.344669 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8224ce90-3f8b-4562-b8ae-14f9d965f20f-host-run-netns\") pod \"ovnkube-node-qm2hk\" (UID: \"8224ce90-3f8b-4562-b8ae-14f9d965f20f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:06:34.346116 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.344707 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8224ce90-3f8b-4562-b8ae-14f9d965f20f-var-lib-openvswitch\") pod \"ovnkube-node-qm2hk\" (UID: \"8224ce90-3f8b-4562-b8ae-14f9d965f20f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:06:34.346116 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.344747 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8224ce90-3f8b-4562-b8ae-14f9d965f20f-host-run-netns\") pod \"ovnkube-node-qm2hk\" (UID: \"8224ce90-3f8b-4562-b8ae-14f9d965f20f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:06:34.346116 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.344803 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8224ce90-3f8b-4562-b8ae-14f9d965f20f-var-lib-openvswitch\") pod \"ovnkube-node-qm2hk\" (UID: \"8224ce90-3f8b-4562-b8ae-14f9d965f20f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:06:34.346116 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.344836 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prvc8\" (UniqueName: \"kubernetes.io/projected/8224ce90-3f8b-4562-b8ae-14f9d965f20f-kube-api-access-prvc8\") pod \"ovnkube-node-qm2hk\" (UID: \"8224ce90-3f8b-4562-b8ae-14f9d965f20f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:06:34.346116 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.344876 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f12efede-b144-4c22-9e44-0990b6bb00af-kubelet-config\") pod \"global-pull-secret-syncer-6n6hw\" (UID: \"f12efede-b144-4c22-9e44-0990b6bb00af\") " pod="kube-system/global-pull-secret-syncer-6n6hw" Jul 15 21:06:34.346116 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.344912 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9a3fc2a3-52d8-4ac3-99be-a76046969eaf-run\") pod \"tuned-hz4sl\" (UID: \"9a3fc2a3-52d8-4ac3-99be-a76046969eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-hz4sl" Jul 15 21:06:34.346116 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.344943 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9a3fc2a3-52d8-4ac3-99be-a76046969eaf-sys\") pod \"tuned-hz4sl\" (UID: \"9a3fc2a3-52d8-4ac3-99be-a76046969eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-hz4sl" Jul 15 21:06:34.346116 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.344977 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9a3fc2a3-52d8-4ac3-99be-a76046969eaf-host\") pod \"tuned-hz4sl\" (UID: \"9a3fc2a3-52d8-4ac3-99be-a76046969eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-hz4sl" Jul 15 21:06:34.346116 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.345012 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8224ce90-3f8b-4562-b8ae-14f9d965f20f-run-ovn\") pod \"ovnkube-node-qm2hk\" (UID: \"8224ce90-3f8b-4562-b8ae-14f9d965f20f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:06:34.346116 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.345047 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8224ce90-3f8b-4562-b8ae-14f9d965f20f-log-socket\") pod \"ovnkube-node-qm2hk\" (UID: \"8224ce90-3f8b-4562-b8ae-14f9d965f20f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:06:34.346116 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.345072 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8224ce90-3f8b-4562-b8ae-14f9d965f20f-ovnkube-script-lib\") pod \"ovnkube-node-qm2hk\" (UID: \"8224ce90-3f8b-4562-b8ae-14f9d965f20f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:06:34.346116 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.345101 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9a3fc2a3-52d8-4ac3-99be-a76046969eaf-run\") pod \"tuned-hz4sl\" (UID: \"9a3fc2a3-52d8-4ac3-99be-a76046969eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-hz4sl" Jul 15 21:06:34.346116 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.345107 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8224ce90-3f8b-4562-b8ae-14f9d965f20f-log-socket\") pod \"ovnkube-node-qm2hk\" (UID: \"8224ce90-3f8b-4562-b8ae-14f9d965f20f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:06:34.346723 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.345172 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9a3fc2a3-52d8-4ac3-99be-a76046969eaf-tmp\") pod \"tuned-hz4sl\" (UID: \"9a3fc2a3-52d8-4ac3-99be-a76046969eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-hz4sl" Jul 15 21:06:34.346723 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.345206 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/790d9bc9-5d2c-4c27-b89e-78aaa7feb547-host-var-lib-cni-multus\") pod \"multus-cz97m\" (UID: \"790d9bc9-5d2c-4c27-b89e-78aaa7feb547\") " pod="openshift-multus/multus-cz97m" Jul 15 21:06:34.346723 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.345233 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8224ce90-3f8b-4562-b8ae-14f9d965f20f-host-kubelet\") pod \"ovnkube-node-qm2hk\" (UID: \"8224ce90-3f8b-4562-b8ae-14f9d965f20f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:06:34.346723 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.345262 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zxr4\" (UniqueName: \"kubernetes.io/projected/d657a4a7-22b8-4894-9ed2-89d76c9d3465-kube-api-access-6zxr4\") pod \"node-resolver-dggdr\" (UID: \"d657a4a7-22b8-4894-9ed2-89d76c9d3465\") " pod="openshift-dns/node-resolver-dggdr" Jul 15 21:06:34.346723 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.345356 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8224ce90-3f8b-4562-b8ae-14f9d965f20f-run-ovn\") pod \"ovnkube-node-qm2hk\" (UID: \"8224ce90-3f8b-4562-b8ae-14f9d965f20f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:06:34.346723 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.345377 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/790d9bc9-5d2c-4c27-b89e-78aaa7feb547-host-var-lib-cni-multus\") pod \"multus-cz97m\" (UID: \"790d9bc9-5d2c-4c27-b89e-78aaa7feb547\") " pod="openshift-multus/multus-cz97m" Jul 15 21:06:34.346723 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.345382 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9a3fc2a3-52d8-4ac3-99be-a76046969eaf-sys\") pod \"tuned-hz4sl\" (UID: \"9a3fc2a3-52d8-4ac3-99be-a76046969eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-hz4sl" Jul 15 21:06:34.346723 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.345431 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f12efede-b144-4c22-9e44-0990b6bb00af-kubelet-config\") pod \"global-pull-secret-syncer-6n6hw\" (UID: \"f12efede-b144-4c22-9e44-0990b6bb00af\") " pod="kube-system/global-pull-secret-syncer-6n6hw" Jul 15 21:06:34.346723 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.345443 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8224ce90-3f8b-4562-b8ae-14f9d965f20f-host-kubelet\") pod \"ovnkube-node-qm2hk\" (UID: \"8224ce90-3f8b-4562-b8ae-14f9d965f20f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:06:34.346723 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.345502 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9a3fc2a3-52d8-4ac3-99be-a76046969eaf-host\") pod \"tuned-hz4sl\" (UID: \"9a3fc2a3-52d8-4ac3-99be-a76046969eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-hz4sl" Jul 15 21:06:34.351542 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:34.351408 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 21:06:34.351542 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:34.351432 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 21:06:34.351542 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:34.351447 2577 projected.go:196] Error preparing data for projected volume kube-api-access-cvdw7 for pod openshift-network-diagnostics/network-check-target-zzmkh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:06:34.351542 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:34.351519 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5a785f71-60da-4c64-b6bb-6c2abb587a4f-kube-api-access-cvdw7 podName:5a785f71-60da-4c64-b6bb-6c2abb587a4f nodeName:}" failed. No retries permitted until 2026-07-15 21:06:34.851499848 +0000 UTC m=+3.101924974 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-cvdw7" (UniqueName: "kubernetes.io/projected/5a785f71-60da-4c64-b6bb-6c2abb587a4f-kube-api-access-cvdw7") pod "network-check-target-zzmkh" (UID: "5a785f71-60da-4c64-b6bb-6c2abb587a4f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:06:34.360947 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.354541 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9a3fc2a3-52d8-4ac3-99be-a76046969eaf-etc-tuned\") pod \"tuned-hz4sl\" (UID: \"9a3fc2a3-52d8-4ac3-99be-a76046969eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-hz4sl" Jul 15 21:06:34.360947 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.355598 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kz2z7\" (UniqueName: \"kubernetes.io/projected/9a3fc2a3-52d8-4ac3-99be-a76046969eaf-kube-api-access-kz2z7\") pod \"tuned-hz4sl\" (UID: \"9a3fc2a3-52d8-4ac3-99be-a76046969eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-hz4sl" Jul 15 21:06:34.360947 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.355873 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-psbxl\" (UniqueName: \"kubernetes.io/projected/790d9bc9-5d2c-4c27-b89e-78aaa7feb547-kube-api-access-psbxl\") pod \"multus-cz97m\" (UID: \"790d9bc9-5d2c-4c27-b89e-78aaa7feb547\") " pod="openshift-multus/multus-cz97m" Jul 15 21:06:34.360947 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.355961 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8224ce90-3f8b-4562-b8ae-14f9d965f20f-ovn-node-metrics-cert\") pod \"ovnkube-node-qm2hk\" (UID: \"8224ce90-3f8b-4562-b8ae-14f9d965f20f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:06:34.360947 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.359522 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-46.ec2.internal" event={"ID":"62c84c35e765c98395b0bedc3e26a159","Type":"ContainerStarted","Data":"cbd20acf3ba2ca6424bb682f42ca42b95dd6f78648e91ef3cf56b1f039f21cb4"} Jul 15 21:06:34.363021 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.361900 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9a3fc2a3-52d8-4ac3-99be-a76046969eaf-tmp\") pod \"tuned-hz4sl\" (UID: \"9a3fc2a3-52d8-4ac3-99be-a76046969eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-hz4sl" Jul 15 21:06:34.363021 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.362323 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7d6nt\" (UniqueName: \"kubernetes.io/projected/31546197-e89f-42c3-a787-577e1441d466-kube-api-access-7d6nt\") pod \"node-ca-lr7lm\" (UID: \"31546197-e89f-42c3-a787-577e1441d466\") " pod="openshift-image-registry/node-ca-lr7lm" Jul 15 21:06:34.363021 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.362448 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-prvc8\" (UniqueName: \"kubernetes.io/projected/8224ce90-3f8b-4562-b8ae-14f9d965f20f-kube-api-access-prvc8\") pod \"ovnkube-node-qm2hk\" (UID: \"8224ce90-3f8b-4562-b8ae-14f9d965f20f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:06:34.364019 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.363784 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-46.ec2.internal" event={"ID":"b1f0b417ff2ce60419276782687d4a52","Type":"ContainerStarted","Data":"09e54c71eda08ba1c49c35bed694d85563bb6f7124fabc2076f960a62052ff80"} Jul 15 21:06:34.364019 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.363951 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqt8b\" (UniqueName: \"kubernetes.io/projected/27d65c91-f6b1-4e9f-bd7e-2f723aa38707-kube-api-access-gqt8b\") pod \"iptables-alerter-rq7ns\" (UID: \"27d65c91-f6b1-4e9f-bd7e-2f723aa38707\") " pod="openshift-network-operator/iptables-alerter-rq7ns" Jul 15 21:06:34.370910 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.370856 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zxr4\" (UniqueName: \"kubernetes.io/projected/d657a4a7-22b8-4894-9ed2-89d76c9d3465-kube-api-access-6zxr4\") pod \"node-resolver-dggdr\" (UID: \"d657a4a7-22b8-4894-9ed2-89d76c9d3465\") " pod="openshift-dns/node-resolver-dggdr" Jul 15 21:06:34.427673 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.427590 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7plx5" Jul 15 21:06:34.437462 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.437346 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tsgc7" Jul 15 21:06:34.441547 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:34.441518 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e956ca6_aae2_482a_a1d6_6b904a4e0551.slice/crio-102a0f0bd33e00e1ac4a4314b2e45a21ad7c15a5abc95f601dd54c8620bc4229 WatchSource:0}: Error finding container 102a0f0bd33e00e1ac4a4314b2e45a21ad7c15a5abc95f601dd54c8620bc4229: Status 404 returned error can't find the container with id 102a0f0bd33e00e1ac4a4314b2e45a21ad7c15a5abc95f601dd54c8620bc4229 Jul 15 21:06:34.446876 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.446744 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsgwz" Jul 15 21:06:34.447992 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:34.447764 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e4f36da_9604_422b_a4b8_35e40e711b19.slice/crio-6c23bae47eeea44d5f047ae5d4d5a8d440b42c7c4c99e28e56815c9b70bdba38 WatchSource:0}: Error finding container 6c23bae47eeea44d5f047ae5d4d5a8d440b42c7c4c99e28e56815c9b70bdba38: Status 404 returned error can't find the container with id 6c23bae47eeea44d5f047ae5d4d5a8d440b42c7c4c99e28e56815c9b70bdba38 Jul 15 21:06:34.457266 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:34.457237 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99025321_ebf4_4a9b_8a53_f7aa16cf9d3d.slice/crio-1fa015df940959d0e26534ea9387d683b18022bf4733eceba6b27a7cf007ab54 WatchSource:0}: Error finding container 1fa015df940959d0e26534ea9387d683b18022bf4733eceba6b27a7cf007ab54: Status 404 returned error can't find the container with id 1fa015df940959d0e26534ea9387d683b18022bf4733eceba6b27a7cf007ab54 Jul 15 21:06:34.458734 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.458457 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dggdr" Jul 15 21:06:34.469838 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.469400 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:06:34.470949 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:34.470920 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd657a4a7_22b8_4894_9ed2_89d76c9d3465.slice/crio-b79dff1ff8e96a4106d2ea97d363fe044b7da6ff58950ea1adf5d4cb3d854830 WatchSource:0}: Error finding container b79dff1ff8e96a4106d2ea97d363fe044b7da6ff58950ea1adf5d4cb3d854830: Status 404 returned error can't find the container with id b79dff1ff8e96a4106d2ea97d363fe044b7da6ff58950ea1adf5d4cb3d854830 Jul 15 21:06:34.480689 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:34.480661 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8224ce90_3f8b_4562_b8ae_14f9d965f20f.slice/crio-a16adbab9c67eb39823760fb16e9184f783b509750b94691d92c12e95c9182f1 WatchSource:0}: Error finding container a16adbab9c67eb39823760fb16e9184f783b509750b94691d92c12e95c9182f1: Status 404 returned error can't find the container with id a16adbab9c67eb39823760fb16e9184f783b509750b94691d92c12e95c9182f1 Jul 15 21:06:34.481861 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.481802 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 21:06:34.489118 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.489095 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rq7ns" Jul 15 21:06:34.496598 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.496577 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cz97m" Jul 15 21:06:34.498927 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:34.498901 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27d65c91_f6b1_4e9f_bd7e_2f723aa38707.slice/crio-a32d7189359eae2a50570fde9f6451ca5df42e34a0a63ee4b1387c070f3c439d WatchSource:0}: Error finding container a32d7189359eae2a50570fde9f6451ca5df42e34a0a63ee4b1387c070f3c439d: Status 404 returned error can't find the container with id a32d7189359eae2a50570fde9f6451ca5df42e34a0a63ee4b1387c070f3c439d Jul 15 21:06:34.506375 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.506353 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hz4sl" Jul 15 21:06:34.506782 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:34.506758 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod790d9bc9_5d2c_4c27_b89e_78aaa7feb547.slice/crio-ac0a100b14c59bdcc81038b3bb21c428a24f4448f777fcd98ab8d42ad741ece1 WatchSource:0}: Error finding container ac0a100b14c59bdcc81038b3bb21c428a24f4448f777fcd98ab8d42ad741ece1: Status 404 returned error can't find the container with id ac0a100b14c59bdcc81038b3bb21c428a24f4448f777fcd98ab8d42ad741ece1 Jul 15 21:06:34.511788 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.511732 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lr7lm" Jul 15 21:06:34.519260 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:34.519226 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a3fc2a3_52d8_4ac3_99be_a76046969eaf.slice/crio-332eebbaa2872d2dc1fb76c2e950b9d7f0a04fb84143dc5fc2ce74bb7d422c6e WatchSource:0}: Error finding container 332eebbaa2872d2dc1fb76c2e950b9d7f0a04fb84143dc5fc2ce74bb7d422c6e: Status 404 returned error can't find the container with id 332eebbaa2872d2dc1fb76c2e950b9d7f0a04fb84143dc5fc2ce74bb7d422c6e Jul 15 21:06:34.524348 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:06:34.524324 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31546197_e89f_42c3_a787_577e1441d466.slice/crio-a03fc6715d472a51f565d715583afb585ca71c85a56e948ffe5260e7cb069ed6 WatchSource:0}: Error finding container a03fc6715d472a51f565d715583afb585ca71c85a56e948ffe5260e7cb069ed6: Status 404 returned error can't find the container with id a03fc6715d472a51f565d715583afb585ca71c85a56e948ffe5260e7cb069ed6 Jul 15 21:06:34.748521 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.748439 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb2ca919-f019-4882-af3c-a6f2c6544aef-metrics-certs\") pod \"network-metrics-daemon-4bt89\" (UID: \"cb2ca919-f019-4882-af3c-a6f2c6544aef\") " pod="openshift-multus/network-metrics-daemon-4bt89" Jul 15 21:06:34.748675 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:34.748567 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:06:34.748675 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:34.748625 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb2ca919-f019-4882-af3c-a6f2c6544aef-metrics-certs podName:cb2ca919-f019-4882-af3c-a6f2c6544aef nodeName:}" failed. No retries permitted until 2026-07-15 21:06:35.748610383 +0000 UTC m=+3.999035494 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb2ca919-f019-4882-af3c-a6f2c6544aef-metrics-certs") pod "network-metrics-daemon-4bt89" (UID: "cb2ca919-f019-4882-af3c-a6f2c6544aef") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:06:34.849414 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.849378 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f12efede-b144-4c22-9e44-0990b6bb00af-original-pull-secret\") pod \"global-pull-secret-syncer-6n6hw\" (UID: \"f12efede-b144-4c22-9e44-0990b6bb00af\") " pod="kube-system/global-pull-secret-syncer-6n6hw" Jul 15 21:06:34.849594 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:34.849569 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 21:06:34.849686 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:34.849662 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f12efede-b144-4c22-9e44-0990b6bb00af-original-pull-secret podName:f12efede-b144-4c22-9e44-0990b6bb00af nodeName:}" failed. No retries permitted until 2026-07-15 21:06:35.849637549 +0000 UTC m=+4.100062670 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f12efede-b144-4c22-9e44-0990b6bb00af-original-pull-secret") pod "global-pull-secret-syncer-6n6hw" (UID: "f12efede-b144-4c22-9e44-0990b6bb00af") : object "kube-system"/"original-pull-secret" not registered Jul 15 21:06:34.949993 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:34.949951 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvdw7\" (UniqueName: \"kubernetes.io/projected/5a785f71-60da-4c64-b6bb-6c2abb587a4f-kube-api-access-cvdw7\") pod \"network-check-target-zzmkh\" (UID: \"5a785f71-60da-4c64-b6bb-6c2abb587a4f\") " pod="openshift-network-diagnostics/network-check-target-zzmkh" Jul 15 21:06:34.950146 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:34.950130 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 21:06:34.950200 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:34.950153 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 21:06:34.950200 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:34.950168 2577 projected.go:196] Error preparing data for projected volume kube-api-access-cvdw7 for pod openshift-network-diagnostics/network-check-target-zzmkh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:06:34.950292 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:34.950225 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5a785f71-60da-4c64-b6bb-6c2abb587a4f-kube-api-access-cvdw7 podName:5a785f71-60da-4c64-b6bb-6c2abb587a4f nodeName:}" failed. No retries permitted until 2026-07-15 21:06:35.950210207 +0000 UTC m=+4.200635326 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-cvdw7" (UniqueName: "kubernetes.io/projected/5a785f71-60da-4c64-b6bb-6c2abb587a4f-kube-api-access-cvdw7") pod "network-check-target-zzmkh" (UID: "5a785f71-60da-4c64-b6bb-6c2abb587a4f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:06:35.177913 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:35.177869 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 21:01:34 +0000 UTC" deadline="2028-04-18 15:45:06.957629788 +0000 UTC" Jul 15 21:06:35.177913 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:35.177911 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15426h38m31.779723759s" Jul 15 21:06:35.334215 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:35.334173 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzmkh" Jul 15 21:06:35.334872 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:35.334321 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzmkh" podUID="5a785f71-60da-4c64-b6bb-6c2abb587a4f" Jul 15 21:06:35.367958 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:35.367921 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7plx5" event={"ID":"2e956ca6-aae2-482a-a1d6-6b904a4e0551","Type":"ContainerStarted","Data":"102a0f0bd33e00e1ac4a4314b2e45a21ad7c15a5abc95f601dd54c8620bc4229"} Jul 15 21:06:35.369326 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:35.369294 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lr7lm" event={"ID":"31546197-e89f-42c3-a787-577e1441d466","Type":"ContainerStarted","Data":"a03fc6715d472a51f565d715583afb585ca71c85a56e948ffe5260e7cb069ed6"} Jul 15 21:06:35.370598 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:35.370558 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hz4sl" event={"ID":"9a3fc2a3-52d8-4ac3-99be-a76046969eaf","Type":"ContainerStarted","Data":"332eebbaa2872d2dc1fb76c2e950b9d7f0a04fb84143dc5fc2ce74bb7d422c6e"} Jul 15 21:06:35.372030 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:35.371980 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cz97m" event={"ID":"790d9bc9-5d2c-4c27-b89e-78aaa7feb547","Type":"ContainerStarted","Data":"ac0a100b14c59bdcc81038b3bb21c428a24f4448f777fcd98ab8d42ad741ece1"} Jul 15 21:06:35.373313 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:35.373287 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rq7ns" event={"ID":"27d65c91-f6b1-4e9f-bd7e-2f723aa38707","Type":"ContainerStarted","Data":"a32d7189359eae2a50570fde9f6451ca5df42e34a0a63ee4b1387c070f3c439d"} Jul 15 21:06:35.375005 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:35.374983 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" event={"ID":"8224ce90-3f8b-4562-b8ae-14f9d965f20f","Type":"ContainerStarted","Data":"a16adbab9c67eb39823760fb16e9184f783b509750b94691d92c12e95c9182f1"} Jul 15 21:06:35.376505 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:35.376472 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dggdr" event={"ID":"d657a4a7-22b8-4894-9ed2-89d76c9d3465","Type":"ContainerStarted","Data":"b79dff1ff8e96a4106d2ea97d363fe044b7da6ff58950ea1adf5d4cb3d854830"} Jul 15 21:06:35.378173 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:35.378147 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tsgc7" event={"ID":"8e4f36da-9604-422b-a4b8-35e40e711b19","Type":"ContainerStarted","Data":"6c23bae47eeea44d5f047ae5d4d5a8d440b42c7c4c99e28e56815c9b70bdba38"} Jul 15 21:06:35.379789 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:35.379733 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsgwz" event={"ID":"99025321-ebf4-4a9b-8a53-f7aa16cf9d3d","Type":"ContainerStarted","Data":"1fa015df940959d0e26534ea9387d683b18022bf4733eceba6b27a7cf007ab54"} Jul 15 21:06:35.757684 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:35.757053 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb2ca919-f019-4882-af3c-a6f2c6544aef-metrics-certs\") pod \"network-metrics-daemon-4bt89\" (UID: \"cb2ca919-f019-4882-af3c-a6f2c6544aef\") " pod="openshift-multus/network-metrics-daemon-4bt89" Jul 15 21:06:35.757684 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:35.757257 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:06:35.757684 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:35.757319 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb2ca919-f019-4882-af3c-a6f2c6544aef-metrics-certs podName:cb2ca919-f019-4882-af3c-a6f2c6544aef nodeName:}" failed. No retries permitted until 2026-07-15 21:06:37.75729888 +0000 UTC m=+6.007724006 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb2ca919-f019-4882-af3c-a6f2c6544aef-metrics-certs") pod "network-metrics-daemon-4bt89" (UID: "cb2ca919-f019-4882-af3c-a6f2c6544aef") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:06:35.858269 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:35.857564 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f12efede-b144-4c22-9e44-0990b6bb00af-original-pull-secret\") pod \"global-pull-secret-syncer-6n6hw\" (UID: \"f12efede-b144-4c22-9e44-0990b6bb00af\") " pod="kube-system/global-pull-secret-syncer-6n6hw" Jul 15 21:06:35.858269 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:35.857819 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 21:06:35.858269 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:35.857891 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f12efede-b144-4c22-9e44-0990b6bb00af-original-pull-secret podName:f12efede-b144-4c22-9e44-0990b6bb00af nodeName:}" failed. No retries permitted until 2026-07-15 21:06:37.857871753 +0000 UTC m=+6.108296880 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f12efede-b144-4c22-9e44-0990b6bb00af-original-pull-secret") pod "global-pull-secret-syncer-6n6hw" (UID: "f12efede-b144-4c22-9e44-0990b6bb00af") : object "kube-system"/"original-pull-secret" not registered Jul 15 21:06:35.958888 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:35.958258 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvdw7\" (UniqueName: \"kubernetes.io/projected/5a785f71-60da-4c64-b6bb-6c2abb587a4f-kube-api-access-cvdw7\") pod \"network-check-target-zzmkh\" (UID: \"5a785f71-60da-4c64-b6bb-6c2abb587a4f\") " pod="openshift-network-diagnostics/network-check-target-zzmkh" Jul 15 21:06:35.958888 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:35.958443 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 21:06:35.958888 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:35.958466 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 21:06:35.958888 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:35.958479 2577 projected.go:196] Error preparing data for projected volume kube-api-access-cvdw7 for pod openshift-network-diagnostics/network-check-target-zzmkh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:06:35.958888 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:35.958536 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5a785f71-60da-4c64-b6bb-6c2abb587a4f-kube-api-access-cvdw7 podName:5a785f71-60da-4c64-b6bb-6c2abb587a4f nodeName:}" failed. No retries permitted until 2026-07-15 21:06:37.958517602 +0000 UTC m=+6.208942727 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-cvdw7" (UniqueName: "kubernetes.io/projected/5a785f71-60da-4c64-b6bb-6c2abb587a4f-kube-api-access-cvdw7") pod "network-check-target-zzmkh" (UID: "5a785f71-60da-4c64-b6bb-6c2abb587a4f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:06:36.127907 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:36.127248 2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 21:06:36.178225 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:36.178190 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 21:01:34 +0000 UTC" deadline="2028-01-04 21:05:44.034570534 +0000 UTC" Jul 15 21:06:36.178316 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:36.178228 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12911h59m7.856347897s" Jul 15 21:06:36.337748 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:36.336003 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6n6hw" Jul 15 21:06:36.337748 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:36.336138 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6n6hw" podUID="f12efede-b144-4c22-9e44-0990b6bb00af" Jul 15 21:06:36.337748 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:36.336641 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bt89" Jul 15 21:06:36.337748 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:36.336767 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bt89" podUID="cb2ca919-f019-4882-af3c-a6f2c6544aef" Jul 15 21:06:36.392863 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:36.392759 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-46.ec2.internal" event={"ID":"b1f0b417ff2ce60419276782687d4a52","Type":"ContainerStarted","Data":"0c6cd2d1c326482c92417c6c03bfeac1e249753376b8b756de717f3c23c1febd"} Jul 15 21:06:37.335027 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:37.334516 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzmkh" Jul 15 21:06:37.335027 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:37.334644 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzmkh" podUID="5a785f71-60da-4c64-b6bb-6c2abb587a4f" Jul 15 21:06:37.399504 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:37.399365 2577 generic.go:356] "Generic (PLEG): container finished" podID="62c84c35e765c98395b0bedc3e26a159" containerID="3bc86dd2886daf5f6639bf07a266d55e4adb1b83cb73f7c3989531524af1220e" exitCode=0 Jul 15 21:06:37.399504 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:37.399424 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-46.ec2.internal" event={"ID":"62c84c35e765c98395b0bedc3e26a159","Type":"ContainerDied","Data":"3bc86dd2886daf5f6639bf07a266d55e4adb1b83cb73f7c3989531524af1220e"} Jul 15 21:06:37.419270 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:37.418525 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-46.ec2.internal" podStartSLOduration=4.418503754 podStartE2EDuration="4.418503754s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:06:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:06:36.413762394 +0000 UTC m=+4.664187527" watchObservedRunningTime="2026-07-15 21:06:37.418503754 +0000 UTC m=+5.668928887" Jul 15 21:06:37.774189 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:37.773537 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb2ca919-f019-4882-af3c-a6f2c6544aef-metrics-certs\") pod \"network-metrics-daemon-4bt89\" (UID: \"cb2ca919-f019-4882-af3c-a6f2c6544aef\") " pod="openshift-multus/network-metrics-daemon-4bt89" Jul 15 21:06:37.774189 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:37.773741 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:06:37.774189 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:37.773802 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb2ca919-f019-4882-af3c-a6f2c6544aef-metrics-certs podName:cb2ca919-f019-4882-af3c-a6f2c6544aef nodeName:}" failed. No retries permitted until 2026-07-15 21:06:41.773783791 +0000 UTC m=+10.024208905 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb2ca919-f019-4882-af3c-a6f2c6544aef-metrics-certs") pod "network-metrics-daemon-4bt89" (UID: "cb2ca919-f019-4882-af3c-a6f2c6544aef") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:06:37.874089 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:37.874052 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f12efede-b144-4c22-9e44-0990b6bb00af-original-pull-secret\") pod \"global-pull-secret-syncer-6n6hw\" (UID: \"f12efede-b144-4c22-9e44-0990b6bb00af\") " pod="kube-system/global-pull-secret-syncer-6n6hw" Jul 15 21:06:37.874285 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:37.874225 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 21:06:37.874342 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:37.874292 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f12efede-b144-4c22-9e44-0990b6bb00af-original-pull-secret podName:f12efede-b144-4c22-9e44-0990b6bb00af nodeName:}" failed. No retries permitted until 2026-07-15 21:06:41.874274537 +0000 UTC m=+10.124699649 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f12efede-b144-4c22-9e44-0990b6bb00af-original-pull-secret") pod "global-pull-secret-syncer-6n6hw" (UID: "f12efede-b144-4c22-9e44-0990b6bb00af") : object "kube-system"/"original-pull-secret" not registered Jul 15 21:06:37.974584 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:37.974540 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvdw7\" (UniqueName: \"kubernetes.io/projected/5a785f71-60da-4c64-b6bb-6c2abb587a4f-kube-api-access-cvdw7\") pod \"network-check-target-zzmkh\" (UID: \"5a785f71-60da-4c64-b6bb-6c2abb587a4f\") " pod="openshift-network-diagnostics/network-check-target-zzmkh" Jul 15 21:06:37.974814 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:37.974709 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 21:06:37.974814 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:37.974762 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 21:06:37.974814 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:37.974775 2577 projected.go:196] Error preparing data for projected volume kube-api-access-cvdw7 for pod openshift-network-diagnostics/network-check-target-zzmkh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:06:37.974979 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:37.974841 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5a785f71-60da-4c64-b6bb-6c2abb587a4f-kube-api-access-cvdw7 podName:5a785f71-60da-4c64-b6bb-6c2abb587a4f nodeName:}" failed. No retries permitted until 2026-07-15 21:06:41.974821423 +0000 UTC m=+10.225246535 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-cvdw7" (UniqueName: "kubernetes.io/projected/5a785f71-60da-4c64-b6bb-6c2abb587a4f-kube-api-access-cvdw7") pod "network-check-target-zzmkh" (UID: "5a785f71-60da-4c64-b6bb-6c2abb587a4f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:06:38.334459 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:38.334428 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6n6hw" Jul 15 21:06:38.334636 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:38.334563 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6n6hw" podUID="f12efede-b144-4c22-9e44-0990b6bb00af" Jul 15 21:06:38.334924 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:38.334904 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bt89" Jul 15 21:06:38.335046 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:38.335023 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bt89" podUID="cb2ca919-f019-4882-af3c-a6f2c6544aef" Jul 15 21:06:39.335509 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:39.335063 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzmkh" Jul 15 21:06:39.335509 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:39.335176 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzmkh" podUID="5a785f71-60da-4c64-b6bb-6c2abb587a4f" Jul 15 21:06:40.335547 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:40.334927 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6n6hw" Jul 15 21:06:40.335547 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:40.335059 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6n6hw" podUID="f12efede-b144-4c22-9e44-0990b6bb00af" Jul 15 21:06:40.335547 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:40.335244 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bt89" Jul 15 21:06:40.335547 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:40.335371 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bt89" podUID="cb2ca919-f019-4882-af3c-a6f2c6544aef" Jul 15 21:06:41.335224 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:41.335189 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzmkh" Jul 15 21:06:41.335375 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:41.335321 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzmkh" podUID="5a785f71-60da-4c64-b6bb-6c2abb587a4f" Jul 15 21:06:41.809283 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:41.809246 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb2ca919-f019-4882-af3c-a6f2c6544aef-metrics-certs\") pod \"network-metrics-daemon-4bt89\" (UID: \"cb2ca919-f019-4882-af3c-a6f2c6544aef\") " pod="openshift-multus/network-metrics-daemon-4bt89" Jul 15 21:06:41.809647 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:41.809397 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:06:41.809647 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:41.809462 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb2ca919-f019-4882-af3c-a6f2c6544aef-metrics-certs podName:cb2ca919-f019-4882-af3c-a6f2c6544aef nodeName:}" failed. No retries permitted until 2026-07-15 21:06:49.809443637 +0000 UTC m=+18.059868759 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb2ca919-f019-4882-af3c-a6f2c6544aef-metrics-certs") pod "network-metrics-daemon-4bt89" (UID: "cb2ca919-f019-4882-af3c-a6f2c6544aef") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:06:41.909707 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:41.909637 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f12efede-b144-4c22-9e44-0990b6bb00af-original-pull-secret\") pod \"global-pull-secret-syncer-6n6hw\" (UID: \"f12efede-b144-4c22-9e44-0990b6bb00af\") " pod="kube-system/global-pull-secret-syncer-6n6hw" Jul 15 21:06:41.909883 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:41.909794 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 21:06:41.909970 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:41.909908 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f12efede-b144-4c22-9e44-0990b6bb00af-original-pull-secret podName:f12efede-b144-4c22-9e44-0990b6bb00af nodeName:}" failed. No retries permitted until 2026-07-15 21:06:49.909886831 +0000 UTC m=+18.160311956 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f12efede-b144-4c22-9e44-0990b6bb00af-original-pull-secret") pod "global-pull-secret-syncer-6n6hw" (UID: "f12efede-b144-4c22-9e44-0990b6bb00af") : object "kube-system"/"original-pull-secret" not registered Jul 15 21:06:42.010314 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:42.010276 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvdw7\" (UniqueName: \"kubernetes.io/projected/5a785f71-60da-4c64-b6bb-6c2abb587a4f-kube-api-access-cvdw7\") pod \"network-check-target-zzmkh\" (UID: \"5a785f71-60da-4c64-b6bb-6c2abb587a4f\") " pod="openshift-network-diagnostics/network-check-target-zzmkh" Jul 15 21:06:42.010492 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:42.010444 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 21:06:42.010492 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:42.010476 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 21:06:42.010492 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:42.010489 2577 projected.go:196] Error preparing data for projected volume kube-api-access-cvdw7 for pod openshift-network-diagnostics/network-check-target-zzmkh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:06:42.010645 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:42.010551 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5a785f71-60da-4c64-b6bb-6c2abb587a4f-kube-api-access-cvdw7 podName:5a785f71-60da-4c64-b6bb-6c2abb587a4f nodeName:}" failed. No retries permitted until 2026-07-15 21:06:50.010532151 +0000 UTC m=+18.260957278 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-cvdw7" (UniqueName: "kubernetes.io/projected/5a785f71-60da-4c64-b6bb-6c2abb587a4f-kube-api-access-cvdw7") pod "network-check-target-zzmkh" (UID: "5a785f71-60da-4c64-b6bb-6c2abb587a4f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:06:42.336232 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:42.335615 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6n6hw" Jul 15 21:06:42.336232 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:42.335664 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bt89" Jul 15 21:06:42.336232 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:42.335752 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6n6hw" podUID="f12efede-b144-4c22-9e44-0990b6bb00af" Jul 15 21:06:42.336232 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:42.336190 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bt89" podUID="cb2ca919-f019-4882-af3c-a6f2c6544aef" Jul 15 21:06:43.334743 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:43.334702 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzmkh" Jul 15 21:06:43.335182 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:43.334836 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzmkh" podUID="5a785f71-60da-4c64-b6bb-6c2abb587a4f" Jul 15 21:06:44.334825 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:44.334792 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6n6hw" Jul 15 21:06:44.335266 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:44.334804 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bt89" Jul 15 21:06:44.335266 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:44.334927 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6n6hw" podUID="f12efede-b144-4c22-9e44-0990b6bb00af" Jul 15 21:06:44.335266 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:44.335033 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bt89" podUID="cb2ca919-f019-4882-af3c-a6f2c6544aef" Jul 15 21:06:45.334152 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:45.334125 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzmkh" Jul 15 21:06:45.334262 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:45.334214 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzmkh" podUID="5a785f71-60da-4c64-b6bb-6c2abb587a4f" Jul 15 21:06:46.334422 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:46.334383 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bt89" Jul 15 21:06:46.334422 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:46.334405 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6n6hw" Jul 15 21:06:46.334919 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:46.334530 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bt89" podUID="cb2ca919-f019-4882-af3c-a6f2c6544aef" Jul 15 21:06:46.334919 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:46.334612 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6n6hw" podUID="f12efede-b144-4c22-9e44-0990b6bb00af" Jul 15 21:06:47.334518 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:47.334489 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzmkh" Jul 15 21:06:47.334952 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:47.334593 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzmkh" podUID="5a785f71-60da-4c64-b6bb-6c2abb587a4f" Jul 15 21:06:48.334432 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:48.334402 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6n6hw" Jul 15 21:06:48.334595 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:48.334402 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bt89" Jul 15 21:06:48.334595 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:48.334518 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6n6hw" podUID="f12efede-b144-4c22-9e44-0990b6bb00af" Jul 15 21:06:48.335010 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:48.334610 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bt89" podUID="cb2ca919-f019-4882-af3c-a6f2c6544aef" Jul 15 21:06:49.334660 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:49.334627 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzmkh" Jul 15 21:06:49.335133 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:49.334770 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzmkh" podUID="5a785f71-60da-4c64-b6bb-6c2abb587a4f" Jul 15 21:06:49.872030 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:49.871984 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb2ca919-f019-4882-af3c-a6f2c6544aef-metrics-certs\") pod \"network-metrics-daemon-4bt89\" (UID: \"cb2ca919-f019-4882-af3c-a6f2c6544aef\") " pod="openshift-multus/network-metrics-daemon-4bt89" Jul 15 21:06:49.872204 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:49.872143 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:06:49.872252 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:49.872217 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb2ca919-f019-4882-af3c-a6f2c6544aef-metrics-certs podName:cb2ca919-f019-4882-af3c-a6f2c6544aef nodeName:}" failed. No retries permitted until 2026-07-15 21:07:05.872197206 +0000 UTC m=+34.122622320 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb2ca919-f019-4882-af3c-a6f2c6544aef-metrics-certs") pod "network-metrics-daemon-4bt89" (UID: "cb2ca919-f019-4882-af3c-a6f2c6544aef") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:06:49.972688 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:49.972644 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f12efede-b144-4c22-9e44-0990b6bb00af-original-pull-secret\") pod \"global-pull-secret-syncer-6n6hw\" (UID: \"f12efede-b144-4c22-9e44-0990b6bb00af\") " pod="kube-system/global-pull-secret-syncer-6n6hw" Jul 15 21:06:49.972839 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:49.972794 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 21:06:49.972949 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:49.972858 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f12efede-b144-4c22-9e44-0990b6bb00af-original-pull-secret podName:f12efede-b144-4c22-9e44-0990b6bb00af nodeName:}" failed. No retries permitted until 2026-07-15 21:07:05.972840078 +0000 UTC m=+34.223265192 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f12efede-b144-4c22-9e44-0990b6bb00af-original-pull-secret") pod "global-pull-secret-syncer-6n6hw" (UID: "f12efede-b144-4c22-9e44-0990b6bb00af") : object "kube-system"/"original-pull-secret" not registered Jul 15 21:06:50.073386 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:50.073357 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvdw7\" (UniqueName: \"kubernetes.io/projected/5a785f71-60da-4c64-b6bb-6c2abb587a4f-kube-api-access-cvdw7\") pod \"network-check-target-zzmkh\" (UID: \"5a785f71-60da-4c64-b6bb-6c2abb587a4f\") " pod="openshift-network-diagnostics/network-check-target-zzmkh" Jul 15 21:06:50.073543 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:50.073530 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 21:06:50.073588 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:50.073550 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 21:06:50.073588 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:50.073560 2577 projected.go:196] Error preparing data for projected volume kube-api-access-cvdw7 for pod openshift-network-diagnostics/network-check-target-zzmkh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:06:50.073692 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:50.073617 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5a785f71-60da-4c64-b6bb-6c2abb587a4f-kube-api-access-cvdw7 podName:5a785f71-60da-4c64-b6bb-6c2abb587a4f nodeName:}" failed. No retries permitted until 2026-07-15 21:07:06.073601926 +0000 UTC m=+34.324027056 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-cvdw7" (UniqueName: "kubernetes.io/projected/5a785f71-60da-4c64-b6bb-6c2abb587a4f-kube-api-access-cvdw7") pod "network-check-target-zzmkh" (UID: "5a785f71-60da-4c64-b6bb-6c2abb587a4f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:06:50.335139 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:50.335100 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6n6hw" Jul 15 21:06:50.335584 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:50.335112 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bt89" Jul 15 21:06:50.335584 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:50.335238 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6n6hw" podUID="f12efede-b144-4c22-9e44-0990b6bb00af" Jul 15 21:06:50.335584 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:50.335291 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bt89" podUID="cb2ca919-f019-4882-af3c-a6f2c6544aef" Jul 15 21:06:51.335073 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:51.335042 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzmkh" Jul 15 21:06:51.335255 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:51.335154 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzmkh" podUID="5a785f71-60da-4c64-b6bb-6c2abb587a4f" Jul 15 21:06:52.335382 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:52.335346 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6n6hw" Jul 15 21:06:52.335772 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:52.335461 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6n6hw" podUID="f12efede-b144-4c22-9e44-0990b6bb00af" Jul 15 21:06:52.335772 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:52.335519 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bt89" Jul 15 21:06:52.335772 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:52.335626 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bt89" podUID="cb2ca919-f019-4882-af3c-a6f2c6544aef" Jul 15 21:06:53.335192 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:53.335161 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzmkh" Jul 15 21:06:53.335321 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:53.335269 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzmkh" podUID="5a785f71-60da-4c64-b6bb-6c2abb587a4f" Jul 15 21:06:54.335373 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:54.335216 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6n6hw" Jul 15 21:06:54.335765 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:54.335268 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bt89" Jul 15 21:06:54.335765 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:54.335452 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6n6hw" podUID="f12efede-b144-4c22-9e44-0990b6bb00af" Jul 15 21:06:54.335765 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:54.335507 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bt89" podUID="cb2ca919-f019-4882-af3c-a6f2c6544aef" Jul 15 21:06:54.431851 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:54.431828 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hz4sl" event={"ID":"9a3fc2a3-52d8-4ac3-99be-a76046969eaf","Type":"ContainerStarted","Data":"cd4f4e2e95f70bfa86cf5cace9ca80f43cbad8ebdeea76f0863a285fa19ebf09"} Jul 15 21:06:54.433322 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:54.433281 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cz97m" event={"ID":"790d9bc9-5d2c-4c27-b89e-78aaa7feb547","Type":"ContainerStarted","Data":"cee7e990fb368f53667c5d0e9f0e243ba508ac8adf9684679c195f72636b253d"} Jul 15 21:06:54.435058 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:54.435039 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qm2hk_8224ce90-3f8b-4562-b8ae-14f9d965f20f/ovn-acl-logging/0.log" Jul 15 21:06:54.435475 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:54.435448 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" event={"ID":"8224ce90-3f8b-4562-b8ae-14f9d965f20f","Type":"ContainerStarted","Data":"d0914f9ea4573be961b5eeee2cda8cf3672178f6c54181e6b4f33b89f54bfac8"} Jul 15 21:06:54.435568 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:54.435522 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" event={"ID":"8224ce90-3f8b-4562-b8ae-14f9d965f20f","Type":"ContainerStarted","Data":"9fa6a41b0596747666babe2472bdb66e0bd5699b604f433a7643751b5f1ae2c0"} Jul 15 21:06:54.436804 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:54.436780 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dggdr" event={"ID":"d657a4a7-22b8-4894-9ed2-89d76c9d3465","Type":"ContainerStarted","Data":"71d28d2909bdfeb7af242aa0da70a289fb62e458a8665cca888fb4d4a387e1ef"} Jul 15 21:06:54.438215 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:54.438193 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tsgc7" event={"ID":"8e4f36da-9604-422b-a4b8-35e40e711b19","Type":"ContainerStarted","Data":"b6cc0bf84901c784ec9301797a3ff15e914daafe1f9a47e4686a431029bbeb04"} Jul 15 21:06:54.441542 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:54.440296 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-46.ec2.internal" event={"ID":"62c84c35e765c98395b0bedc3e26a159","Type":"ContainerStarted","Data":"bd8ab10318bfe271c0da29fc0edfc5dd2b09c844b969bcb3d1d6a020c2c836ef"} Jul 15 21:06:54.442654 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:54.442634 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsgwz" event={"ID":"99025321-ebf4-4a9b-8a53-f7aa16cf9d3d","Type":"ContainerStarted","Data":"90f5e2425ad5cdefa21fa3058be4d4716db01e40ce9bbdc7e74cd160914fb403"} Jul 15 21:06:54.443997 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:54.443949 2577 generic.go:356] "Generic (PLEG): container finished" podID="2e956ca6-aae2-482a-a1d6-6b904a4e0551" containerID="d4b5b34ede89f4646215c07c8e4b4da7250e94746c3bd4630a5b2dbf7ccad270" exitCode=0 Jul 15 21:06:54.444061 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:54.444006 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7plx5" event={"ID":"2e956ca6-aae2-482a-a1d6-6b904a4e0551","Type":"ContainerDied","Data":"d4b5b34ede89f4646215c07c8e4b4da7250e94746c3bd4630a5b2dbf7ccad270"} Jul 15 21:06:54.448196 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:54.448168 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lr7lm" event={"ID":"31546197-e89f-42c3-a787-577e1441d466","Type":"ContainerStarted","Data":"382b42ae809ebc26f6180036c8d6ac10473ebf29341dfa6beaaed2fbc4b140f9"} Jul 15 21:06:54.487630 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:54.487590 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-hz4sl" podStartSLOduration=3.313433256 podStartE2EDuration="22.487576793s" totalImagesPullingTime="19.174143537s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:06:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:06:54.457819317 +0000 UTC m=+22.708244447" watchObservedRunningTime="2026-07-15 21:06:54.487576793 +0000 UTC m=+22.738001924" Jul 15 21:06:54.506481 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:54.506442 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-lr7lm" podStartSLOduration=3.3398616309999998 podStartE2EDuration="22.506427049s" totalImagesPullingTime="19.166565418s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:06:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:06:54.505948696 +0000 UTC m=+22.756373827" watchObservedRunningTime="2026-07-15 21:06:54.506427049 +0000 UTC m=+22.756852182" Jul 15 21:06:54.565365 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:54.565326 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-tsgc7" podStartSLOduration=3.322517287 podStartE2EDuration="22.565313078s" totalImagesPullingTime="19.242795791s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:06:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:06:54.564223058 +0000 UTC m=+22.814648188" watchObservedRunningTime="2026-07-15 21:06:54.565313078 +0000 UTC m=+22.815738232" Jul 15 21:06:54.565561 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:54.565531 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-46.ec2.internal" podStartSLOduration=21.565520332 podStartE2EDuration="21.565520332s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:06:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:06:54.537781134 +0000 UTC m=+22.788206266" watchObservedRunningTime="2026-07-15 21:06:54.565520332 +0000 UTC m=+22.815945464" Jul 15 21:06:54.620811 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:54.620579 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-dggdr" podStartSLOduration=3.401807346 podStartE2EDuration="22.620563575s" totalImagesPullingTime="19.218756229s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:06:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:06:54.587687896 +0000 UTC m=+22.838113026" watchObservedRunningTime="2026-07-15 21:06:54.620563575 +0000 UTC m=+22.870988780" Jul 15 21:06:54.912636 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:54.912599 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tsgc7_8e4f36da-9604-422b-a4b8-35e40e711b19/konnectivity-agent/0.log" limit=1024 Jul 15 21:06:55.015601 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:55.015543 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tsgc7_8e4f36da-9604-422b-a4b8-35e40e711b19/konnectivity-agent/0.log" limit=1024 Jul 15 21:06:55.094517 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:55.094497 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tsgc7_8e4f36da-9604-422b-a4b8-35e40e711b19/konnectivity-agent/0.log" limit=1024 Jul 15 21:06:55.334556 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:55.334532 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzmkh" Jul 15 21:06:55.334686 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:55.334640 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzmkh" podUID="5a785f71-60da-4c64-b6bb-6c2abb587a4f" Jul 15 21:06:55.410263 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:55.410239 2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 15 21:06:55.451789 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:55.451756 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rq7ns" event={"ID":"27d65c91-f6b1-4e9f-bd7e-2f723aa38707","Type":"ContainerStarted","Data":"7028661da7dfbe9de7b13b77805dde88411c99b7121ce1381475c561268b12a8"} Jul 15 21:06:55.455082 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:55.455061 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qm2hk_8224ce90-3f8b-4562-b8ae-14f9d965f20f/ovn-acl-logging/0.log" Jul 15 21:06:55.455461 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:55.455440 2577 generic.go:356] "Generic (PLEG): container finished" podID="8224ce90-3f8b-4562-b8ae-14f9d965f20f" containerID="d0914f9ea4573be961b5eeee2cda8cf3672178f6c54181e6b4f33b89f54bfac8" exitCode=1 Jul 15 21:06:55.455539 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:55.455511 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" event={"ID":"8224ce90-3f8b-4562-b8ae-14f9d965f20f","Type":"ContainerDied","Data":"d0914f9ea4573be961b5eeee2cda8cf3672178f6c54181e6b4f33b89f54bfac8"} Jul 15 21:06:55.455602 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:55.455586 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" event={"ID":"8224ce90-3f8b-4562-b8ae-14f9d965f20f","Type":"ContainerStarted","Data":"a666efb117b73fda36f3750114f395cb8d16122af60eac2b837260e5ce8b04d6"} Jul 15 21:06:55.455699 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:55.455638 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" event={"ID":"8224ce90-3f8b-4562-b8ae-14f9d965f20f","Type":"ContainerStarted","Data":"c75080a7f7c95e084e3c70debe790278094c451db3cb2e0acb5e7273d0b8d1a2"} Jul 15 21:06:55.455699 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:55.455685 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" event={"ID":"8224ce90-3f8b-4562-b8ae-14f9d965f20f","Type":"ContainerStarted","Data":"0ac25f4009d322cd6ca726409640639317d63f48bfd874dbe5c5662a1ba6c680"} Jul 15 21:06:55.455802 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:55.455757 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" event={"ID":"8224ce90-3f8b-4562-b8ae-14f9d965f20f","Type":"ContainerStarted","Data":"908324e07a58a9ebf66e95268fe0590af9888fbe620ed4f3dce1ccaa14d19c9a"} Jul 15 21:06:55.457662 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:55.457635 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsgwz" event={"ID":"99025321-ebf4-4a9b-8a53-f7aa16cf9d3d","Type":"ContainerStarted","Data":"3c0685d601b4fd54cb39991150b80fd56b3bec12dea6395dd71dd04f136ab6be"} Jul 15 21:06:55.478969 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:55.478921 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-cz97m" podStartSLOduration=4.27393552 podStartE2EDuration="23.47890365s" totalImagesPullingTime="19.20496813s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:06:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:06:54.621209245 +0000 UTC m=+22.871634377" watchObservedRunningTime="2026-07-15 21:06:55.47890365 +0000 UTC m=+23.729328783" Jul 15 21:06:55.479534 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:55.479502 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rq7ns" podStartSLOduration=8.818931649 podStartE2EDuration="23.479494206s" totalImagesPullingTime="14.660562557s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:06:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:06:55.479248441 +0000 UTC m=+23.729673573" watchObservedRunningTime="2026-07-15 21:06:55.479494206 +0000 UTC m=+23.729919342" Jul 15 21:06:55.610972 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:55.610900 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tsgc7_8e4f36da-9604-422b-a4b8-35e40e711b19/konnectivity-agent/0.log" limit=1024 Jul 15 21:06:55.673869 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:55.673831 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tsgc7_8e4f36da-9604-422b-a4b8-35e40e711b19/konnectivity-agent/0.log" limit=1024 Jul 15 21:06:56.214397 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:56.214241 2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T21:06:55.410254633Z","UUID":"3e8d7f46-ee41-4ec7-9750-58bc343f0d2d","Handler":null,"Name":"","Endpoint":""} Jul 15 21:06:56.217090 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:56.215976 2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 15 21:06:56.217090 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:56.216019 2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 15 21:06:56.335031 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:56.334994 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6n6hw" Jul 15 21:06:56.335239 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:56.334994 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bt89" Jul 15 21:06:56.335239 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:56.335122 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6n6hw" podUID="f12efede-b144-4c22-9e44-0990b6bb00af" Jul 15 21:06:56.335239 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:56.335223 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bt89" podUID="cb2ca919-f019-4882-af3c-a6f2c6544aef" Jul 15 21:06:56.542058 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:56.541986 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tsgc7_8e4f36da-9604-422b-a4b8-35e40e711b19/konnectivity-agent/0.log" limit=1024 Jul 15 21:06:56.642180 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:56.642153 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tsgc7_8e4f36da-9604-422b-a4b8-35e40e711b19/konnectivity-agent/0.log" limit=1024 Jul 15 21:06:56.687176 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:56.687153 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-tsgc7" Jul 15 21:06:56.687646 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:56.687628 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-tsgc7" Jul 15 21:06:57.334461 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:57.334398 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzmkh" Jul 15 21:06:57.334612 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:57.334487 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzmkh" podUID="5a785f71-60da-4c64-b6bb-6c2abb587a4f" Jul 15 21:06:57.465508 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:57.465480 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qm2hk_8224ce90-3f8b-4562-b8ae-14f9d965f20f/ovn-acl-logging/0.log" Jul 15 21:06:57.465948 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:57.465921 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" event={"ID":"8224ce90-3f8b-4562-b8ae-14f9d965f20f","Type":"ContainerStarted","Data":"8487bff0aa5080794daf612f9ce38ab9fc491764395fc71b944c2abe701e7e6b"} Jul 15 21:06:57.468115 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:57.468082 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsgwz" event={"ID":"99025321-ebf4-4a9b-8a53-f7aa16cf9d3d","Type":"ContainerStarted","Data":"1c82491557117cbe8defb8455b5bd960fa65276d759119d7995fa06f56081181"} Jul 15 21:06:57.468486 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:57.468315 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-tsgc7" Jul 15 21:06:57.468782 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:57.468764 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-tsgc7" Jul 15 21:06:57.486912 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:57.486874 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsgwz" podStartSLOduration=3.7534662819999998 podStartE2EDuration="25.486860801s" totalImagesPullingTime="21.733394519s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:06:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:06:57.486613269 +0000 UTC m=+25.737038401" watchObservedRunningTime="2026-07-15 21:06:57.486860801 +0000 UTC m=+25.737285931" Jul 15 21:06:57.550869 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:57.550828 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tsgc7_8e4f36da-9604-422b-a4b8-35e40e711b19/konnectivity-agent/0.log" limit=1024 Jul 15 21:06:58.335333 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:58.335306 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6n6hw" Jul 15 21:06:58.335589 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:58.335307 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bt89" Jul 15 21:06:58.335589 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:58.335409 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6n6hw" podUID="f12efede-b144-4c22-9e44-0990b6bb00af" Jul 15 21:06:58.335589 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:58.335482 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bt89" podUID="cb2ca919-f019-4882-af3c-a6f2c6544aef" Jul 15 21:06:58.345313 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:58.345273 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tsgc7_8e4f36da-9604-422b-a4b8-35e40e711b19/konnectivity-agent/0.log" limit=1024 Jul 15 21:06:59.334986 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:06:59.334918 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzmkh" Jul 15 21:06:59.335460 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:06:59.335022 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzmkh" podUID="5a785f71-60da-4c64-b6bb-6c2abb587a4f" Jul 15 21:07:00.335216 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:00.334955 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6n6hw" Jul 15 21:07:00.335719 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:00.335021 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bt89" Jul 15 21:07:00.335719 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:07:00.335288 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6n6hw" podUID="f12efede-b144-4c22-9e44-0990b6bb00af" Jul 15 21:07:00.335719 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:07:00.335352 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bt89" podUID="cb2ca919-f019-4882-af3c-a6f2c6544aef" Jul 15 21:07:00.477857 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:00.477827 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qm2hk_8224ce90-3f8b-4562-b8ae-14f9d965f20f/ovn-acl-logging/0.log" Jul 15 21:07:00.478225 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:00.478200 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" event={"ID":"8224ce90-3f8b-4562-b8ae-14f9d965f20f","Type":"ContainerStarted","Data":"b459c22224a26c8ea4ef001e3ddace7cb4626cfe750c34318c894e1256cc8355"} Jul 15 21:07:00.478497 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:00.478475 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:07:00.478604 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:00.478546 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:07:00.478704 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:00.478664 2577 scope.go:117] "RemoveContainer" containerID="d0914f9ea4573be961b5eeee2cda8cf3672178f6c54181e6b4f33b89f54bfac8" Jul 15 21:07:00.480418 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:00.480397 2577 generic.go:356] "Generic (PLEG): container finished" podID="2e956ca6-aae2-482a-a1d6-6b904a4e0551" containerID="cf1924d1c29ad592a5bf2c4f8622c151c82a910cf30fe41439c478d2c26f8f31" exitCode=0 Jul 15 21:07:00.480522 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:00.480433 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7plx5" event={"ID":"2e956ca6-aae2-482a-a1d6-6b904a4e0551","Type":"ContainerDied","Data":"cf1924d1c29ad592a5bf2c4f8622c151c82a910cf30fe41439c478d2c26f8f31"} Jul 15 21:07:00.496139 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:00.496119 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:07:00.497072 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:00.497056 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:07:01.335154 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:01.335125 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzmkh" Jul 15 21:07:01.335289 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:07:01.335236 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzmkh" podUID="5a785f71-60da-4c64-b6bb-6c2abb587a4f" Jul 15 21:07:01.487173 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:01.487151 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qm2hk_8224ce90-3f8b-4562-b8ae-14f9d965f20f/ovn-acl-logging/0.log" Jul 15 21:07:01.487502 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:01.487481 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" event={"ID":"8224ce90-3f8b-4562-b8ae-14f9d965f20f","Type":"ContainerStarted","Data":"722c45438af0e3e287532ea23dec1e5b663b0b9cbbd4d3dbdccedd50b6143fb4"} Jul 15 21:07:01.487581 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:01.487568 2577 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 15 21:07:01.520236 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:01.520035 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" podStartSLOduration=9.784540129 podStartE2EDuration="29.520018588s" totalImagesPullingTime="19.735478459s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:06:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:07:01.518250139 +0000 UTC m=+29.768675281" watchObservedRunningTime="2026-07-15 21:07:01.520018588 +0000 UTC m=+29.770443718" Jul 15 21:07:01.693691 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:01.693499 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zzmkh"] Jul 15 21:07:01.693822 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:01.693809 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzmkh" Jul 15 21:07:01.693919 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:07:01.693896 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzmkh" podUID="5a785f71-60da-4c64-b6bb-6c2abb587a4f" Jul 15 21:07:01.694222 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:01.694207 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6n6hw"] Jul 15 21:07:01.694302 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:01.694289 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6n6hw" Jul 15 21:07:01.694389 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:07:01.694373 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6n6hw" podUID="f12efede-b144-4c22-9e44-0990b6bb00af" Jul 15 21:07:01.694839 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:01.694818 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4bt89"] Jul 15 21:07:01.694932 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:01.694919 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bt89" Jul 15 21:07:01.695046 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:07:01.695026 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bt89" podUID="cb2ca919-f019-4882-af3c-a6f2c6544aef" Jul 15 21:07:01.749123 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:01.749097 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:07:02.491014 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:02.490982 2577 generic.go:356] "Generic (PLEG): container finished" podID="2e956ca6-aae2-482a-a1d6-6b904a4e0551" containerID="4169bbe58d2caa2fd0bd6915661aa672e8e326eb58e38fbf1524f10d70d4d4ad" exitCode=0 Jul 15 21:07:02.491481 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:02.491070 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7plx5" event={"ID":"2e956ca6-aae2-482a-a1d6-6b904a4e0551","Type":"ContainerDied","Data":"4169bbe58d2caa2fd0bd6915661aa672e8e326eb58e38fbf1524f10d70d4d4ad"} Jul 15 21:07:03.175281 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:03.175260 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dggdr_d657a4a7-22b8-4894-9ed2-89d76c9d3465/dns-node-resolver/0.log" Jul 15 21:07:03.334516 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:03.334491 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bt89" Jul 15 21:07:03.334692 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:03.334533 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzmkh" Jul 15 21:07:03.334692 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:03.334596 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6n6hw" Jul 15 21:07:03.334692 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:07:03.334613 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bt89" podUID="cb2ca919-f019-4882-af3c-a6f2c6544aef" Jul 15 21:07:03.334692 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:07:03.334662 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6n6hw" podUID="f12efede-b144-4c22-9e44-0990b6bb00af" Jul 15 21:07:03.334933 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:07:03.334769 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzmkh" podUID="5a785f71-60da-4c64-b6bb-6c2abb587a4f" Jul 15 21:07:04.177261 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:04.177237 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lr7lm_31546197-e89f-42c3-a787-577e1441d466/node-ca/0.log" Jul 15 21:07:04.498049 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:04.497966 2577 generic.go:356] "Generic (PLEG): container finished" podID="2e956ca6-aae2-482a-a1d6-6b904a4e0551" containerID="fc862df3ee68c30df373b5aff021960ddf9966a5b330339e45a3c0424410319b" exitCode=0 Jul 15 21:07:04.498049 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:04.498006 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7plx5" event={"ID":"2e956ca6-aae2-482a-a1d6-6b904a4e0551","Type":"ContainerDied","Data":"fc862df3ee68c30df373b5aff021960ddf9966a5b330339e45a3c0424410319b"} Jul 15 21:07:05.334674 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:05.334648 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bt89" Jul 15 21:07:05.335103 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:05.334786 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6n6hw" Jul 15 21:07:05.335103 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:07:05.334800 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bt89" podUID="cb2ca919-f019-4882-af3c-a6f2c6544aef" Jul 15 21:07:05.335103 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:05.334820 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzmkh" Jul 15 21:07:05.335103 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:07:05.334915 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6n6hw" podUID="f12efede-b144-4c22-9e44-0990b6bb00af" Jul 15 21:07:05.335103 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:07:05.335001 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzmkh" podUID="5a785f71-60da-4c64-b6bb-6c2abb587a4f" Jul 15 21:07:05.890808 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:05.890778 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb2ca919-f019-4882-af3c-a6f2c6544aef-metrics-certs\") pod \"network-metrics-daemon-4bt89\" (UID: \"cb2ca919-f019-4882-af3c-a6f2c6544aef\") " pod="openshift-multus/network-metrics-daemon-4bt89" Jul 15 21:07:05.890996 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:07:05.890910 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:07:05.890996 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:07:05.890975 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb2ca919-f019-4882-af3c-a6f2c6544aef-metrics-certs podName:cb2ca919-f019-4882-af3c-a6f2c6544aef nodeName:}" failed. No retries permitted until 2026-07-15 21:07:37.890957936 +0000 UTC m=+66.141383045 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb2ca919-f019-4882-af3c-a6f2c6544aef-metrics-certs") pod "network-metrics-daemon-4bt89" (UID: "cb2ca919-f019-4882-af3c-a6f2c6544aef") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:07:05.991768 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:05.991719 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f12efede-b144-4c22-9e44-0990b6bb00af-original-pull-secret\") pod \"global-pull-secret-syncer-6n6hw\" (UID: \"f12efede-b144-4c22-9e44-0990b6bb00af\") " pod="kube-system/global-pull-secret-syncer-6n6hw" Jul 15 21:07:05.991940 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:07:05.991862 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 21:07:05.991940 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:07:05.991930 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f12efede-b144-4c22-9e44-0990b6bb00af-original-pull-secret podName:f12efede-b144-4c22-9e44-0990b6bb00af nodeName:}" failed. No retries permitted until 2026-07-15 21:07:37.991913316 +0000 UTC m=+66.242338438 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f12efede-b144-4c22-9e44-0990b6bb00af-original-pull-secret") pod "global-pull-secret-syncer-6n6hw" (UID: "f12efede-b144-4c22-9e44-0990b6bb00af") : object "kube-system"/"original-pull-secret" not registered Jul 15 21:07:06.092444 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.092414 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvdw7\" (UniqueName: \"kubernetes.io/projected/5a785f71-60da-4c64-b6bb-6c2abb587a4f-kube-api-access-cvdw7\") pod \"network-check-target-zzmkh\" (UID: \"5a785f71-60da-4c64-b6bb-6c2abb587a4f\") " pod="openshift-network-diagnostics/network-check-target-zzmkh" Jul 15 21:07:06.092602 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:07:06.092585 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 21:07:06.092655 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:07:06.092608 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 21:07:06.092655 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:07:06.092618 2577 projected.go:196] Error preparing data for projected volume kube-api-access-cvdw7 for pod openshift-network-diagnostics/network-check-target-zzmkh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:07:06.092740 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:07:06.092670 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5a785f71-60da-4c64-b6bb-6c2abb587a4f-kube-api-access-cvdw7 podName:5a785f71-60da-4c64-b6bb-6c2abb587a4f nodeName:}" failed. No retries permitted until 2026-07-15 21:07:38.092654086 +0000 UTC m=+66.343079196 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-cvdw7" (UniqueName: "kubernetes.io/projected/5a785f71-60da-4c64-b6bb-6c2abb587a4f-kube-api-access-cvdw7") pod "network-check-target-zzmkh" (UID: "5a785f71-60da-4c64-b6bb-6c2abb587a4f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:07:06.549873 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.549801 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-46.ec2.internal" event="NodeReady" Jul 15 21:07:06.550198 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.549918 2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 15 21:07:06.586476 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.586450 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-67fbf55486-b7b2r"] Jul 15 21:07:06.588220 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.588205 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67fbf55486-b7b2r" Jul 15 21:07:06.591152 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.590982 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 15 21:07:06.591284 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.591126 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 15 21:07:06.591427 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.591406 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 15 21:07:06.591524 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.591455 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zhpfs\"" Jul 15 21:07:06.600104 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.598365 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 15 21:07:06.604193 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.604170 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67fbf55486-b7b2r"] Jul 15 21:07:06.606655 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.606514 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-nnjbb"] Jul 15 21:07:06.608321 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.608302 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-fnq4r"] Jul 15 21:07:06.608439 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.608420 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nnjbb" Jul 15 21:07:06.610004 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.609984 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fnq4r" Jul 15 21:07:06.611059 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.611038 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 15 21:07:06.611059 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.611050 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 15 21:07:06.611530 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.611515 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 15 21:07:06.611595 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.611557 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-g2hd4\"" Jul 15 21:07:06.612748 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.612717 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 15 21:07:06.612839 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.612719 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zr29g\"" Jul 15 21:07:06.613036 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.613009 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 15 21:07:06.613036 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.613010 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 15 21:07:06.613166 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.613054 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 15 21:07:06.623610 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.623590 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nnjbb"] Jul 15 21:07:06.624467 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.624423 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fnq4r"] Jul 15 21:07:06.625258 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.625241 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-2fm9z"] Jul 15 21:07:06.628056 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.628036 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2fm9z" Jul 15 21:07:06.630608 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.630590 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mhzfs\"" Jul 15 21:07:06.631532 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.631516 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 15 21:07:06.631630 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.631547 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 15 21:07:06.644160 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.644139 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2fm9z"] Jul 15 21:07:06.696448 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.696420 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5dsn\" (UniqueName: \"kubernetes.io/projected/2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830-kube-api-access-q5dsn\") pod \"image-registry-67fbf55486-b7b2r\" (UID: \"2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830\") " pod="openshift-image-registry/image-registry-67fbf55486-b7b2r" Jul 15 21:07:06.696569 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.696457 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/93d20337-473b-42b5-ac3d-a0194250fbed-cert\") pod \"ingress-canary-nnjbb\" (UID: \"93d20337-473b-42b5-ac3d-a0194250fbed\") " pod="openshift-ingress-canary/ingress-canary-nnjbb" Jul 15 21:07:06.696569 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.696481 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830-bound-sa-token\") pod \"image-registry-67fbf55486-b7b2r\" (UID: \"2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830\") " pod="openshift-image-registry/image-registry-67fbf55486-b7b2r" Jul 15 21:07:06.696569 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.696520 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830-registry-certificates\") pod \"image-registry-67fbf55486-b7b2r\" (UID: \"2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830\") " pod="openshift-image-registry/image-registry-67fbf55486-b7b2r" Jul 15 21:07:06.696569 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.696547 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830-image-registry-private-configuration\") pod \"image-registry-67fbf55486-b7b2r\" (UID: \"2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830\") " pod="openshift-image-registry/image-registry-67fbf55486-b7b2r" Jul 15 21:07:06.696809 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.696576 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830-registry-tls\") pod \"image-registry-67fbf55486-b7b2r\" (UID: \"2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830\") " pod="openshift-image-registry/image-registry-67fbf55486-b7b2r" Jul 15 21:07:06.696809 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.696609 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830-ca-trust-extracted\") pod \"image-registry-67fbf55486-b7b2r\" (UID: \"2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830\") " pod="openshift-image-registry/image-registry-67fbf55486-b7b2r" Jul 15 21:07:06.696809 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.696675 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwdq5\" (UniqueName: \"kubernetes.io/projected/93d20337-473b-42b5-ac3d-a0194250fbed-kube-api-access-hwdq5\") pod \"ingress-canary-nnjbb\" (UID: \"93d20337-473b-42b5-ac3d-a0194250fbed\") " pod="openshift-ingress-canary/ingress-canary-nnjbb" Jul 15 21:07:06.696809 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.696694 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830-installation-pull-secrets\") pod \"image-registry-67fbf55486-b7b2r\" (UID: \"2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830\") " pod="openshift-image-registry/image-registry-67fbf55486-b7b2r" Jul 15 21:07:06.696809 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.696737 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830-trusted-ca\") pod \"image-registry-67fbf55486-b7b2r\" (UID: \"2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830\") " pod="openshift-image-registry/image-registry-67fbf55486-b7b2r" Jul 15 21:07:06.797709 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.797677 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5dsn\" (UniqueName: \"kubernetes.io/projected/2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830-kube-api-access-q5dsn\") pod \"image-registry-67fbf55486-b7b2r\" (UID: \"2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830\") " pod="openshift-image-registry/image-registry-67fbf55486-b7b2r" Jul 15 21:07:06.797709 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.797718 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c0912f3f-c1ed-4638-b0d4-06b0c1e30446-data-volume\") pod \"insights-runtime-extractor-fnq4r\" (UID: \"c0912f3f-c1ed-4638-b0d4-06b0c1e30446\") " pod="openshift-insights/insights-runtime-extractor-fnq4r" Jul 15 21:07:06.797945 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.797769 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b3235b9-54ed-4356-be73-4bf0dccf41ac-metrics-tls\") pod \"dns-default-2fm9z\" (UID: \"3b3235b9-54ed-4356-be73-4bf0dccf41ac\") " pod="openshift-dns/dns-default-2fm9z" Jul 15 21:07:06.797945 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.797796 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/93d20337-473b-42b5-ac3d-a0194250fbed-cert\") pod \"ingress-canary-nnjbb\" (UID: \"93d20337-473b-42b5-ac3d-a0194250fbed\") " pod="openshift-ingress-canary/ingress-canary-nnjbb" Jul 15 21:07:06.797945 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.797819 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830-bound-sa-token\") pod \"image-registry-67fbf55486-b7b2r\" (UID: \"2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830\") " pod="openshift-image-registry/image-registry-67fbf55486-b7b2r" Jul 15 21:07:06.797945 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.797909 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830-registry-certificates\") pod \"image-registry-67fbf55486-b7b2r\" (UID: \"2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830\") " pod="openshift-image-registry/image-registry-67fbf55486-b7b2r" Jul 15 21:07:06.798144 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.797945 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c0912f3f-c1ed-4638-b0d4-06b0c1e30446-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fnq4r\" (UID: \"c0912f3f-c1ed-4638-b0d4-06b0c1e30446\") " pod="openshift-insights/insights-runtime-extractor-fnq4r" Jul 15 21:07:06.798144 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.797971 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dwg2\" (UniqueName: \"kubernetes.io/projected/c0912f3f-c1ed-4638-b0d4-06b0c1e30446-kube-api-access-9dwg2\") pod \"insights-runtime-extractor-fnq4r\" (UID: \"c0912f3f-c1ed-4638-b0d4-06b0c1e30446\") " pod="openshift-insights/insights-runtime-extractor-fnq4r" Jul 15 21:07:06.798144 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.798007 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830-image-registry-private-configuration\") pod \"image-registry-67fbf55486-b7b2r\" (UID: \"2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830\") " pod="openshift-image-registry/image-registry-67fbf55486-b7b2r" Jul 15 21:07:06.798144 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.798053 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830-registry-tls\") pod \"image-registry-67fbf55486-b7b2r\" (UID: \"2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830\") " pod="openshift-image-registry/image-registry-67fbf55486-b7b2r" Jul 15 21:07:06.798144 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.798098 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830-ca-trust-extracted\") pod \"image-registry-67fbf55486-b7b2r\" (UID: \"2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830\") " pod="openshift-image-registry/image-registry-67fbf55486-b7b2r" Jul 15 21:07:06.798383 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.798153 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwdq5\" (UniqueName: \"kubernetes.io/projected/93d20337-473b-42b5-ac3d-a0194250fbed-kube-api-access-hwdq5\") pod \"ingress-canary-nnjbb\" (UID: \"93d20337-473b-42b5-ac3d-a0194250fbed\") " pod="openshift-ingress-canary/ingress-canary-nnjbb" Jul 15 21:07:06.798383 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:07:06.798180 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 21:07:06.798383 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:07:06.798197 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67fbf55486-b7b2r: secret "image-registry-tls" not found Jul 15 21:07:06.798383 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:07:06.798259 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830-registry-tls podName:2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830 nodeName:}" failed. No retries permitted until 2026-07-15 21:07:07.298239764 +0000 UTC m=+35.548664875 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830-registry-tls") pod "image-registry-67fbf55486-b7b2r" (UID: "2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830") : secret "image-registry-tls" not found Jul 15 21:07:06.798584 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.798185 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830-installation-pull-secrets\") pod \"image-registry-67fbf55486-b7b2r\" (UID: \"2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830\") " pod="openshift-image-registry/image-registry-67fbf55486-b7b2r" Jul 15 21:07:06.798584 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.798480 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c0912f3f-c1ed-4638-b0d4-06b0c1e30446-crio-socket\") pod \"insights-runtime-extractor-fnq4r\" (UID: \"c0912f3f-c1ed-4638-b0d4-06b0c1e30446\") " pod="openshift-insights/insights-runtime-extractor-fnq4r" Jul 15 21:07:06.798584 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.798493 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830-ca-trust-extracted\") pod \"image-registry-67fbf55486-b7b2r\" (UID: \"2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830\") " pod="openshift-image-registry/image-registry-67fbf55486-b7b2r" Jul 15 21:07:06.798584 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.798508 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b3235b9-54ed-4356-be73-4bf0dccf41ac-tmp-dir\") pod \"dns-default-2fm9z\" (UID: \"3b3235b9-54ed-4356-be73-4bf0dccf41ac\") " pod="openshift-dns/dns-default-2fm9z" Jul 15 21:07:06.798584 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.798574 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830-trusted-ca\") pod \"image-registry-67fbf55486-b7b2r\" (UID: \"2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830\") " pod="openshift-image-registry/image-registry-67fbf55486-b7b2r" Jul 15 21:07:06.798840 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.798591 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830-registry-certificates\") pod \"image-registry-67fbf55486-b7b2r\" (UID: \"2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830\") " pod="openshift-image-registry/image-registry-67fbf55486-b7b2r" Jul 15 21:07:06.798840 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.798602 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c0912f3f-c1ed-4638-b0d4-06b0c1e30446-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fnq4r\" (UID: \"c0912f3f-c1ed-4638-b0d4-06b0c1e30446\") " pod="openshift-insights/insights-runtime-extractor-fnq4r" Jul 15 21:07:06.798840 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.798651 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3b3235b9-54ed-4356-be73-4bf0dccf41ac-config-volume\") pod \"dns-default-2fm9z\" (UID: \"3b3235b9-54ed-4356-be73-4bf0dccf41ac\") " pod="openshift-dns/dns-default-2fm9z" Jul 15 21:07:06.798840 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.798678 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnxbp\" (UniqueName: \"kubernetes.io/projected/3b3235b9-54ed-4356-be73-4bf0dccf41ac-kube-api-access-qnxbp\") pod \"dns-default-2fm9z\" (UID: \"3b3235b9-54ed-4356-be73-4bf0dccf41ac\") " pod="openshift-dns/dns-default-2fm9z" Jul 15 21:07:06.799480 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.799430 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830-trusted-ca\") pod \"image-registry-67fbf55486-b7b2r\" (UID: \"2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830\") " pod="openshift-image-registry/image-registry-67fbf55486-b7b2r" Jul 15 21:07:06.802799 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.802716 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830-installation-pull-secrets\") pod \"image-registry-67fbf55486-b7b2r\" (UID: \"2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830\") " pod="openshift-image-registry/image-registry-67fbf55486-b7b2r" Jul 15 21:07:06.802799 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.802762 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830-image-registry-private-configuration\") pod \"image-registry-67fbf55486-b7b2r\" (UID: \"2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830\") " pod="openshift-image-registry/image-registry-67fbf55486-b7b2r" Jul 15 21:07:06.802799 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.802716 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/93d20337-473b-42b5-ac3d-a0194250fbed-cert\") pod \"ingress-canary-nnjbb\" (UID: \"93d20337-473b-42b5-ac3d-a0194250fbed\") " pod="openshift-ingress-canary/ingress-canary-nnjbb" Jul 15 21:07:06.808075 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.808054 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830-bound-sa-token\") pod \"image-registry-67fbf55486-b7b2r\" (UID: \"2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830\") " pod="openshift-image-registry/image-registry-67fbf55486-b7b2r" Jul 15 21:07:06.808239 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.808221 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5dsn\" (UniqueName: \"kubernetes.io/projected/2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830-kube-api-access-q5dsn\") pod \"image-registry-67fbf55486-b7b2r\" (UID: \"2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830\") " pod="openshift-image-registry/image-registry-67fbf55486-b7b2r" Jul 15 21:07:06.808750 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.808714 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwdq5\" (UniqueName: \"kubernetes.io/projected/93d20337-473b-42b5-ac3d-a0194250fbed-kube-api-access-hwdq5\") pod \"ingress-canary-nnjbb\" (UID: \"93d20337-473b-42b5-ac3d-a0194250fbed\") " pod="openshift-ingress-canary/ingress-canary-nnjbb" Jul 15 21:07:06.899930 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.899890 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c0912f3f-c1ed-4638-b0d4-06b0c1e30446-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fnq4r\" (UID: \"c0912f3f-c1ed-4638-b0d4-06b0c1e30446\") " pod="openshift-insights/insights-runtime-extractor-fnq4r" Jul 15 21:07:06.900071 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.899942 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3b3235b9-54ed-4356-be73-4bf0dccf41ac-config-volume\") pod \"dns-default-2fm9z\" (UID: \"3b3235b9-54ed-4356-be73-4bf0dccf41ac\") " pod="openshift-dns/dns-default-2fm9z" Jul 15 21:07:06.900071 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.899971 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnxbp\" (UniqueName: \"kubernetes.io/projected/3b3235b9-54ed-4356-be73-4bf0dccf41ac-kube-api-access-qnxbp\") pod \"dns-default-2fm9z\" (UID: \"3b3235b9-54ed-4356-be73-4bf0dccf41ac\") " pod="openshift-dns/dns-default-2fm9z" Jul 15 21:07:06.900071 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.900005 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c0912f3f-c1ed-4638-b0d4-06b0c1e30446-data-volume\") pod \"insights-runtime-extractor-fnq4r\" (UID: \"c0912f3f-c1ed-4638-b0d4-06b0c1e30446\") " pod="openshift-insights/insights-runtime-extractor-fnq4r" Jul 15 21:07:06.900071 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:07:06.900007 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 21:07:06.900071 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.900036 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b3235b9-54ed-4356-be73-4bf0dccf41ac-metrics-tls\") pod \"dns-default-2fm9z\" (UID: \"3b3235b9-54ed-4356-be73-4bf0dccf41ac\") " pod="openshift-dns/dns-default-2fm9z" Jul 15 21:07:06.900326 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:07:06.900091 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c0912f3f-c1ed-4638-b0d4-06b0c1e30446-kube-rbac-proxy-cm podName:c0912f3f-c1ed-4638-b0d4-06b0c1e30446 nodeName:}" failed. No retries permitted until 2026-07-15 21:07:07.400072157 +0000 UTC m=+35.650497283 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c0912f3f-c1ed-4638-b0d4-06b0c1e30446-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fnq4r" (UID: "c0912f3f-c1ed-4638-b0d4-06b0c1e30446") : configmap "kube-rbac-proxy" not found Jul 15 21:07:06.900326 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.900116 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c0912f3f-c1ed-4638-b0d4-06b0c1e30446-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fnq4r\" (UID: \"c0912f3f-c1ed-4638-b0d4-06b0c1e30446\") " pod="openshift-insights/insights-runtime-extractor-fnq4r" Jul 15 21:07:06.900326 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.900147 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dwg2\" (UniqueName: \"kubernetes.io/projected/c0912f3f-c1ed-4638-b0d4-06b0c1e30446-kube-api-access-9dwg2\") pod \"insights-runtime-extractor-fnq4r\" (UID: \"c0912f3f-c1ed-4638-b0d4-06b0c1e30446\") " pod="openshift-insights/insights-runtime-extractor-fnq4r" Jul 15 21:07:06.900326 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:07:06.900154 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 21:07:06.900326 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:07:06.900213 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b3235b9-54ed-4356-be73-4bf0dccf41ac-metrics-tls podName:3b3235b9-54ed-4356-be73-4bf0dccf41ac nodeName:}" failed. No retries permitted until 2026-07-15 21:07:07.400196616 +0000 UTC m=+35.650621726 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3b3235b9-54ed-4356-be73-4bf0dccf41ac-metrics-tls") pod "dns-default-2fm9z" (UID: "3b3235b9-54ed-4356-be73-4bf0dccf41ac") : secret "dns-default-metrics-tls" not found Jul 15 21:07:06.900326 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.900243 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c0912f3f-c1ed-4638-b0d4-06b0c1e30446-crio-socket\") pod \"insights-runtime-extractor-fnq4r\" (UID: \"c0912f3f-c1ed-4638-b0d4-06b0c1e30446\") " pod="openshift-insights/insights-runtime-extractor-fnq4r" Jul 15 21:07:06.900326 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.900269 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b3235b9-54ed-4356-be73-4bf0dccf41ac-tmp-dir\") pod \"dns-default-2fm9z\" (UID: \"3b3235b9-54ed-4356-be73-4bf0dccf41ac\") " pod="openshift-dns/dns-default-2fm9z" Jul 15 21:07:06.900326 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:07:06.900305 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 21:07:06.900736 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:07:06.900352 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0912f3f-c1ed-4638-b0d4-06b0c1e30446-insights-runtime-extractor-tls podName:c0912f3f-c1ed-4638-b0d4-06b0c1e30446 nodeName:}" failed. No retries permitted until 2026-07-15 21:07:07.400337522 +0000 UTC m=+35.650762643 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c0912f3f-c1ed-4638-b0d4-06b0c1e30446-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fnq4r" (UID: "c0912f3f-c1ed-4638-b0d4-06b0c1e30446") : secret "insights-runtime-extractor-tls" not found Jul 15 21:07:06.900736 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.900368 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c0912f3f-c1ed-4638-b0d4-06b0c1e30446-data-volume\") pod \"insights-runtime-extractor-fnq4r\" (UID: \"c0912f3f-c1ed-4638-b0d4-06b0c1e30446\") " pod="openshift-insights/insights-runtime-extractor-fnq4r" Jul 15 21:07:06.900736 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.900518 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c0912f3f-c1ed-4638-b0d4-06b0c1e30446-crio-socket\") pod \"insights-runtime-extractor-fnq4r\" (UID: \"c0912f3f-c1ed-4638-b0d4-06b0c1e30446\") " pod="openshift-insights/insights-runtime-extractor-fnq4r" Jul 15 21:07:06.900736 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.900572 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3b3235b9-54ed-4356-be73-4bf0dccf41ac-config-volume\") pod \"dns-default-2fm9z\" (UID: \"3b3235b9-54ed-4356-be73-4bf0dccf41ac\") " pod="openshift-dns/dns-default-2fm9z" Jul 15 21:07:06.900736 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.900584 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b3235b9-54ed-4356-be73-4bf0dccf41ac-tmp-dir\") pod \"dns-default-2fm9z\" (UID: \"3b3235b9-54ed-4356-be73-4bf0dccf41ac\") " pod="openshift-dns/dns-default-2fm9z" Jul 15 21:07:06.910661 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.910635 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnxbp\" (UniqueName: \"kubernetes.io/projected/3b3235b9-54ed-4356-be73-4bf0dccf41ac-kube-api-access-qnxbp\") pod \"dns-default-2fm9z\" (UID: \"3b3235b9-54ed-4356-be73-4bf0dccf41ac\") " pod="openshift-dns/dns-default-2fm9z" Jul 15 21:07:06.910753 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.910686 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dwg2\" (UniqueName: \"kubernetes.io/projected/c0912f3f-c1ed-4638-b0d4-06b0c1e30446-kube-api-access-9dwg2\") pod \"insights-runtime-extractor-fnq4r\" (UID: \"c0912f3f-c1ed-4638-b0d4-06b0c1e30446\") " pod="openshift-insights/insights-runtime-extractor-fnq4r" Jul 15 21:07:06.918151 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:06.918127 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nnjbb" Jul 15 21:07:07.055226 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:07.055149 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nnjbb"] Jul 15 21:07:07.059699 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:07:07.059671 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93d20337_473b_42b5_ac3d_a0194250fbed.slice/crio-aeb76accc41fac44a30f97b13575b61222238226e867184fb530e48d2ba262d6 WatchSource:0}: Error finding container aeb76accc41fac44a30f97b13575b61222238226e867184fb530e48d2ba262d6: Status 404 returned error can't find the container with id aeb76accc41fac44a30f97b13575b61222238226e867184fb530e48d2ba262d6 Jul 15 21:07:07.302645 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:07.302610 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830-registry-tls\") pod \"image-registry-67fbf55486-b7b2r\" (UID: \"2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830\") " pod="openshift-image-registry/image-registry-67fbf55486-b7b2r" Jul 15 21:07:07.302806 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:07:07.302770 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 21:07:07.302806 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:07:07.302790 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67fbf55486-b7b2r: secret "image-registry-tls" not found Jul 15 21:07:07.302895 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:07:07.302853 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830-registry-tls podName:2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830 nodeName:}" failed. No retries permitted until 2026-07-15 21:07:08.302833978 +0000 UTC m=+36.553259110 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830-registry-tls") pod "image-registry-67fbf55486-b7b2r" (UID: "2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830") : secret "image-registry-tls" not found Jul 15 21:07:07.335241 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:07.335171 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6n6hw" Jul 15 21:07:07.335241 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:07.335191 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bt89" Jul 15 21:07:07.335438 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:07.335317 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzmkh" Jul 15 21:07:07.338412 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:07.338390 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 15 21:07:07.338518 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:07.338392 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jw9wn\"" Jul 15 21:07:07.338650 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:07.338634 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-v4wmg\"" Jul 15 21:07:07.338693 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:07.338647 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 15 21:07:07.338693 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:07.338687 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 15 21:07:07.339256 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:07.339239 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 15 21:07:07.403951 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:07.403919 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c0912f3f-c1ed-4638-b0d4-06b0c1e30446-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fnq4r\" (UID: \"c0912f3f-c1ed-4638-b0d4-06b0c1e30446\") " pod="openshift-insights/insights-runtime-extractor-fnq4r" Jul 15 21:07:07.404094 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:07:07.404030 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 21:07:07.404094 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:07.404071 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b3235b9-54ed-4356-be73-4bf0dccf41ac-metrics-tls\") pod \"dns-default-2fm9z\" (UID: \"3b3235b9-54ed-4356-be73-4bf0dccf41ac\") " pod="openshift-dns/dns-default-2fm9z" Jul 15 21:07:07.404094 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:07:07.404082 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c0912f3f-c1ed-4638-b0d4-06b0c1e30446-kube-rbac-proxy-cm podName:c0912f3f-c1ed-4638-b0d4-06b0c1e30446 nodeName:}" failed. No retries permitted until 2026-07-15 21:07:08.404067381 +0000 UTC m=+36.654492490 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c0912f3f-c1ed-4638-b0d4-06b0c1e30446-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fnq4r" (UID: "c0912f3f-c1ed-4638-b0d4-06b0c1e30446") : configmap "kube-rbac-proxy" not found Jul 15 21:07:07.404243 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:07.404123 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c0912f3f-c1ed-4638-b0d4-06b0c1e30446-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fnq4r\" (UID: \"c0912f3f-c1ed-4638-b0d4-06b0c1e30446\") " pod="openshift-insights/insights-runtime-extractor-fnq4r" Jul 15 21:07:07.404299 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:07:07.404201 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 21:07:07.404299 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:07:07.404266 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 21:07:07.404389 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:07:07.404300 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b3235b9-54ed-4356-be73-4bf0dccf41ac-metrics-tls podName:3b3235b9-54ed-4356-be73-4bf0dccf41ac nodeName:}" failed. No retries permitted until 2026-07-15 21:07:08.404286486 +0000 UTC m=+36.654711612 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3b3235b9-54ed-4356-be73-4bf0dccf41ac-metrics-tls") pod "dns-default-2fm9z" (UID: "3b3235b9-54ed-4356-be73-4bf0dccf41ac") : secret "dns-default-metrics-tls" not found Jul 15 21:07:07.404389 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:07:07.404317 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0912f3f-c1ed-4638-b0d4-06b0c1e30446-insights-runtime-extractor-tls podName:c0912f3f-c1ed-4638-b0d4-06b0c1e30446 nodeName:}" failed. No retries permitted until 2026-07-15 21:07:08.404309015 +0000 UTC m=+36.654734123 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c0912f3f-c1ed-4638-b0d4-06b0c1e30446-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fnq4r" (UID: "c0912f3f-c1ed-4638-b0d4-06b0c1e30446") : secret "insights-runtime-extractor-tls" not found Jul 15 21:07:07.508986 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:07.508955 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nnjbb" event={"ID":"93d20337-473b-42b5-ac3d-a0194250fbed","Type":"ContainerStarted","Data":"aeb76accc41fac44a30f97b13575b61222238226e867184fb530e48d2ba262d6"} Jul 15 21:07:08.311801 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:08.311752 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830-registry-tls\") pod \"image-registry-67fbf55486-b7b2r\" (UID: \"2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830\") " pod="openshift-image-registry/image-registry-67fbf55486-b7b2r" Jul 15 21:07:08.312317 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:07:08.311924 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 21:07:08.312317 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:07:08.311948 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67fbf55486-b7b2r: secret "image-registry-tls" not found Jul 15 21:07:08.312317 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:07:08.312013 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830-registry-tls podName:2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830 nodeName:}" failed. No retries permitted until 2026-07-15 21:07:10.311992033 +0000 UTC m=+38.562417162 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830-registry-tls") pod "image-registry-67fbf55486-b7b2r" (UID: "2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830") : secret "image-registry-tls" not found Jul 15 21:07:08.412904 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:08.412865 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c0912f3f-c1ed-4638-b0d4-06b0c1e30446-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fnq4r\" (UID: \"c0912f3f-c1ed-4638-b0d4-06b0c1e30446\") " pod="openshift-insights/insights-runtime-extractor-fnq4r" Jul 15 21:07:08.413056 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:08.412931 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b3235b9-54ed-4356-be73-4bf0dccf41ac-metrics-tls\") pod \"dns-default-2fm9z\" (UID: \"3b3235b9-54ed-4356-be73-4bf0dccf41ac\") " pod="openshift-dns/dns-default-2fm9z" Jul 15 21:07:08.413056 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:08.412976 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c0912f3f-c1ed-4638-b0d4-06b0c1e30446-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fnq4r\" (UID: \"c0912f3f-c1ed-4638-b0d4-06b0c1e30446\") " pod="openshift-insights/insights-runtime-extractor-fnq4r" Jul 15 21:07:08.413056 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:07:08.413008 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 21:07:08.413219 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:07:08.413058 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 21:07:08.413219 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:07:08.413084 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 21:07:08.413219 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:07:08.413087 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c0912f3f-c1ed-4638-b0d4-06b0c1e30446-kube-rbac-proxy-cm podName:c0912f3f-c1ed-4638-b0d4-06b0c1e30446 nodeName:}" failed. No retries permitted until 2026-07-15 21:07:10.413065689 +0000 UTC m=+38.663490798 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c0912f3f-c1ed-4638-b0d4-06b0c1e30446-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fnq4r" (UID: "c0912f3f-c1ed-4638-b0d4-06b0c1e30446") : configmap "kube-rbac-proxy" not found Jul 15 21:07:08.413219 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:07:08.413143 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b3235b9-54ed-4356-be73-4bf0dccf41ac-metrics-tls podName:3b3235b9-54ed-4356-be73-4bf0dccf41ac nodeName:}" failed. No retries permitted until 2026-07-15 21:07:10.413126903 +0000 UTC m=+38.663552020 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3b3235b9-54ed-4356-be73-4bf0dccf41ac-metrics-tls") pod "dns-default-2fm9z" (UID: "3b3235b9-54ed-4356-be73-4bf0dccf41ac") : secret "dns-default-metrics-tls" not found Jul 15 21:07:08.413219 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:07:08.413157 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0912f3f-c1ed-4638-b0d4-06b0c1e30446-insights-runtime-extractor-tls podName:c0912f3f-c1ed-4638-b0d4-06b0c1e30446 nodeName:}" failed. No retries permitted until 2026-07-15 21:07:10.413148333 +0000 UTC m=+38.663573447 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c0912f3f-c1ed-4638-b0d4-06b0c1e30446-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fnq4r" (UID: "c0912f3f-c1ed-4638-b0d4-06b0c1e30446") : secret "insights-runtime-extractor-tls" not found Jul 15 21:07:10.328773 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:10.328616 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830-registry-tls\") pod \"image-registry-67fbf55486-b7b2r\" (UID: \"2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830\") " pod="openshift-image-registry/image-registry-67fbf55486-b7b2r" Jul 15 21:07:10.328773 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:07:10.328768 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 21:07:10.329195 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:07:10.328790 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67fbf55486-b7b2r: secret "image-registry-tls" not found Jul 15 21:07:10.329195 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:07:10.328848 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830-registry-tls podName:2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830 nodeName:}" failed. No retries permitted until 2026-07-15 21:07:14.328828011 +0000 UTC m=+42.579253125 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830-registry-tls") pod "image-registry-67fbf55486-b7b2r" (UID: "2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830") : secret "image-registry-tls" not found Jul 15 21:07:10.429613 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:10.429586 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c0912f3f-c1ed-4638-b0d4-06b0c1e30446-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fnq4r\" (UID: \"c0912f3f-c1ed-4638-b0d4-06b0c1e30446\") " pod="openshift-insights/insights-runtime-extractor-fnq4r" Jul 15 21:07:10.429746 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:10.429647 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b3235b9-54ed-4356-be73-4bf0dccf41ac-metrics-tls\") pod \"dns-default-2fm9z\" (UID: \"3b3235b9-54ed-4356-be73-4bf0dccf41ac\") " pod="openshift-dns/dns-default-2fm9z" Jul 15 21:07:10.429746 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:10.429690 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c0912f3f-c1ed-4638-b0d4-06b0c1e30446-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fnq4r\" (UID: \"c0912f3f-c1ed-4638-b0d4-06b0c1e30446\") " pod="openshift-insights/insights-runtime-extractor-fnq4r" Jul 15 21:07:10.429746 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:07:10.429715 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 21:07:10.429903 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:07:10.429794 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c0912f3f-c1ed-4638-b0d4-06b0c1e30446-kube-rbac-proxy-cm podName:c0912f3f-c1ed-4638-b0d4-06b0c1e30446 nodeName:}" failed. No retries permitted until 2026-07-15 21:07:14.429779957 +0000 UTC m=+42.680205067 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c0912f3f-c1ed-4638-b0d4-06b0c1e30446-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fnq4r" (UID: "c0912f3f-c1ed-4638-b0d4-06b0c1e30446") : configmap "kube-rbac-proxy" not found Jul 15 21:07:10.429903 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:07:10.429824 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 21:07:10.429903 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:07:10.429866 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 21:07:10.430018 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:07:10.429876 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b3235b9-54ed-4356-be73-4bf0dccf41ac-metrics-tls podName:3b3235b9-54ed-4356-be73-4bf0dccf41ac nodeName:}" failed. No retries permitted until 2026-07-15 21:07:14.429863539 +0000 UTC m=+42.680288647 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3b3235b9-54ed-4356-be73-4bf0dccf41ac-metrics-tls") pod "dns-default-2fm9z" (UID: "3b3235b9-54ed-4356-be73-4bf0dccf41ac") : secret "dns-default-metrics-tls" not found Jul 15 21:07:10.430018 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:07:10.429928 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0912f3f-c1ed-4638-b0d4-06b0c1e30446-insights-runtime-extractor-tls podName:c0912f3f-c1ed-4638-b0d4-06b0c1e30446 nodeName:}" failed. No retries permitted until 2026-07-15 21:07:14.429912885 +0000 UTC m=+42.680337999 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c0912f3f-c1ed-4638-b0d4-06b0c1e30446-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fnq4r" (UID: "c0912f3f-c1ed-4638-b0d4-06b0c1e30446") : secret "insights-runtime-extractor-tls" not found Jul 15 21:07:10.518322 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:10.518230 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nnjbb" event={"ID":"93d20337-473b-42b5-ac3d-a0194250fbed","Type":"ContainerStarted","Data":"d45d6134f73c3a426abb99a52e95535a433f1e2c5aa93b19115fc26c41f44c06"} Jul 15 21:07:10.520945 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:10.520915 2577 generic.go:356] "Generic (PLEG): container finished" podID="2e956ca6-aae2-482a-a1d6-6b904a4e0551" containerID="e7b8438ac7d6087b3d0c8cdf9f33712e5e64a866b1b6606ad6bda0a206eebe1e" exitCode=0 Jul 15 21:07:10.521045 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:10.520959 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7plx5" event={"ID":"2e956ca6-aae2-482a-a1d6-6b904a4e0551","Type":"ContainerDied","Data":"e7b8438ac7d6087b3d0c8cdf9f33712e5e64a866b1b6606ad6bda0a206eebe1e"} Jul 15 21:07:10.541364 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:10.541192 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-nnjbb" podStartSLOduration=1.400164347 podStartE2EDuration="4.541175259s" totalImagesPullingTime="3.141010912s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:07:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:07:10.540457277 +0000 UTC m=+38.790882408" watchObservedRunningTime="2026-07-15 21:07:10.541175259 +0000 UTC m=+38.791600391" Jul 15 21:07:11.528704 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:11.528673 2577 generic.go:356] "Generic (PLEG): container finished" podID="2e956ca6-aae2-482a-a1d6-6b904a4e0551" containerID="1fddb72fa2622531afddcc79608e732265234e50722b36b4d7a68c3e60d38e3b" exitCode=0 Jul 15 21:07:11.529217 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:11.528758 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7plx5" event={"ID":"2e956ca6-aae2-482a-a1d6-6b904a4e0551","Type":"ContainerDied","Data":"1fddb72fa2622531afddcc79608e732265234e50722b36b4d7a68c3e60d38e3b"} Jul 15 21:07:12.534616 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:12.534581 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7plx5" event={"ID":"2e956ca6-aae2-482a-a1d6-6b904a4e0551","Type":"ContainerStarted","Data":"2111c025e7eda300831f1839f6a45a2315ce815238e6644cbdca4d83d8d3e866"} Jul 15 21:07:12.563298 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:12.563259 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7plx5" podStartSLOduration=8.339107181 podStartE2EDuration="40.563243938s" totalImagesPullingTime="32.224136757s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:06:32 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:07:12.561530111 +0000 UTC m=+40.811955238" watchObservedRunningTime="2026-07-15 21:07:12.563243938 +0000 UTC m=+40.813669069" Jul 15 21:07:14.360345 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:14.360313 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830-registry-tls\") pod \"image-registry-67fbf55486-b7b2r\" (UID: \"2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830\") " pod="openshift-image-registry/image-registry-67fbf55486-b7b2r" Jul 15 21:07:14.360834 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:07:14.360438 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 21:07:14.360834 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:07:14.360456 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67fbf55486-b7b2r: secret "image-registry-tls" not found Jul 15 21:07:14.360834 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:07:14.360521 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830-registry-tls podName:2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830 nodeName:}" failed. No retries permitted until 2026-07-15 21:07:22.360501216 +0000 UTC m=+50.610926341 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830-registry-tls") pod "image-registry-67fbf55486-b7b2r" (UID: "2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830") : secret "image-registry-tls" not found Jul 15 21:07:14.460862 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:14.460824 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c0912f3f-c1ed-4638-b0d4-06b0c1e30446-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fnq4r\" (UID: \"c0912f3f-c1ed-4638-b0d4-06b0c1e30446\") " pod="openshift-insights/insights-runtime-extractor-fnq4r" Jul 15 21:07:14.461028 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:14.460883 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b3235b9-54ed-4356-be73-4bf0dccf41ac-metrics-tls\") pod \"dns-default-2fm9z\" (UID: \"3b3235b9-54ed-4356-be73-4bf0dccf41ac\") " pod="openshift-dns/dns-default-2fm9z" Jul 15 21:07:14.461028 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:14.460925 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c0912f3f-c1ed-4638-b0d4-06b0c1e30446-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fnq4r\" (UID: \"c0912f3f-c1ed-4638-b0d4-06b0c1e30446\") " pod="openshift-insights/insights-runtime-extractor-fnq4r" Jul 15 21:07:14.461142 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:07:14.461030 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 21:07:14.461142 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:07:14.461069 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 21:07:14.461142 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:07:14.461088 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b3235b9-54ed-4356-be73-4bf0dccf41ac-metrics-tls podName:3b3235b9-54ed-4356-be73-4bf0dccf41ac nodeName:}" failed. No retries permitted until 2026-07-15 21:07:22.461073833 +0000 UTC m=+50.711498943 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3b3235b9-54ed-4356-be73-4bf0dccf41ac-metrics-tls") pod "dns-default-2fm9z" (UID: "3b3235b9-54ed-4356-be73-4bf0dccf41ac") : secret "dns-default-metrics-tls" not found Jul 15 21:07:14.461142 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:07:14.461120 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0912f3f-c1ed-4638-b0d4-06b0c1e30446-insights-runtime-extractor-tls podName:c0912f3f-c1ed-4638-b0d4-06b0c1e30446 nodeName:}" failed. No retries permitted until 2026-07-15 21:07:22.461104407 +0000 UTC m=+50.711529519 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c0912f3f-c1ed-4638-b0d4-06b0c1e30446-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fnq4r" (UID: "c0912f3f-c1ed-4638-b0d4-06b0c1e30446") : secret "insights-runtime-extractor-tls" not found Jul 15 21:07:14.461382 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:14.461362 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c0912f3f-c1ed-4638-b0d4-06b0c1e30446-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fnq4r\" (UID: \"c0912f3f-c1ed-4638-b0d4-06b0c1e30446\") " pod="openshift-insights/insights-runtime-extractor-fnq4r" Jul 15 21:07:22.419471 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:22.419438 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830-registry-tls\") pod \"image-registry-67fbf55486-b7b2r\" (UID: \"2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830\") " pod="openshift-image-registry/image-registry-67fbf55486-b7b2r" Jul 15 21:07:22.422960 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:22.422939 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830-registry-tls\") pod \"image-registry-67fbf55486-b7b2r\" (UID: \"2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830\") " pod="openshift-image-registry/image-registry-67fbf55486-b7b2r" Jul 15 21:07:22.498780 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:22.498750 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67fbf55486-b7b2r" Jul 15 21:07:22.519926 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:22.519899 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b3235b9-54ed-4356-be73-4bf0dccf41ac-metrics-tls\") pod \"dns-default-2fm9z\" (UID: \"3b3235b9-54ed-4356-be73-4bf0dccf41ac\") " pod="openshift-dns/dns-default-2fm9z" Jul 15 21:07:22.520033 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:22.519955 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c0912f3f-c1ed-4638-b0d4-06b0c1e30446-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fnq4r\" (UID: \"c0912f3f-c1ed-4638-b0d4-06b0c1e30446\") " pod="openshift-insights/insights-runtime-extractor-fnq4r" Jul 15 21:07:22.522251 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:22.522225 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c0912f3f-c1ed-4638-b0d4-06b0c1e30446-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fnq4r\" (UID: \"c0912f3f-c1ed-4638-b0d4-06b0c1e30446\") " pod="openshift-insights/insights-runtime-extractor-fnq4r" Jul 15 21:07:22.522348 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:22.522225 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b3235b9-54ed-4356-be73-4bf0dccf41ac-metrics-tls\") pod \"dns-default-2fm9z\" (UID: \"3b3235b9-54ed-4356-be73-4bf0dccf41ac\") " pod="openshift-dns/dns-default-2fm9z" Jul 15 21:07:22.537147 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:22.537125 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2fm9z" Jul 15 21:07:22.644504 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:22.644427 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67fbf55486-b7b2r"] Jul 15 21:07:22.648832 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:07:22.648805 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c1aa2c4_5cf3_40af_b9aa_9d97b3eab830.slice/crio-659bbf6e29db7b461248d48f3fe75a75d3c70ff1d0485af4d79e8bd7a9ba7b59 WatchSource:0}: Error finding container 659bbf6e29db7b461248d48f3fe75a75d3c70ff1d0485af4d79e8bd7a9ba7b59: Status 404 returned error can't find the container with id 659bbf6e29db7b461248d48f3fe75a75d3c70ff1d0485af4d79e8bd7a9ba7b59 Jul 15 21:07:22.694648 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:22.694618 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2fm9z"] Jul 15 21:07:22.700700 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:07:22.700668 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b3235b9_54ed_4356_be73_4bf0dccf41ac.slice/crio-2c6e711a25915de787db0663b108718c471c1d264260525958781034e83bae8f WatchSource:0}: Error finding container 2c6e711a25915de787db0663b108718c471c1d264260525958781034e83bae8f: Status 404 returned error can't find the container with id 2c6e711a25915de787db0663b108718c471c1d264260525958781034e83bae8f Jul 15 21:07:22.822479 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:22.822454 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fnq4r" Jul 15 21:07:22.955128 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:22.955057 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fnq4r"] Jul 15 21:07:22.958221 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:07:22.958198 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0912f3f_c1ed_4638_b0d4_06b0c1e30446.slice/crio-3cc44f46fcb04c8b52304d82b88c347486606d800cad7df5c72af423eaabcbd9 WatchSource:0}: Error finding container 3cc44f46fcb04c8b52304d82b88c347486606d800cad7df5c72af423eaabcbd9: Status 404 returned error can't find the container with id 3cc44f46fcb04c8b52304d82b88c347486606d800cad7df5c72af423eaabcbd9 Jul 15 21:07:23.563275 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:23.563235 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2fm9z" event={"ID":"3b3235b9-54ed-4356-be73-4bf0dccf41ac","Type":"ContainerStarted","Data":"2c6e711a25915de787db0663b108718c471c1d264260525958781034e83bae8f"} Jul 15 21:07:23.565560 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:23.565514 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67fbf55486-b7b2r" event={"ID":"2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830","Type":"ContainerStarted","Data":"f7e19102c0fe0964c933945f26b8f77ef8fdb95f8cd6d9db63d6ef880f18c2d6"} Jul 15 21:07:23.567947 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:23.567419 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67fbf55486-b7b2r" event={"ID":"2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830","Type":"ContainerStarted","Data":"659bbf6e29db7b461248d48f3fe75a75d3c70ff1d0485af4d79e8bd7a9ba7b59"} Jul 15 21:07:23.567947 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:23.567489 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-67fbf55486-b7b2r" Jul 15 21:07:23.570234 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:23.569805 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fnq4r" event={"ID":"c0912f3f-c1ed-4638-b0d4-06b0c1e30446","Type":"ContainerStarted","Data":"3cc44f46fcb04c8b52304d82b88c347486606d800cad7df5c72af423eaabcbd9"} Jul 15 21:07:23.591424 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:23.591349 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-67fbf55486-b7b2r" podStartSLOduration=24.591332048 podStartE2EDuration="24.591332048s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:06:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:07:23.589811956 +0000 UTC m=+51.840237090" watchObservedRunningTime="2026-07-15 21:07:23.591332048 +0000 UTC m=+51.841757180" Jul 15 21:07:28.586055 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:28.586009 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fnq4r" event={"ID":"c0912f3f-c1ed-4638-b0d4-06b0c1e30446","Type":"ContainerStarted","Data":"c0c99b059d8cfa978c6ed776dca1f502397f89411f6a62970da6fbb6cf4798de"} Jul 15 21:07:28.589174 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:28.589136 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2fm9z" event={"ID":"3b3235b9-54ed-4356-be73-4bf0dccf41ac","Type":"ContainerStarted","Data":"57537a3095eab2aa98eb14ab2fe0107634862eb8071565be8acf5a5993910673"} Jul 15 21:07:28.589302 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:28.589190 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2fm9z" event={"ID":"3b3235b9-54ed-4356-be73-4bf0dccf41ac","Type":"ContainerStarted","Data":"d304eb4539706ac5ac287f95d52a4ac2188a05c7409bc2edc7966ab1928d35ec"} Jul 15 21:07:28.589440 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:28.589419 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-2fm9z" Jul 15 21:07:28.623816 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:28.623763 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-2fm9z" podStartSLOduration=17.289903796 podStartE2EDuration="22.623708622s" totalImagesPullingTime="5.333804826s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:07:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:07:28.622498186 +0000 UTC m=+56.872923310" watchObservedRunningTime="2026-07-15 21:07:28.623708622 +0000 UTC m=+56.874133756" Jul 15 21:07:31.443321 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:31.443274 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-9b7885786-hs275"] Jul 15 21:07:31.449058 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:31.449034 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9b7885786-hs275" Jul 15 21:07:31.454937 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:31.454913 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 15 21:07:31.455077 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:31.454972 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 15 21:07:31.456074 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:31.456059 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 15 21:07:31.456178 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:31.456140 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 15 21:07:31.483625 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:31.483606 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-9b7885786-hs275"] Jul 15 21:07:31.490710 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:31.490692 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zkzq\" (UniqueName: \"kubernetes.io/projected/55b41f22-1ae1-4595-a3d8-c06d446595eb-kube-api-access-2zkzq\") pod \"klusterlet-addon-workmgr-9b7885786-hs275\" (UID: \"55b41f22-1ae1-4595-a3d8-c06d446595eb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9b7885786-hs275" Jul 15 21:07:31.490773 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:31.490739 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/55b41f22-1ae1-4595-a3d8-c06d446595eb-tmp\") pod \"klusterlet-addon-workmgr-9b7885786-hs275\" (UID: \"55b41f22-1ae1-4595-a3d8-c06d446595eb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9b7885786-hs275" Jul 15 21:07:31.490815 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:31.490786 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/55b41f22-1ae1-4595-a3d8-c06d446595eb-klusterlet-config\") pod \"klusterlet-addon-workmgr-9b7885786-hs275\" (UID: \"55b41f22-1ae1-4595-a3d8-c06d446595eb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9b7885786-hs275" Jul 15 21:07:31.526001 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:31.525976 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-hq278"] Jul 15 21:07:31.544246 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:31.544202 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-67fbf55486-b7b2r"] Jul 15 21:07:31.544382 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:31.544366 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-hq278" Jul 15 21:07:31.545789 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:31.545709 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-hq278"] Jul 15 21:07:31.547860 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:31.547838 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 15 21:07:31.548878 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:31.548858 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 15 21:07:31.549026 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:31.548954 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-wt6wl\"" Jul 15 21:07:31.591142 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:31.591119 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/55b41f22-1ae1-4595-a3d8-c06d446595eb-tmp\") pod \"klusterlet-addon-workmgr-9b7885786-hs275\" (UID: \"55b41f22-1ae1-4595-a3d8-c06d446595eb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9b7885786-hs275" Jul 15 21:07:31.591233 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:31.591148 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fbe2bf2b-9f4b-4117-bcf1-1631124eb65d-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-hq278\" (UID: \"fbe2bf2b-9f4b-4117-bcf1-1631124eb65d\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-hq278" Jul 15 21:07:31.591233 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:31.591180 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fbe2bf2b-9f4b-4117-bcf1-1631124eb65d-nginx-conf\") pod \"networking-console-plugin-6cf856758c-hq278\" (UID: \"fbe2bf2b-9f4b-4117-bcf1-1631124eb65d\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-hq278" Jul 15 21:07:31.591310 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:31.591236 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/55b41f22-1ae1-4595-a3d8-c06d446595eb-klusterlet-config\") pod \"klusterlet-addon-workmgr-9b7885786-hs275\" (UID: \"55b41f22-1ae1-4595-a3d8-c06d446595eb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9b7885786-hs275" Jul 15 21:07:31.591361 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:31.591343 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zkzq\" (UniqueName: \"kubernetes.io/projected/55b41f22-1ae1-4595-a3d8-c06d446595eb-kube-api-access-2zkzq\") pod \"klusterlet-addon-workmgr-9b7885786-hs275\" (UID: \"55b41f22-1ae1-4595-a3d8-c06d446595eb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9b7885786-hs275" Jul 15 21:07:31.591541 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:31.591508 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/55b41f22-1ae1-4595-a3d8-c06d446595eb-tmp\") pod \"klusterlet-addon-workmgr-9b7885786-hs275\" (UID: \"55b41f22-1ae1-4595-a3d8-c06d446595eb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9b7885786-hs275" Jul 15 21:07:31.593398 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:31.593381 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/55b41f22-1ae1-4595-a3d8-c06d446595eb-klusterlet-config\") pod \"klusterlet-addon-workmgr-9b7885786-hs275\" (UID: \"55b41f22-1ae1-4595-a3d8-c06d446595eb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9b7885786-hs275" Jul 15 21:07:31.600960 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:31.600931 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fnq4r" event={"ID":"c0912f3f-c1ed-4638-b0d4-06b0c1e30446","Type":"ContainerStarted","Data":"e13e6a07c6273a31e8d82cd3e5b515f43638147dadc5245c45e094f2cc2397b8"} Jul 15 21:07:31.604760 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:31.604738 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zkzq\" (UniqueName: \"kubernetes.io/projected/55b41f22-1ae1-4595-a3d8-c06d446595eb-kube-api-access-2zkzq\") pod \"klusterlet-addon-workmgr-9b7885786-hs275\" (UID: \"55b41f22-1ae1-4595-a3d8-c06d446595eb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9b7885786-hs275" Jul 15 21:07:31.605640 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:31.605624 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5577c596d-np767"] Jul 15 21:07:31.624403 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:31.624388 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5577c596d-np767" Jul 15 21:07:31.627427 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:31.627399 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5577c596d-np767"] Jul 15 21:07:31.692411 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:31.692388 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkrhb\" (UniqueName: \"kubernetes.io/projected/3609b182-cc8b-4cb8-a87a-5b17b361b0df-kube-api-access-zkrhb\") pod \"image-registry-5577c596d-np767\" (UID: \"3609b182-cc8b-4cb8-a87a-5b17b361b0df\") " pod="openshift-image-registry/image-registry-5577c596d-np767" Jul 15 21:07:31.692497 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:31.692415 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3609b182-cc8b-4cb8-a87a-5b17b361b0df-ca-trust-extracted\") pod \"image-registry-5577c596d-np767\" (UID: \"3609b182-cc8b-4cb8-a87a-5b17b361b0df\") " pod="openshift-image-registry/image-registry-5577c596d-np767" Jul 15 21:07:31.692497 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:31.692435 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3609b182-cc8b-4cb8-a87a-5b17b361b0df-registry-tls\") pod \"image-registry-5577c596d-np767\" (UID: \"3609b182-cc8b-4cb8-a87a-5b17b361b0df\") " pod="openshift-image-registry/image-registry-5577c596d-np767" Jul 15 21:07:31.692497 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:31.692449 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3609b182-cc8b-4cb8-a87a-5b17b361b0df-registry-certificates\") pod \"image-registry-5577c596d-np767\" (UID: \"3609b182-cc8b-4cb8-a87a-5b17b361b0df\") " pod="openshift-image-registry/image-registry-5577c596d-np767" Jul 15 21:07:31.692497 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:31.692483 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3609b182-cc8b-4cb8-a87a-5b17b361b0df-installation-pull-secrets\") pod \"image-registry-5577c596d-np767\" (UID: \"3609b182-cc8b-4cb8-a87a-5b17b361b0df\") " pod="openshift-image-registry/image-registry-5577c596d-np767" Jul 15 21:07:31.692642 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:31.692568 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3609b182-cc8b-4cb8-a87a-5b17b361b0df-bound-sa-token\") pod \"image-registry-5577c596d-np767\" (UID: \"3609b182-cc8b-4cb8-a87a-5b17b361b0df\") " pod="openshift-image-registry/image-registry-5577c596d-np767" Jul 15 21:07:31.692642 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:31.692613 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3609b182-cc8b-4cb8-a87a-5b17b361b0df-image-registry-private-configuration\") pod \"image-registry-5577c596d-np767\" (UID: \"3609b182-cc8b-4cb8-a87a-5b17b361b0df\") " pod="openshift-image-registry/image-registry-5577c596d-np767" Jul 15 21:07:31.692739 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:31.692652 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3609b182-cc8b-4cb8-a87a-5b17b361b0df-trusted-ca\") pod \"image-registry-5577c596d-np767\" (UID: \"3609b182-cc8b-4cb8-a87a-5b17b361b0df\") " pod="openshift-image-registry/image-registry-5577c596d-np767" Jul 15 21:07:31.692739 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:31.692685 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fbe2bf2b-9f4b-4117-bcf1-1631124eb65d-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-hq278\" (UID: \"fbe2bf2b-9f4b-4117-bcf1-1631124eb65d\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-hq278" Jul 15 21:07:31.692854 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:31.692839 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fbe2bf2b-9f4b-4117-bcf1-1631124eb65d-nginx-conf\") pod \"networking-console-plugin-6cf856758c-hq278\" (UID: \"fbe2bf2b-9f4b-4117-bcf1-1631124eb65d\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-hq278" Jul 15 21:07:31.693430 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:31.693391 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fbe2bf2b-9f4b-4117-bcf1-1631124eb65d-nginx-conf\") pod \"networking-console-plugin-6cf856758c-hq278\" (UID: \"fbe2bf2b-9f4b-4117-bcf1-1631124eb65d\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-hq278" Jul 15 21:07:31.694884 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:31.694863 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fbe2bf2b-9f4b-4117-bcf1-1631124eb65d-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-hq278\" (UID: \"fbe2bf2b-9f4b-4117-bcf1-1631124eb65d\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-hq278" Jul 15 21:07:31.759246 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:31.759218 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9b7885786-hs275" Jul 15 21:07:31.793346 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:31.793325 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3609b182-cc8b-4cb8-a87a-5b17b361b0df-bound-sa-token\") pod \"image-registry-5577c596d-np767\" (UID: \"3609b182-cc8b-4cb8-a87a-5b17b361b0df\") " pod="openshift-image-registry/image-registry-5577c596d-np767" Jul 15 21:07:31.793441 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:31.793370 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3609b182-cc8b-4cb8-a87a-5b17b361b0df-image-registry-private-configuration\") pod \"image-registry-5577c596d-np767\" (UID: \"3609b182-cc8b-4cb8-a87a-5b17b361b0df\") " pod="openshift-image-registry/image-registry-5577c596d-np767" Jul 15 21:07:31.793441 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:31.793417 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3609b182-cc8b-4cb8-a87a-5b17b361b0df-trusted-ca\") pod \"image-registry-5577c596d-np767\" (UID: \"3609b182-cc8b-4cb8-a87a-5b17b361b0df\") " pod="openshift-image-registry/image-registry-5577c596d-np767" Jul 15 21:07:31.793538 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:31.793468 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkrhb\" (UniqueName: \"kubernetes.io/projected/3609b182-cc8b-4cb8-a87a-5b17b361b0df-kube-api-access-zkrhb\") pod \"image-registry-5577c596d-np767\" (UID: \"3609b182-cc8b-4cb8-a87a-5b17b361b0df\") " pod="openshift-image-registry/image-registry-5577c596d-np767" Jul 15 21:07:31.793538 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:31.793519 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3609b182-cc8b-4cb8-a87a-5b17b361b0df-ca-trust-extracted\") pod \"image-registry-5577c596d-np767\" (UID: \"3609b182-cc8b-4cb8-a87a-5b17b361b0df\") " pod="openshift-image-registry/image-registry-5577c596d-np767" Jul 15 21:07:31.793694 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:31.793566 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3609b182-cc8b-4cb8-a87a-5b17b361b0df-registry-tls\") pod \"image-registry-5577c596d-np767\" (UID: \"3609b182-cc8b-4cb8-a87a-5b17b361b0df\") " pod="openshift-image-registry/image-registry-5577c596d-np767" Jul 15 21:07:31.793694 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:31.793592 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3609b182-cc8b-4cb8-a87a-5b17b361b0df-registry-certificates\") pod \"image-registry-5577c596d-np767\" (UID: \"3609b182-cc8b-4cb8-a87a-5b17b361b0df\") " pod="openshift-image-registry/image-registry-5577c596d-np767" Jul 15 21:07:31.793694 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:31.793611 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3609b182-cc8b-4cb8-a87a-5b17b361b0df-installation-pull-secrets\") pod \"image-registry-5577c596d-np767\" (UID: \"3609b182-cc8b-4cb8-a87a-5b17b361b0df\") " pod="openshift-image-registry/image-registry-5577c596d-np767" Jul 15 21:07:31.794008 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:31.793988 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3609b182-cc8b-4cb8-a87a-5b17b361b0df-ca-trust-extracted\") pod \"image-registry-5577c596d-np767\" (UID: \"3609b182-cc8b-4cb8-a87a-5b17b361b0df\") " pod="openshift-image-registry/image-registry-5577c596d-np767" Jul 15 21:07:31.794393 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:31.794371 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3609b182-cc8b-4cb8-a87a-5b17b361b0df-trusted-ca\") pod \"image-registry-5577c596d-np767\" (UID: \"3609b182-cc8b-4cb8-a87a-5b17b361b0df\") " pod="openshift-image-registry/image-registry-5577c596d-np767" Jul 15 21:07:31.794535 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:31.794512 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3609b182-cc8b-4cb8-a87a-5b17b361b0df-registry-certificates\") pod \"image-registry-5577c596d-np767\" (UID: \"3609b182-cc8b-4cb8-a87a-5b17b361b0df\") " pod="openshift-image-registry/image-registry-5577c596d-np767" Jul 15 21:07:31.796123 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:31.796102 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3609b182-cc8b-4cb8-a87a-5b17b361b0df-registry-tls\") pod \"image-registry-5577c596d-np767\" (UID: \"3609b182-cc8b-4cb8-a87a-5b17b361b0df\") " pod="openshift-image-registry/image-registry-5577c596d-np767" Jul 15 21:07:31.796351 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:31.796333 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3609b182-cc8b-4cb8-a87a-5b17b361b0df-installation-pull-secrets\") pod \"image-registry-5577c596d-np767\" (UID: \"3609b182-cc8b-4cb8-a87a-5b17b361b0df\") " pod="openshift-image-registry/image-registry-5577c596d-np767" Jul 15 21:07:31.796409 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:31.796382 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3609b182-cc8b-4cb8-a87a-5b17b361b0df-image-registry-private-configuration\") pod \"image-registry-5577c596d-np767\" (UID: \"3609b182-cc8b-4cb8-a87a-5b17b361b0df\") " pod="openshift-image-registry/image-registry-5577c596d-np767" Jul 15 21:07:31.803132 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:31.803109 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkrhb\" (UniqueName: \"kubernetes.io/projected/3609b182-cc8b-4cb8-a87a-5b17b361b0df-kube-api-access-zkrhb\") pod \"image-registry-5577c596d-np767\" (UID: \"3609b182-cc8b-4cb8-a87a-5b17b361b0df\") " pod="openshift-image-registry/image-registry-5577c596d-np767" Jul 15 21:07:31.803293 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:31.803271 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3609b182-cc8b-4cb8-a87a-5b17b361b0df-bound-sa-token\") pod \"image-registry-5577c596d-np767\" (UID: \"3609b182-cc8b-4cb8-a87a-5b17b361b0df\") " pod="openshift-image-registry/image-registry-5577c596d-np767" Jul 15 21:07:31.854962 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:31.854933 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-hq278" Jul 15 21:07:31.901677 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:31.901562 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-9b7885786-hs275"] Jul 15 21:07:31.903867 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:07:31.903845 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55b41f22_1ae1_4595_a3d8_c06d446595eb.slice/crio-a830566fb7f4d620aecb5f94d08c1c09df952859ffcffa1fb346f870bdfb3f2c WatchSource:0}: Error finding container a830566fb7f4d620aecb5f94d08c1c09df952859ffcffa1fb346f870bdfb3f2c: Status 404 returned error can't find the container with id a830566fb7f4d620aecb5f94d08c1c09df952859ffcffa1fb346f870bdfb3f2c Jul 15 21:07:31.933415 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:31.933332 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5577c596d-np767" Jul 15 21:07:32.016277 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:32.016239 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-hq278"] Jul 15 21:07:32.020188 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:07:32.020156 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbe2bf2b_9f4b_4117_bcf1_1631124eb65d.slice/crio-50f2ba777e393f027731a4df41f8d08bda4e8c0af8504bc0358d29c05e19ea7a WatchSource:0}: Error finding container 50f2ba777e393f027731a4df41f8d08bda4e8c0af8504bc0358d29c05e19ea7a: Status 404 returned error can't find the container with id 50f2ba777e393f027731a4df41f8d08bda4e8c0af8504bc0358d29c05e19ea7a Jul 15 21:07:32.094778 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:32.094748 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5577c596d-np767"] Jul 15 21:07:32.097693 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:07:32.097665 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3609b182_cc8b_4cb8_a87a_5b17b361b0df.slice/crio-71519d6f0923bedf9c8f31de0e6aad2b7cab0bb79a7bf7d424852b0d1d62ad7e WatchSource:0}: Error finding container 71519d6f0923bedf9c8f31de0e6aad2b7cab0bb79a7bf7d424852b0d1d62ad7e: Status 404 returned error can't find the container with id 71519d6f0923bedf9c8f31de0e6aad2b7cab0bb79a7bf7d424852b0d1d62ad7e Jul 15 21:07:32.605991 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:32.605871 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-hq278" event={"ID":"fbe2bf2b-9f4b-4117-bcf1-1631124eb65d","Type":"ContainerStarted","Data":"50f2ba777e393f027731a4df41f8d08bda4e8c0af8504bc0358d29c05e19ea7a"} Jul 15 21:07:32.607484 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:32.607440 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5577c596d-np767" event={"ID":"3609b182-cc8b-4cb8-a87a-5b17b361b0df","Type":"ContainerStarted","Data":"ae22803f0ad4b025b610f6cada9419e9061ffa535ad0b953e05afec1e19b8da4"} Jul 15 21:07:32.607622 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:32.607496 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5577c596d-np767" event={"ID":"3609b182-cc8b-4cb8-a87a-5b17b361b0df","Type":"ContainerStarted","Data":"71519d6f0923bedf9c8f31de0e6aad2b7cab0bb79a7bf7d424852b0d1d62ad7e"} Jul 15 21:07:32.607622 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:32.607561 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5577c596d-np767" Jul 15 21:07:32.608836 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:32.608797 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9b7885786-hs275" event={"ID":"55b41f22-1ae1-4595-a3d8-c06d446595eb","Type":"ContainerStarted","Data":"a830566fb7f4d620aecb5f94d08c1c09df952859ffcffa1fb346f870bdfb3f2c"} Jul 15 21:07:32.630740 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:32.630670 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5577c596d-np767" podStartSLOduration=1.6306557430000002 podStartE2EDuration="1.630655743s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:07:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:07:32.629261819 +0000 UTC m=+60.879686951" watchObservedRunningTime="2026-07-15 21:07:32.630655743 +0000 UTC m=+60.881080873" Jul 15 21:07:33.521626 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:33.520090 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qm2hk" Jul 15 21:07:33.914381 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:33.914344 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-rxsxm"] Jul 15 21:07:33.918443 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:33.918412 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-rxsxm" Jul 15 21:07:33.923552 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:33.923089 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-jr94j\"" Jul 15 21:07:33.929147 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:33.929121 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-rxsxm"] Jul 15 21:07:33.938912 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:33.938892 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 15 21:07:34.013784 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:34.013752 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e7dd7a2c-856f-4661-85a0-46b89d4f8e61-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-rxsxm\" (UID: \"e7dd7a2c-856f-4661-85a0-46b89d4f8e61\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-rxsxm" Jul 15 21:07:34.115177 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:34.115138 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e7dd7a2c-856f-4661-85a0-46b89d4f8e61-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-rxsxm\" (UID: \"e7dd7a2c-856f-4661-85a0-46b89d4f8e61\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-rxsxm" Jul 15 21:07:34.118234 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:34.118209 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e7dd7a2c-856f-4661-85a0-46b89d4f8e61-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-rxsxm\" (UID: \"e7dd7a2c-856f-4661-85a0-46b89d4f8e61\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-rxsxm" Jul 15 21:07:34.232004 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:34.231925 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-rxsxm" Jul 15 21:07:35.623285 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:35.623252 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-hq278" event={"ID":"fbe2bf2b-9f4b-4117-bcf1-1631124eb65d","Type":"ContainerStarted","Data":"ec11f88a9884b4251f6fa9fa9ea33ae5d9374da1be447930406483c6cbd40282"} Jul 15 21:07:35.645299 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:35.645239 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-hq278" podStartSLOduration=3.085378327 podStartE2EDuration="4.645217933s" totalImagesPullingTime="1.559839606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:07:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:07:35.644602205 +0000 UTC m=+63.895027337" watchObservedRunningTime="2026-07-15 21:07:35.645217933 +0000 UTC m=+63.895643062" Jul 15 21:07:37.378762 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:37.378716 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-rxsxm"] Jul 15 21:07:37.381770 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:07:37.381742 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7dd7a2c_856f_4661_85a0_46b89d4f8e61.slice/crio-e228007c7a80f9259950178bb916fac18e4a6767faa740059d4ded34931257cf WatchSource:0}: Error finding container e228007c7a80f9259950178bb916fac18e4a6767faa740059d4ded34931257cf: Status 404 returned error can't find the container with id e228007c7a80f9259950178bb916fac18e4a6767faa740059d4ded34931257cf Jul 15 21:07:37.630961 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:37.630867 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-rxsxm" event={"ID":"e7dd7a2c-856f-4661-85a0-46b89d4f8e61","Type":"ContainerStarted","Data":"e228007c7a80f9259950178bb916fac18e4a6767faa740059d4ded34931257cf"} Jul 15 21:07:37.632203 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:37.632178 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9b7885786-hs275" event={"ID":"55b41f22-1ae1-4595-a3d8-c06d446595eb","Type":"ContainerStarted","Data":"de100069ae2890ff3d269891b36acc531230533355a540e0f74189493515b327"} Jul 15 21:07:37.632353 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:37.632330 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9b7885786-hs275" Jul 15 21:07:37.634215 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:37.634196 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9b7885786-hs275" Jul 15 21:07:37.634405 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:37.634387 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fnq4r" event={"ID":"c0912f3f-c1ed-4638-b0d4-06b0c1e30446","Type":"ContainerStarted","Data":"38fbd9a67075133f5a434269b1b73258411aad7f82a43d3bda7c02ffe35890a5"} Jul 15 21:07:37.650610 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:37.650572 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9b7885786-hs275" podStartSLOduration=1.262622604 podStartE2EDuration="6.650559375s" totalImagesPullingTime="5.387936771s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:07:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:07:37.650182686 +0000 UTC m=+65.900607835" watchObservedRunningTime="2026-07-15 21:07:37.650559375 +0000 UTC m=+65.900984499" Jul 15 21:07:37.692281 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:37.692236 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-fnq4r" podStartSLOduration=17.519407641 podStartE2EDuration="31.69222251s" totalImagesPullingTime="14.172814869s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:07:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:07:37.691668147 +0000 UTC m=+65.942093291" watchObservedRunningTime="2026-07-15 21:07:37.69222251 +0000 UTC m=+65.942647640" Jul 15 21:07:37.947227 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:37.947186 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb2ca919-f019-4882-af3c-a6f2c6544aef-metrics-certs\") pod \"network-metrics-daemon-4bt89\" (UID: \"cb2ca919-f019-4882-af3c-a6f2c6544aef\") " pod="openshift-multus/network-metrics-daemon-4bt89" Jul 15 21:07:37.950286 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:37.950264 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 15 21:07:37.959605 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:37.959587 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb2ca919-f019-4882-af3c-a6f2c6544aef-metrics-certs\") pod \"network-metrics-daemon-4bt89\" (UID: \"cb2ca919-f019-4882-af3c-a6f2c6544aef\") " pod="openshift-multus/network-metrics-daemon-4bt89" Jul 15 21:07:38.048160 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:38.048122 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f12efede-b144-4c22-9e44-0990b6bb00af-original-pull-secret\") pod \"global-pull-secret-syncer-6n6hw\" (UID: \"f12efede-b144-4c22-9e44-0990b6bb00af\") " pod="kube-system/global-pull-secret-syncer-6n6hw" Jul 15 21:07:38.051211 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:38.051186 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 15 21:07:38.061059 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:38.061034 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f12efede-b144-4c22-9e44-0990b6bb00af-original-pull-secret\") pod \"global-pull-secret-syncer-6n6hw\" (UID: \"f12efede-b144-4c22-9e44-0990b6bb00af\") " pod="kube-system/global-pull-secret-syncer-6n6hw" Jul 15 21:07:38.149529 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:38.149497 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvdw7\" (UniqueName: \"kubernetes.io/projected/5a785f71-60da-4c64-b6bb-6c2abb587a4f-kube-api-access-cvdw7\") pod \"network-check-target-zzmkh\" (UID: \"5a785f71-60da-4c64-b6bb-6c2abb587a4f\") " pod="openshift-network-diagnostics/network-check-target-zzmkh" Jul 15 21:07:38.152392 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:38.152369 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 15 21:07:38.162685 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:38.162668 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 15 21:07:38.174084 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:38.174064 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvdw7\" (UniqueName: \"kubernetes.io/projected/5a785f71-60da-4c64-b6bb-6c2abb587a4f-kube-api-access-cvdw7\") pod \"network-check-target-zzmkh\" (UID: \"5a785f71-60da-4c64-b6bb-6c2abb587a4f\") " pod="openshift-network-diagnostics/network-check-target-zzmkh" Jul 15 21:07:38.247876 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:38.247853 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6n6hw" Jul 15 21:07:38.259107 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:38.259087 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jw9wn\"" Jul 15 21:07:38.264234 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:38.264213 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-v4wmg\"" Jul 15 21:07:38.267295 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:38.267279 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bt89" Jul 15 21:07:38.271545 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:38.271409 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzmkh" Jul 15 21:07:38.402858 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:38.402837 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6n6hw"] Jul 15 21:07:38.405959 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:07:38.405932 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf12efede_b144_4c22_9e44_0990b6bb00af.slice/crio-b74cb3430b8189efb4b03b939247a86bcea535b5c363d2d237363e07509503b9 WatchSource:0}: Error finding container b74cb3430b8189efb4b03b939247a86bcea535b5c363d2d237363e07509503b9: Status 404 returned error can't find the container with id b74cb3430b8189efb4b03b939247a86bcea535b5c363d2d237363e07509503b9 Jul 15 21:07:38.595306 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:38.595235 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-2fm9z" Jul 15 21:07:38.632586 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:38.632548 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4bt89"] Jul 15 21:07:38.633568 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:38.633549 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zzmkh"] Jul 15 21:07:38.635943 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:07:38.635912 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a785f71_60da_4c64_b6bb_6c2abb587a4f.slice/crio-b7c48b0cbfc4c3fd5f919b676887c07f2f87c892f7a833d84f83246fda5a48d3 WatchSource:0}: Error finding container b7c48b0cbfc4c3fd5f919b676887c07f2f87c892f7a833d84f83246fda5a48d3: Status 404 returned error can't find the container with id b7c48b0cbfc4c3fd5f919b676887c07f2f87c892f7a833d84f83246fda5a48d3 Jul 15 21:07:38.636497 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:07:38.636461 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb2ca919_f019_4882_af3c_a6f2c6544aef.slice/crio-f506a25e8e3316c7822e0c7e1987eb100fdd662ac3cd06c7553f79de95add52e WatchSource:0}: Error finding container f506a25e8e3316c7822e0c7e1987eb100fdd662ac3cd06c7553f79de95add52e: Status 404 returned error can't find the container with id f506a25e8e3316c7822e0c7e1987eb100fdd662ac3cd06c7553f79de95add52e Jul 15 21:07:38.641148 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:38.640990 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-rxsxm" event={"ID":"e7dd7a2c-856f-4661-85a0-46b89d4f8e61","Type":"ContainerStarted","Data":"bd23c4aaa9dd56d2e4578e5c5b141a11eeb5a0beb6be64e6204683f417cacfc4"} Jul 15 21:07:38.641387 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:38.641363 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-rxsxm" Jul 15 21:07:38.643794 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:38.643477 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6n6hw" event={"ID":"f12efede-b144-4c22-9e44-0990b6bb00af","Type":"ContainerStarted","Data":"b74cb3430b8189efb4b03b939247a86bcea535b5c363d2d237363e07509503b9"} Jul 15 21:07:38.647418 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:38.647397 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-rxsxm" Jul 15 21:07:38.659684 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:38.659639 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-rxsxm" podStartSLOduration=4.820413176 podStartE2EDuration="5.659624915s" totalImagesPullingTime="839.211739ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:07:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:07:38.658860115 +0000 UTC m=+66.909285259" watchObservedRunningTime="2026-07-15 21:07:38.659624915 +0000 UTC m=+66.910050046" Jul 15 21:07:38.963642 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:38.963611 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-5mlzb"] Jul 15 21:07:38.977290 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:38.977252 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-5mlzb"] Jul 15 21:07:38.977407 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:38.977389 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-5mlzb" Jul 15 21:07:38.980120 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:38.980099 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-5k6xc\"" Jul 15 21:07:38.980230 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:38.980117 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 15 21:07:38.980230 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:38.980106 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 15 21:07:38.981255 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:38.981125 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 15 21:07:38.981255 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:38.981145 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 15 21:07:38.981255 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:38.981152 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 15 21:07:39.057280 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:39.057260 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prnc6\" (UniqueName: \"kubernetes.io/projected/f391540e-4578-4baf-8b2a-92242f45c3e1-kube-api-access-prnc6\") pod \"prometheus-operator-64785b6675-5mlzb\" (UID: \"f391540e-4578-4baf-8b2a-92242f45c3e1\") " pod="openshift-monitoring/prometheus-operator-64785b6675-5mlzb" Jul 15 21:07:39.057387 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:39.057297 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f391540e-4578-4baf-8b2a-92242f45c3e1-metrics-client-ca\") pod \"prometheus-operator-64785b6675-5mlzb\" (UID: \"f391540e-4578-4baf-8b2a-92242f45c3e1\") " pod="openshift-monitoring/prometheus-operator-64785b6675-5mlzb" Jul 15 21:07:39.057387 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:39.057336 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f391540e-4578-4baf-8b2a-92242f45c3e1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-5mlzb\" (UID: \"f391540e-4578-4baf-8b2a-92242f45c3e1\") " pod="openshift-monitoring/prometheus-operator-64785b6675-5mlzb" Jul 15 21:07:39.057387 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:39.057369 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f391540e-4578-4baf-8b2a-92242f45c3e1-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-5mlzb\" (UID: \"f391540e-4578-4baf-8b2a-92242f45c3e1\") " pod="openshift-monitoring/prometheus-operator-64785b6675-5mlzb" Jul 15 21:07:39.160387 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:39.159309 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prnc6\" (UniqueName: \"kubernetes.io/projected/f391540e-4578-4baf-8b2a-92242f45c3e1-kube-api-access-prnc6\") pod \"prometheus-operator-64785b6675-5mlzb\" (UID: \"f391540e-4578-4baf-8b2a-92242f45c3e1\") " pod="openshift-monitoring/prometheus-operator-64785b6675-5mlzb" Jul 15 21:07:39.160387 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:39.159360 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f391540e-4578-4baf-8b2a-92242f45c3e1-metrics-client-ca\") pod \"prometheus-operator-64785b6675-5mlzb\" (UID: \"f391540e-4578-4baf-8b2a-92242f45c3e1\") " pod="openshift-monitoring/prometheus-operator-64785b6675-5mlzb" Jul 15 21:07:39.160387 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:39.159402 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f391540e-4578-4baf-8b2a-92242f45c3e1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-5mlzb\" (UID: \"f391540e-4578-4baf-8b2a-92242f45c3e1\") " pod="openshift-monitoring/prometheus-operator-64785b6675-5mlzb" Jul 15 21:07:39.160387 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:39.159432 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f391540e-4578-4baf-8b2a-92242f45c3e1-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-5mlzb\" (UID: \"f391540e-4578-4baf-8b2a-92242f45c3e1\") " pod="openshift-monitoring/prometheus-operator-64785b6675-5mlzb" Jul 15 21:07:39.160387 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:07:39.160230 2577 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 15 21:07:39.160387 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:07:39.160296 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f391540e-4578-4baf-8b2a-92242f45c3e1-prometheus-operator-tls podName:f391540e-4578-4baf-8b2a-92242f45c3e1 nodeName:}" failed. No retries permitted until 2026-07-15 21:07:39.660282272 +0000 UTC m=+67.910707382 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/f391540e-4578-4baf-8b2a-92242f45c3e1-prometheus-operator-tls") pod "prometheus-operator-64785b6675-5mlzb" (UID: "f391540e-4578-4baf-8b2a-92242f45c3e1") : secret "prometheus-operator-tls" not found Jul 15 21:07:39.160818 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:39.160430 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f391540e-4578-4baf-8b2a-92242f45c3e1-metrics-client-ca\") pod \"prometheus-operator-64785b6675-5mlzb\" (UID: \"f391540e-4578-4baf-8b2a-92242f45c3e1\") " pod="openshift-monitoring/prometheus-operator-64785b6675-5mlzb" Jul 15 21:07:39.162997 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:39.162971 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f391540e-4578-4baf-8b2a-92242f45c3e1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-5mlzb\" (UID: \"f391540e-4578-4baf-8b2a-92242f45c3e1\") " pod="openshift-monitoring/prometheus-operator-64785b6675-5mlzb" Jul 15 21:07:39.169390 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:39.169367 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-prnc6\" (UniqueName: \"kubernetes.io/projected/f391540e-4578-4baf-8b2a-92242f45c3e1-kube-api-access-prnc6\") pod \"prometheus-operator-64785b6675-5mlzb\" (UID: \"f391540e-4578-4baf-8b2a-92242f45c3e1\") " pod="openshift-monitoring/prometheus-operator-64785b6675-5mlzb" Jul 15 21:07:39.649649 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:39.649605 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zzmkh" event={"ID":"5a785f71-60da-4c64-b6bb-6c2abb587a4f","Type":"ContainerStarted","Data":"b7c48b0cbfc4c3fd5f919b676887c07f2f87c892f7a833d84f83246fda5a48d3"} Jul 15 21:07:39.651085 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:39.651054 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4bt89" event={"ID":"cb2ca919-f019-4882-af3c-a6f2c6544aef","Type":"ContainerStarted","Data":"f506a25e8e3316c7822e0c7e1987eb100fdd662ac3cd06c7553f79de95add52e"} Jul 15 21:07:39.664701 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:39.664675 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f391540e-4578-4baf-8b2a-92242f45c3e1-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-5mlzb\" (UID: \"f391540e-4578-4baf-8b2a-92242f45c3e1\") " pod="openshift-monitoring/prometheus-operator-64785b6675-5mlzb" Jul 15 21:07:39.667372 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:39.667347 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f391540e-4578-4baf-8b2a-92242f45c3e1-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-5mlzb\" (UID: \"f391540e-4578-4baf-8b2a-92242f45c3e1\") " pod="openshift-monitoring/prometheus-operator-64785b6675-5mlzb" Jul 15 21:07:39.887613 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:39.887580 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-5mlzb" Jul 15 21:07:40.231744 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:40.231663 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-5mlzb"] Jul 15 21:07:40.234995 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:07:40.234952 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf391540e_4578_4baf_8b2a_92242f45c3e1.slice/crio-0b37205ca9e511617d0646c033688d649082e68cff6bde580af0f70eb57848c4 WatchSource:0}: Error finding container 0b37205ca9e511617d0646c033688d649082e68cff6bde580af0f70eb57848c4: Status 404 returned error can't find the container with id 0b37205ca9e511617d0646c033688d649082e68cff6bde580af0f70eb57848c4 Jul 15 21:07:40.658021 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:40.657883 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4bt89" event={"ID":"cb2ca919-f019-4882-af3c-a6f2c6544aef","Type":"ContainerStarted","Data":"0ae5ad9c66ed69efaff125962c3b9c965711676f1a4b0649b86b4e85abca36fb"} Jul 15 21:07:40.658021 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:40.657982 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4bt89" event={"ID":"cb2ca919-f019-4882-af3c-a6f2c6544aef","Type":"ContainerStarted","Data":"469393919da289c0fc6270f5ee501eb68a8518d0d594e4f35fe06e74e9a3634d"} Jul 15 21:07:40.659606 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:40.659577 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-5mlzb" event={"ID":"f391540e-4578-4baf-8b2a-92242f45c3e1","Type":"ContainerStarted","Data":"0b37205ca9e511617d0646c033688d649082e68cff6bde580af0f70eb57848c4"} Jul 15 21:07:41.551322 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:41.551286 2577 patch_prober.go:28] interesting pod/image-registry-67fbf55486-b7b2r container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 15 21:07:41.551322 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:41.551349 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-67fbf55486-b7b2r" podUID="2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 15 21:07:44.675896 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:44.675859 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zzmkh" event={"ID":"5a785f71-60da-4c64-b6bb-6c2abb587a4f","Type":"ContainerStarted","Data":"cc59f246f54cc3a533b8a12e7d4711b87362954d1da2b549fbf51fb4998eea74"} Jul 15 21:07:44.676357 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:44.675998 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-zzmkh" Jul 15 21:07:44.677672 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:44.677649 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-5mlzb" event={"ID":"f391540e-4578-4baf-8b2a-92242f45c3e1","Type":"ContainerStarted","Data":"1db87e95b53f3544280f0a24c7650e9d47159ad170e2fedb8440ddc30ec1916e"} Jul 15 21:07:44.677822 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:44.677699 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-5mlzb" event={"ID":"f391540e-4578-4baf-8b2a-92242f45c3e1","Type":"ContainerStarted","Data":"822ec29c15c110de764e4c49c0baca417618937cd2661cd993f6d424c1b9837f"} Jul 15 21:07:44.678964 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:44.678941 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6n6hw" event={"ID":"f12efede-b144-4c22-9e44-0990b6bb00af","Type":"ContainerStarted","Data":"d62889065a2c1b2b826f8aaadb191d2367237a3c1285b854e13899a8c907597a"} Jul 15 21:07:44.694301 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:44.694257 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4bt89" podStartSLOduration=71.258250029 podStartE2EDuration="1m12.694245609s" totalImagesPullingTime="1.43599558s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:06:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:07:40.676467212 +0000 UTC m=+68.926892345" watchObservedRunningTime="2026-07-15 21:07:44.694245609 +0000 UTC m=+72.944670764" Jul 15 21:07:44.694769 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:44.694745 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-zzmkh" podStartSLOduration=67.361402926 podStartE2EDuration="1m12.694739114s" totalImagesPullingTime="5.333336188s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:06:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:07:44.693216805 +0000 UTC m=+72.943641938" watchObservedRunningTime="2026-07-15 21:07:44.694739114 +0000 UTC m=+72.945164242" Jul 15 21:07:44.710785 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:44.710746 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-5mlzb" podStartSLOduration=2.986242942 podStartE2EDuration="6.71071694s" totalImagesPullingTime="3.724473998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:07:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:07:44.710251402 +0000 UTC m=+72.960676536" watchObservedRunningTime="2026-07-15 21:07:44.71071694 +0000 UTC m=+72.961142073" Jul 15 21:07:44.724515 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:44.724481 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6n6hw" podStartSLOduration=67.159157787 podStartE2EDuration="1m12.724467561s" totalImagesPullingTime="5.565309774s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:06:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:07:44.724419223 +0000 UTC m=+72.974844355" watchObservedRunningTime="2026-07-15 21:07:44.724467561 +0000 UTC m=+72.974892694" Jul 15 21:07:46.349897 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.349861 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-c6plm"] Jul 15 21:07:46.352253 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.352231 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-c6plm" Jul 15 21:07:46.354886 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.354864 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 15 21:07:46.355000 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.354965 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 15 21:07:46.355056 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.355011 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-l2z4f\"" Jul 15 21:07:46.367082 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.367060 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-nd8zb"] Jul 15 21:07:46.368898 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.368881 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-c6plm"] Jul 15 21:07:46.368981 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.368966 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-nd8zb" Jul 15 21:07:46.371488 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.371469 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 15 21:07:46.371584 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.371567 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-hh2p7\"" Jul 15 21:07:46.371751 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.371709 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 15 21:07:46.371832 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.371818 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 15 21:07:46.380000 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.379977 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5f8pf"] Jul 15 21:07:46.406743 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.405885 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-nd8zb"] Jul 15 21:07:46.406743 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.406020 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5f8pf" Jul 15 21:07:46.409864 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.409842 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 15 21:07:46.410001 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.409937 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 15 21:07:46.410001 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.409960 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-c6c44\"" Jul 15 21:07:46.410001 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.409973 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 15 21:07:46.418772 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.418750 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fe7f1124-0391-435d-884d-8fbaf89be8f6-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-c6plm\" (UID: \"fe7f1124-0391-435d-884d-8fbaf89be8f6\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-c6plm" Jul 15 21:07:46.418894 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.418781 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fe7f1124-0391-435d-884d-8fbaf89be8f6-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-c6plm\" (UID: \"fe7f1124-0391-435d-884d-8fbaf89be8f6\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-c6plm" Jul 15 21:07:46.418894 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.418799 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6krdc\" (UniqueName: \"kubernetes.io/projected/fe7f1124-0391-435d-884d-8fbaf89be8f6-kube-api-access-6krdc\") pod \"openshift-state-metrics-84bd68b896-c6plm\" (UID: \"fe7f1124-0391-435d-884d-8fbaf89be8f6\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-c6plm" Jul 15 21:07:46.418894 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.418820 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe7f1124-0391-435d-884d-8fbaf89be8f6-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-c6plm\" (UID: \"fe7f1124-0391-435d-884d-8fbaf89be8f6\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-c6plm" Jul 15 21:07:46.519346 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.519320 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4ab78046-a03c-46af-aea2-b6f1f8fc7a37-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-nd8zb\" (UID: \"4ab78046-a03c-46af-aea2-b6f1f8fc7a37\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-nd8zb" Jul 15 21:07:46.519495 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.519356 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fe7f1124-0391-435d-884d-8fbaf89be8f6-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-c6plm\" (UID: \"fe7f1124-0391-435d-884d-8fbaf89be8f6\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-c6plm" Jul 15 21:07:46.519495 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.519384 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fe7f1124-0391-435d-884d-8fbaf89be8f6-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-c6plm\" (UID: \"fe7f1124-0391-435d-884d-8fbaf89be8f6\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-c6plm" Jul 15 21:07:46.519571 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.519497 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6krdc\" (UniqueName: \"kubernetes.io/projected/fe7f1124-0391-435d-884d-8fbaf89be8f6-kube-api-access-6krdc\") pod \"openshift-state-metrics-84bd68b896-c6plm\" (UID: \"fe7f1124-0391-435d-884d-8fbaf89be8f6\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-c6plm" Jul 15 21:07:46.519571 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.519527 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ddcb79f-d39f-4152-930a-bb318e1ac148-sys\") pod \"node-exporter-5f8pf\" (UID: \"7ddcb79f-d39f-4152-930a-bb318e1ac148\") " pod="openshift-monitoring/node-exporter-5f8pf" Jul 15 21:07:46.519571 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.519548 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7ddcb79f-d39f-4152-930a-bb318e1ac148-node-exporter-tls\") pod \"node-exporter-5f8pf\" (UID: \"7ddcb79f-d39f-4152-930a-bb318e1ac148\") " pod="openshift-monitoring/node-exporter-5f8pf" Jul 15 21:07:46.519683 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.519569 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ddcb79f-d39f-4152-930a-bb318e1ac148-metrics-client-ca\") pod \"node-exporter-5f8pf\" (UID: \"7ddcb79f-d39f-4152-930a-bb318e1ac148\") " pod="openshift-monitoring/node-exporter-5f8pf" Jul 15 21:07:46.519758 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.519681 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7ddcb79f-d39f-4152-930a-bb318e1ac148-node-exporter-accelerators-collector-config\") pod \"node-exporter-5f8pf\" (UID: \"7ddcb79f-d39f-4152-930a-bb318e1ac148\") " pod="openshift-monitoring/node-exporter-5f8pf" Jul 15 21:07:46.519758 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.519747 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ab78046-a03c-46af-aea2-b6f1f8fc7a37-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-nd8zb\" (UID: \"4ab78046-a03c-46af-aea2-b6f1f8fc7a37\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-nd8zb" Jul 15 21:07:46.519859 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.519781 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7ddcb79f-d39f-4152-930a-bb318e1ac148-root\") pod \"node-exporter-5f8pf\" (UID: \"7ddcb79f-d39f-4152-930a-bb318e1ac148\") " pod="openshift-monitoring/node-exporter-5f8pf" Jul 15 21:07:46.519859 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.519829 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe7f1124-0391-435d-884d-8fbaf89be8f6-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-c6plm\" (UID: \"fe7f1124-0391-435d-884d-8fbaf89be8f6\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-c6plm" Jul 15 21:07:46.519961 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.519867 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4ab78046-a03c-46af-aea2-b6f1f8fc7a37-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-nd8zb\" (UID: \"4ab78046-a03c-46af-aea2-b6f1f8fc7a37\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-nd8zb" Jul 15 21:07:46.519961 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.519895 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7ddcb79f-d39f-4152-930a-bb318e1ac148-node-exporter-wtmp\") pod \"node-exporter-5f8pf\" (UID: \"7ddcb79f-d39f-4152-930a-bb318e1ac148\") " pod="openshift-monitoring/node-exporter-5f8pf" Jul 15 21:07:46.520031 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.519962 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7ddcb79f-d39f-4152-930a-bb318e1ac148-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5f8pf\" (UID: \"7ddcb79f-d39f-4152-930a-bb318e1ac148\") " pod="openshift-monitoring/node-exporter-5f8pf" Jul 15 21:07:46.520031 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.520014 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4ab78046-a03c-46af-aea2-b6f1f8fc7a37-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-nd8zb\" (UID: \"4ab78046-a03c-46af-aea2-b6f1f8fc7a37\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-nd8zb" Jul 15 21:07:46.520125 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.520049 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4ab78046-a03c-46af-aea2-b6f1f8fc7a37-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-nd8zb\" (UID: \"4ab78046-a03c-46af-aea2-b6f1f8fc7a37\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-nd8zb" Jul 15 21:07:46.520125 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.520075 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6lxr\" (UniqueName: \"kubernetes.io/projected/4ab78046-a03c-46af-aea2-b6f1f8fc7a37-kube-api-access-p6lxr\") pod \"kube-state-metrics-785778ff74-nd8zb\" (UID: \"4ab78046-a03c-46af-aea2-b6f1f8fc7a37\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-nd8zb" Jul 15 21:07:46.520125 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.520114 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2bk8\" (UniqueName: \"kubernetes.io/projected/7ddcb79f-d39f-4152-930a-bb318e1ac148-kube-api-access-c2bk8\") pod \"node-exporter-5f8pf\" (UID: \"7ddcb79f-d39f-4152-930a-bb318e1ac148\") " pod="openshift-monitoring/node-exporter-5f8pf" Jul 15 21:07:46.520251 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.520198 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7ddcb79f-d39f-4152-930a-bb318e1ac148-node-exporter-textfile\") pod \"node-exporter-5f8pf\" (UID: \"7ddcb79f-d39f-4152-930a-bb318e1ac148\") " pod="openshift-monitoring/node-exporter-5f8pf" Jul 15 21:07:46.520456 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.520440 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe7f1124-0391-435d-884d-8fbaf89be8f6-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-c6plm\" (UID: \"fe7f1124-0391-435d-884d-8fbaf89be8f6\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-c6plm" Jul 15 21:07:46.521746 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.521712 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fe7f1124-0391-435d-884d-8fbaf89be8f6-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-c6plm\" (UID: \"fe7f1124-0391-435d-884d-8fbaf89be8f6\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-c6plm" Jul 15 21:07:46.521842 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.521776 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fe7f1124-0391-435d-884d-8fbaf89be8f6-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-c6plm\" (UID: \"fe7f1124-0391-435d-884d-8fbaf89be8f6\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-c6plm" Jul 15 21:07:46.528442 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.528422 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6krdc\" (UniqueName: \"kubernetes.io/projected/fe7f1124-0391-435d-884d-8fbaf89be8f6-kube-api-access-6krdc\") pod \"openshift-state-metrics-84bd68b896-c6plm\" (UID: \"fe7f1124-0391-435d-884d-8fbaf89be8f6\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-c6plm" Jul 15 21:07:46.621045 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.620929 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7ddcb79f-d39f-4152-930a-bb318e1ac148-node-exporter-textfile\") pod \"node-exporter-5f8pf\" (UID: \"7ddcb79f-d39f-4152-930a-bb318e1ac148\") " pod="openshift-monitoring/node-exporter-5f8pf" Jul 15 21:07:46.621045 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.620982 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4ab78046-a03c-46af-aea2-b6f1f8fc7a37-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-nd8zb\" (UID: \"4ab78046-a03c-46af-aea2-b6f1f8fc7a37\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-nd8zb" Jul 15 21:07:46.621045 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.621016 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ddcb79f-d39f-4152-930a-bb318e1ac148-sys\") pod \"node-exporter-5f8pf\" (UID: \"7ddcb79f-d39f-4152-930a-bb318e1ac148\") " pod="openshift-monitoring/node-exporter-5f8pf" Jul 15 21:07:46.621045 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.621040 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7ddcb79f-d39f-4152-930a-bb318e1ac148-node-exporter-tls\") pod \"node-exporter-5f8pf\" (UID: \"7ddcb79f-d39f-4152-930a-bb318e1ac148\") " pod="openshift-monitoring/node-exporter-5f8pf" Jul 15 21:07:46.621347 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.621056 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ddcb79f-d39f-4152-930a-bb318e1ac148-metrics-client-ca\") pod \"node-exporter-5f8pf\" (UID: \"7ddcb79f-d39f-4152-930a-bb318e1ac148\") " pod="openshift-monitoring/node-exporter-5f8pf" Jul 15 21:07:46.621347 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.621080 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7ddcb79f-d39f-4152-930a-bb318e1ac148-node-exporter-accelerators-collector-config\") pod \"node-exporter-5f8pf\" (UID: \"7ddcb79f-d39f-4152-930a-bb318e1ac148\") " pod="openshift-monitoring/node-exporter-5f8pf" Jul 15 21:07:46.621347 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.621106 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ab78046-a03c-46af-aea2-b6f1f8fc7a37-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-nd8zb\" (UID: \"4ab78046-a03c-46af-aea2-b6f1f8fc7a37\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-nd8zb" Jul 15 21:07:46.621347 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.621128 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7ddcb79f-d39f-4152-930a-bb318e1ac148-root\") pod \"node-exporter-5f8pf\" (UID: \"7ddcb79f-d39f-4152-930a-bb318e1ac148\") " pod="openshift-monitoring/node-exporter-5f8pf" Jul 15 21:07:46.621347 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.621132 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ddcb79f-d39f-4152-930a-bb318e1ac148-sys\") pod \"node-exporter-5f8pf\" (UID: \"7ddcb79f-d39f-4152-930a-bb318e1ac148\") " pod="openshift-monitoring/node-exporter-5f8pf" Jul 15 21:07:46.621347 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.621156 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4ab78046-a03c-46af-aea2-b6f1f8fc7a37-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-nd8zb\" (UID: \"4ab78046-a03c-46af-aea2-b6f1f8fc7a37\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-nd8zb" Jul 15 21:07:46.621347 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.621191 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7ddcb79f-d39f-4152-930a-bb318e1ac148-node-exporter-wtmp\") pod \"node-exporter-5f8pf\" (UID: \"7ddcb79f-d39f-4152-930a-bb318e1ac148\") " pod="openshift-monitoring/node-exporter-5f8pf" Jul 15 21:07:46.621347 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.621208 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7ddcb79f-d39f-4152-930a-bb318e1ac148-root\") pod \"node-exporter-5f8pf\" (UID: \"7ddcb79f-d39f-4152-930a-bb318e1ac148\") " pod="openshift-monitoring/node-exporter-5f8pf" Jul 15 21:07:46.621347 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.621231 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7ddcb79f-d39f-4152-930a-bb318e1ac148-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5f8pf\" (UID: \"7ddcb79f-d39f-4152-930a-bb318e1ac148\") " pod="openshift-monitoring/node-exporter-5f8pf" Jul 15 21:07:46.621347 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.621288 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4ab78046-a03c-46af-aea2-b6f1f8fc7a37-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-nd8zb\" (UID: \"4ab78046-a03c-46af-aea2-b6f1f8fc7a37\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-nd8zb" Jul 15 21:07:46.621347 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.621309 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7ddcb79f-d39f-4152-930a-bb318e1ac148-node-exporter-wtmp\") pod \"node-exporter-5f8pf\" (UID: \"7ddcb79f-d39f-4152-930a-bb318e1ac148\") " pod="openshift-monitoring/node-exporter-5f8pf" Jul 15 21:07:46.621347 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.621326 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4ab78046-a03c-46af-aea2-b6f1f8fc7a37-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-nd8zb\" (UID: \"4ab78046-a03c-46af-aea2-b6f1f8fc7a37\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-nd8zb" Jul 15 21:07:46.621347 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.621351 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6lxr\" (UniqueName: \"kubernetes.io/projected/4ab78046-a03c-46af-aea2-b6f1f8fc7a37-kube-api-access-p6lxr\") pod \"kube-state-metrics-785778ff74-nd8zb\" (UID: \"4ab78046-a03c-46af-aea2-b6f1f8fc7a37\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-nd8zb" Jul 15 21:07:46.621941 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.621385 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2bk8\" (UniqueName: \"kubernetes.io/projected/7ddcb79f-d39f-4152-930a-bb318e1ac148-kube-api-access-c2bk8\") pod \"node-exporter-5f8pf\" (UID: \"7ddcb79f-d39f-4152-930a-bb318e1ac148\") " pod="openshift-monitoring/node-exporter-5f8pf" Jul 15 21:07:46.621941 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.621708 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ddcb79f-d39f-4152-930a-bb318e1ac148-metrics-client-ca\") pod \"node-exporter-5f8pf\" (UID: \"7ddcb79f-d39f-4152-930a-bb318e1ac148\") " pod="openshift-monitoring/node-exporter-5f8pf" Jul 15 21:07:46.622170 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.622123 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7ddcb79f-d39f-4152-930a-bb318e1ac148-node-exporter-textfile\") pod \"node-exporter-5f8pf\" (UID: \"7ddcb79f-d39f-4152-930a-bb318e1ac148\") " pod="openshift-monitoring/node-exporter-5f8pf" Jul 15 21:07:46.622264 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.622192 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4ab78046-a03c-46af-aea2-b6f1f8fc7a37-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-nd8zb\" (UID: \"4ab78046-a03c-46af-aea2-b6f1f8fc7a37\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-nd8zb" Jul 15 21:07:46.622371 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.622349 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ab78046-a03c-46af-aea2-b6f1f8fc7a37-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-nd8zb\" (UID: \"4ab78046-a03c-46af-aea2-b6f1f8fc7a37\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-nd8zb" Jul 15 21:07:46.622448 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.622414 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7ddcb79f-d39f-4152-930a-bb318e1ac148-node-exporter-accelerators-collector-config\") pod \"node-exporter-5f8pf\" (UID: \"7ddcb79f-d39f-4152-930a-bb318e1ac148\") " pod="openshift-monitoring/node-exporter-5f8pf" Jul 15 21:07:46.622675 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.622644 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4ab78046-a03c-46af-aea2-b6f1f8fc7a37-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-nd8zb\" (UID: \"4ab78046-a03c-46af-aea2-b6f1f8fc7a37\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-nd8zb" Jul 15 21:07:46.623495 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.623465 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7ddcb79f-d39f-4152-930a-bb318e1ac148-node-exporter-tls\") pod \"node-exporter-5f8pf\" (UID: \"7ddcb79f-d39f-4152-930a-bb318e1ac148\") " pod="openshift-monitoring/node-exporter-5f8pf" Jul 15 21:07:46.623786 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.623762 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7ddcb79f-d39f-4152-930a-bb318e1ac148-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5f8pf\" (UID: \"7ddcb79f-d39f-4152-930a-bb318e1ac148\") " pod="openshift-monitoring/node-exporter-5f8pf" Jul 15 21:07:46.623907 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.623888 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4ab78046-a03c-46af-aea2-b6f1f8fc7a37-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-nd8zb\" (UID: \"4ab78046-a03c-46af-aea2-b6f1f8fc7a37\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-nd8zb" Jul 15 21:07:46.624035 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.624017 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4ab78046-a03c-46af-aea2-b6f1f8fc7a37-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-nd8zb\" (UID: \"4ab78046-a03c-46af-aea2-b6f1f8fc7a37\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-nd8zb" Jul 15 21:07:46.630988 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.630968 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2bk8\" (UniqueName: \"kubernetes.io/projected/7ddcb79f-d39f-4152-930a-bb318e1ac148-kube-api-access-c2bk8\") pod \"node-exporter-5f8pf\" (UID: \"7ddcb79f-d39f-4152-930a-bb318e1ac148\") " pod="openshift-monitoring/node-exporter-5f8pf" Jul 15 21:07:46.631268 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.631246 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6lxr\" (UniqueName: \"kubernetes.io/projected/4ab78046-a03c-46af-aea2-b6f1f8fc7a37-kube-api-access-p6lxr\") pod \"kube-state-metrics-785778ff74-nd8zb\" (UID: \"4ab78046-a03c-46af-aea2-b6f1f8fc7a37\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-nd8zb" Jul 15 21:07:46.660990 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.660969 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-c6plm" Jul 15 21:07:46.677917 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.677894 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-nd8zb" Jul 15 21:07:46.716814 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.716777 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5f8pf" Jul 15 21:07:46.731385 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:07:46.731351 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ddcb79f_d39f_4152_930a_bb318e1ac148.slice/crio-4e185bfddadb91c312a5f67914db01c4375fe9aacef88bcf2a5a08e30265ed7c WatchSource:0}: Error finding container 4e185bfddadb91c312a5f67914db01c4375fe9aacef88bcf2a5a08e30265ed7c: Status 404 returned error can't find the container with id 4e185bfddadb91c312a5f67914db01c4375fe9aacef88bcf2a5a08e30265ed7c Jul 15 21:07:46.798378 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.798251 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-c6plm"] Jul 15 21:07:46.800692 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:07:46.800664 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe7f1124_0391_435d_884d_8fbaf89be8f6.slice/crio-4c9d06b74cde07b7600208df2b9ad04d355adf43a5eda3a2f46b625a39b6c8b7 WatchSource:0}: Error finding container 4c9d06b74cde07b7600208df2b9ad04d355adf43a5eda3a2f46b625a39b6c8b7: Status 404 returned error can't find the container with id 4c9d06b74cde07b7600208df2b9ad04d355adf43a5eda3a2f46b625a39b6c8b7 Jul 15 21:07:46.817474 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:46.817454 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-nd8zb"] Jul 15 21:07:46.834768 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:07:46.834740 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ab78046_a03c_46af_aea2_b6f1f8fc7a37.slice/crio-23f7d7d51ae08058ea7eeb742ca7074ae228a5d5636e070257e95bcb9738406e WatchSource:0}: Error finding container 23f7d7d51ae08058ea7eeb742ca7074ae228a5d5636e070257e95bcb9738406e: Status 404 returned error can't find the container with id 23f7d7d51ae08058ea7eeb742ca7074ae228a5d5636e070257e95bcb9738406e Jul 15 21:07:47.464611 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:47.464345 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 15 21:07:47.468596 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:47.468570 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:07:47.471594 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:47.471275 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 15 21:07:47.471594 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:47.471549 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 15 21:07:47.473374 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:47.472971 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 15 21:07:47.473374 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:47.473009 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 15 21:07:47.473374 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:47.473070 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 15 21:07:47.473374 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:47.473168 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 15 21:07:47.473374 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:47.473251 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 15 21:07:47.473374 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:47.473290 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 15 21:07:47.473374 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:47.473377 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 15 21:07:47.473814 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:47.473394 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-jspkb\"" Jul 15 21:07:47.482107 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:47.482018 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 15 21:07:47.628966 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:47.628928 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wb5lj\" (UniqueName: \"kubernetes.io/projected/c420cf29-760e-4b7a-b052-958d4584f9fa-kube-api-access-wb5lj\") pod \"alertmanager-main-0\" (UID: \"c420cf29-760e-4b7a-b052-958d4584f9fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:07:47.629174 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:47.628985 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c420cf29-760e-4b7a-b052-958d4584f9fa-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c420cf29-760e-4b7a-b052-958d4584f9fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:07:47.629174 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:47.629020 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c420cf29-760e-4b7a-b052-958d4584f9fa-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c420cf29-760e-4b7a-b052-958d4584f9fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:07:47.629174 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:47.629087 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c420cf29-760e-4b7a-b052-958d4584f9fa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c420cf29-760e-4b7a-b052-958d4584f9fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:07:47.629174 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:47.629109 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c420cf29-760e-4b7a-b052-958d4584f9fa-web-config\") pod \"alertmanager-main-0\" (UID: \"c420cf29-760e-4b7a-b052-958d4584f9fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:07:47.629174 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:47.629137 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c420cf29-760e-4b7a-b052-958d4584f9fa-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c420cf29-760e-4b7a-b052-958d4584f9fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:07:47.629174 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:47.629170 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c420cf29-760e-4b7a-b052-958d4584f9fa-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c420cf29-760e-4b7a-b052-958d4584f9fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:07:47.629456 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:47.629193 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c420cf29-760e-4b7a-b052-958d4584f9fa-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c420cf29-760e-4b7a-b052-958d4584f9fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:07:47.629456 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:47.629288 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c420cf29-760e-4b7a-b052-958d4584f9fa-config-volume\") pod \"alertmanager-main-0\" (UID: \"c420cf29-760e-4b7a-b052-958d4584f9fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:07:47.629456 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:47.629337 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c420cf29-760e-4b7a-b052-958d4584f9fa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c420cf29-760e-4b7a-b052-958d4584f9fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:07:47.629456 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:47.629370 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c420cf29-760e-4b7a-b052-958d4584f9fa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c420cf29-760e-4b7a-b052-958d4584f9fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:07:47.629456 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:47.629396 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c420cf29-760e-4b7a-b052-958d4584f9fa-config-out\") pod \"alertmanager-main-0\" (UID: \"c420cf29-760e-4b7a-b052-958d4584f9fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:07:47.629456 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:47.629418 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c420cf29-760e-4b7a-b052-958d4584f9fa-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c420cf29-760e-4b7a-b052-958d4584f9fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:07:47.697555 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:47.697410 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5f8pf" event={"ID":"7ddcb79f-d39f-4152-930a-bb318e1ac148","Type":"ContainerStarted","Data":"4e185bfddadb91c312a5f67914db01c4375fe9aacef88bcf2a5a08e30265ed7c"} Jul 15 21:07:47.700708 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:47.700678 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-c6plm" event={"ID":"fe7f1124-0391-435d-884d-8fbaf89be8f6","Type":"ContainerStarted","Data":"d7574d2e23286ed75cb3b5149c8ff8a39089549959c759bedc52285923faa1e0"} Jul 15 21:07:47.700863 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:47.700764 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-c6plm" event={"ID":"fe7f1124-0391-435d-884d-8fbaf89be8f6","Type":"ContainerStarted","Data":"c13a2efd84753d4270ccf339bb2c55bf91c9ec3ac22f235f3c10fdc17a3c691c"} Jul 15 21:07:47.700863 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:47.700794 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-c6plm" event={"ID":"fe7f1124-0391-435d-884d-8fbaf89be8f6","Type":"ContainerStarted","Data":"4c9d06b74cde07b7600208df2b9ad04d355adf43a5eda3a2f46b625a39b6c8b7"} Jul 15 21:07:47.702610 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:47.702540 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-nd8zb" event={"ID":"4ab78046-a03c-46af-aea2-b6f1f8fc7a37","Type":"ContainerStarted","Data":"23f7d7d51ae08058ea7eeb742ca7074ae228a5d5636e070257e95bcb9738406e"} Jul 15 21:07:47.730377 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:47.730317 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c420cf29-760e-4b7a-b052-958d4584f9fa-web-config\") pod \"alertmanager-main-0\" (UID: \"c420cf29-760e-4b7a-b052-958d4584f9fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:07:47.730377 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:47.730355 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c420cf29-760e-4b7a-b052-958d4584f9fa-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c420cf29-760e-4b7a-b052-958d4584f9fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:07:47.730538 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:47.730385 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c420cf29-760e-4b7a-b052-958d4584f9fa-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c420cf29-760e-4b7a-b052-958d4584f9fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:07:47.730538 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:47.730411 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c420cf29-760e-4b7a-b052-958d4584f9fa-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c420cf29-760e-4b7a-b052-958d4584f9fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:07:47.730538 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:47.730446 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c420cf29-760e-4b7a-b052-958d4584f9fa-config-volume\") pod \"alertmanager-main-0\" (UID: \"c420cf29-760e-4b7a-b052-958d4584f9fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:07:47.730538 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:47.730480 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c420cf29-760e-4b7a-b052-958d4584f9fa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c420cf29-760e-4b7a-b052-958d4584f9fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:07:47.730538 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:47.730514 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c420cf29-760e-4b7a-b052-958d4584f9fa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c420cf29-760e-4b7a-b052-958d4584f9fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:07:47.730810 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:47.730548 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c420cf29-760e-4b7a-b052-958d4584f9fa-config-out\") pod \"alertmanager-main-0\" (UID: \"c420cf29-760e-4b7a-b052-958d4584f9fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:07:47.730810 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:47.730571 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c420cf29-760e-4b7a-b052-958d4584f9fa-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c420cf29-760e-4b7a-b052-958d4584f9fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:07:47.730810 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:47.730627 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb5lj\" (UniqueName: \"kubernetes.io/projected/c420cf29-760e-4b7a-b052-958d4584f9fa-kube-api-access-wb5lj\") pod \"alertmanager-main-0\" (UID: \"c420cf29-760e-4b7a-b052-958d4584f9fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:07:47.730810 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:47.730659 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c420cf29-760e-4b7a-b052-958d4584f9fa-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c420cf29-760e-4b7a-b052-958d4584f9fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:07:47.730810 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:47.730681 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c420cf29-760e-4b7a-b052-958d4584f9fa-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c420cf29-760e-4b7a-b052-958d4584f9fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:07:47.730810 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:47.730738 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c420cf29-760e-4b7a-b052-958d4584f9fa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c420cf29-760e-4b7a-b052-958d4584f9fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:07:47.732125 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:47.732098 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c420cf29-760e-4b7a-b052-958d4584f9fa-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c420cf29-760e-4b7a-b052-958d4584f9fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:07:47.732443 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:47.732417 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c420cf29-760e-4b7a-b052-958d4584f9fa-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c420cf29-760e-4b7a-b052-958d4584f9fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:07:47.733656 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:47.733305 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c420cf29-760e-4b7a-b052-958d4584f9fa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c420cf29-760e-4b7a-b052-958d4584f9fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:07:47.735600 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:47.735575 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c420cf29-760e-4b7a-b052-958d4584f9fa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c420cf29-760e-4b7a-b052-958d4584f9fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:07:47.735698 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:07:47.735665 2577 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 15 21:07:47.735783 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:07:47.735740 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c420cf29-760e-4b7a-b052-958d4584f9fa-secret-alertmanager-main-tls podName:c420cf29-760e-4b7a-b052-958d4584f9fa nodeName:}" failed. No retries permitted until 2026-07-15 21:07:48.235701365 +0000 UTC m=+76.486126478 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/c420cf29-760e-4b7a-b052-958d4584f9fa-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "c420cf29-760e-4b7a-b052-958d4584f9fa") : secret "alertmanager-main-tls" not found Jul 15 21:07:47.735862 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:47.735841 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c420cf29-760e-4b7a-b052-958d4584f9fa-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c420cf29-760e-4b7a-b052-958d4584f9fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:07:47.736025 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:47.735983 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c420cf29-760e-4b7a-b052-958d4584f9fa-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c420cf29-760e-4b7a-b052-958d4584f9fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:07:47.736334 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:47.736293 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c420cf29-760e-4b7a-b052-958d4584f9fa-web-config\") pod \"alertmanager-main-0\" (UID: \"c420cf29-760e-4b7a-b052-958d4584f9fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:07:47.736885 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:47.736843 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c420cf29-760e-4b7a-b052-958d4584f9fa-config-volume\") pod \"alertmanager-main-0\" (UID: \"c420cf29-760e-4b7a-b052-958d4584f9fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:07:47.738133 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:47.738111 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c420cf29-760e-4b7a-b052-958d4584f9fa-config-out\") pod \"alertmanager-main-0\" (UID: \"c420cf29-760e-4b7a-b052-958d4584f9fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:07:47.738133 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:47.738121 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c420cf29-760e-4b7a-b052-958d4584f9fa-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c420cf29-760e-4b7a-b052-958d4584f9fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:07:47.738875 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:47.738837 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c420cf29-760e-4b7a-b052-958d4584f9fa-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c420cf29-760e-4b7a-b052-958d4584f9fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:07:47.742307 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:47.742251 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wb5lj\" (UniqueName: \"kubernetes.io/projected/c420cf29-760e-4b7a-b052-958d4584f9fa-kube-api-access-wb5lj\") pod \"alertmanager-main-0\" (UID: \"c420cf29-760e-4b7a-b052-958d4584f9fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:07:48.336437 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:48.336345 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c420cf29-760e-4b7a-b052-958d4584f9fa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c420cf29-760e-4b7a-b052-958d4584f9fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:07:48.340057 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:48.340027 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c420cf29-760e-4b7a-b052-958d4584f9fa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c420cf29-760e-4b7a-b052-958d4584f9fa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:07:48.383332 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:48.383270 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:07:48.541237 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:48.541214 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 15 21:07:48.543340 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:07:48.543315 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc420cf29_760e_4b7a_b052_958d4584f9fa.slice/crio-3607d292f184da5f01b1bd9fc37c1c8c1833122d5e11e356a885767f41637dc5 WatchSource:0}: Error finding container 3607d292f184da5f01b1bd9fc37c1c8c1833122d5e11e356a885767f41637dc5: Status 404 returned error can't find the container with id 3607d292f184da5f01b1bd9fc37c1c8c1833122d5e11e356a885767f41637dc5 Jul 15 21:07:48.709496 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:48.709410 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-nd8zb" event={"ID":"4ab78046-a03c-46af-aea2-b6f1f8fc7a37","Type":"ContainerStarted","Data":"1a93f26fd895b031e92bf28266193d805e77e5146482b7201aa031fc5845ee0e"} Jul 15 21:07:48.709496 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:48.709468 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-nd8zb" event={"ID":"4ab78046-a03c-46af-aea2-b6f1f8fc7a37","Type":"ContainerStarted","Data":"737d0322e3e75555e88154fd63537c17d95ffbe25f3fc93ad7c032e5fe963f9c"} Jul 15 21:07:48.709704 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:48.709497 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-nd8zb" event={"ID":"4ab78046-a03c-46af-aea2-b6f1f8fc7a37","Type":"ContainerStarted","Data":"ba4d6421667e5797c7b6a500b1253f4fce283ef445677937ea3642d89d6613ff"} Jul 15 21:07:48.710783 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:48.710756 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c420cf29-760e-4b7a-b052-958d4584f9fa","Type":"ContainerStarted","Data":"3607d292f184da5f01b1bd9fc37c1c8c1833122d5e11e356a885767f41637dc5"} Jul 15 21:07:48.712324 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:48.712299 2577 generic.go:356] "Generic (PLEG): container finished" podID="7ddcb79f-d39f-4152-930a-bb318e1ac148" containerID="572f8b0fd5bd911c7e70692704808df8460038424f1bc6c18a4dc64f1b099cc4" exitCode=0 Jul 15 21:07:48.712441 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:48.712382 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5f8pf" event={"ID":"7ddcb79f-d39f-4152-930a-bb318e1ac148","Type":"ContainerDied","Data":"572f8b0fd5bd911c7e70692704808df8460038424f1bc6c18a4dc64f1b099cc4"} Jul 15 21:07:48.714837 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:48.714815 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-c6plm" event={"ID":"fe7f1124-0391-435d-884d-8fbaf89be8f6","Type":"ContainerStarted","Data":"a331565065cd9e16c5c3db4a6062af22fb2d0870541292231ab3d4bbd9e7d9a4"} Jul 15 21:07:48.731901 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:48.731860 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-nd8zb" podStartSLOduration=1.353046529 podStartE2EDuration="2.731847734s" totalImagesPullingTime="1.378801205s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:07:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:07:48.730513259 +0000 UTC m=+76.980938390" watchObservedRunningTime="2026-07-15 21:07:48.731847734 +0000 UTC m=+76.982272864" Jul 15 21:07:48.750766 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:48.750702 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-c6plm" podStartSLOduration=1.4493538670000001 podStartE2EDuration="2.750690353s" totalImagesPullingTime="1.301336486s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:07:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:07:48.750039666 +0000 UTC m=+77.000464810" watchObservedRunningTime="2026-07-15 21:07:48.750690353 +0000 UTC m=+77.001115484" Jul 15 21:07:49.720500 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:49.720473 2577 generic.go:356] "Generic (PLEG): container finished" podID="c420cf29-760e-4b7a-b052-958d4584f9fa" containerID="aa6f5e90307749d8b16f52fce399adb6a11c6caa4b0c7af97f1067d41244a534" exitCode=0 Jul 15 21:07:49.720821 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:49.720564 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c420cf29-760e-4b7a-b052-958d4584f9fa","Type":"ContainerDied","Data":"aa6f5e90307749d8b16f52fce399adb6a11c6caa4b0c7af97f1067d41244a534"} Jul 15 21:07:49.722867 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:49.722840 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5f8pf" event={"ID":"7ddcb79f-d39f-4152-930a-bb318e1ac148","Type":"ContainerStarted","Data":"163a774b5d7252ab9b6a4412dc8c1429bc7412e164e763619cca4e7874a16203"} Jul 15 21:07:49.722954 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:49.722895 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5f8pf" event={"ID":"7ddcb79f-d39f-4152-930a-bb318e1ac148","Type":"ContainerStarted","Data":"3a1110bf2e11c8db7b3a9393e80fd6b2b4df271484d25f2b7450092eef9a5e08"} Jul 15 21:07:49.803952 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:49.803911 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5f8pf" podStartSLOduration=2.239954377 podStartE2EDuration="3.803896735s" totalImagesPullingTime="1.479412522s" totalInitContainerRuntime="84.529836ms" isStatefulPod=true podCreationTimestamp="2026-07-15 21:07:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:07:49.80229493 +0000 UTC m=+78.052720061" watchObservedRunningTime="2026-07-15 21:07:49.803896735 +0000 UTC m=+78.054321866" Jul 15 21:07:51.549486 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:51.549396 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-67fbf55486-b7b2r" Jul 15 21:07:51.738124 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:51.738091 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c420cf29-760e-4b7a-b052-958d4584f9fa","Type":"ContainerStarted","Data":"0f68d36243777ad21133a20ba0a820b0a9c892eedf9ded6d4a07017f5e3f16a4"} Jul 15 21:07:51.738280 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:51.738176 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c420cf29-760e-4b7a-b052-958d4584f9fa","Type":"ContainerStarted","Data":"c62d438ebec887d26a0a6380c10b189b1f9aa32af53c3c118f36a1e2c993e0bb"} Jul 15 21:07:51.738280 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:51.738201 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c420cf29-760e-4b7a-b052-958d4584f9fa","Type":"ContainerStarted","Data":"69fb172b0cbccbab0134463a45b709368f3f26879d38334e097a9e7ae1cabdce"} Jul 15 21:07:51.738280 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:51.738226 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c420cf29-760e-4b7a-b052-958d4584f9fa","Type":"ContainerStarted","Data":"1093e5a98ed41dc30c545661d798ccad4a801f8237a718813d127620bd1cd207"} Jul 15 21:07:51.738280 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:51.738250 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c420cf29-760e-4b7a-b052-958d4584f9fa","Type":"ContainerStarted","Data":"226501f75985ea3711a91941e4ae2683a56a80a5930d088fd490a160c9aedef5"} Jul 15 21:07:52.746076 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:52.746039 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c420cf29-760e-4b7a-b052-958d4584f9fa","Type":"ContainerStarted","Data":"4da5d03f9a7ad32f3dbe7d807d85135099b0d979dc7f879956272f2611d0b5ff"} Jul 15 21:07:52.776688 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:52.776641 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.610457684 podStartE2EDuration="5.776624594s" totalImagesPullingTime="3.150439907s" totalInitContainerRuntime="15.727003ms" isStatefulPod=false podCreationTimestamp="2026-07-15 21:07:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:07:52.773520924 +0000 UTC m=+81.023946055" watchObservedRunningTime="2026-07-15 21:07:52.776624594 +0000 UTC m=+81.027049724" Jul 15 21:07:53.618631 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:53.618598 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5577c596d-np767" Jul 15 21:07:56.564952 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:56.564830 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-67fbf55486-b7b2r" podUID="2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830" containerName="registry" containerID="cri-o://f7e19102c0fe0964c933945f26b8f77ef8fdb95f8cd6d9db63d6ef880f18c2d6" gracePeriod=30 Jul 15 21:07:56.761491 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:56.761452 2577 generic.go:356] "Generic (PLEG): container finished" podID="2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830" containerID="f7e19102c0fe0964c933945f26b8f77ef8fdb95f8cd6d9db63d6ef880f18c2d6" exitCode=0 Jul 15 21:07:56.761631 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:56.761525 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67fbf55486-b7b2r" event={"ID":"2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830","Type":"ContainerDied","Data":"f7e19102c0fe0964c933945f26b8f77ef8fdb95f8cd6d9db63d6ef880f18c2d6"} Jul 15 21:07:56.805415 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:56.805394 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67fbf55486-b7b2r" Jul 15 21:07:56.909207 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:56.909183 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830-registry-certificates\") pod \"2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830\" (UID: \"2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830\") " Jul 15 21:07:56.909311 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:56.909225 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830-bound-sa-token\") pod \"2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830\" (UID: \"2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830\") " Jul 15 21:07:56.909311 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:56.909270 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830-registry-tls\") pod \"2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830\" (UID: \"2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830\") " Jul 15 21:07:56.909311 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:56.909294 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830-ca-trust-extracted\") pod \"2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830\" (UID: \"2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830\") " Jul 15 21:07:56.909419 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:56.909316 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830-trusted-ca\") pod \"2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830\" (UID: \"2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830\") " Jul 15 21:07:56.909419 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:56.909354 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830-image-registry-private-configuration\") pod \"2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830\" (UID: \"2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830\") " Jul 15 21:07:56.909419 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:56.909402 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830-installation-pull-secrets\") pod \"2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830\" (UID: \"2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830\") " Jul 15 21:07:56.909552 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:56.909458 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q5dsn\" (UniqueName: \"kubernetes.io/projected/2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830-kube-api-access-q5dsn\") pod \"2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830\" (UID: \"2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830\") " Jul 15 21:07:56.909794 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:56.909717 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830" (UID: "2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:07:56.909904 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:56.909825 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830" (UID: "2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:07:56.911875 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:56.911833 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830" (UID: "2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:07:56.911875 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:56.911858 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830" (UID: "2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 21:07:56.912055 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:56.912027 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830-kube-api-access-q5dsn" (OuterVolumeSpecName: "kube-api-access-q5dsn") pod "2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830" (UID: "2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830"). InnerVolumeSpecName "kube-api-access-q5dsn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:07:56.912055 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:56.912035 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830" (UID: "2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 21:07:56.912130 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:56.912080 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830" (UID: "2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:07:56.918434 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:56.918403 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830" (UID: "2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:07:57.010496 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:57.010474 2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830-registry-tls\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\"" Jul 15 21:07:57.010496 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:57.010494 2577 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830-ca-trust-extracted\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\"" Jul 15 21:07:57.010602 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:57.010503 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830-trusted-ca\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\"" Jul 15 21:07:57.010602 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:57.010514 2577 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830-image-registry-private-configuration\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\"" Jul 15 21:07:57.010602 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:57.010525 2577 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830-installation-pull-secrets\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\"" Jul 15 21:07:57.010602 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:57.010534 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q5dsn\" (UniqueName: \"kubernetes.io/projected/2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830-kube-api-access-q5dsn\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\"" Jul 15 21:07:57.010602 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:57.010542 2577 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830-registry-certificates\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\"" Jul 15 21:07:57.010602 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:57.010550 2577 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830-bound-sa-token\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\"" Jul 15 21:07:57.767471 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:57.767431 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67fbf55486-b7b2r" event={"ID":"2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830","Type":"ContainerDied","Data":"659bbf6e29db7b461248d48f3fe75a75d3c70ff1d0485af4d79e8bd7a9ba7b59"} Jul 15 21:07:57.767878 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:57.767444 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67fbf55486-b7b2r" Jul 15 21:07:57.771846 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:57.771792 2577 scope.go:117] "RemoveContainer" containerID="f7e19102c0fe0964c933945f26b8f77ef8fdb95f8cd6d9db63d6ef880f18c2d6" Jul 15 21:07:57.795596 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:57.795575 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-67fbf55486-b7b2r"] Jul 15 21:07:57.797932 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:57.797911 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-67fbf55486-b7b2r"] Jul 15 21:07:58.339050 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:07:58.339015 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830" path="/var/lib/kubelet/pods/2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830/volumes" Jul 15 21:08:10.672528 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:08:10.672486 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-86b6549f64-jgx8h"] Jul 15 21:08:10.673101 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:08:10.672919 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830" containerName="registry" Jul 15 21:08:10.673101 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:08:10.672938 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830" containerName="registry" Jul 15 21:08:10.673101 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:08:10.673020 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c1aa2c4-5cf3-40af-b9aa-9d97b3eab830" containerName="registry" Jul 15 21:08:11.136055 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:08:11.136019 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86b6549f64-jgx8h"] Jul 15 21:08:11.136210 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:08:11.136139 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86b6549f64-jgx8h" Jul 15 21:08:11.139257 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:08:11.139231 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 15 21:08:11.139257 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:08:11.139233 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 15 21:08:11.140416 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:08:11.140346 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 15 21:08:11.140416 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:08:11.140371 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 15 21:08:11.140416 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:08:11.140351 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 15 21:08:11.140713 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:08:11.140458 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 15 21:08:11.140713 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:08:11.140505 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 15 21:08:11.140713 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:08:11.140562 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-8lbxz\"" Jul 15 21:08:11.144903 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:08:11.144873 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 15 21:08:11.207407 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:08:11.207377 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27496bd0-04f0-4cf3-9db2-6e30d76b1dd1-console-serving-cert\") pod \"console-86b6549f64-jgx8h\" (UID: \"27496bd0-04f0-4cf3-9db2-6e30d76b1dd1\") " pod="openshift-console/console-86b6549f64-jgx8h" Jul 15 21:08:11.207407 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:08:11.207408 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27496bd0-04f0-4cf3-9db2-6e30d76b1dd1-console-config\") pod \"console-86b6549f64-jgx8h\" (UID: \"27496bd0-04f0-4cf3-9db2-6e30d76b1dd1\") " pod="openshift-console/console-86b6549f64-jgx8h" Jul 15 21:08:11.207598 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:08:11.207429 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27496bd0-04f0-4cf3-9db2-6e30d76b1dd1-oauth-serving-cert\") pod \"console-86b6549f64-jgx8h\" (UID: \"27496bd0-04f0-4cf3-9db2-6e30d76b1dd1\") " pod="openshift-console/console-86b6549f64-jgx8h" Jul 15 21:08:11.207598 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:08:11.207447 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7tc5\" (UniqueName: \"kubernetes.io/projected/27496bd0-04f0-4cf3-9db2-6e30d76b1dd1-kube-api-access-d7tc5\") pod \"console-86b6549f64-jgx8h\" (UID: \"27496bd0-04f0-4cf3-9db2-6e30d76b1dd1\") " pod="openshift-console/console-86b6549f64-jgx8h" Jul 15 21:08:11.207598 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:08:11.207508 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27496bd0-04f0-4cf3-9db2-6e30d76b1dd1-console-oauth-config\") pod \"console-86b6549f64-jgx8h\" (UID: \"27496bd0-04f0-4cf3-9db2-6e30d76b1dd1\") " pod="openshift-console/console-86b6549f64-jgx8h" Jul 15 21:08:11.207598 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:08:11.207550 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27496bd0-04f0-4cf3-9db2-6e30d76b1dd1-trusted-ca-bundle\") pod \"console-86b6549f64-jgx8h\" (UID: \"27496bd0-04f0-4cf3-9db2-6e30d76b1dd1\") " pod="openshift-console/console-86b6549f64-jgx8h" Jul 15 21:08:11.207598 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:08:11.207571 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27496bd0-04f0-4cf3-9db2-6e30d76b1dd1-service-ca\") pod \"console-86b6549f64-jgx8h\" (UID: \"27496bd0-04f0-4cf3-9db2-6e30d76b1dd1\") " pod="openshift-console/console-86b6549f64-jgx8h" Jul 15 21:08:11.308274 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:08:11.308246 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27496bd0-04f0-4cf3-9db2-6e30d76b1dd1-oauth-serving-cert\") pod \"console-86b6549f64-jgx8h\" (UID: \"27496bd0-04f0-4cf3-9db2-6e30d76b1dd1\") " pod="openshift-console/console-86b6549f64-jgx8h" Jul 15 21:08:11.308274 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:08:11.308275 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7tc5\" (UniqueName: \"kubernetes.io/projected/27496bd0-04f0-4cf3-9db2-6e30d76b1dd1-kube-api-access-d7tc5\") pod \"console-86b6549f64-jgx8h\" (UID: \"27496bd0-04f0-4cf3-9db2-6e30d76b1dd1\") " pod="openshift-console/console-86b6549f64-jgx8h" Jul 15 21:08:11.308429 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:08:11.308296 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27496bd0-04f0-4cf3-9db2-6e30d76b1dd1-console-oauth-config\") pod \"console-86b6549f64-jgx8h\" (UID: \"27496bd0-04f0-4cf3-9db2-6e30d76b1dd1\") " pod="openshift-console/console-86b6549f64-jgx8h" Jul 15 21:08:11.308429 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:08:11.308319 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27496bd0-04f0-4cf3-9db2-6e30d76b1dd1-trusted-ca-bundle\") pod \"console-86b6549f64-jgx8h\" (UID: \"27496bd0-04f0-4cf3-9db2-6e30d76b1dd1\") " pod="openshift-console/console-86b6549f64-jgx8h" Jul 15 21:08:11.308847 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:08:11.308428 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27496bd0-04f0-4cf3-9db2-6e30d76b1dd1-service-ca\") pod \"console-86b6549f64-jgx8h\" (UID: \"27496bd0-04f0-4cf3-9db2-6e30d76b1dd1\") " pod="openshift-console/console-86b6549f64-jgx8h" Jul 15 21:08:11.308957 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:08:11.308930 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27496bd0-04f0-4cf3-9db2-6e30d76b1dd1-console-serving-cert\") pod \"console-86b6549f64-jgx8h\" (UID: \"27496bd0-04f0-4cf3-9db2-6e30d76b1dd1\") " pod="openshift-console/console-86b6549f64-jgx8h" Jul 15 21:08:11.309011 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:08:11.308993 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27496bd0-04f0-4cf3-9db2-6e30d76b1dd1-console-config\") pod \"console-86b6549f64-jgx8h\" (UID: \"27496bd0-04f0-4cf3-9db2-6e30d76b1dd1\") " pod="openshift-console/console-86b6549f64-jgx8h" Jul 15 21:08:11.310071 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:08:11.310042 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27496bd0-04f0-4cf3-9db2-6e30d76b1dd1-console-config\") pod \"console-86b6549f64-jgx8h\" (UID: \"27496bd0-04f0-4cf3-9db2-6e30d76b1dd1\") " pod="openshift-console/console-86b6549f64-jgx8h" Jul 15 21:08:11.310246 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:08:11.310076 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27496bd0-04f0-4cf3-9db2-6e30d76b1dd1-oauth-serving-cert\") pod \"console-86b6549f64-jgx8h\" (UID: \"27496bd0-04f0-4cf3-9db2-6e30d76b1dd1\") " pod="openshift-console/console-86b6549f64-jgx8h" Jul 15 21:08:11.310343 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:08:11.310121 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27496bd0-04f0-4cf3-9db2-6e30d76b1dd1-service-ca\") pod \"console-86b6549f64-jgx8h\" (UID: \"27496bd0-04f0-4cf3-9db2-6e30d76b1dd1\") " pod="openshift-console/console-86b6549f64-jgx8h" Jul 15 21:08:11.310827 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:08:11.310801 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27496bd0-04f0-4cf3-9db2-6e30d76b1dd1-trusted-ca-bundle\") pod \"console-86b6549f64-jgx8h\" (UID: \"27496bd0-04f0-4cf3-9db2-6e30d76b1dd1\") " pod="openshift-console/console-86b6549f64-jgx8h" Jul 15 21:08:11.314652 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:08:11.311669 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27496bd0-04f0-4cf3-9db2-6e30d76b1dd1-console-oauth-config\") pod \"console-86b6549f64-jgx8h\" (UID: \"27496bd0-04f0-4cf3-9db2-6e30d76b1dd1\") " pod="openshift-console/console-86b6549f64-jgx8h" Jul 15 21:08:11.314652 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:08:11.312231 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27496bd0-04f0-4cf3-9db2-6e30d76b1dd1-console-serving-cert\") pod \"console-86b6549f64-jgx8h\" (UID: \"27496bd0-04f0-4cf3-9db2-6e30d76b1dd1\") " pod="openshift-console/console-86b6549f64-jgx8h" Jul 15 21:08:11.324422 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:08:11.324401 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7tc5\" (UniqueName: \"kubernetes.io/projected/27496bd0-04f0-4cf3-9db2-6e30d76b1dd1-kube-api-access-d7tc5\") pod \"console-86b6549f64-jgx8h\" (UID: \"27496bd0-04f0-4cf3-9db2-6e30d76b1dd1\") " pod="openshift-console/console-86b6549f64-jgx8h" Jul 15 21:08:11.445203 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:08:11.445179 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86b6549f64-jgx8h" Jul 15 21:08:11.600192 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:08:11.600166 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86b6549f64-jgx8h"] Jul 15 21:08:11.602670 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:08:11.602641 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27496bd0_04f0_4cf3_9db2_6e30d76b1dd1.slice/crio-620024f50a34b1448dad0fd5bc762fa03e56870d73d69b3341e01498bf9f4d43 WatchSource:0}: Error finding container 620024f50a34b1448dad0fd5bc762fa03e56870d73d69b3341e01498bf9f4d43: Status 404 returned error can't find the container with id 620024f50a34b1448dad0fd5bc762fa03e56870d73d69b3341e01498bf9f4d43 Jul 15 21:08:11.823052 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:08:11.822968 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86b6549f64-jgx8h" event={"ID":"27496bd0-04f0-4cf3-9db2-6e30d76b1dd1","Type":"ContainerStarted","Data":"620024f50a34b1448dad0fd5bc762fa03e56870d73d69b3341e01498bf9f4d43"} Jul 15 21:08:15.685742 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:08:15.685693 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-zzmkh" Jul 15 21:08:15.842233 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:08:15.842196 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86b6549f64-jgx8h" event={"ID":"27496bd0-04f0-4cf3-9db2-6e30d76b1dd1","Type":"ContainerStarted","Data":"8412fedc36ab028ef0ede06f5f265c9e94758d3cb9c28cd9e5d4522b01ed57d5"} Jul 15 21:08:15.863515 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:08:15.863438 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-86b6549f64-jgx8h" podStartSLOduration=2.1324455 podStartE2EDuration="5.863422789s" totalImagesPullingTime="3.730977289s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:08:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:08:15.862628819 +0000 UTC m=+104.113053955" watchObservedRunningTime="2026-07-15 21:08:15.863422789 +0000 UTC m=+104.113847919" Jul 15 21:08:21.445900 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:08:21.445862 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-86b6549f64-jgx8h" Jul 15 21:08:21.446461 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:08:21.445949 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-86b6549f64-jgx8h" Jul 15 21:08:21.450708 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:08:21.450684 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-86b6549f64-jgx8h" Jul 15 21:08:21.866884 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:08:21.866795 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-86b6549f64-jgx8h" Jul 15 21:09:06.830355 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:06.830325 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 15 21:09:06.830913 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:06.830687 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c420cf29-760e-4b7a-b052-958d4584f9fa" containerName="alertmanager" containerID="cri-o://226501f75985ea3711a91941e4ae2683a56a80a5930d088fd490a160c9aedef5" gracePeriod=120 Jul 15 21:09:06.830913 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:06.830745 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c420cf29-760e-4b7a-b052-958d4584f9fa" containerName="kube-rbac-proxy-metric" containerID="cri-o://0f68d36243777ad21133a20ba0a820b0a9c892eedf9ded6d4a07017f5e3f16a4" gracePeriod=120 Jul 15 21:09:06.830913 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:06.830758 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c420cf29-760e-4b7a-b052-958d4584f9fa" containerName="kube-rbac-proxy" containerID="cri-o://c62d438ebec887d26a0a6380c10b189b1f9aa32af53c3c118f36a1e2c993e0bb" gracePeriod=120 Jul 15 21:09:06.830913 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:06.830794 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c420cf29-760e-4b7a-b052-958d4584f9fa" containerName="config-reloader" containerID="cri-o://1093e5a98ed41dc30c545661d798ccad4a801f8237a718813d127620bd1cd207" gracePeriod=120 Jul 15 21:09:06.830913 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:06.830848 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c420cf29-760e-4b7a-b052-958d4584f9fa" containerName="prom-label-proxy" containerID="cri-o://4da5d03f9a7ad32f3dbe7d807d85135099b0d979dc7f879956272f2611d0b5ff" gracePeriod=120 Jul 15 21:09:06.830913 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:06.830719 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c420cf29-760e-4b7a-b052-958d4584f9fa" containerName="kube-rbac-proxy-web" containerID="cri-o://69fb172b0cbccbab0134463a45b709368f3f26879d38334e097a9e7ae1cabdce" gracePeriod=120 Jul 15 21:09:07.033116 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:07.033084 2577 generic.go:356] "Generic (PLEG): container finished" podID="c420cf29-760e-4b7a-b052-958d4584f9fa" containerID="4da5d03f9a7ad32f3dbe7d807d85135099b0d979dc7f879956272f2611d0b5ff" exitCode=0 Jul 15 21:09:07.033116 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:07.033110 2577 generic.go:356] "Generic (PLEG): container finished" podID="c420cf29-760e-4b7a-b052-958d4584f9fa" containerID="c62d438ebec887d26a0a6380c10b189b1f9aa32af53c3c118f36a1e2c993e0bb" exitCode=0 Jul 15 21:09:07.033116 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:07.033117 2577 generic.go:356] "Generic (PLEG): container finished" podID="c420cf29-760e-4b7a-b052-958d4584f9fa" containerID="1093e5a98ed41dc30c545661d798ccad4a801f8237a718813d127620bd1cd207" exitCode=0 Jul 15 21:09:07.033116 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:07.033124 2577 generic.go:356] "Generic (PLEG): container finished" podID="c420cf29-760e-4b7a-b052-958d4584f9fa" containerID="226501f75985ea3711a91941e4ae2683a56a80a5930d088fd490a160c9aedef5" exitCode=0 Jul 15 21:09:07.033418 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:07.033155 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c420cf29-760e-4b7a-b052-958d4584f9fa","Type":"ContainerDied","Data":"4da5d03f9a7ad32f3dbe7d807d85135099b0d979dc7f879956272f2611d0b5ff"} Jul 15 21:09:07.033418 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:07.033271 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c420cf29-760e-4b7a-b052-958d4584f9fa","Type":"ContainerDied","Data":"c62d438ebec887d26a0a6380c10b189b1f9aa32af53c3c118f36a1e2c993e0bb"} Jul 15 21:09:07.033418 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:07.033318 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c420cf29-760e-4b7a-b052-958d4584f9fa","Type":"ContainerDied","Data":"1093e5a98ed41dc30c545661d798ccad4a801f8237a718813d127620bd1cd207"} Jul 15 21:09:07.033418 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:07.033361 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c420cf29-760e-4b7a-b052-958d4584f9fa","Type":"ContainerDied","Data":"226501f75985ea3711a91941e4ae2683a56a80a5930d088fd490a160c9aedef5"} Jul 15 21:09:08.063435 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:08.063402 2577 generic.go:356] "Generic (PLEG): container finished" podID="c420cf29-760e-4b7a-b052-958d4584f9fa" containerID="0f68d36243777ad21133a20ba0a820b0a9c892eedf9ded6d4a07017f5e3f16a4" exitCode=0 Jul 15 21:09:08.063435 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:08.063432 2577 generic.go:356] "Generic (PLEG): container finished" podID="c420cf29-760e-4b7a-b052-958d4584f9fa" containerID="69fb172b0cbccbab0134463a45b709368f3f26879d38334e097a9e7ae1cabdce" exitCode=0 Jul 15 21:09:08.063865 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:08.063473 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c420cf29-760e-4b7a-b052-958d4584f9fa","Type":"ContainerDied","Data":"0f68d36243777ad21133a20ba0a820b0a9c892eedf9ded6d4a07017f5e3f16a4"} Jul 15 21:09:08.063865 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:08.063539 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c420cf29-760e-4b7a-b052-958d4584f9fa","Type":"ContainerDied","Data":"69fb172b0cbccbab0134463a45b709368f3f26879d38334e097a9e7ae1cabdce"} Jul 15 21:09:08.088127 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:08.088110 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:09:08.220814 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:08.220778 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c420cf29-760e-4b7a-b052-958d4584f9fa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"c420cf29-760e-4b7a-b052-958d4584f9fa\" (UID: \"c420cf29-760e-4b7a-b052-958d4584f9fa\") " Jul 15 21:09:08.220814 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:08.220818 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c420cf29-760e-4b7a-b052-958d4584f9fa-alertmanager-trusted-ca-bundle\") pod \"c420cf29-760e-4b7a-b052-958d4584f9fa\" (UID: \"c420cf29-760e-4b7a-b052-958d4584f9fa\") " Jul 15 21:09:08.221013 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:08.220855 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c420cf29-760e-4b7a-b052-958d4584f9fa-secret-alertmanager-kube-rbac-proxy-web\") pod \"c420cf29-760e-4b7a-b052-958d4584f9fa\" (UID: \"c420cf29-760e-4b7a-b052-958d4584f9fa\") " Jul 15 21:09:08.221055 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:08.221010 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c420cf29-760e-4b7a-b052-958d4584f9fa-secret-alertmanager-main-tls\") pod \"c420cf29-760e-4b7a-b052-958d4584f9fa\" (UID: \"c420cf29-760e-4b7a-b052-958d4584f9fa\") " Jul 15 21:09:08.221086 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:08.221061 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c420cf29-760e-4b7a-b052-958d4584f9fa-cluster-tls-config\") pod \"c420cf29-760e-4b7a-b052-958d4584f9fa\" (UID: \"c420cf29-760e-4b7a-b052-958d4584f9fa\") " Jul 15 21:09:08.221123 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:08.221092 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wb5lj\" (UniqueName: \"kubernetes.io/projected/c420cf29-760e-4b7a-b052-958d4584f9fa-kube-api-access-wb5lj\") pod \"c420cf29-760e-4b7a-b052-958d4584f9fa\" (UID: \"c420cf29-760e-4b7a-b052-958d4584f9fa\") " Jul 15 21:09:08.221123 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:08.221115 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c420cf29-760e-4b7a-b052-958d4584f9fa-metrics-client-ca\") pod \"c420cf29-760e-4b7a-b052-958d4584f9fa\" (UID: \"c420cf29-760e-4b7a-b052-958d4584f9fa\") " Jul 15 21:09:08.221229 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:08.221157 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c420cf29-760e-4b7a-b052-958d4584f9fa-secret-alertmanager-kube-rbac-proxy\") pod \"c420cf29-760e-4b7a-b052-958d4584f9fa\" (UID: \"c420cf29-760e-4b7a-b052-958d4584f9fa\") " Jul 15 21:09:08.221288 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:08.221251 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c420cf29-760e-4b7a-b052-958d4584f9fa-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "c420cf29-760e-4b7a-b052-958d4584f9fa" (UID: "c420cf29-760e-4b7a-b052-958d4584f9fa"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:09:08.221823 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:08.221510 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c420cf29-760e-4b7a-b052-958d4584f9fa-tls-assets\") pod \"c420cf29-760e-4b7a-b052-958d4584f9fa\" (UID: \"c420cf29-760e-4b7a-b052-958d4584f9fa\") " Jul 15 21:09:08.221823 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:08.221545 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c420cf29-760e-4b7a-b052-958d4584f9fa-config-volume\") pod \"c420cf29-760e-4b7a-b052-958d4584f9fa\" (UID: \"c420cf29-760e-4b7a-b052-958d4584f9fa\") " Jul 15 21:09:08.221823 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:08.221565 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c420cf29-760e-4b7a-b052-958d4584f9fa-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "c420cf29-760e-4b7a-b052-958d4584f9fa" (UID: "c420cf29-760e-4b7a-b052-958d4584f9fa"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:09:08.221823 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:08.221576 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c420cf29-760e-4b7a-b052-958d4584f9fa-alertmanager-main-db\") pod \"c420cf29-760e-4b7a-b052-958d4584f9fa\" (UID: \"c420cf29-760e-4b7a-b052-958d4584f9fa\") " Jul 15 21:09:08.221823 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:08.221623 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c420cf29-760e-4b7a-b052-958d4584f9fa-config-out\") pod \"c420cf29-760e-4b7a-b052-958d4584f9fa\" (UID: \"c420cf29-760e-4b7a-b052-958d4584f9fa\") " Jul 15 21:09:08.221823 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:08.221653 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c420cf29-760e-4b7a-b052-958d4584f9fa-web-config\") pod \"c420cf29-760e-4b7a-b052-958d4584f9fa\" (UID: \"c420cf29-760e-4b7a-b052-958d4584f9fa\") " Jul 15 21:09:08.222220 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:08.221935 2577 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c420cf29-760e-4b7a-b052-958d4584f9fa-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\"" Jul 15 21:09:08.222220 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:08.221956 2577 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c420cf29-760e-4b7a-b052-958d4584f9fa-metrics-client-ca\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\"" Jul 15 21:09:08.222870 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:08.222797 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c420cf29-760e-4b7a-b052-958d4584f9fa-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "c420cf29-760e-4b7a-b052-958d4584f9fa" (UID: "c420cf29-760e-4b7a-b052-958d4584f9fa"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:09:08.223704 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:08.223666 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c420cf29-760e-4b7a-b052-958d4584f9fa-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "c420cf29-760e-4b7a-b052-958d4584f9fa" (UID: "c420cf29-760e-4b7a-b052-958d4584f9fa"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 21:09:08.223951 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:08.223921 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c420cf29-760e-4b7a-b052-958d4584f9fa-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "c420cf29-760e-4b7a-b052-958d4584f9fa" (UID: "c420cf29-760e-4b7a-b052-958d4584f9fa"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 21:09:08.224115 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:08.224087 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c420cf29-760e-4b7a-b052-958d4584f9fa-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "c420cf29-760e-4b7a-b052-958d4584f9fa" (UID: "c420cf29-760e-4b7a-b052-958d4584f9fa"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 21:09:08.224695 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:08.224656 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c420cf29-760e-4b7a-b052-958d4584f9fa-config-volume" (OuterVolumeSpecName: "config-volume") pod "c420cf29-760e-4b7a-b052-958d4584f9fa" (UID: "c420cf29-760e-4b7a-b052-958d4584f9fa"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 21:09:08.224805 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:08.224750 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c420cf29-760e-4b7a-b052-958d4584f9fa-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "c420cf29-760e-4b7a-b052-958d4584f9fa" (UID: "c420cf29-760e-4b7a-b052-958d4584f9fa"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 21:09:08.224971 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:08.224951 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c420cf29-760e-4b7a-b052-958d4584f9fa-kube-api-access-wb5lj" (OuterVolumeSpecName: "kube-api-access-wb5lj") pod "c420cf29-760e-4b7a-b052-958d4584f9fa" (UID: "c420cf29-760e-4b7a-b052-958d4584f9fa"). InnerVolumeSpecName "kube-api-access-wb5lj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:09:08.225156 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:08.225139 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c420cf29-760e-4b7a-b052-958d4584f9fa-config-out" (OuterVolumeSpecName: "config-out") pod "c420cf29-760e-4b7a-b052-958d4584f9fa" (UID: "c420cf29-760e-4b7a-b052-958d4584f9fa"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:09:08.225564 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:08.225549 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c420cf29-760e-4b7a-b052-958d4584f9fa-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "c420cf29-760e-4b7a-b052-958d4584f9fa" (UID: "c420cf29-760e-4b7a-b052-958d4584f9fa"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:09:08.229143 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:08.229121 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c420cf29-760e-4b7a-b052-958d4584f9fa-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "c420cf29-760e-4b7a-b052-958d4584f9fa" (UID: "c420cf29-760e-4b7a-b052-958d4584f9fa"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 21:09:08.234337 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:08.234319 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c420cf29-760e-4b7a-b052-958d4584f9fa-web-config" (OuterVolumeSpecName: "web-config") pod "c420cf29-760e-4b7a-b052-958d4584f9fa" (UID: "c420cf29-760e-4b7a-b052-958d4584f9fa"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 21:09:08.322815 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:08.322792 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c420cf29-760e-4b7a-b052-958d4584f9fa-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\"" Jul 15 21:09:08.322815 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:08.322812 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c420cf29-760e-4b7a-b052-958d4584f9fa-secret-alertmanager-main-tls\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\"" Jul 15 21:09:08.322928 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:08.322822 2577 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c420cf29-760e-4b7a-b052-958d4584f9fa-cluster-tls-config\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\"" Jul 15 21:09:08.322928 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:08.322831 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wb5lj\" (UniqueName: \"kubernetes.io/projected/c420cf29-760e-4b7a-b052-958d4584f9fa-kube-api-access-wb5lj\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\"" Jul 15 21:09:08.322928 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:08.322839 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c420cf29-760e-4b7a-b052-958d4584f9fa-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\"" Jul 15 21:09:08.322928 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:08.322848 2577 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c420cf29-760e-4b7a-b052-958d4584f9fa-tls-assets\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\"" Jul 15 21:09:08.322928 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:08.322855 2577 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c420cf29-760e-4b7a-b052-958d4584f9fa-config-volume\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\"" Jul 15 21:09:08.322928 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:08.322863 2577 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c420cf29-760e-4b7a-b052-958d4584f9fa-alertmanager-main-db\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\"" Jul 15 21:09:08.322928 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:08.322870 2577 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c420cf29-760e-4b7a-b052-958d4584f9fa-config-out\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\"" Jul 15 21:09:08.322928 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:08.322877 2577 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c420cf29-760e-4b7a-b052-958d4584f9fa-web-config\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\"" Jul 15 21:09:08.322928 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:08.322886 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c420cf29-760e-4b7a-b052-958d4584f9fa-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\"" Jul 15 21:09:09.070287 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.070251 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c420cf29-760e-4b7a-b052-958d4584f9fa","Type":"ContainerDied","Data":"3607d292f184da5f01b1bd9fc37c1c8c1833122d5e11e356a885767f41637dc5"} Jul 15 21:09:09.070287 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.070281 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:09:09.070796 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.070342 2577 scope.go:117] "RemoveContainer" containerID="4da5d03f9a7ad32f3dbe7d807d85135099b0d979dc7f879956272f2611d0b5ff" Jul 15 21:09:09.077667 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.077651 2577 scope.go:117] "RemoveContainer" containerID="0f68d36243777ad21133a20ba0a820b0a9c892eedf9ded6d4a07017f5e3f16a4" Jul 15 21:09:09.084182 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.084163 2577 scope.go:117] "RemoveContainer" containerID="c62d438ebec887d26a0a6380c10b189b1f9aa32af53c3c118f36a1e2c993e0bb" Jul 15 21:09:09.090299 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.090285 2577 scope.go:117] "RemoveContainer" containerID="69fb172b0cbccbab0134463a45b709368f3f26879d38334e097a9e7ae1cabdce" Jul 15 21:09:09.096993 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.096976 2577 scope.go:117] "RemoveContainer" containerID="1093e5a98ed41dc30c545661d798ccad4a801f8237a718813d127620bd1cd207" Jul 15 21:09:09.097076 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.097017 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 15 21:09:09.102779 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.102755 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 15 21:09:09.104251 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.104237 2577 scope.go:117] "RemoveContainer" containerID="226501f75985ea3711a91941e4ae2683a56a80a5930d088fd490a160c9aedef5" Jul 15 21:09:09.110699 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.110682 2577 scope.go:117] "RemoveContainer" containerID="aa6f5e90307749d8b16f52fce399adb6a11c6caa4b0c7af97f1067d41244a534" Jul 15 21:09:09.131022 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.130999 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 15 21:09:09.131261 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.131249 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c420cf29-760e-4b7a-b052-958d4584f9fa" containerName="init-config-reloader" Jul 15 21:09:09.131300 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.131262 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c420cf29-760e-4b7a-b052-958d4584f9fa" containerName="init-config-reloader" Jul 15 21:09:09.131300 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.131269 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c420cf29-760e-4b7a-b052-958d4584f9fa" containerName="prom-label-proxy" Jul 15 21:09:09.131300 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.131275 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c420cf29-760e-4b7a-b052-958d4584f9fa" containerName="prom-label-proxy" Jul 15 21:09:09.131300 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.131290 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c420cf29-760e-4b7a-b052-958d4584f9fa" containerName="alertmanager" Jul 15 21:09:09.131300 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.131295 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c420cf29-760e-4b7a-b052-958d4584f9fa" containerName="alertmanager" Jul 15 21:09:09.131436 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.131302 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c420cf29-760e-4b7a-b052-958d4584f9fa" containerName="config-reloader" Jul 15 21:09:09.131436 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.131307 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c420cf29-760e-4b7a-b052-958d4584f9fa" containerName="config-reloader" Jul 15 21:09:09.131436 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.131316 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c420cf29-760e-4b7a-b052-958d4584f9fa" containerName="kube-rbac-proxy" Jul 15 21:09:09.131436 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.131321 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c420cf29-760e-4b7a-b052-958d4584f9fa" containerName="kube-rbac-proxy" Jul 15 21:09:09.131436 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.131328 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c420cf29-760e-4b7a-b052-958d4584f9fa" containerName="kube-rbac-proxy-metric" Jul 15 21:09:09.131436 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.131334 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c420cf29-760e-4b7a-b052-958d4584f9fa" containerName="kube-rbac-proxy-metric" Jul 15 21:09:09.131436 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.131341 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c420cf29-760e-4b7a-b052-958d4584f9fa" containerName="kube-rbac-proxy-web" Jul 15 21:09:09.131436 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.131345 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c420cf29-760e-4b7a-b052-958d4584f9fa" containerName="kube-rbac-proxy-web" Jul 15 21:09:09.131436 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.131384 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c420cf29-760e-4b7a-b052-958d4584f9fa" containerName="kube-rbac-proxy-metric" Jul 15 21:09:09.131436 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.131391 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c420cf29-760e-4b7a-b052-958d4584f9fa" containerName="config-reloader" Jul 15 21:09:09.131436 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.131398 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c420cf29-760e-4b7a-b052-958d4584f9fa" containerName="kube-rbac-proxy" Jul 15 21:09:09.131436 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.131403 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c420cf29-760e-4b7a-b052-958d4584f9fa" containerName="prom-label-proxy" Jul 15 21:09:09.131436 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.131410 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c420cf29-760e-4b7a-b052-958d4584f9fa" containerName="kube-rbac-proxy-web" Jul 15 21:09:09.131436 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.131417 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c420cf29-760e-4b7a-b052-958d4584f9fa" containerName="alertmanager" Jul 15 21:09:09.135927 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.135910 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:09:09.138440 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.138400 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 15 21:09:09.138615 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.138585 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 15 21:09:09.138698 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.138630 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 15 21:09:09.138698 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.138641 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 15 21:09:09.138844 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.138641 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 15 21:09:09.138844 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.138790 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-jspkb\"" Jul 15 21:09:09.138988 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.138940 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 15 21:09:09.138988 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.138983 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 15 21:09:09.139145 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.138949 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 15 21:09:09.143353 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.143334 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 15 21:09:09.153585 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.153564 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 15 21:09:09.229761 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.229680 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cfeccf21-6b74-4a3c-b181-808c47017a9d-config-volume\") pod \"alertmanager-main-0\" (UID: \"cfeccf21-6b74-4a3c-b181-808c47017a9d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:09:09.229761 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.229709 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cfeccf21-6b74-4a3c-b181-808c47017a9d-config-out\") pod \"alertmanager-main-0\" (UID: \"cfeccf21-6b74-4a3c-b181-808c47017a9d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:09:09.229761 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.229744 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlxw8\" (UniqueName: \"kubernetes.io/projected/cfeccf21-6b74-4a3c-b181-808c47017a9d-kube-api-access-rlxw8\") pod \"alertmanager-main-0\" (UID: \"cfeccf21-6b74-4a3c-b181-808c47017a9d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:09:09.229932 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.229809 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cfeccf21-6b74-4a3c-b181-808c47017a9d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cfeccf21-6b74-4a3c-b181-808c47017a9d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:09:09.229932 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.229839 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfeccf21-6b74-4a3c-b181-808c47017a9d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cfeccf21-6b74-4a3c-b181-808c47017a9d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:09:09.229932 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.229860 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cfeccf21-6b74-4a3c-b181-808c47017a9d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cfeccf21-6b74-4a3c-b181-808c47017a9d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:09:09.229932 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.229875 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cfeccf21-6b74-4a3c-b181-808c47017a9d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cfeccf21-6b74-4a3c-b181-808c47017a9d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:09:09.229932 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.229890 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cfeccf21-6b74-4a3c-b181-808c47017a9d-web-config\") pod \"alertmanager-main-0\" (UID: \"cfeccf21-6b74-4a3c-b181-808c47017a9d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:09:09.229932 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.229906 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cfeccf21-6b74-4a3c-b181-808c47017a9d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cfeccf21-6b74-4a3c-b181-808c47017a9d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:09:09.230105 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.229947 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cfeccf21-6b74-4a3c-b181-808c47017a9d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cfeccf21-6b74-4a3c-b181-808c47017a9d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:09:09.230105 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.229981 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cfeccf21-6b74-4a3c-b181-808c47017a9d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cfeccf21-6b74-4a3c-b181-808c47017a9d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:09:09.230105 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.230024 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cfeccf21-6b74-4a3c-b181-808c47017a9d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cfeccf21-6b74-4a3c-b181-808c47017a9d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:09:09.230105 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.230043 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cfeccf21-6b74-4a3c-b181-808c47017a9d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cfeccf21-6b74-4a3c-b181-808c47017a9d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:09:09.330869 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.330829 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cfeccf21-6b74-4a3c-b181-808c47017a9d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cfeccf21-6b74-4a3c-b181-808c47017a9d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:09:09.330869 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.330870 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfeccf21-6b74-4a3c-b181-808c47017a9d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cfeccf21-6b74-4a3c-b181-808c47017a9d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:09:09.331085 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.330890 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cfeccf21-6b74-4a3c-b181-808c47017a9d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cfeccf21-6b74-4a3c-b181-808c47017a9d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:09:09.331085 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.330911 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cfeccf21-6b74-4a3c-b181-808c47017a9d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cfeccf21-6b74-4a3c-b181-808c47017a9d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:09:09.331085 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.330937 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cfeccf21-6b74-4a3c-b181-808c47017a9d-web-config\") pod \"alertmanager-main-0\" (UID: \"cfeccf21-6b74-4a3c-b181-808c47017a9d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:09:09.331085 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.330961 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cfeccf21-6b74-4a3c-b181-808c47017a9d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cfeccf21-6b74-4a3c-b181-808c47017a9d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:09:09.331085 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.330991 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cfeccf21-6b74-4a3c-b181-808c47017a9d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cfeccf21-6b74-4a3c-b181-808c47017a9d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:09:09.331085 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.331030 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cfeccf21-6b74-4a3c-b181-808c47017a9d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cfeccf21-6b74-4a3c-b181-808c47017a9d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:09:09.331351 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.331093 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cfeccf21-6b74-4a3c-b181-808c47017a9d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cfeccf21-6b74-4a3c-b181-808c47017a9d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:09:09.331351 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.331121 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cfeccf21-6b74-4a3c-b181-808c47017a9d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cfeccf21-6b74-4a3c-b181-808c47017a9d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:09:09.331351 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.331152 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cfeccf21-6b74-4a3c-b181-808c47017a9d-config-volume\") pod \"alertmanager-main-0\" (UID: \"cfeccf21-6b74-4a3c-b181-808c47017a9d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:09:09.331351 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.331178 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cfeccf21-6b74-4a3c-b181-808c47017a9d-config-out\") pod \"alertmanager-main-0\" (UID: \"cfeccf21-6b74-4a3c-b181-808c47017a9d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:09:09.331351 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.331201 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlxw8\" (UniqueName: \"kubernetes.io/projected/cfeccf21-6b74-4a3c-b181-808c47017a9d-kube-api-access-rlxw8\") pod \"alertmanager-main-0\" (UID: \"cfeccf21-6b74-4a3c-b181-808c47017a9d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:09:09.331975 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.331948 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfeccf21-6b74-4a3c-b181-808c47017a9d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cfeccf21-6b74-4a3c-b181-808c47017a9d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:09:09.332222 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.332199 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cfeccf21-6b74-4a3c-b181-808c47017a9d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cfeccf21-6b74-4a3c-b181-808c47017a9d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:09:09.334006 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.333976 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cfeccf21-6b74-4a3c-b181-808c47017a9d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cfeccf21-6b74-4a3c-b181-808c47017a9d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:09:09.334006 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.333990 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cfeccf21-6b74-4a3c-b181-808c47017a9d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cfeccf21-6b74-4a3c-b181-808c47017a9d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:09:09.334155 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.334006 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cfeccf21-6b74-4a3c-b181-808c47017a9d-web-config\") pod \"alertmanager-main-0\" (UID: \"cfeccf21-6b74-4a3c-b181-808c47017a9d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:09:09.334218 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.334151 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cfeccf21-6b74-4a3c-b181-808c47017a9d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cfeccf21-6b74-4a3c-b181-808c47017a9d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:09:09.334316 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.334289 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cfeccf21-6b74-4a3c-b181-808c47017a9d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cfeccf21-6b74-4a3c-b181-808c47017a9d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:09:09.334496 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.334451 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cfeccf21-6b74-4a3c-b181-808c47017a9d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cfeccf21-6b74-4a3c-b181-808c47017a9d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:09:09.334496 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.334482 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cfeccf21-6b74-4a3c-b181-808c47017a9d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cfeccf21-6b74-4a3c-b181-808c47017a9d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:09:09.334907 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.334890 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cfeccf21-6b74-4a3c-b181-808c47017a9d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cfeccf21-6b74-4a3c-b181-808c47017a9d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:09:09.335469 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.335446 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cfeccf21-6b74-4a3c-b181-808c47017a9d-config-volume\") pod \"alertmanager-main-0\" (UID: \"cfeccf21-6b74-4a3c-b181-808c47017a9d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:09:09.335805 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.335789 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cfeccf21-6b74-4a3c-b181-808c47017a9d-config-out\") pod \"alertmanager-main-0\" (UID: \"cfeccf21-6b74-4a3c-b181-808c47017a9d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:09:09.341536 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.341520 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlxw8\" (UniqueName: \"kubernetes.io/projected/cfeccf21-6b74-4a3c-b181-808c47017a9d-kube-api-access-rlxw8\") pod \"alertmanager-main-0\" (UID: \"cfeccf21-6b74-4a3c-b181-808c47017a9d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:09:09.445347 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.445304 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:09:09.584284 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:09.584261 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 15 21:09:09.586591 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:09:09.586567 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfeccf21_6b74_4a3c_b181_808c47017a9d.slice/crio-0bc03f5cb5ad47808453cc0eba0d6f96e8d8e1c9e432dc5e267b3f608eb5cca4 WatchSource:0}: Error finding container 0bc03f5cb5ad47808453cc0eba0d6f96e8d8e1c9e432dc5e267b3f608eb5cca4: Status 404 returned error can't find the container with id 0bc03f5cb5ad47808453cc0eba0d6f96e8d8e1c9e432dc5e267b3f608eb5cca4 Jul 15 21:09:10.075677 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:10.075642 2577 generic.go:356] "Generic (PLEG): container finished" podID="cfeccf21-6b74-4a3c-b181-808c47017a9d" containerID="5e1c3e3b282d90b06b96ed6d3bfec9367a9ceb9a6cb76d42b92c78d4b8cb09ab" exitCode=0 Jul 15 21:09:10.076067 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:10.075751 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cfeccf21-6b74-4a3c-b181-808c47017a9d","Type":"ContainerDied","Data":"5e1c3e3b282d90b06b96ed6d3bfec9367a9ceb9a6cb76d42b92c78d4b8cb09ab"} Jul 15 21:09:10.076067 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:10.075817 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cfeccf21-6b74-4a3c-b181-808c47017a9d","Type":"ContainerStarted","Data":"0bc03f5cb5ad47808453cc0eba0d6f96e8d8e1c9e432dc5e267b3f608eb5cca4"} Jul 15 21:09:10.340189 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:10.340165 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c420cf29-760e-4b7a-b052-958d4584f9fa" path="/var/lib/kubelet/pods/c420cf29-760e-4b7a-b052-958d4584f9fa/volumes" Jul 15 21:09:10.828261 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:10.828222 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-59db54f7cd-lq9nw"] Jul 15 21:09:10.832037 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:10.832016 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-59db54f7cd-lq9nw" Jul 15 21:09:10.835598 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:10.834707 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 15 21:09:10.835598 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:10.834751 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 15 21:09:10.835598 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:10.834894 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 15 21:09:10.835598 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:10.834934 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 15 21:09:10.835598 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:10.835135 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-t6rsl\"" Jul 15 21:09:10.835598 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:10.835368 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 15 21:09:10.839931 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:10.839868 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 15 21:09:10.847585 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:10.847561 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-59db54f7cd-lq9nw"] Jul 15 21:09:10.945271 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:10.945229 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8499994f-8522-47a4-b74e-870aa0ec723e-metrics-client-ca\") pod \"telemeter-client-59db54f7cd-lq9nw\" (UID: \"8499994f-8522-47a4-b74e-870aa0ec723e\") " pod="openshift-monitoring/telemeter-client-59db54f7cd-lq9nw" Jul 15 21:09:10.945271 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:10.945262 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhhmd\" (UniqueName: \"kubernetes.io/projected/8499994f-8522-47a4-b74e-870aa0ec723e-kube-api-access-qhhmd\") pod \"telemeter-client-59db54f7cd-lq9nw\" (UID: \"8499994f-8522-47a4-b74e-870aa0ec723e\") " pod="openshift-monitoring/telemeter-client-59db54f7cd-lq9nw" Jul 15 21:09:10.945499 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:10.945282 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/8499994f-8522-47a4-b74e-870aa0ec723e-secret-telemeter-client\") pod \"telemeter-client-59db54f7cd-lq9nw\" (UID: \"8499994f-8522-47a4-b74e-870aa0ec723e\") " pod="openshift-monitoring/telemeter-client-59db54f7cd-lq9nw" Jul 15 21:09:10.945499 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:10.945308 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8499994f-8522-47a4-b74e-870aa0ec723e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-59db54f7cd-lq9nw\" (UID: \"8499994f-8522-47a4-b74e-870aa0ec723e\") " pod="openshift-monitoring/telemeter-client-59db54f7cd-lq9nw" Jul 15 21:09:10.945499 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:10.945350 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8499994f-8522-47a4-b74e-870aa0ec723e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-59db54f7cd-lq9nw\" (UID: \"8499994f-8522-47a4-b74e-870aa0ec723e\") " pod="openshift-monitoring/telemeter-client-59db54f7cd-lq9nw" Jul 15 21:09:10.945499 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:10.945393 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8499994f-8522-47a4-b74e-870aa0ec723e-serving-certs-ca-bundle\") pod \"telemeter-client-59db54f7cd-lq9nw\" (UID: \"8499994f-8522-47a4-b74e-870aa0ec723e\") " pod="openshift-monitoring/telemeter-client-59db54f7cd-lq9nw" Jul 15 21:09:10.945499 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:10.945407 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/8499994f-8522-47a4-b74e-870aa0ec723e-telemeter-client-tls\") pod \"telemeter-client-59db54f7cd-lq9nw\" (UID: \"8499994f-8522-47a4-b74e-870aa0ec723e\") " pod="openshift-monitoring/telemeter-client-59db54f7cd-lq9nw" Jul 15 21:09:10.945499 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:10.945423 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/8499994f-8522-47a4-b74e-870aa0ec723e-federate-client-tls\") pod \"telemeter-client-59db54f7cd-lq9nw\" (UID: \"8499994f-8522-47a4-b74e-870aa0ec723e\") " pod="openshift-monitoring/telemeter-client-59db54f7cd-lq9nw" Jul 15 21:09:11.046288 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:11.046251 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8499994f-8522-47a4-b74e-870aa0ec723e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-59db54f7cd-lq9nw\" (UID: \"8499994f-8522-47a4-b74e-870aa0ec723e\") " pod="openshift-monitoring/telemeter-client-59db54f7cd-lq9nw" Jul 15 21:09:11.046463 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:11.046313 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8499994f-8522-47a4-b74e-870aa0ec723e-serving-certs-ca-bundle\") pod \"telemeter-client-59db54f7cd-lq9nw\" (UID: \"8499994f-8522-47a4-b74e-870aa0ec723e\") " pod="openshift-monitoring/telemeter-client-59db54f7cd-lq9nw" Jul 15 21:09:11.046463 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:11.046332 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/8499994f-8522-47a4-b74e-870aa0ec723e-telemeter-client-tls\") pod \"telemeter-client-59db54f7cd-lq9nw\" (UID: \"8499994f-8522-47a4-b74e-870aa0ec723e\") " pod="openshift-monitoring/telemeter-client-59db54f7cd-lq9nw" Jul 15 21:09:11.046463 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:11.046349 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/8499994f-8522-47a4-b74e-870aa0ec723e-federate-client-tls\") pod \"telemeter-client-59db54f7cd-lq9nw\" (UID: \"8499994f-8522-47a4-b74e-870aa0ec723e\") " pod="openshift-monitoring/telemeter-client-59db54f7cd-lq9nw" Jul 15 21:09:11.046463 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:11.046378 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8499994f-8522-47a4-b74e-870aa0ec723e-metrics-client-ca\") pod \"telemeter-client-59db54f7cd-lq9nw\" (UID: \"8499994f-8522-47a4-b74e-870aa0ec723e\") " pod="openshift-monitoring/telemeter-client-59db54f7cd-lq9nw" Jul 15 21:09:11.046463 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:11.046394 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhhmd\" (UniqueName: \"kubernetes.io/projected/8499994f-8522-47a4-b74e-870aa0ec723e-kube-api-access-qhhmd\") pod \"telemeter-client-59db54f7cd-lq9nw\" (UID: \"8499994f-8522-47a4-b74e-870aa0ec723e\") " pod="openshift-monitoring/telemeter-client-59db54f7cd-lq9nw" Jul 15 21:09:11.046463 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:11.046411 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/8499994f-8522-47a4-b74e-870aa0ec723e-secret-telemeter-client\") pod \"telemeter-client-59db54f7cd-lq9nw\" (UID: \"8499994f-8522-47a4-b74e-870aa0ec723e\") " pod="openshift-monitoring/telemeter-client-59db54f7cd-lq9nw" Jul 15 21:09:11.046463 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:11.046426 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8499994f-8522-47a4-b74e-870aa0ec723e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-59db54f7cd-lq9nw\" (UID: \"8499994f-8522-47a4-b74e-870aa0ec723e\") " pod="openshift-monitoring/telemeter-client-59db54f7cd-lq9nw" Jul 15 21:09:11.047275 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:11.047245 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8499994f-8522-47a4-b74e-870aa0ec723e-metrics-client-ca\") pod \"telemeter-client-59db54f7cd-lq9nw\" (UID: \"8499994f-8522-47a4-b74e-870aa0ec723e\") " pod="openshift-monitoring/telemeter-client-59db54f7cd-lq9nw" Jul 15 21:09:11.047390 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:11.047274 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8499994f-8522-47a4-b74e-870aa0ec723e-serving-certs-ca-bundle\") pod \"telemeter-client-59db54f7cd-lq9nw\" (UID: \"8499994f-8522-47a4-b74e-870aa0ec723e\") " pod="openshift-monitoring/telemeter-client-59db54f7cd-lq9nw" Jul 15 21:09:11.047561 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:11.047537 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8499994f-8522-47a4-b74e-870aa0ec723e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-59db54f7cd-lq9nw\" (UID: \"8499994f-8522-47a4-b74e-870aa0ec723e\") " pod="openshift-monitoring/telemeter-client-59db54f7cd-lq9nw" Jul 15 21:09:11.048895 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:11.048866 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8499994f-8522-47a4-b74e-870aa0ec723e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-59db54f7cd-lq9nw\" (UID: \"8499994f-8522-47a4-b74e-870aa0ec723e\") " pod="openshift-monitoring/telemeter-client-59db54f7cd-lq9nw" Jul 15 21:09:11.049027 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:11.049008 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/8499994f-8522-47a4-b74e-870aa0ec723e-telemeter-client-tls\") pod \"telemeter-client-59db54f7cd-lq9nw\" (UID: \"8499994f-8522-47a4-b74e-870aa0ec723e\") " pod="openshift-monitoring/telemeter-client-59db54f7cd-lq9nw" Jul 15 21:09:11.049163 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:11.049139 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/8499994f-8522-47a4-b74e-870aa0ec723e-secret-telemeter-client\") pod \"telemeter-client-59db54f7cd-lq9nw\" (UID: \"8499994f-8522-47a4-b74e-870aa0ec723e\") " pod="openshift-monitoring/telemeter-client-59db54f7cd-lq9nw" Jul 15 21:09:11.049218 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:11.049169 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/8499994f-8522-47a4-b74e-870aa0ec723e-federate-client-tls\") pod \"telemeter-client-59db54f7cd-lq9nw\" (UID: \"8499994f-8522-47a4-b74e-870aa0ec723e\") " pod="openshift-monitoring/telemeter-client-59db54f7cd-lq9nw" Jul 15 21:09:11.056227 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:11.056206 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhhmd\" (UniqueName: \"kubernetes.io/projected/8499994f-8522-47a4-b74e-870aa0ec723e-kube-api-access-qhhmd\") pod \"telemeter-client-59db54f7cd-lq9nw\" (UID: \"8499994f-8522-47a4-b74e-870aa0ec723e\") " pod="openshift-monitoring/telemeter-client-59db54f7cd-lq9nw" Jul 15 21:09:11.082025 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:11.081973 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cfeccf21-6b74-4a3c-b181-808c47017a9d","Type":"ContainerStarted","Data":"f0bbafe39b4c03b8c7d21785c1c9dac184b145bd49afc7827e626a5a3a64e9cb"} Jul 15 21:09:11.082319 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:11.082054 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cfeccf21-6b74-4a3c-b181-808c47017a9d","Type":"ContainerStarted","Data":"79039966b47d189708deaac5f61eeeb7231abacee0c2c76610416a5481ddb599"} Jul 15 21:09:11.082319 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:11.082081 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cfeccf21-6b74-4a3c-b181-808c47017a9d","Type":"ContainerStarted","Data":"69969cdd6b0f1d4c88a58a4c2fc30a5f27c69d034d0e65273f368386ab486df8"} Jul 15 21:09:11.082319 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:11.082106 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cfeccf21-6b74-4a3c-b181-808c47017a9d","Type":"ContainerStarted","Data":"47610550a8608b8c9224980012809cefb8f322172a6cc39438747d8f6bbd381a"} Jul 15 21:09:11.082319 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:11.082129 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cfeccf21-6b74-4a3c-b181-808c47017a9d","Type":"ContainerStarted","Data":"5210641edb727e802699d44ac1a2507b74a91e34be15d2dcd08cb9ce718841a1"} Jul 15 21:09:11.082319 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:11.082153 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cfeccf21-6b74-4a3c-b181-808c47017a9d","Type":"ContainerStarted","Data":"9a2b2174d33bf94e590080eb039db5b55272d5d6aba6ff1936752dcba2b2dbc8"} Jul 15 21:09:11.111056 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:11.111007 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.095490555 podStartE2EDuration="2.110990962s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.500407ms" isStatefulPod=false podCreationTimestamp="2026-07-15 21:09:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:09:11.109779607 +0000 UTC m=+159.360204744" watchObservedRunningTime="2026-07-15 21:09:11.110990962 +0000 UTC m=+159.361416092" Jul 15 21:09:11.142449 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:11.142420 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-59db54f7cd-lq9nw" Jul 15 21:09:11.288140 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:11.287853 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-59db54f7cd-lq9nw"] Jul 15 21:09:11.290967 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:09:11.290933 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8499994f_8522_47a4_b74e_870aa0ec723e.slice/crio-efa7b78647066a88a59b0bdcdf3338ed679bca4db5d52bdf0034c9a460761dd5 WatchSource:0}: Error finding container efa7b78647066a88a59b0bdcdf3338ed679bca4db5d52bdf0034c9a460761dd5: Status 404 returned error can't find the container with id efa7b78647066a88a59b0bdcdf3338ed679bca4db5d52bdf0034c9a460761dd5 Jul 15 21:09:12.088442 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:12.088396 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-59db54f7cd-lq9nw" event={"ID":"8499994f-8522-47a4-b74e-870aa0ec723e","Type":"ContainerStarted","Data":"efa7b78647066a88a59b0bdcdf3338ed679bca4db5d52bdf0034c9a460761dd5"} Jul 15 21:09:14.098822 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:14.098786 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-59db54f7cd-lq9nw" event={"ID":"8499994f-8522-47a4-b74e-870aa0ec723e","Type":"ContainerStarted","Data":"07dcca9fab873556b5a735b123d7cc2d632270ae638fe81348ec3866041387c4"} Jul 15 21:09:14.099331 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:14.098884 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-59db54f7cd-lq9nw" event={"ID":"8499994f-8522-47a4-b74e-870aa0ec723e","Type":"ContainerStarted","Data":"49a054287b69dfa1dba8dd3c933868ed5b1a91c08e09220b89b1d7ac70ab2370"} Jul 15 21:09:14.099331 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:14.098917 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-59db54f7cd-lq9nw" event={"ID":"8499994f-8522-47a4-b74e-870aa0ec723e","Type":"ContainerStarted","Data":"5b25bef4ec968cc7f0b803512bda0f95ba144d101f5cf693523b0b77bfd02a23"} Jul 15 21:09:14.124944 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:14.124890 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-59db54f7cd-lq9nw" podStartSLOduration=2.2617617340000002 podStartE2EDuration="4.124875249s" totalImagesPullingTime="1.863113515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:09:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:09:14.12188856 +0000 UTC m=+162.372313714" watchObservedRunningTime="2026-07-15 21:09:14.124875249 +0000 UTC m=+162.375300377" Jul 15 21:09:15.074946 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:15.074911 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d6ff5f888-qp86f"] Jul 15 21:09:15.078669 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:15.078648 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d6ff5f888-qp86f" Jul 15 21:09:15.089864 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:15.089836 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d6ff5f888-qp86f"] Jul 15 21:09:15.179447 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:15.179409 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1-oauth-serving-cert\") pod \"console-7d6ff5f888-qp86f\" (UID: \"3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1\") " pod="openshift-console/console-7d6ff5f888-qp86f" Jul 15 21:09:15.179856 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:15.179468 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1-trusted-ca-bundle\") pod \"console-7d6ff5f888-qp86f\" (UID: \"3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1\") " pod="openshift-console/console-7d6ff5f888-qp86f" Jul 15 21:09:15.179856 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:15.179518 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrdj9\" (UniqueName: \"kubernetes.io/projected/3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1-kube-api-access-rrdj9\") pod \"console-7d6ff5f888-qp86f\" (UID: \"3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1\") " pod="openshift-console/console-7d6ff5f888-qp86f" Jul 15 21:09:15.179856 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:15.179563 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1-console-config\") pod \"console-7d6ff5f888-qp86f\" (UID: \"3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1\") " pod="openshift-console/console-7d6ff5f888-qp86f" Jul 15 21:09:15.179856 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:15.179609 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1-console-serving-cert\") pod \"console-7d6ff5f888-qp86f\" (UID: \"3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1\") " pod="openshift-console/console-7d6ff5f888-qp86f" Jul 15 21:09:15.179856 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:15.179674 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1-console-oauth-config\") pod \"console-7d6ff5f888-qp86f\" (UID: \"3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1\") " pod="openshift-console/console-7d6ff5f888-qp86f" Jul 15 21:09:15.180124 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:15.179865 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1-service-ca\") pod \"console-7d6ff5f888-qp86f\" (UID: \"3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1\") " pod="openshift-console/console-7d6ff5f888-qp86f" Jul 15 21:09:15.280377 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:15.280337 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1-service-ca\") pod \"console-7d6ff5f888-qp86f\" (UID: \"3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1\") " pod="openshift-console/console-7d6ff5f888-qp86f" Jul 15 21:09:15.280377 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:15.280381 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1-oauth-serving-cert\") pod \"console-7d6ff5f888-qp86f\" (UID: \"3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1\") " pod="openshift-console/console-7d6ff5f888-qp86f" Jul 15 21:09:15.280603 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:15.280505 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1-trusted-ca-bundle\") pod \"console-7d6ff5f888-qp86f\" (UID: \"3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1\") " pod="openshift-console/console-7d6ff5f888-qp86f" Jul 15 21:09:15.280603 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:15.280537 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrdj9\" (UniqueName: \"kubernetes.io/projected/3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1-kube-api-access-rrdj9\") pod \"console-7d6ff5f888-qp86f\" (UID: \"3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1\") " pod="openshift-console/console-7d6ff5f888-qp86f" Jul 15 21:09:15.280603 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:15.280558 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1-console-config\") pod \"console-7d6ff5f888-qp86f\" (UID: \"3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1\") " pod="openshift-console/console-7d6ff5f888-qp86f" Jul 15 21:09:15.280603 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:15.280587 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1-console-serving-cert\") pod \"console-7d6ff5f888-qp86f\" (UID: \"3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1\") " pod="openshift-console/console-7d6ff5f888-qp86f" Jul 15 21:09:15.280845 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:15.280625 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1-console-oauth-config\") pod \"console-7d6ff5f888-qp86f\" (UID: \"3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1\") " pod="openshift-console/console-7d6ff5f888-qp86f" Jul 15 21:09:15.281224 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:15.281199 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1-service-ca\") pod \"console-7d6ff5f888-qp86f\" (UID: \"3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1\") " pod="openshift-console/console-7d6ff5f888-qp86f" Jul 15 21:09:15.281325 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:15.281203 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1-oauth-serving-cert\") pod \"console-7d6ff5f888-qp86f\" (UID: \"3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1\") " pod="openshift-console/console-7d6ff5f888-qp86f" Jul 15 21:09:15.281325 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:15.281290 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1-console-config\") pod \"console-7d6ff5f888-qp86f\" (UID: \"3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1\") " pod="openshift-console/console-7d6ff5f888-qp86f" Jul 15 21:09:15.281417 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:15.281332 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1-trusted-ca-bundle\") pod \"console-7d6ff5f888-qp86f\" (UID: \"3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1\") " pod="openshift-console/console-7d6ff5f888-qp86f" Jul 15 21:09:15.283195 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:15.283172 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1-console-oauth-config\") pod \"console-7d6ff5f888-qp86f\" (UID: \"3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1\") " pod="openshift-console/console-7d6ff5f888-qp86f" Jul 15 21:09:15.283271 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:15.283243 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1-console-serving-cert\") pod \"console-7d6ff5f888-qp86f\" (UID: \"3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1\") " pod="openshift-console/console-7d6ff5f888-qp86f" Jul 15 21:09:15.290408 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:15.290389 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrdj9\" (UniqueName: \"kubernetes.io/projected/3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1-kube-api-access-rrdj9\") pod \"console-7d6ff5f888-qp86f\" (UID: \"3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1\") " pod="openshift-console/console-7d6ff5f888-qp86f" Jul 15 21:09:15.388793 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:15.388734 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d6ff5f888-qp86f" Jul 15 21:09:15.518713 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:15.518690 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d6ff5f888-qp86f"] Jul 15 21:09:15.520806 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:09:15.520776 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3837d11b_48e9_49aa_b93e_fd6a0ae6e8c1.slice/crio-07b9512135409bebdab209a96aa236ced1d784115958f654af800094514467e8 WatchSource:0}: Error finding container 07b9512135409bebdab209a96aa236ced1d784115958f654af800094514467e8: Status 404 returned error can't find the container with id 07b9512135409bebdab209a96aa236ced1d784115958f654af800094514467e8 Jul 15 21:09:16.109954 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:16.109918 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d6ff5f888-qp86f" event={"ID":"3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1","Type":"ContainerStarted","Data":"c75c2ee928a3e7ea85b6eec41664dab462ff4296bbd379bca47d09f7021ef5ac"} Jul 15 21:09:16.110119 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:16.109966 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d6ff5f888-qp86f" event={"ID":"3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1","Type":"ContainerStarted","Data":"07b9512135409bebdab209a96aa236ced1d784115958f654af800094514467e8"} Jul 15 21:09:16.137476 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:16.137425 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7d6ff5f888-qp86f" podStartSLOduration=1.1374097619999999 podStartE2EDuration="1.137409762s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:09:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:09:16.136204889 +0000 UTC m=+164.386630020" watchObservedRunningTime="2026-07-15 21:09:16.137409762 +0000 UTC m=+164.387834892" Jul 15 21:09:25.389227 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:25.389143 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d6ff5f888-qp86f" Jul 15 21:09:25.389227 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:25.389216 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7d6ff5f888-qp86f" Jul 15 21:09:25.394001 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:25.393971 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7d6ff5f888-qp86f" Jul 15 21:09:26.151215 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:26.151188 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7d6ff5f888-qp86f" Jul 15 21:09:26.203824 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:26.203796 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86b6549f64-jgx8h"] Jul 15 21:09:51.230432 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:51.230389 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-86b6549f64-jgx8h" podUID="27496bd0-04f0-4cf3-9db2-6e30d76b1dd1" containerName="console" containerID="cri-o://8412fedc36ab028ef0ede06f5f265c9e94758d3cb9c28cd9e5d4522b01ed57d5" gracePeriod=15 Jul 15 21:09:51.470904 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:51.470875 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86b6549f64-jgx8h" Jul 15 21:09:51.542784 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:51.542691 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27496bd0-04f0-4cf3-9db2-6e30d76b1dd1-console-serving-cert\") pod \"27496bd0-04f0-4cf3-9db2-6e30d76b1dd1\" (UID: \"27496bd0-04f0-4cf3-9db2-6e30d76b1dd1\") " Jul 15 21:09:51.542784 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:51.542752 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27496bd0-04f0-4cf3-9db2-6e30d76b1dd1-console-config\") pod \"27496bd0-04f0-4cf3-9db2-6e30d76b1dd1\" (UID: \"27496bd0-04f0-4cf3-9db2-6e30d76b1dd1\") " Jul 15 21:09:51.542971 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:51.542956 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27496bd0-04f0-4cf3-9db2-6e30d76b1dd1-trusted-ca-bundle\") pod \"27496bd0-04f0-4cf3-9db2-6e30d76b1dd1\" (UID: \"27496bd0-04f0-4cf3-9db2-6e30d76b1dd1\") " Jul 15 21:09:51.543026 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:51.542998 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d7tc5\" (UniqueName: \"kubernetes.io/projected/27496bd0-04f0-4cf3-9db2-6e30d76b1dd1-kube-api-access-d7tc5\") pod \"27496bd0-04f0-4cf3-9db2-6e30d76b1dd1\" (UID: \"27496bd0-04f0-4cf3-9db2-6e30d76b1dd1\") " Jul 15 21:09:51.543077 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:51.543016 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27496bd0-04f0-4cf3-9db2-6e30d76b1dd1-console-config" (OuterVolumeSpecName: "console-config") pod "27496bd0-04f0-4cf3-9db2-6e30d76b1dd1" (UID: "27496bd0-04f0-4cf3-9db2-6e30d76b1dd1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:09:51.543077 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:51.543045 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27496bd0-04f0-4cf3-9db2-6e30d76b1dd1-service-ca\") pod \"27496bd0-04f0-4cf3-9db2-6e30d76b1dd1\" (UID: \"27496bd0-04f0-4cf3-9db2-6e30d76b1dd1\") " Jul 15 21:09:51.543179 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:51.543091 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27496bd0-04f0-4cf3-9db2-6e30d76b1dd1-oauth-serving-cert\") pod \"27496bd0-04f0-4cf3-9db2-6e30d76b1dd1\" (UID: \"27496bd0-04f0-4cf3-9db2-6e30d76b1dd1\") " Jul 15 21:09:51.543179 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:51.543126 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27496bd0-04f0-4cf3-9db2-6e30d76b1dd1-console-oauth-config\") pod \"27496bd0-04f0-4cf3-9db2-6e30d76b1dd1\" (UID: \"27496bd0-04f0-4cf3-9db2-6e30d76b1dd1\") " Jul 15 21:09:51.543330 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:51.543291 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27496bd0-04f0-4cf3-9db2-6e30d76b1dd1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "27496bd0-04f0-4cf3-9db2-6e30d76b1dd1" (UID: "27496bd0-04f0-4cf3-9db2-6e30d76b1dd1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:09:51.543432 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:51.543411 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27496bd0-04f0-4cf3-9db2-6e30d76b1dd1-service-ca" (OuterVolumeSpecName: "service-ca") pod "27496bd0-04f0-4cf3-9db2-6e30d76b1dd1" (UID: "27496bd0-04f0-4cf3-9db2-6e30d76b1dd1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:09:51.543522 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:51.543493 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27496bd0-04f0-4cf3-9db2-6e30d76b1dd1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "27496bd0-04f0-4cf3-9db2-6e30d76b1dd1" (UID: "27496bd0-04f0-4cf3-9db2-6e30d76b1dd1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:09:51.543522 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:51.543500 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27496bd0-04f0-4cf3-9db2-6e30d76b1dd1-trusted-ca-bundle\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\"" Jul 15 21:09:51.543693 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:51.543539 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27496bd0-04f0-4cf3-9db2-6e30d76b1dd1-service-ca\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\"" Jul 15 21:09:51.543693 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:51.543551 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27496bd0-04f0-4cf3-9db2-6e30d76b1dd1-console-config\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\"" Jul 15 21:09:51.545009 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:51.544983 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27496bd0-04f0-4cf3-9db2-6e30d76b1dd1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "27496bd0-04f0-4cf3-9db2-6e30d76b1dd1" (UID: "27496bd0-04f0-4cf3-9db2-6e30d76b1dd1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 21:09:51.545093 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:51.545061 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27496bd0-04f0-4cf3-9db2-6e30d76b1dd1-kube-api-access-d7tc5" (OuterVolumeSpecName: "kube-api-access-d7tc5") pod "27496bd0-04f0-4cf3-9db2-6e30d76b1dd1" (UID: "27496bd0-04f0-4cf3-9db2-6e30d76b1dd1"). InnerVolumeSpecName "kube-api-access-d7tc5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:09:51.545198 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:51.545179 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27496bd0-04f0-4cf3-9db2-6e30d76b1dd1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "27496bd0-04f0-4cf3-9db2-6e30d76b1dd1" (UID: "27496bd0-04f0-4cf3-9db2-6e30d76b1dd1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 21:09:51.644594 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:51.644562 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d7tc5\" (UniqueName: \"kubernetes.io/projected/27496bd0-04f0-4cf3-9db2-6e30d76b1dd1-kube-api-access-d7tc5\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\"" Jul 15 21:09:51.644594 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:51.644588 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27496bd0-04f0-4cf3-9db2-6e30d76b1dd1-oauth-serving-cert\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\"" Jul 15 21:09:51.644594 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:51.644597 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27496bd0-04f0-4cf3-9db2-6e30d76b1dd1-console-oauth-config\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\"" Jul 15 21:09:51.644808 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:51.644606 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27496bd0-04f0-4cf3-9db2-6e30d76b1dd1-console-serving-cert\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\"" Jul 15 21:09:52.247765 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:52.247708 2577 generic.go:356] "Generic (PLEG): container finished" podID="27496bd0-04f0-4cf3-9db2-6e30d76b1dd1" containerID="8412fedc36ab028ef0ede06f5f265c9e94758d3cb9c28cd9e5d4522b01ed57d5" exitCode=0 Jul 15 21:09:52.248238 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:52.247767 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86b6549f64-jgx8h" event={"ID":"27496bd0-04f0-4cf3-9db2-6e30d76b1dd1","Type":"ContainerDied","Data":"8412fedc36ab028ef0ede06f5f265c9e94758d3cb9c28cd9e5d4522b01ed57d5"} Jul 15 21:09:52.248238 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:52.247798 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86b6549f64-jgx8h" Jul 15 21:09:52.248238 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:52.247824 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86b6549f64-jgx8h" event={"ID":"27496bd0-04f0-4cf3-9db2-6e30d76b1dd1","Type":"ContainerDied","Data":"620024f50a34b1448dad0fd5bc762fa03e56870d73d69b3341e01498bf9f4d43"} Jul 15 21:09:52.248238 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:52.247854 2577 scope.go:117] "RemoveContainer" containerID="8412fedc36ab028ef0ede06f5f265c9e94758d3cb9c28cd9e5d4522b01ed57d5" Jul 15 21:09:52.257365 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:52.257350 2577 scope.go:117] "RemoveContainer" containerID="8412fedc36ab028ef0ede06f5f265c9e94758d3cb9c28cd9e5d4522b01ed57d5" Jul 15 21:09:52.257618 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:09:52.257595 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8412fedc36ab028ef0ede06f5f265c9e94758d3cb9c28cd9e5d4522b01ed57d5\": container with ID starting with 8412fedc36ab028ef0ede06f5f265c9e94758d3cb9c28cd9e5d4522b01ed57d5 not found: ID does not exist" containerID="8412fedc36ab028ef0ede06f5f265c9e94758d3cb9c28cd9e5d4522b01ed57d5" Jul 15 21:09:52.257665 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:52.257630 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8412fedc36ab028ef0ede06f5f265c9e94758d3cb9c28cd9e5d4522b01ed57d5"} err="failed to get container status \"8412fedc36ab028ef0ede06f5f265c9e94758d3cb9c28cd9e5d4522b01ed57d5\": rpc error: code = NotFound desc = could not find container \"8412fedc36ab028ef0ede06f5f265c9e94758d3cb9c28cd9e5d4522b01ed57d5\": container with ID starting with 8412fedc36ab028ef0ede06f5f265c9e94758d3cb9c28cd9e5d4522b01ed57d5 not found: ID does not exist" Jul 15 21:09:52.279085 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:52.279063 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86b6549f64-jgx8h"] Jul 15 21:09:52.283553 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:52.283534 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-86b6549f64-jgx8h"] Jul 15 21:09:52.339327 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:09:52.339304 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27496bd0-04f0-4cf3-9db2-6e30d76b1dd1" path="/var/lib/kubelet/pods/27496bd0-04f0-4cf3-9db2-6e30d76b1dd1/volumes" Jul 15 21:10:35.413268 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:10:35.413238 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-745bdb69fd-cjr7p"] Jul 15 21:10:35.413641 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:10:35.413512 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27496bd0-04f0-4cf3-9db2-6e30d76b1dd1" containerName="console" Jul 15 21:10:35.413641 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:10:35.413522 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="27496bd0-04f0-4cf3-9db2-6e30d76b1dd1" containerName="console" Jul 15 21:10:35.413641 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:10:35.413593 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="27496bd0-04f0-4cf3-9db2-6e30d76b1dd1" containerName="console" Jul 15 21:10:35.416637 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:10:35.416621 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-745bdb69fd-cjr7p" Jul 15 21:10:35.440540 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:10:35.440517 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-745bdb69fd-cjr7p"] Jul 15 21:10:35.574860 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:10:35.574822 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f23336f7-c3d2-483f-bc7e-9d5297eed8c2-console-oauth-config\") pod \"console-745bdb69fd-cjr7p\" (UID: \"f23336f7-c3d2-483f-bc7e-9d5297eed8c2\") " pod="openshift-console/console-745bdb69fd-cjr7p" Jul 15 21:10:35.575024 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:10:35.574885 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f23336f7-c3d2-483f-bc7e-9d5297eed8c2-oauth-serving-cert\") pod \"console-745bdb69fd-cjr7p\" (UID: \"f23336f7-c3d2-483f-bc7e-9d5297eed8c2\") " pod="openshift-console/console-745bdb69fd-cjr7p" Jul 15 21:10:35.575024 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:10:35.574931 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f23336f7-c3d2-483f-bc7e-9d5297eed8c2-console-serving-cert\") pod \"console-745bdb69fd-cjr7p\" (UID: \"f23336f7-c3d2-483f-bc7e-9d5297eed8c2\") " pod="openshift-console/console-745bdb69fd-cjr7p" Jul 15 21:10:35.575024 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:10:35.574950 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f23336f7-c3d2-483f-bc7e-9d5297eed8c2-console-config\") pod \"console-745bdb69fd-cjr7p\" (UID: \"f23336f7-c3d2-483f-bc7e-9d5297eed8c2\") " pod="openshift-console/console-745bdb69fd-cjr7p" Jul 15 21:10:35.575024 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:10:35.574981 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f23336f7-c3d2-483f-bc7e-9d5297eed8c2-trusted-ca-bundle\") pod \"console-745bdb69fd-cjr7p\" (UID: \"f23336f7-c3d2-483f-bc7e-9d5297eed8c2\") " pod="openshift-console/console-745bdb69fd-cjr7p" Jul 15 21:10:35.575024 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:10:35.575006 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f23336f7-c3d2-483f-bc7e-9d5297eed8c2-service-ca\") pod \"console-745bdb69fd-cjr7p\" (UID: \"f23336f7-c3d2-483f-bc7e-9d5297eed8c2\") " pod="openshift-console/console-745bdb69fd-cjr7p" Jul 15 21:10:35.575024 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:10:35.575021 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsc4n\" (UniqueName: \"kubernetes.io/projected/f23336f7-c3d2-483f-bc7e-9d5297eed8c2-kube-api-access-nsc4n\") pod \"console-745bdb69fd-cjr7p\" (UID: \"f23336f7-c3d2-483f-bc7e-9d5297eed8c2\") " pod="openshift-console/console-745bdb69fd-cjr7p" Jul 15 21:10:35.675600 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:10:35.675527 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f23336f7-c3d2-483f-bc7e-9d5297eed8c2-oauth-serving-cert\") pod \"console-745bdb69fd-cjr7p\" (UID: \"f23336f7-c3d2-483f-bc7e-9d5297eed8c2\") " pod="openshift-console/console-745bdb69fd-cjr7p" Jul 15 21:10:35.675600 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:10:35.675575 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f23336f7-c3d2-483f-bc7e-9d5297eed8c2-console-serving-cert\") pod \"console-745bdb69fd-cjr7p\" (UID: \"f23336f7-c3d2-483f-bc7e-9d5297eed8c2\") " pod="openshift-console/console-745bdb69fd-cjr7p" Jul 15 21:10:35.675600 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:10:35.675591 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f23336f7-c3d2-483f-bc7e-9d5297eed8c2-console-config\") pod \"console-745bdb69fd-cjr7p\" (UID: \"f23336f7-c3d2-483f-bc7e-9d5297eed8c2\") " pod="openshift-console/console-745bdb69fd-cjr7p" Jul 15 21:10:35.675890 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:10:35.675607 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f23336f7-c3d2-483f-bc7e-9d5297eed8c2-trusted-ca-bundle\") pod \"console-745bdb69fd-cjr7p\" (UID: \"f23336f7-c3d2-483f-bc7e-9d5297eed8c2\") " pod="openshift-console/console-745bdb69fd-cjr7p" Jul 15 21:10:35.675890 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:10:35.675643 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f23336f7-c3d2-483f-bc7e-9d5297eed8c2-service-ca\") pod \"console-745bdb69fd-cjr7p\" (UID: \"f23336f7-c3d2-483f-bc7e-9d5297eed8c2\") " pod="openshift-console/console-745bdb69fd-cjr7p" Jul 15 21:10:35.675890 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:10:35.675667 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsc4n\" (UniqueName: \"kubernetes.io/projected/f23336f7-c3d2-483f-bc7e-9d5297eed8c2-kube-api-access-nsc4n\") pod \"console-745bdb69fd-cjr7p\" (UID: \"f23336f7-c3d2-483f-bc7e-9d5297eed8c2\") " pod="openshift-console/console-745bdb69fd-cjr7p" Jul 15 21:10:35.675890 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:10:35.675703 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f23336f7-c3d2-483f-bc7e-9d5297eed8c2-console-oauth-config\") pod \"console-745bdb69fd-cjr7p\" (UID: \"f23336f7-c3d2-483f-bc7e-9d5297eed8c2\") " pod="openshift-console/console-745bdb69fd-cjr7p" Jul 15 21:10:35.676357 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:10:35.676327 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f23336f7-c3d2-483f-bc7e-9d5297eed8c2-oauth-serving-cert\") pod \"console-745bdb69fd-cjr7p\" (UID: \"f23336f7-c3d2-483f-bc7e-9d5297eed8c2\") " pod="openshift-console/console-745bdb69fd-cjr7p" Jul 15 21:10:35.676456 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:10:35.676421 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f23336f7-c3d2-483f-bc7e-9d5297eed8c2-service-ca\") pod \"console-745bdb69fd-cjr7p\" (UID: \"f23336f7-c3d2-483f-bc7e-9d5297eed8c2\") " pod="openshift-console/console-745bdb69fd-cjr7p" Jul 15 21:10:35.676456 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:10:35.676419 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f23336f7-c3d2-483f-bc7e-9d5297eed8c2-console-config\") pod \"console-745bdb69fd-cjr7p\" (UID: \"f23336f7-c3d2-483f-bc7e-9d5297eed8c2\") " pod="openshift-console/console-745bdb69fd-cjr7p" Jul 15 21:10:35.676667 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:10:35.676641 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f23336f7-c3d2-483f-bc7e-9d5297eed8c2-trusted-ca-bundle\") pod \"console-745bdb69fd-cjr7p\" (UID: \"f23336f7-c3d2-483f-bc7e-9d5297eed8c2\") " pod="openshift-console/console-745bdb69fd-cjr7p" Jul 15 21:10:35.678100 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:10:35.678071 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f23336f7-c3d2-483f-bc7e-9d5297eed8c2-console-serving-cert\") pod \"console-745bdb69fd-cjr7p\" (UID: \"f23336f7-c3d2-483f-bc7e-9d5297eed8c2\") " pod="openshift-console/console-745bdb69fd-cjr7p" Jul 15 21:10:35.678100 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:10:35.678096 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f23336f7-c3d2-483f-bc7e-9d5297eed8c2-console-oauth-config\") pod \"console-745bdb69fd-cjr7p\" (UID: \"f23336f7-c3d2-483f-bc7e-9d5297eed8c2\") " pod="openshift-console/console-745bdb69fd-cjr7p" Jul 15 21:10:35.686216 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:10:35.686187 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsc4n\" (UniqueName: \"kubernetes.io/projected/f23336f7-c3d2-483f-bc7e-9d5297eed8c2-kube-api-access-nsc4n\") pod \"console-745bdb69fd-cjr7p\" (UID: \"f23336f7-c3d2-483f-bc7e-9d5297eed8c2\") " pod="openshift-console/console-745bdb69fd-cjr7p" Jul 15 21:10:35.725992 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:10:35.725973 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-745bdb69fd-cjr7p" Jul 15 21:10:35.867974 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:10:35.867946 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-745bdb69fd-cjr7p"] Jul 15 21:10:35.870685 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:10:35.870662 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf23336f7_c3d2_483f_bc7e_9d5297eed8c2.slice/crio-135011d33928c630a321c67d4e16811f91c4a6ad6bef6b89c1c36d1a8c5c2db5 WatchSource:0}: Error finding container 135011d33928c630a321c67d4e16811f91c4a6ad6bef6b89c1c36d1a8c5c2db5: Status 404 returned error can't find the container with id 135011d33928c630a321c67d4e16811f91c4a6ad6bef6b89c1c36d1a8c5c2db5 Jul 15 21:10:36.411979 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:10:36.411941 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-745bdb69fd-cjr7p" event={"ID":"f23336f7-c3d2-483f-bc7e-9d5297eed8c2","Type":"ContainerStarted","Data":"f440eb78bb947d586b72b09dc95ba3fc1b06804c460e7b530b0e82481894b527"} Jul 15 21:10:36.412142 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:10:36.411990 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-745bdb69fd-cjr7p" event={"ID":"f23336f7-c3d2-483f-bc7e-9d5297eed8c2","Type":"ContainerStarted","Data":"135011d33928c630a321c67d4e16811f91c4a6ad6bef6b89c1c36d1a8c5c2db5"} Jul 15 21:10:36.441875 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:10:36.441828 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-745bdb69fd-cjr7p" podStartSLOduration=1.4418123760000001 podStartE2EDuration="1.441812376s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:10:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:36.440947189 +0000 UTC m=+244.691372320" watchObservedRunningTime="2026-07-15 21:10:36.441812376 +0000 UTC m=+244.692237509" Jul 15 21:10:45.726200 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:10:45.726168 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-745bdb69fd-cjr7p" Jul 15 21:10:45.726583 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:10:45.726227 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-745bdb69fd-cjr7p" Jul 15 21:10:45.730761 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:10:45.730719 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-745bdb69fd-cjr7p" Jul 15 21:10:46.454351 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:10:46.454323 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-745bdb69fd-cjr7p" Jul 15 21:10:46.539551 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:10:46.539518 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d6ff5f888-qp86f"] Jul 15 21:11:11.560028 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:11.559971 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7d6ff5f888-qp86f" podUID="3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1" containerName="console" containerID="cri-o://c75c2ee928a3e7ea85b6eec41664dab462ff4296bbd379bca47d09f7021ef5ac" gracePeriod=15 Jul 15 21:11:11.800694 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:11.800669 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d6ff5f888-qp86f" Jul 15 21:11:11.839054 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:11.838993 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1-console-oauth-config\") pod \"3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1\" (UID: \"3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1\") " Jul 15 21:11:11.839202 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:11.839054 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1-trusted-ca-bundle\") pod \"3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1\" (UID: \"3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1\") " Jul 15 21:11:11.839202 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:11.839080 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1-service-ca\") pod \"3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1\" (UID: \"3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1\") " Jul 15 21:11:11.839202 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:11.839135 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rrdj9\" (UniqueName: \"kubernetes.io/projected/3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1-kube-api-access-rrdj9\") pod \"3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1\" (UID: \"3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1\") " Jul 15 21:11:11.839202 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:11.839183 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1-console-serving-cert\") pod \"3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1\" (UID: \"3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1\") " Jul 15 21:11:11.839404 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:11.839219 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1-console-config\") pod \"3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1\" (UID: \"3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1\") " Jul 15 21:11:11.839404 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:11.839246 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1-oauth-serving-cert\") pod \"3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1\" (UID: \"3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1\") " Jul 15 21:11:11.839509 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:11.839457 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1-service-ca" (OuterVolumeSpecName: "service-ca") pod "3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1" (UID: "3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:11:11.839685 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:11.839655 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1-console-config" (OuterVolumeSpecName: "console-config") pod "3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1" (UID: "3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:11:11.839840 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:11.839787 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1" (UID: "3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:11:11.839920 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:11.839852 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1" (UID: "3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:11:11.841240 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:11.841217 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1" (UID: "3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 21:11:11.841621 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:11.841599 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1" (UID: "3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 21:11:11.841621 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:11.841609 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1-kube-api-access-rrdj9" (OuterVolumeSpecName: "kube-api-access-rrdj9") pod "3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1" (UID: "3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1"). InnerVolumeSpecName "kube-api-access-rrdj9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:11:11.939814 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:11.939790 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1-console-serving-cert\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\"" Jul 15 21:11:11.939814 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:11.939812 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1-console-config\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\"" Jul 15 21:11:11.939950 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:11.939822 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1-oauth-serving-cert\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\"" Jul 15 21:11:11.939950 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:11.939830 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1-console-oauth-config\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\"" Jul 15 21:11:11.939950 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:11.939840 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1-trusted-ca-bundle\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\"" Jul 15 21:11:11.939950 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:11.939848 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1-service-ca\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\"" Jul 15 21:11:11.939950 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:11.939856 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rrdj9\" (UniqueName: \"kubernetes.io/projected/3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1-kube-api-access-rrdj9\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\"" Jul 15 21:11:12.544697 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:12.544664 2577 generic.go:356] "Generic (PLEG): container finished" podID="3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1" containerID="c75c2ee928a3e7ea85b6eec41664dab462ff4296bbd379bca47d09f7021ef5ac" exitCode=0 Jul 15 21:11:12.544877 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:12.544711 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d6ff5f888-qp86f" Jul 15 21:11:12.544877 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:12.544751 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d6ff5f888-qp86f" event={"ID":"3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1","Type":"ContainerDied","Data":"c75c2ee928a3e7ea85b6eec41664dab462ff4296bbd379bca47d09f7021ef5ac"} Jul 15 21:11:12.544877 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:12.544798 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d6ff5f888-qp86f" event={"ID":"3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1","Type":"ContainerDied","Data":"07b9512135409bebdab209a96aa236ced1d784115958f654af800094514467e8"} Jul 15 21:11:12.544877 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:12.544816 2577 scope.go:117] "RemoveContainer" containerID="c75c2ee928a3e7ea85b6eec41664dab462ff4296bbd379bca47d09f7021ef5ac" Jul 15 21:11:12.552648 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:12.552621 2577 scope.go:117] "RemoveContainer" containerID="c75c2ee928a3e7ea85b6eec41664dab462ff4296bbd379bca47d09f7021ef5ac" Jul 15 21:11:12.552903 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:11:12.552881 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c75c2ee928a3e7ea85b6eec41664dab462ff4296bbd379bca47d09f7021ef5ac\": container with ID starting with c75c2ee928a3e7ea85b6eec41664dab462ff4296bbd379bca47d09f7021ef5ac not found: ID does not exist" containerID="c75c2ee928a3e7ea85b6eec41664dab462ff4296bbd379bca47d09f7021ef5ac" Jul 15 21:11:12.552974 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:12.552914 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c75c2ee928a3e7ea85b6eec41664dab462ff4296bbd379bca47d09f7021ef5ac"} err="failed to get container status \"c75c2ee928a3e7ea85b6eec41664dab462ff4296bbd379bca47d09f7021ef5ac\": rpc error: code = NotFound desc = could not find container \"c75c2ee928a3e7ea85b6eec41664dab462ff4296bbd379bca47d09f7021ef5ac\": container with ID starting with c75c2ee928a3e7ea85b6eec41664dab462ff4296bbd379bca47d09f7021ef5ac not found: ID does not exist" Jul 15 21:11:12.565417 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:12.565393 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d6ff5f888-qp86f"] Jul 15 21:11:12.570704 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:12.570685 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7d6ff5f888-qp86f"] Jul 15 21:11:14.338889 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:14.338854 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1" path="/var/lib/kubelet/pods/3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1/volumes" Jul 15 21:11:32.134791 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:32.134766 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qm2hk_8224ce90-3f8b-4562-b8ae-14f9d965f20f/ovn-acl-logging/0.log" Jul 15 21:11:32.136681 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:32.136656 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qm2hk_8224ce90-3f8b-4562-b8ae-14f9d965f20f/ovn-acl-logging/0.log" Jul 15 21:11:32.140249 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:32.140231 2577 kubelet.go:1648] "Image garbage collection succeeded" Jul 15 21:11:44.074910 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:44.074876 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wggp9"] Jul 15 21:11:44.077135 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:44.075172 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1" containerName="console" Jul 15 21:11:44.077135 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:44.075183 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1" containerName="console" Jul 15 21:11:44.077135 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:44.075227 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3837d11b-48e9-49aa-b93e-fd6a0ae6e8c1" containerName="console" Jul 15 21:11:44.077979 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:44.077962 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wggp9" Jul 15 21:11:44.081245 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:44.081222 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-82479\"" Jul 15 21:11:44.081496 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:44.081480 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 15 21:11:44.081630 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:44.081610 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 15 21:11:44.129109 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:44.129065 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wggp9"] Jul 15 21:11:44.178621 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:44.178586 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/46791484-b7c3-44c5-8e3b-33f993a82578-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-wggp9\" (UID: \"46791484-b7c3-44c5-8e3b-33f993a82578\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wggp9" Jul 15 21:11:44.178621 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:44.178619 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jdnq\" (UniqueName: \"kubernetes.io/projected/46791484-b7c3-44c5-8e3b-33f993a82578-kube-api-access-9jdnq\") pod \"cert-manager-operator-controller-manager-55c444bf86-wggp9\" (UID: \"46791484-b7c3-44c5-8e3b-33f993a82578\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wggp9" Jul 15 21:11:44.279914 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:44.279886 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/46791484-b7c3-44c5-8e3b-33f993a82578-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-wggp9\" (UID: \"46791484-b7c3-44c5-8e3b-33f993a82578\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wggp9" Jul 15 21:11:44.279914 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:44.279917 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jdnq\" (UniqueName: \"kubernetes.io/projected/46791484-b7c3-44c5-8e3b-33f993a82578-kube-api-access-9jdnq\") pod \"cert-manager-operator-controller-manager-55c444bf86-wggp9\" (UID: \"46791484-b7c3-44c5-8e3b-33f993a82578\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wggp9" Jul 15 21:11:44.280256 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:44.280236 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/46791484-b7c3-44c5-8e3b-33f993a82578-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-wggp9\" (UID: \"46791484-b7c3-44c5-8e3b-33f993a82578\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wggp9" Jul 15 21:11:44.301645 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:44.301620 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jdnq\" (UniqueName: \"kubernetes.io/projected/46791484-b7c3-44c5-8e3b-33f993a82578-kube-api-access-9jdnq\") pod \"cert-manager-operator-controller-manager-55c444bf86-wggp9\" (UID: \"46791484-b7c3-44c5-8e3b-33f993a82578\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wggp9" Jul 15 21:11:44.386837 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:44.386777 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wggp9" Jul 15 21:11:44.530645 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:44.530619 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wggp9"] Jul 15 21:11:44.533274 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:11:44.533243 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46791484_b7c3_44c5_8e3b_33f993a82578.slice/crio-7c6b82936cc0e6b7b1a7deef49536038cecf5ff24846ec1f6dd67287dac42144 WatchSource:0}: Error finding container 7c6b82936cc0e6b7b1a7deef49536038cecf5ff24846ec1f6dd67287dac42144: Status 404 returned error can't find the container with id 7c6b82936cc0e6b7b1a7deef49536038cecf5ff24846ec1f6dd67287dac42144 Jul 15 21:11:44.535927 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:44.535912 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 21:11:44.659744 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:44.659698 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wggp9" event={"ID":"46791484-b7c3-44c5-8e3b-33f993a82578","Type":"ContainerStarted","Data":"7c6b82936cc0e6b7b1a7deef49536038cecf5ff24846ec1f6dd67287dac42144"} Jul 15 21:11:47.674772 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:47.674739 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wggp9" event={"ID":"46791484-b7c3-44c5-8e3b-33f993a82578","Type":"ContainerStarted","Data":"617ecd9c715407060b7a121a687b0b3c6fca2155d738db323f01fc6979cbb01e"} Jul 15 21:11:47.713126 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:47.713079 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wggp9" podStartSLOduration=0.880107085 podStartE2EDuration="3.713065058s" totalImagesPullingTime="2.832957973s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:11:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:11:47.711278998 +0000 UTC m=+315.961704129" watchObservedRunningTime="2026-07-15 21:11:47.713065058 +0000 UTC m=+315.963490189" Jul 15 21:11:48.410918 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:48.410883 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzfgtj"] Jul 15 21:11:48.414414 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:48.414390 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzfgtj" Jul 15 21:11:48.423238 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:48.423215 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 15 21:11:48.423351 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:48.423311 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 15 21:11:48.423408 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:48.423314 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-4zcp8\"" Jul 15 21:11:48.438858 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:48.438835 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzfgtj"] Jul 15 21:11:48.515136 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:48.515112 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f58c89b1-3025-4720-805e-318fad7307d2-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzfgtj\" (UID: \"f58c89b1-3025-4720-805e-318fad7307d2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzfgtj" Jul 15 21:11:48.515240 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:48.515157 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f58c89b1-3025-4720-805e-318fad7307d2-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzfgtj\" (UID: \"f58c89b1-3025-4720-805e-318fad7307d2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzfgtj" Jul 15 21:11:48.515240 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:48.515192 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhwkh\" (UniqueName: \"kubernetes.io/projected/f58c89b1-3025-4720-805e-318fad7307d2-kube-api-access-lhwkh\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzfgtj\" (UID: \"f58c89b1-3025-4720-805e-318fad7307d2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzfgtj" Jul 15 21:11:48.616365 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:48.616336 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f58c89b1-3025-4720-805e-318fad7307d2-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzfgtj\" (UID: \"f58c89b1-3025-4720-805e-318fad7307d2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzfgtj" Jul 15 21:11:48.616497 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:48.616372 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhwkh\" (UniqueName: \"kubernetes.io/projected/f58c89b1-3025-4720-805e-318fad7307d2-kube-api-access-lhwkh\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzfgtj\" (UID: \"f58c89b1-3025-4720-805e-318fad7307d2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzfgtj" Jul 15 21:11:48.616558 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:48.616497 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f58c89b1-3025-4720-805e-318fad7307d2-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzfgtj\" (UID: \"f58c89b1-3025-4720-805e-318fad7307d2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzfgtj" Jul 15 21:11:48.616820 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:48.616801 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f58c89b1-3025-4720-805e-318fad7307d2-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzfgtj\" (UID: \"f58c89b1-3025-4720-805e-318fad7307d2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzfgtj" Jul 15 21:11:48.616896 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:48.616817 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f58c89b1-3025-4720-805e-318fad7307d2-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzfgtj\" (UID: \"f58c89b1-3025-4720-805e-318fad7307d2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzfgtj" Jul 15 21:11:48.651252 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:48.651231 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhwkh\" (UniqueName: \"kubernetes.io/projected/f58c89b1-3025-4720-805e-318fad7307d2-kube-api-access-lhwkh\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzfgtj\" (UID: \"f58c89b1-3025-4720-805e-318fad7307d2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzfgtj" Jul 15 21:11:48.723637 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:48.723582 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzfgtj" Jul 15 21:11:48.851430 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:48.851405 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzfgtj"] Jul 15 21:11:48.853858 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:11:48.853830 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf58c89b1_3025_4720_805e_318fad7307d2.slice/crio-5c4f7a6083836fb3f009178a3ea19a160e0fe003f80a2e2308d8f9a8050a4be8 WatchSource:0}: Error finding container 5c4f7a6083836fb3f009178a3ea19a160e0fe003f80a2e2308d8f9a8050a4be8: Status 404 returned error can't find the container with id 5c4f7a6083836fb3f009178a3ea19a160e0fe003f80a2e2308d8f9a8050a4be8 Jul 15 21:11:49.684177 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:49.684143 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzfgtj" event={"ID":"f58c89b1-3025-4720-805e-318fad7307d2","Type":"ContainerStarted","Data":"5c4f7a6083836fb3f009178a3ea19a160e0fe003f80a2e2308d8f9a8050a4be8"} Jul 15 21:11:54.707597 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:54.707570 2577 generic.go:356] "Generic (PLEG): container finished" podID="f58c89b1-3025-4720-805e-318fad7307d2" containerID="9142dfc2bf5b57efaf26606735672fbe8b3bbc40352d426fc434fb784e2628e8" exitCode=0 Jul 15 21:11:54.707920 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:54.707647 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzfgtj" event={"ID":"f58c89b1-3025-4720-805e-318fad7307d2","Type":"ContainerDied","Data":"9142dfc2bf5b57efaf26606735672fbe8b3bbc40352d426fc434fb784e2628e8"} Jul 15 21:11:56.425163 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:56.425074 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-p5k9q"] Jul 15 21:11:56.428458 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:56.428437 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-p5k9q" Jul 15 21:11:56.431226 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:56.431204 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 15 21:11:56.432292 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:56.432246 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 15 21:11:56.432292 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:56.432265 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-mhc7g\"" Jul 15 21:11:56.439374 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:56.439349 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-p5k9q"] Jul 15 21:11:56.578781 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:56.578749 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/55896b80-bc4c-40f7-a9fb-d7ad120f96c3-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-p5k9q\" (UID: \"55896b80-bc4c-40f7-a9fb-d7ad120f96c3\") " pod="cert-manager/cert-manager-webhook-6486ffd997-p5k9q" Jul 15 21:11:56.578961 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:56.578828 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bj82k\" (UniqueName: \"kubernetes.io/projected/55896b80-bc4c-40f7-a9fb-d7ad120f96c3-kube-api-access-bj82k\") pod \"cert-manager-webhook-6486ffd997-p5k9q\" (UID: \"55896b80-bc4c-40f7-a9fb-d7ad120f96c3\") " pod="cert-manager/cert-manager-webhook-6486ffd997-p5k9q" Jul 15 21:11:56.680163 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:56.680074 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/55896b80-bc4c-40f7-a9fb-d7ad120f96c3-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-p5k9q\" (UID: \"55896b80-bc4c-40f7-a9fb-d7ad120f96c3\") " pod="cert-manager/cert-manager-webhook-6486ffd997-p5k9q" Jul 15 21:11:56.680163 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:56.680155 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bj82k\" (UniqueName: \"kubernetes.io/projected/55896b80-bc4c-40f7-a9fb-d7ad120f96c3-kube-api-access-bj82k\") pod \"cert-manager-webhook-6486ffd997-p5k9q\" (UID: \"55896b80-bc4c-40f7-a9fb-d7ad120f96c3\") " pod="cert-manager/cert-manager-webhook-6486ffd997-p5k9q" Jul 15 21:11:56.689915 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:56.689886 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bj82k\" (UniqueName: \"kubernetes.io/projected/55896b80-bc4c-40f7-a9fb-d7ad120f96c3-kube-api-access-bj82k\") pod \"cert-manager-webhook-6486ffd997-p5k9q\" (UID: \"55896b80-bc4c-40f7-a9fb-d7ad120f96c3\") " pod="cert-manager/cert-manager-webhook-6486ffd997-p5k9q" Jul 15 21:11:56.690067 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:56.689950 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/55896b80-bc4c-40f7-a9fb-d7ad120f96c3-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-p5k9q\" (UID: \"55896b80-bc4c-40f7-a9fb-d7ad120f96c3\") " pod="cert-manager/cert-manager-webhook-6486ffd997-p5k9q" Jul 15 21:11:56.750461 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:56.750126 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-p5k9q" Jul 15 21:11:57.462076 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:57.462052 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-p5k9q"] Jul 15 21:11:57.464116 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:11:57.464096 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod55896b80_bc4c_40f7_a9fb_d7ad120f96c3.slice/crio-9cf22c4f4c359fa3d4900b262c35ada57148a1fb8cc0de8cd6eef67b93f264bc WatchSource:0}: Error finding container 9cf22c4f4c359fa3d4900b262c35ada57148a1fb8cc0de8cd6eef67b93f264bc: Status 404 returned error can't find the container with id 9cf22c4f4c359fa3d4900b262c35ada57148a1fb8cc0de8cd6eef67b93f264bc Jul 15 21:11:57.722406 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:57.722372 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-p5k9q" event={"ID":"55896b80-bc4c-40f7-a9fb-d7ad120f96c3","Type":"ContainerStarted","Data":"9cf22c4f4c359fa3d4900b262c35ada57148a1fb8cc0de8cd6eef67b93f264bc"} Jul 15 21:11:57.724015 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:57.723992 2577 generic.go:356] "Generic (PLEG): container finished" podID="f58c89b1-3025-4720-805e-318fad7307d2" containerID="789ca0cf986aa6c7e2f070019bbc7fd2da865d3dc192bb0ff71fd479cf34a1e2" exitCode=0 Jul 15 21:11:57.724134 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:57.724055 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzfgtj" event={"ID":"f58c89b1-3025-4720-805e-318fad7307d2","Type":"ContainerDied","Data":"789ca0cf986aa6c7e2f070019bbc7fd2da865d3dc192bb0ff71fd479cf34a1e2"} Jul 15 21:11:59.522113 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:59.522081 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-9qjj6"] Jul 15 21:11:59.525436 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:59.525413 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-9qjj6" Jul 15 21:11:59.528447 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:59.528422 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-9lz2h\"" Jul 15 21:11:59.534642 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:59.534614 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-9qjj6"] Jul 15 21:11:59.604878 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:59.604845 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f0ad7665-5bea-4782-b8b6-594069d35600-bound-sa-token\") pod \"cert-manager-55b4d954d5-9qjj6\" (UID: \"f0ad7665-5bea-4782-b8b6-594069d35600\") " pod="cert-manager/cert-manager-55b4d954d5-9qjj6" Jul 15 21:11:59.605047 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:59.604911 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6ljv\" (UniqueName: \"kubernetes.io/projected/f0ad7665-5bea-4782-b8b6-594069d35600-kube-api-access-w6ljv\") pod \"cert-manager-55b4d954d5-9qjj6\" (UID: \"f0ad7665-5bea-4782-b8b6-594069d35600\") " pod="cert-manager/cert-manager-55b4d954d5-9qjj6" Jul 15 21:11:59.705432 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:59.705404 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f0ad7665-5bea-4782-b8b6-594069d35600-bound-sa-token\") pod \"cert-manager-55b4d954d5-9qjj6\" (UID: \"f0ad7665-5bea-4782-b8b6-594069d35600\") " pod="cert-manager/cert-manager-55b4d954d5-9qjj6" Jul 15 21:11:59.705593 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:59.705451 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6ljv\" (UniqueName: \"kubernetes.io/projected/f0ad7665-5bea-4782-b8b6-594069d35600-kube-api-access-w6ljv\") pod \"cert-manager-55b4d954d5-9qjj6\" (UID: \"f0ad7665-5bea-4782-b8b6-594069d35600\") " pod="cert-manager/cert-manager-55b4d954d5-9qjj6" Jul 15 21:11:59.716558 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:59.716507 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f0ad7665-5bea-4782-b8b6-594069d35600-bound-sa-token\") pod \"cert-manager-55b4d954d5-9qjj6\" (UID: \"f0ad7665-5bea-4782-b8b6-594069d35600\") " pod="cert-manager/cert-manager-55b4d954d5-9qjj6" Jul 15 21:11:59.717268 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:59.717228 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6ljv\" (UniqueName: \"kubernetes.io/projected/f0ad7665-5bea-4782-b8b6-594069d35600-kube-api-access-w6ljv\") pod \"cert-manager-55b4d954d5-9qjj6\" (UID: \"f0ad7665-5bea-4782-b8b6-594069d35600\") " pod="cert-manager/cert-manager-55b4d954d5-9qjj6" Jul 15 21:11:59.836872 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:11:59.836796 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-9qjj6" Jul 15 21:12:00.176317 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:00.176220 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-9qjj6"] Jul 15 21:12:00.178604 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:12:00.178578 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf0ad7665_5bea_4782_b8b6_594069d35600.slice/crio-64dc5e889c6560f5357b5207cf0f7d546d5697d50e2a6ff5fd35116a372ff01d WatchSource:0}: Error finding container 64dc5e889c6560f5357b5207cf0f7d546d5697d50e2a6ff5fd35116a372ff01d: Status 404 returned error can't find the container with id 64dc5e889c6560f5357b5207cf0f7d546d5697d50e2a6ff5fd35116a372ff01d Jul 15 21:12:00.740402 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:00.740370 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-p5k9q" event={"ID":"55896b80-bc4c-40f7-a9fb-d7ad120f96c3","Type":"ContainerStarted","Data":"08c602ecf79a2ba76812d65467be1c7175919c2026359e1ff739e53799aa3e8e"} Jul 15 21:12:00.740851 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:00.740438 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-p5k9q" Jul 15 21:12:00.741946 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:00.741918 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-9qjj6" event={"ID":"f0ad7665-5bea-4782-b8b6-594069d35600","Type":"ContainerStarted","Data":"2fc9daa25cb99eee31d0e4f4a5e5e5d0cb2429ad7146fa6554b2782583c7307c"} Jul 15 21:12:00.742046 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:00.741954 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-9qjj6" event={"ID":"f0ad7665-5bea-4782-b8b6-594069d35600","Type":"ContainerStarted","Data":"64dc5e889c6560f5357b5207cf0f7d546d5697d50e2a6ff5fd35116a372ff01d"} Jul 15 21:12:00.760711 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:00.760655 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-p5k9q" podStartSLOduration=2.097302718 podStartE2EDuration="4.760633195s" totalImagesPullingTime="2.663330477s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:11:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:12:00.760117336 +0000 UTC m=+329.010542470" watchObservedRunningTime="2026-07-15 21:12:00.760633195 +0000 UTC m=+329.011058326" Jul 15 21:12:00.778102 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:00.778056 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-9qjj6" podStartSLOduration=1.778042833 podStartE2EDuration="1.778042833s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:11:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:12:00.776887238 +0000 UTC m=+329.027312369" watchObservedRunningTime="2026-07-15 21:12:00.778042833 +0000 UTC m=+329.028467964" Jul 15 21:12:04.762821 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:04.762711 2577 generic.go:356] "Generic (PLEG): container finished" podID="f58c89b1-3025-4720-805e-318fad7307d2" containerID="04a74a2701e972b566bea0a430a372ece3d6815e11103abcb87815e151dd9f14" exitCode=0 Jul 15 21:12:04.762821 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:04.762799 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzfgtj" event={"ID":"f58c89b1-3025-4720-805e-318fad7307d2","Type":"ContainerDied","Data":"04a74a2701e972b566bea0a430a372ece3d6815e11103abcb87815e151dd9f14"} Jul 15 21:12:05.890131 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:05.890108 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzfgtj" Jul 15 21:12:05.965940 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:05.965918 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f58c89b1-3025-4720-805e-318fad7307d2-bundle\") pod \"f58c89b1-3025-4720-805e-318fad7307d2\" (UID: \"f58c89b1-3025-4720-805e-318fad7307d2\") " Jul 15 21:12:05.966076 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:05.965997 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lhwkh\" (UniqueName: \"kubernetes.io/projected/f58c89b1-3025-4720-805e-318fad7307d2-kube-api-access-lhwkh\") pod \"f58c89b1-3025-4720-805e-318fad7307d2\" (UID: \"f58c89b1-3025-4720-805e-318fad7307d2\") " Jul 15 21:12:05.966076 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:05.966019 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f58c89b1-3025-4720-805e-318fad7307d2-util\") pod \"f58c89b1-3025-4720-805e-318fad7307d2\" (UID: \"f58c89b1-3025-4720-805e-318fad7307d2\") " Jul 15 21:12:05.966363 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:05.966250 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f58c89b1-3025-4720-805e-318fad7307d2-bundle" (OuterVolumeSpecName: "bundle") pod "f58c89b1-3025-4720-805e-318fad7307d2" (UID: "f58c89b1-3025-4720-805e-318fad7307d2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:12:05.968047 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:05.968024 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f58c89b1-3025-4720-805e-318fad7307d2-kube-api-access-lhwkh" (OuterVolumeSpecName: "kube-api-access-lhwkh") pod "f58c89b1-3025-4720-805e-318fad7307d2" (UID: "f58c89b1-3025-4720-805e-318fad7307d2"). InnerVolumeSpecName "kube-api-access-lhwkh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:12:05.970129 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:05.970103 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f58c89b1-3025-4720-805e-318fad7307d2-util" (OuterVolumeSpecName: "util") pod "f58c89b1-3025-4720-805e-318fad7307d2" (UID: "f58c89b1-3025-4720-805e-318fad7307d2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:12:06.066558 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:06.066494 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f58c89b1-3025-4720-805e-318fad7307d2-bundle\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\"" Jul 15 21:12:06.066558 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:06.066517 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lhwkh\" (UniqueName: \"kubernetes.io/projected/f58c89b1-3025-4720-805e-318fad7307d2-kube-api-access-lhwkh\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\"" Jul 15 21:12:06.066558 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:06.066528 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f58c89b1-3025-4720-805e-318fad7307d2-util\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\"" Jul 15 21:12:06.749546 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:06.749516 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-p5k9q" Jul 15 21:12:06.772674 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:06.772650 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzfgtj" Jul 15 21:12:06.772674 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:06.772665 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzfgtj" event={"ID":"f58c89b1-3025-4720-805e-318fad7307d2","Type":"ContainerDied","Data":"5c4f7a6083836fb3f009178a3ea19a160e0fe003f80a2e2308d8f9a8050a4be8"} Jul 15 21:12:06.772879 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:06.772703 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5c4f7a6083836fb3f009178a3ea19a160e0fe003f80a2e2308d8f9a8050a4be8" Jul 15 21:12:22.924843 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:22.924805 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6dd8d546cd-w7xnh"] Jul 15 21:12:22.925455 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:22.925236 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f58c89b1-3025-4720-805e-318fad7307d2" containerName="extract" Jul 15 21:12:22.925455 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:22.925255 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f58c89b1-3025-4720-805e-318fad7307d2" containerName="extract" Jul 15 21:12:22.925455 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:22.925285 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f58c89b1-3025-4720-805e-318fad7307d2" containerName="util" Jul 15 21:12:22.925455 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:22.925293 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f58c89b1-3025-4720-805e-318fad7307d2" containerName="util" Jul 15 21:12:22.925455 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:22.925314 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f58c89b1-3025-4720-805e-318fad7307d2" containerName="pull" Jul 15 21:12:22.925455 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:22.925323 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f58c89b1-3025-4720-805e-318fad7307d2" containerName="pull" Jul 15 21:12:22.925455 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:22.925434 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f58c89b1-3025-4720-805e-318fad7307d2" containerName="extract" Jul 15 21:12:22.930699 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:22.930680 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6dd8d546cd-w7xnh" Jul 15 21:12:22.933693 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:22.933673 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 15 21:12:22.933693 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:22.933683 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 15 21:12:22.934782 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:22.934759 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 15 21:12:22.934782 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:22.934762 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 15 21:12:22.934946 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:22.934790 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 15 21:12:22.934946 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:22.934762 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-4m5cr\"" Jul 15 21:12:22.938965 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:22.938945 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6dd8d546cd-w7xnh"] Jul 15 21:12:22.998685 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:22.998653 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/742496a3-53cf-42f8-a443-fb25b83dc60c-cert\") pod \"lws-controller-manager-6dd8d546cd-w7xnh\" (UID: \"742496a3-53cf-42f8-a443-fb25b83dc60c\") " pod="openshift-lws-operator/lws-controller-manager-6dd8d546cd-w7xnh" Jul 15 21:12:22.998861 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:22.998719 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/742496a3-53cf-42f8-a443-fb25b83dc60c-metrics-cert\") pod \"lws-controller-manager-6dd8d546cd-w7xnh\" (UID: \"742496a3-53cf-42f8-a443-fb25b83dc60c\") " pod="openshift-lws-operator/lws-controller-manager-6dd8d546cd-w7xnh" Jul 15 21:12:22.998861 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:22.998788 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hj95l\" (UniqueName: \"kubernetes.io/projected/742496a3-53cf-42f8-a443-fb25b83dc60c-kube-api-access-hj95l\") pod \"lws-controller-manager-6dd8d546cd-w7xnh\" (UID: \"742496a3-53cf-42f8-a443-fb25b83dc60c\") " pod="openshift-lws-operator/lws-controller-manager-6dd8d546cd-w7xnh" Jul 15 21:12:22.998861 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:22.998812 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/742496a3-53cf-42f8-a443-fb25b83dc60c-manager-config\") pod \"lws-controller-manager-6dd8d546cd-w7xnh\" (UID: \"742496a3-53cf-42f8-a443-fb25b83dc60c\") " pod="openshift-lws-operator/lws-controller-manager-6dd8d546cd-w7xnh" Jul 15 21:12:23.099361 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:23.099332 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/742496a3-53cf-42f8-a443-fb25b83dc60c-cert\") pod \"lws-controller-manager-6dd8d546cd-w7xnh\" (UID: \"742496a3-53cf-42f8-a443-fb25b83dc60c\") " pod="openshift-lws-operator/lws-controller-manager-6dd8d546cd-w7xnh" Jul 15 21:12:23.099505 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:23.099369 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/742496a3-53cf-42f8-a443-fb25b83dc60c-metrics-cert\") pod \"lws-controller-manager-6dd8d546cd-w7xnh\" (UID: \"742496a3-53cf-42f8-a443-fb25b83dc60c\") " pod="openshift-lws-operator/lws-controller-manager-6dd8d546cd-w7xnh" Jul 15 21:12:23.099505 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:23.099398 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hj95l\" (UniqueName: \"kubernetes.io/projected/742496a3-53cf-42f8-a443-fb25b83dc60c-kube-api-access-hj95l\") pod \"lws-controller-manager-6dd8d546cd-w7xnh\" (UID: \"742496a3-53cf-42f8-a443-fb25b83dc60c\") " pod="openshift-lws-operator/lws-controller-manager-6dd8d546cd-w7xnh" Jul 15 21:12:23.099505 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:23.099420 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/742496a3-53cf-42f8-a443-fb25b83dc60c-manager-config\") pod \"lws-controller-manager-6dd8d546cd-w7xnh\" (UID: \"742496a3-53cf-42f8-a443-fb25b83dc60c\") " pod="openshift-lws-operator/lws-controller-manager-6dd8d546cd-w7xnh" Jul 15 21:12:23.100117 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:23.100095 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/742496a3-53cf-42f8-a443-fb25b83dc60c-manager-config\") pod \"lws-controller-manager-6dd8d546cd-w7xnh\" (UID: \"742496a3-53cf-42f8-a443-fb25b83dc60c\") " pod="openshift-lws-operator/lws-controller-manager-6dd8d546cd-w7xnh" Jul 15 21:12:23.101783 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:23.101762 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/742496a3-53cf-42f8-a443-fb25b83dc60c-metrics-cert\") pod \"lws-controller-manager-6dd8d546cd-w7xnh\" (UID: \"742496a3-53cf-42f8-a443-fb25b83dc60c\") " pod="openshift-lws-operator/lws-controller-manager-6dd8d546cd-w7xnh" Jul 15 21:12:23.101855 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:23.101797 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/742496a3-53cf-42f8-a443-fb25b83dc60c-cert\") pod \"lws-controller-manager-6dd8d546cd-w7xnh\" (UID: \"742496a3-53cf-42f8-a443-fb25b83dc60c\") " pod="openshift-lws-operator/lws-controller-manager-6dd8d546cd-w7xnh" Jul 15 21:12:23.117324 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:23.117300 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hj95l\" (UniqueName: \"kubernetes.io/projected/742496a3-53cf-42f8-a443-fb25b83dc60c-kube-api-access-hj95l\") pod \"lws-controller-manager-6dd8d546cd-w7xnh\" (UID: \"742496a3-53cf-42f8-a443-fb25b83dc60c\") " pod="openshift-lws-operator/lws-controller-manager-6dd8d546cd-w7xnh" Jul 15 21:12:23.240183 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:23.240120 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6dd8d546cd-w7xnh" Jul 15 21:12:23.370177 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:23.370153 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6dd8d546cd-w7xnh"] Jul 15 21:12:23.372087 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:12:23.372062 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod742496a3_53cf_42f8_a443_fb25b83dc60c.slice/crio-d0e0da03bc5f84dd81017d7ff3ac70eb785a1df81f0c75b3b339e99154d2b3f1 WatchSource:0}: Error finding container d0e0da03bc5f84dd81017d7ff3ac70eb785a1df81f0c75b3b339e99154d2b3f1: Status 404 returned error can't find the container with id d0e0da03bc5f84dd81017d7ff3ac70eb785a1df81f0c75b3b339e99154d2b3f1 Jul 15 21:12:23.846074 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:23.846037 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6dd8d546cd-w7xnh" event={"ID":"742496a3-53cf-42f8-a443-fb25b83dc60c","Type":"ContainerStarted","Data":"d0e0da03bc5f84dd81017d7ff3ac70eb785a1df81f0c75b3b339e99154d2b3f1"} Jul 15 21:12:24.852087 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:24.851999 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6dd8d546cd-w7xnh" event={"ID":"742496a3-53cf-42f8-a443-fb25b83dc60c","Type":"ContainerStarted","Data":"045db3d3e2a32a0dbe3385ea7b5743221ea07834b7376e99b06d535e3aee893e"} Jul 15 21:12:24.852087 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:24.852077 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6dd8d546cd-w7xnh" Jul 15 21:12:24.871671 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:24.871621 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6dd8d546cd-w7xnh" podStartSLOduration=1.715901401 podStartE2EDuration="2.871608303s" totalImagesPullingTime="1.155706902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:12:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:12:24.869600383 +0000 UTC m=+353.120025526" watchObservedRunningTime="2026-07-15 21:12:24.871608303 +0000 UTC m=+353.122033433" Jul 15 21:12:35.449904 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:35.449866 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-858d4f578f-fw26k"] Jul 15 21:12:35.452523 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:35.452505 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-858d4f578f-fw26k" Jul 15 21:12:35.455792 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:35.455777 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 15 21:12:35.456009 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:35.455992 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 15 21:12:35.456093 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:35.456080 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-zg2b8\"" Jul 15 21:12:35.456810 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:35.456790 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 15 21:12:35.456891 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:35.456797 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 15 21:12:35.468071 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:35.468053 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-858d4f578f-fw26k"] Jul 15 21:12:35.594921 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:35.594885 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqz4t\" (UniqueName: \"kubernetes.io/projected/82779c00-af56-4bb8-a70f-a5d57ed9c2a8-kube-api-access-vqz4t\") pod \"opendatahub-operator-controller-manager-858d4f578f-fw26k\" (UID: \"82779c00-af56-4bb8-a70f-a5d57ed9c2a8\") " pod="opendatahub/opendatahub-operator-controller-manager-858d4f578f-fw26k" Jul 15 21:12:35.595092 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:35.594938 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/82779c00-af56-4bb8-a70f-a5d57ed9c2a8-manifests\") pod \"opendatahub-operator-controller-manager-858d4f578f-fw26k\" (UID: \"82779c00-af56-4bb8-a70f-a5d57ed9c2a8\") " pod="opendatahub/opendatahub-operator-controller-manager-858d4f578f-fw26k" Jul 15 21:12:35.595092 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:35.594965 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82779c00-af56-4bb8-a70f-a5d57ed9c2a8-tmp\") pod \"opendatahub-operator-controller-manager-858d4f578f-fw26k\" (UID: \"82779c00-af56-4bb8-a70f-a5d57ed9c2a8\") " pod="opendatahub/opendatahub-operator-controller-manager-858d4f578f-fw26k" Jul 15 21:12:35.595092 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:35.595019 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/82779c00-af56-4bb8-a70f-a5d57ed9c2a8-webhook-cert\") pod \"opendatahub-operator-controller-manager-858d4f578f-fw26k\" (UID: \"82779c00-af56-4bb8-a70f-a5d57ed9c2a8\") " pod="opendatahub/opendatahub-operator-controller-manager-858d4f578f-fw26k" Jul 15 21:12:35.595092 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:35.595070 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/82779c00-af56-4bb8-a70f-a5d57ed9c2a8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-858d4f578f-fw26k\" (UID: \"82779c00-af56-4bb8-a70f-a5d57ed9c2a8\") " pod="opendatahub/opendatahub-operator-controller-manager-858d4f578f-fw26k" Jul 15 21:12:35.696252 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:35.696228 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/82779c00-af56-4bb8-a70f-a5d57ed9c2a8-webhook-cert\") pod \"opendatahub-operator-controller-manager-858d4f578f-fw26k\" (UID: \"82779c00-af56-4bb8-a70f-a5d57ed9c2a8\") " pod="opendatahub/opendatahub-operator-controller-manager-858d4f578f-fw26k" Jul 15 21:12:35.696383 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:35.696261 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/82779c00-af56-4bb8-a70f-a5d57ed9c2a8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-858d4f578f-fw26k\" (UID: \"82779c00-af56-4bb8-a70f-a5d57ed9c2a8\") " pod="opendatahub/opendatahub-operator-controller-manager-858d4f578f-fw26k" Jul 15 21:12:35.696383 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:35.696317 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqz4t\" (UniqueName: \"kubernetes.io/projected/82779c00-af56-4bb8-a70f-a5d57ed9c2a8-kube-api-access-vqz4t\") pod \"opendatahub-operator-controller-manager-858d4f578f-fw26k\" (UID: \"82779c00-af56-4bb8-a70f-a5d57ed9c2a8\") " pod="opendatahub/opendatahub-operator-controller-manager-858d4f578f-fw26k" Jul 15 21:12:35.696383 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:35.696357 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/82779c00-af56-4bb8-a70f-a5d57ed9c2a8-manifests\") pod \"opendatahub-operator-controller-manager-858d4f578f-fw26k\" (UID: \"82779c00-af56-4bb8-a70f-a5d57ed9c2a8\") " pod="opendatahub/opendatahub-operator-controller-manager-858d4f578f-fw26k" Jul 15 21:12:35.696383 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:35.696377 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82779c00-af56-4bb8-a70f-a5d57ed9c2a8-tmp\") pod \"opendatahub-operator-controller-manager-858d4f578f-fw26k\" (UID: \"82779c00-af56-4bb8-a70f-a5d57ed9c2a8\") " pod="opendatahub/opendatahub-operator-controller-manager-858d4f578f-fw26k" Jul 15 21:12:35.696931 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:35.696791 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/82779c00-af56-4bb8-a70f-a5d57ed9c2a8-manifests\") pod \"opendatahub-operator-controller-manager-858d4f578f-fw26k\" (UID: \"82779c00-af56-4bb8-a70f-a5d57ed9c2a8\") " pod="opendatahub/opendatahub-operator-controller-manager-858d4f578f-fw26k" Jul 15 21:12:35.698668 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:35.698638 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82779c00-af56-4bb8-a70f-a5d57ed9c2a8-tmp\") pod \"opendatahub-operator-controller-manager-858d4f578f-fw26k\" (UID: \"82779c00-af56-4bb8-a70f-a5d57ed9c2a8\") " pod="opendatahub/opendatahub-operator-controller-manager-858d4f578f-fw26k" Jul 15 21:12:35.698857 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:35.698838 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/82779c00-af56-4bb8-a70f-a5d57ed9c2a8-webhook-cert\") pod \"opendatahub-operator-controller-manager-858d4f578f-fw26k\" (UID: \"82779c00-af56-4bb8-a70f-a5d57ed9c2a8\") " pod="opendatahub/opendatahub-operator-controller-manager-858d4f578f-fw26k" Jul 15 21:12:35.698984 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:35.698962 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/82779c00-af56-4bb8-a70f-a5d57ed9c2a8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-858d4f578f-fw26k\" (UID: \"82779c00-af56-4bb8-a70f-a5d57ed9c2a8\") " pod="opendatahub/opendatahub-operator-controller-manager-858d4f578f-fw26k" Jul 15 21:12:35.706415 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:35.706360 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqz4t\" (UniqueName: \"kubernetes.io/projected/82779c00-af56-4bb8-a70f-a5d57ed9c2a8-kube-api-access-vqz4t\") pod \"opendatahub-operator-controller-manager-858d4f578f-fw26k\" (UID: \"82779c00-af56-4bb8-a70f-a5d57ed9c2a8\") " pod="opendatahub/opendatahub-operator-controller-manager-858d4f578f-fw26k" Jul 15 21:12:35.763173 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:35.763152 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-858d4f578f-fw26k" Jul 15 21:12:35.858755 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:35.858711 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6dd8d546cd-w7xnh" Jul 15 21:12:35.907314 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:35.907280 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-858d4f578f-fw26k"] Jul 15 21:12:35.909430 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:12:35.909406 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82779c00_af56_4bb8_a70f_a5d57ed9c2a8.slice/crio-c7fed7ef0a624d6f804c26bc4dacb418e74a52e6b3d2f3bff8eb873579550153 WatchSource:0}: Error finding container c7fed7ef0a624d6f804c26bc4dacb418e74a52e6b3d2f3bff8eb873579550153: Status 404 returned error can't find the container with id c7fed7ef0a624d6f804c26bc4dacb418e74a52e6b3d2f3bff8eb873579550153 Jul 15 21:12:36.908565 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:36.908510 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-858d4f578f-fw26k" event={"ID":"82779c00-af56-4bb8-a70f-a5d57ed9c2a8","Type":"ContainerStarted","Data":"c7fed7ef0a624d6f804c26bc4dacb418e74a52e6b3d2f3bff8eb873579550153"} Jul 15 21:12:39.924182 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:39.924139 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-858d4f578f-fw26k" event={"ID":"82779c00-af56-4bb8-a70f-a5d57ed9c2a8","Type":"ContainerStarted","Data":"519dc6d70678016f1296b5f27e6cdabd8b3ccee85bc86b6ad7fce162e79ad97c"} Jul 15 21:12:40.929895 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:40.929857 2577 generic.go:356] "Generic (PLEG): container finished" podID="82779c00-af56-4bb8-a70f-a5d57ed9c2a8" containerID="519dc6d70678016f1296b5f27e6cdabd8b3ccee85bc86b6ad7fce162e79ad97c" exitCode=0 Jul 15 21:12:40.930273 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:40.929947 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-858d4f578f-fw26k" event={"ID":"82779c00-af56-4bb8-a70f-a5d57ed9c2a8","Type":"ContainerDied","Data":"519dc6d70678016f1296b5f27e6cdabd8b3ccee85bc86b6ad7fce162e79ad97c"} Jul 15 21:12:41.936309 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:41.936272 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-858d4f578f-fw26k" event={"ID":"82779c00-af56-4bb8-a70f-a5d57ed9c2a8","Type":"ContainerStarted","Data":"28184c2e206869e98933a533746e28e6174fdfcfdd3f4b9c3d1bee7176a0988e"} Jul 15 21:12:41.936785 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:41.936344 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-858d4f578f-fw26k" Jul 15 21:12:41.961781 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:41.961719 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-858d4f578f-fw26k" podStartSLOduration=2.483950201 podStartE2EDuration="6.961704527s" totalImagesPullingTime="3.407326449s" totalInitContainerRuntime="1.070427877s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:12:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:12:41.959468317 +0000 UTC m=+370.209893447" watchObservedRunningTime="2026-07-15 21:12:41.961704527 +0000 UTC m=+370.212129655" Jul 15 21:12:52.942872 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:12:52.942844 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-858d4f578f-fw26k" Jul 15 21:13:02.851490 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:02.851459 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tpbsr"] Jul 15 21:13:02.853642 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:02.853620 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tpbsr" Jul 15 21:13:02.857225 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:02.857207 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-gp7vv\"" Jul 15 21:13:02.857559 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:02.857537 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 15 21:13:02.858075 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:02.858059 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 15 21:13:02.858430 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:02.858415 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 15 21:13:02.871767 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:02.871713 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tpbsr"] Jul 15 21:13:02.912699 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:02.912675 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aee0e022-eff4-467c-beeb-ed82aeda0745-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678tpbsr\" (UID: \"aee0e022-eff4-467c-beeb-ed82aeda0745\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tpbsr" Jul 15 21:13:02.912823 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:02.912718 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aee0e022-eff4-467c-beeb-ed82aeda0745-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678tpbsr\" (UID: \"aee0e022-eff4-467c-beeb-ed82aeda0745\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tpbsr" Jul 15 21:13:02.912873 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:02.912817 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aee0e022-eff4-467c-beeb-ed82aeda0745-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678tpbsr\" (UID: \"aee0e022-eff4-467c-beeb-ed82aeda0745\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tpbsr" Jul 15 21:13:02.912914 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:02.912874 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aee0e022-eff4-467c-beeb-ed82aeda0745-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678tpbsr\" (UID: \"aee0e022-eff4-467c-beeb-ed82aeda0745\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tpbsr" Jul 15 21:13:02.912959 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:02.912925 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aee0e022-eff4-467c-beeb-ed82aeda0745-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678tpbsr\" (UID: \"aee0e022-eff4-467c-beeb-ed82aeda0745\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tpbsr" Jul 15 21:13:02.912994 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:02.912967 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8hhz\" (UniqueName: \"kubernetes.io/projected/aee0e022-eff4-467c-beeb-ed82aeda0745-kube-api-access-p8hhz\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678tpbsr\" (UID: \"aee0e022-eff4-467c-beeb-ed82aeda0745\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tpbsr" Jul 15 21:13:02.913035 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:02.913018 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aee0e022-eff4-467c-beeb-ed82aeda0745-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678tpbsr\" (UID: \"aee0e022-eff4-467c-beeb-ed82aeda0745\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tpbsr" Jul 15 21:13:02.913070 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:02.913055 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aee0e022-eff4-467c-beeb-ed82aeda0745-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678tpbsr\" (UID: \"aee0e022-eff4-467c-beeb-ed82aeda0745\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tpbsr" Jul 15 21:13:02.913112 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:02.913075 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aee0e022-eff4-467c-beeb-ed82aeda0745-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678tpbsr\" (UID: \"aee0e022-eff4-467c-beeb-ed82aeda0745\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tpbsr" Jul 15 21:13:03.014559 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:03.014366 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aee0e022-eff4-467c-beeb-ed82aeda0745-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678tpbsr\" (UID: \"aee0e022-eff4-467c-beeb-ed82aeda0745\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tpbsr" Jul 15 21:13:03.014559 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:03.014412 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aee0e022-eff4-467c-beeb-ed82aeda0745-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678tpbsr\" (UID: \"aee0e022-eff4-467c-beeb-ed82aeda0745\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tpbsr" Jul 15 21:13:03.014743 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:03.014555 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8hhz\" (UniqueName: \"kubernetes.io/projected/aee0e022-eff4-467c-beeb-ed82aeda0745-kube-api-access-p8hhz\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678tpbsr\" (UID: \"aee0e022-eff4-467c-beeb-ed82aeda0745\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tpbsr" Jul 15 21:13:03.014743 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:03.014610 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aee0e022-eff4-467c-beeb-ed82aeda0745-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678tpbsr\" (UID: \"aee0e022-eff4-467c-beeb-ed82aeda0745\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tpbsr" Jul 15 21:13:03.014743 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:03.014691 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aee0e022-eff4-467c-beeb-ed82aeda0745-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678tpbsr\" (UID: \"aee0e022-eff4-467c-beeb-ed82aeda0745\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tpbsr" Jul 15 21:13:03.014889 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:03.014743 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aee0e022-eff4-467c-beeb-ed82aeda0745-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678tpbsr\" (UID: \"aee0e022-eff4-467c-beeb-ed82aeda0745\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tpbsr" Jul 15 21:13:03.014889 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:03.014784 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aee0e022-eff4-467c-beeb-ed82aeda0745-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678tpbsr\" (UID: \"aee0e022-eff4-467c-beeb-ed82aeda0745\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tpbsr" Jul 15 21:13:03.014889 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:03.014798 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aee0e022-eff4-467c-beeb-ed82aeda0745-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678tpbsr\" (UID: \"aee0e022-eff4-467c-beeb-ed82aeda0745\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tpbsr" Jul 15 21:13:03.014889 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:03.014821 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aee0e022-eff4-467c-beeb-ed82aeda0745-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678tpbsr\" (UID: \"aee0e022-eff4-467c-beeb-ed82aeda0745\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tpbsr" Jul 15 21:13:03.014889 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:03.014853 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aee0e022-eff4-467c-beeb-ed82aeda0745-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678tpbsr\" (UID: \"aee0e022-eff4-467c-beeb-ed82aeda0745\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tpbsr" Jul 15 21:13:03.015164 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:03.015141 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aee0e022-eff4-467c-beeb-ed82aeda0745-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678tpbsr\" (UID: \"aee0e022-eff4-467c-beeb-ed82aeda0745\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tpbsr" Jul 15 21:13:03.015220 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:03.015159 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aee0e022-eff4-467c-beeb-ed82aeda0745-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678tpbsr\" (UID: \"aee0e022-eff4-467c-beeb-ed82aeda0745\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tpbsr" Jul 15 21:13:03.015297 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:03.015275 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aee0e022-eff4-467c-beeb-ed82aeda0745-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678tpbsr\" (UID: \"aee0e022-eff4-467c-beeb-ed82aeda0745\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tpbsr" Jul 15 21:13:03.015427 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:03.015407 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aee0e022-eff4-467c-beeb-ed82aeda0745-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678tpbsr\" (UID: \"aee0e022-eff4-467c-beeb-ed82aeda0745\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tpbsr" Jul 15 21:13:03.016878 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:03.016857 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aee0e022-eff4-467c-beeb-ed82aeda0745-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678tpbsr\" (UID: \"aee0e022-eff4-467c-beeb-ed82aeda0745\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tpbsr" Jul 15 21:13:03.017226 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:03.017206 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aee0e022-eff4-467c-beeb-ed82aeda0745-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678tpbsr\" (UID: \"aee0e022-eff4-467c-beeb-ed82aeda0745\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tpbsr" Jul 15 21:13:03.024511 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:03.024482 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8hhz\" (UniqueName: \"kubernetes.io/projected/aee0e022-eff4-467c-beeb-ed82aeda0745-kube-api-access-p8hhz\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678tpbsr\" (UID: \"aee0e022-eff4-467c-beeb-ed82aeda0745\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tpbsr" Jul 15 21:13:03.024653 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:03.024627 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aee0e022-eff4-467c-beeb-ed82aeda0745-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678tpbsr\" (UID: \"aee0e022-eff4-467c-beeb-ed82aeda0745\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tpbsr" Jul 15 21:13:03.163369 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:03.163338 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tpbsr" Jul 15 21:13:03.303565 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:13:03.303527 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaee0e022_eff4_467c_beeb_ed82aeda0745.slice/crio-3b9294b29eb98ebf87cf41ef6599d1311bab42e1763cba8f368e7ba77b1fb581 WatchSource:0}: Error finding container 3b9294b29eb98ebf87cf41ef6599d1311bab42e1763cba8f368e7ba77b1fb581: Status 404 returned error can't find the container with id 3b9294b29eb98ebf87cf41ef6599d1311bab42e1763cba8f368e7ba77b1fb581 Jul 15 21:13:03.303748 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:03.303709 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tpbsr"] Jul 15 21:13:04.034232 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:04.034198 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tpbsr" event={"ID":"aee0e022-eff4-467c-beeb-ed82aeda0745","Type":"ContainerStarted","Data":"3b9294b29eb98ebf87cf41ef6599d1311bab42e1763cba8f368e7ba77b1fb581"} Jul 15 21:13:05.603857 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:05.601409 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6tjm9"] Jul 15 21:13:05.608224 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:05.608199 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6tjm9" Jul 15 21:13:05.612162 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:05.612141 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 15 21:13:05.612297 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:05.612149 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 15 21:13:05.612297 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:05.612170 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 15 21:13:05.612552 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:05.612535 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-72hmm\"" Jul 15 21:13:05.621580 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:05.621556 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6tjm9"] Jul 15 21:13:05.641066 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:05.641042 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5522bda4-9085-4a65-9fb6-d21d0b6f2f7d-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-6tjm9\" (UID: \"5522bda4-9085-4a65-9fb6-d21d0b6f2f7d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6tjm9" Jul 15 21:13:05.641213 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:05.641072 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5522bda4-9085-4a65-9fb6-d21d0b6f2f7d-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-6tjm9\" (UID: \"5522bda4-9085-4a65-9fb6-d21d0b6f2f7d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6tjm9" Jul 15 21:13:05.641213 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:05.641177 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5522bda4-9085-4a65-9fb6-d21d0b6f2f7d-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-6tjm9\" (UID: \"5522bda4-9085-4a65-9fb6-d21d0b6f2f7d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6tjm9" Jul 15 21:13:05.641305 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:05.641232 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5522bda4-9085-4a65-9fb6-d21d0b6f2f7d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-6tjm9\" (UID: \"5522bda4-9085-4a65-9fb6-d21d0b6f2f7d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6tjm9" Jul 15 21:13:05.641305 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:05.641265 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zrk2\" (UniqueName: \"kubernetes.io/projected/5522bda4-9085-4a65-9fb6-d21d0b6f2f7d-kube-api-access-4zrk2\") pod \"istiod-openshift-gateway-94bb8fbfd-6tjm9\" (UID: \"5522bda4-9085-4a65-9fb6-d21d0b6f2f7d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6tjm9" Jul 15 21:13:05.641305 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:05.641292 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5522bda4-9085-4a65-9fb6-d21d0b6f2f7d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-6tjm9\" (UID: \"5522bda4-9085-4a65-9fb6-d21d0b6f2f7d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6tjm9" Jul 15 21:13:05.641429 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:05.641363 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5522bda4-9085-4a65-9fb6-d21d0b6f2f7d-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-6tjm9\" (UID: \"5522bda4-9085-4a65-9fb6-d21d0b6f2f7d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6tjm9" Jul 15 21:13:05.741889 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:05.741853 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5522bda4-9085-4a65-9fb6-d21d0b6f2f7d-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-6tjm9\" (UID: \"5522bda4-9085-4a65-9fb6-d21d0b6f2f7d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6tjm9" Jul 15 21:13:05.742065 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:05.741919 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5522bda4-9085-4a65-9fb6-d21d0b6f2f7d-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-6tjm9\" (UID: \"5522bda4-9085-4a65-9fb6-d21d0b6f2f7d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6tjm9" Jul 15 21:13:05.742065 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:05.741948 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5522bda4-9085-4a65-9fb6-d21d0b6f2f7d-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-6tjm9\" (UID: \"5522bda4-9085-4a65-9fb6-d21d0b6f2f7d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6tjm9" Jul 15 21:13:05.742065 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:05.742015 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5522bda4-9085-4a65-9fb6-d21d0b6f2f7d-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-6tjm9\" (UID: \"5522bda4-9085-4a65-9fb6-d21d0b6f2f7d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6tjm9" Jul 15 21:13:05.742065 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:05.742046 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5522bda4-9085-4a65-9fb6-d21d0b6f2f7d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-6tjm9\" (UID: \"5522bda4-9085-4a65-9fb6-d21d0b6f2f7d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6tjm9" Jul 15 21:13:05.742269 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:05.742093 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zrk2\" (UniqueName: \"kubernetes.io/projected/5522bda4-9085-4a65-9fb6-d21d0b6f2f7d-kube-api-access-4zrk2\") pod \"istiod-openshift-gateway-94bb8fbfd-6tjm9\" (UID: \"5522bda4-9085-4a65-9fb6-d21d0b6f2f7d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6tjm9" Jul 15 21:13:05.742269 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:05.742124 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5522bda4-9085-4a65-9fb6-d21d0b6f2f7d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-6tjm9\" (UID: \"5522bda4-9085-4a65-9fb6-d21d0b6f2f7d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6tjm9" Jul 15 21:13:05.742955 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:05.742925 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5522bda4-9085-4a65-9fb6-d21d0b6f2f7d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-6tjm9\" (UID: \"5522bda4-9085-4a65-9fb6-d21d0b6f2f7d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6tjm9" Jul 15 21:13:05.744783 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:05.744741 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5522bda4-9085-4a65-9fb6-d21d0b6f2f7d-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-6tjm9\" (UID: \"5522bda4-9085-4a65-9fb6-d21d0b6f2f7d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6tjm9" Jul 15 21:13:05.744993 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:05.744974 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5522bda4-9085-4a65-9fb6-d21d0b6f2f7d-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-6tjm9\" (UID: \"5522bda4-9085-4a65-9fb6-d21d0b6f2f7d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6tjm9" Jul 15 21:13:05.745036 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:05.744977 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5522bda4-9085-4a65-9fb6-d21d0b6f2f7d-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-6tjm9\" (UID: \"5522bda4-9085-4a65-9fb6-d21d0b6f2f7d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6tjm9" Jul 15 21:13:05.745036 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:05.745003 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5522bda4-9085-4a65-9fb6-d21d0b6f2f7d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-6tjm9\" (UID: \"5522bda4-9085-4a65-9fb6-d21d0b6f2f7d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6tjm9" Jul 15 21:13:05.756318 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:05.756291 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5522bda4-9085-4a65-9fb6-d21d0b6f2f7d-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-6tjm9\" (UID: \"5522bda4-9085-4a65-9fb6-d21d0b6f2f7d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6tjm9" Jul 15 21:13:05.756777 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:05.756751 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zrk2\" (UniqueName: \"kubernetes.io/projected/5522bda4-9085-4a65-9fb6-d21d0b6f2f7d-kube-api-access-4zrk2\") pod \"istiod-openshift-gateway-94bb8fbfd-6tjm9\" (UID: \"5522bda4-9085-4a65-9fb6-d21d0b6f2f7d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6tjm9" Jul 15 21:13:05.921439 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:05.921193 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6tjm9" Jul 15 21:13:06.098756 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:06.098681 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:13:06.098879 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:06.098776 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:13:06.098879 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:06.098811 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:13:06.187197 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:06.187176 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6tjm9"] Jul 15 21:13:06.188612 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:13:06.188585 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5522bda4_9085_4a65_9fb6_d21d0b6f2f7d.slice/crio-71f71c065907fcadd168927e7f97d694881932d0f7d0ebce96bfbf26c44529f4 WatchSource:0}: Error finding container 71f71c065907fcadd168927e7f97d694881932d0f7d0ebce96bfbf26c44529f4: Status 404 returned error can't find the container with id 71f71c065907fcadd168927e7f97d694881932d0f7d0ebce96bfbf26c44529f4 Jul 15 21:13:07.051334 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:07.051267 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tpbsr" event={"ID":"aee0e022-eff4-467c-beeb-ed82aeda0745","Type":"ContainerStarted","Data":"1520b483f9aad765da373bf2854f927ce880da6e22fa8fe55fbd388560335066"} Jul 15 21:13:07.052747 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:07.052705 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6tjm9" event={"ID":"5522bda4-9085-4a65-9fb6-d21d0b6f2f7d","Type":"ContainerStarted","Data":"71f71c065907fcadd168927e7f97d694881932d0f7d0ebce96bfbf26c44529f4"} Jul 15 21:13:07.163860 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:07.163831 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tpbsr" Jul 15 21:13:07.169776 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:07.169753 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tpbsr" Jul 15 21:13:07.201831 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:07.201779 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tpbsr" podStartSLOduration=2.409357526 podStartE2EDuration="5.201749414s" totalImagesPullingTime="2.792391888s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:13:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:13:07.19777749 +0000 UTC m=+395.448202622" watchObservedRunningTime="2026-07-15 21:13:07.201749414 +0000 UTC m=+395.452174536" Jul 15 21:13:08.057070 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:08.057041 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tpbsr" Jul 15 21:13:08.058268 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:08.058235 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tpbsr" Jul 15 21:13:08.468084 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:08.468053 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:13:08.468192 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:08.468115 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:13:09.062543 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:09.062507 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6tjm9" event={"ID":"5522bda4-9085-4a65-9fb6-d21d0b6f2f7d","Type":"ContainerStarted","Data":"8277a3fd59f3d18158902f2b74c56c59f0de5a07b3fcf35f4eaf65d32ccd71f0"} Jul 15 21:13:09.062994 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:09.062841 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6tjm9" Jul 15 21:13:09.064175 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:09.064150 2577 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-6tjm9 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 15 21:13:09.064285 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:09.064197 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6tjm9" podUID="5522bda4-9085-4a65-9fb6-d21d0b6f2f7d" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 15 21:13:09.117416 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:09.117341 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6tjm9" podStartSLOduration=1.840203204 podStartE2EDuration="4.117324816s" totalImagesPullingTime="2.277121612s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:13:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:13:09.11466456 +0000 UTC m=+397.365089694" watchObservedRunningTime="2026-07-15 21:13:09.117324816 +0000 UTC m=+397.367749960" Jul 15 21:13:10.073156 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:13:10.073130 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6tjm9" Jul 15 21:14:36.446353 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:14:36.446317 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-745bdb69fd-cjr7p"] Jul 15 21:15:01.475401 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:01.475357 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-745bdb69fd-cjr7p" podUID="f23336f7-c3d2-483f-bc7e-9d5297eed8c2" containerName="console" containerID="cri-o://f440eb78bb947d586b72b09dc95ba3fc1b06804c460e7b530b0e82481894b527" gracePeriod=15 Jul 15 21:15:01.720447 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:01.720422 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-745bdb69fd-cjr7p" Jul 15 21:15:01.793372 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:01.793301 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f23336f7-c3d2-483f-bc7e-9d5297eed8c2-console-oauth-config\") pod \"f23336f7-c3d2-483f-bc7e-9d5297eed8c2\" (UID: \"f23336f7-c3d2-483f-bc7e-9d5297eed8c2\") " Jul 15 21:15:01.793372 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:01.793342 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f23336f7-c3d2-483f-bc7e-9d5297eed8c2-trusted-ca-bundle\") pod \"f23336f7-c3d2-483f-bc7e-9d5297eed8c2\" (UID: \"f23336f7-c3d2-483f-bc7e-9d5297eed8c2\") " Jul 15 21:15:01.793372 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:01.793367 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f23336f7-c3d2-483f-bc7e-9d5297eed8c2-console-config\") pod \"f23336f7-c3d2-483f-bc7e-9d5297eed8c2\" (UID: \"f23336f7-c3d2-483f-bc7e-9d5297eed8c2\") " Jul 15 21:15:01.793569 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:01.793402 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nsc4n\" (UniqueName: \"kubernetes.io/projected/f23336f7-c3d2-483f-bc7e-9d5297eed8c2-kube-api-access-nsc4n\") pod \"f23336f7-c3d2-483f-bc7e-9d5297eed8c2\" (UID: \"f23336f7-c3d2-483f-bc7e-9d5297eed8c2\") " Jul 15 21:15:01.793569 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:01.793437 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f23336f7-c3d2-483f-bc7e-9d5297eed8c2-oauth-serving-cert\") pod \"f23336f7-c3d2-483f-bc7e-9d5297eed8c2\" (UID: \"f23336f7-c3d2-483f-bc7e-9d5297eed8c2\") " Jul 15 21:15:01.793569 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:01.793486 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f23336f7-c3d2-483f-bc7e-9d5297eed8c2-service-ca\") pod \"f23336f7-c3d2-483f-bc7e-9d5297eed8c2\" (UID: \"f23336f7-c3d2-483f-bc7e-9d5297eed8c2\") " Jul 15 21:15:01.793569 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:01.793565 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f23336f7-c3d2-483f-bc7e-9d5297eed8c2-console-serving-cert\") pod \"f23336f7-c3d2-483f-bc7e-9d5297eed8c2\" (UID: \"f23336f7-c3d2-483f-bc7e-9d5297eed8c2\") " Jul 15 21:15:01.793883 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:01.793790 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f23336f7-c3d2-483f-bc7e-9d5297eed8c2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f23336f7-c3d2-483f-bc7e-9d5297eed8c2" (UID: "f23336f7-c3d2-483f-bc7e-9d5297eed8c2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:15:01.793992 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:01.793921 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f23336f7-c3d2-483f-bc7e-9d5297eed8c2-console-config" (OuterVolumeSpecName: "console-config") pod "f23336f7-c3d2-483f-bc7e-9d5297eed8c2" (UID: "f23336f7-c3d2-483f-bc7e-9d5297eed8c2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:15:01.793992 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:01.793947 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f23336f7-c3d2-483f-bc7e-9d5297eed8c2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f23336f7-c3d2-483f-bc7e-9d5297eed8c2" (UID: "f23336f7-c3d2-483f-bc7e-9d5297eed8c2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:15:01.794101 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:01.794034 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f23336f7-c3d2-483f-bc7e-9d5297eed8c2-service-ca" (OuterVolumeSpecName: "service-ca") pod "f23336f7-c3d2-483f-bc7e-9d5297eed8c2" (UID: "f23336f7-c3d2-483f-bc7e-9d5297eed8c2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:15:01.795489 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:01.795458 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f23336f7-c3d2-483f-bc7e-9d5297eed8c2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f23336f7-c3d2-483f-bc7e-9d5297eed8c2" (UID: "f23336f7-c3d2-483f-bc7e-9d5297eed8c2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 21:15:01.795588 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:01.795535 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f23336f7-c3d2-483f-bc7e-9d5297eed8c2-kube-api-access-nsc4n" (OuterVolumeSpecName: "kube-api-access-nsc4n") pod "f23336f7-c3d2-483f-bc7e-9d5297eed8c2" (UID: "f23336f7-c3d2-483f-bc7e-9d5297eed8c2"). InnerVolumeSpecName "kube-api-access-nsc4n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:15:01.795757 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:01.795713 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f23336f7-c3d2-483f-bc7e-9d5297eed8c2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f23336f7-c3d2-483f-bc7e-9d5297eed8c2" (UID: "f23336f7-c3d2-483f-bc7e-9d5297eed8c2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 21:15:01.894187 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:01.894158 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f23336f7-c3d2-483f-bc7e-9d5297eed8c2-console-config\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\"" Jul 15 21:15:01.894187 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:01.894182 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nsc4n\" (UniqueName: \"kubernetes.io/projected/f23336f7-c3d2-483f-bc7e-9d5297eed8c2-kube-api-access-nsc4n\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\"" Jul 15 21:15:01.894349 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:01.894196 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f23336f7-c3d2-483f-bc7e-9d5297eed8c2-oauth-serving-cert\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\"" Jul 15 21:15:01.894349 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:01.894209 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f23336f7-c3d2-483f-bc7e-9d5297eed8c2-service-ca\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\"" Jul 15 21:15:01.894349 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:01.894222 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f23336f7-c3d2-483f-bc7e-9d5297eed8c2-console-serving-cert\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\"" Jul 15 21:15:01.894349 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:01.894234 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f23336f7-c3d2-483f-bc7e-9d5297eed8c2-console-oauth-config\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\"" Jul 15 21:15:01.894349 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:01.894246 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f23336f7-c3d2-483f-bc7e-9d5297eed8c2-trusted-ca-bundle\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\"" Jul 15 21:15:02.594678 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:02.594645 2577 generic.go:356] "Generic (PLEG): container finished" podID="f23336f7-c3d2-483f-bc7e-9d5297eed8c2" containerID="f440eb78bb947d586b72b09dc95ba3fc1b06804c460e7b530b0e82481894b527" exitCode=0 Jul 15 21:15:02.595111 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:02.594688 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-745bdb69fd-cjr7p" Jul 15 21:15:02.595111 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:02.594748 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-745bdb69fd-cjr7p" event={"ID":"f23336f7-c3d2-483f-bc7e-9d5297eed8c2","Type":"ContainerDied","Data":"f440eb78bb947d586b72b09dc95ba3fc1b06804c460e7b530b0e82481894b527"} Jul 15 21:15:02.595111 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:02.594796 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-745bdb69fd-cjr7p" event={"ID":"f23336f7-c3d2-483f-bc7e-9d5297eed8c2","Type":"ContainerDied","Data":"135011d33928c630a321c67d4e16811f91c4a6ad6bef6b89c1c36d1a8c5c2db5"} Jul 15 21:15:02.595111 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:02.594817 2577 scope.go:117] "RemoveContainer" containerID="f440eb78bb947d586b72b09dc95ba3fc1b06804c460e7b530b0e82481894b527" Jul 15 21:15:02.603144 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:02.603130 2577 scope.go:117] "RemoveContainer" containerID="f440eb78bb947d586b72b09dc95ba3fc1b06804c460e7b530b0e82481894b527" Jul 15 21:15:02.603410 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:15:02.603391 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f440eb78bb947d586b72b09dc95ba3fc1b06804c460e7b530b0e82481894b527\": container with ID starting with f440eb78bb947d586b72b09dc95ba3fc1b06804c460e7b530b0e82481894b527 not found: ID does not exist" containerID="f440eb78bb947d586b72b09dc95ba3fc1b06804c460e7b530b0e82481894b527" Jul 15 21:15:02.603456 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:02.603420 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f440eb78bb947d586b72b09dc95ba3fc1b06804c460e7b530b0e82481894b527"} err="failed to get container status \"f440eb78bb947d586b72b09dc95ba3fc1b06804c460e7b530b0e82481894b527\": rpc error: code = NotFound desc = could not find container \"f440eb78bb947d586b72b09dc95ba3fc1b06804c460e7b530b0e82481894b527\": container with ID starting with f440eb78bb947d586b72b09dc95ba3fc1b06804c460e7b530b0e82481894b527 not found: ID does not exist" Jul 15 21:15:02.616626 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:02.616599 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-745bdb69fd-cjr7p"] Jul 15 21:15:02.621024 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:02.620999 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-745bdb69fd-cjr7p"] Jul 15 21:15:04.339971 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:04.339927 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f23336f7-c3d2-483f-bc7e-9d5297eed8c2" path="/var/lib/kubelet/pods/f23336f7-c3d2-483f-bc7e-9d5297eed8c2/volumes" Jul 15 21:15:33.851844 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:33.851815 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-s87vd"] Jul 15 21:15:33.852235 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:33.852140 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f23336f7-c3d2-483f-bc7e-9d5297eed8c2" containerName="console" Jul 15 21:15:33.852235 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:33.852151 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f23336f7-c3d2-483f-bc7e-9d5297eed8c2" containerName="console" Jul 15 21:15:33.852235 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:33.852218 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f23336f7-c3d2-483f-bc7e-9d5297eed8c2" containerName="console" Jul 15 21:15:33.856309 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:33.856287 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-s87vd" Jul 15 21:15:33.858957 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:33.858936 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-ppvzg\"" Jul 15 21:15:33.868284 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:33.868258 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-s87vd"] Jul 15 21:15:33.951331 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:33.951295 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90807657-53da-46c4-9395-32d2838799fb-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-s87vd\" (UID: \"90807657-53da-46c4-9395-32d2838799fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-s87vd" Jul 15 21:15:33.951506 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:33.951345 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90807657-53da-46c4-9395-32d2838799fb-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-s87vd\" (UID: \"90807657-53da-46c4-9395-32d2838799fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-s87vd" Jul 15 21:15:33.951506 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:33.951384 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49qfj\" (UniqueName: \"kubernetes.io/projected/90807657-53da-46c4-9395-32d2838799fb-kube-api-access-49qfj\") pod \"maas-default-gateway-openshift-default-5896d4dd49-s87vd\" (UID: \"90807657-53da-46c4-9395-32d2838799fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-s87vd" Jul 15 21:15:33.951506 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:33.951428 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90807657-53da-46c4-9395-32d2838799fb-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-s87vd\" (UID: \"90807657-53da-46c4-9395-32d2838799fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-s87vd" Jul 15 21:15:33.951506 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:33.951449 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90807657-53da-46c4-9395-32d2838799fb-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-s87vd\" (UID: \"90807657-53da-46c4-9395-32d2838799fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-s87vd" Jul 15 21:15:33.951506 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:33.951489 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90807657-53da-46c4-9395-32d2838799fb-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-s87vd\" (UID: \"90807657-53da-46c4-9395-32d2838799fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-s87vd" Jul 15 21:15:33.951713 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:33.951513 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90807657-53da-46c4-9395-32d2838799fb-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-s87vd\" (UID: \"90807657-53da-46c4-9395-32d2838799fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-s87vd" Jul 15 21:15:33.951713 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:33.951537 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90807657-53da-46c4-9395-32d2838799fb-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-s87vd\" (UID: \"90807657-53da-46c4-9395-32d2838799fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-s87vd" Jul 15 21:15:33.951713 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:33.951568 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90807657-53da-46c4-9395-32d2838799fb-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-s87vd\" (UID: \"90807657-53da-46c4-9395-32d2838799fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-s87vd" Jul 15 21:15:34.052141 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:34.052112 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90807657-53da-46c4-9395-32d2838799fb-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-s87vd\" (UID: \"90807657-53da-46c4-9395-32d2838799fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-s87vd" Jul 15 21:15:34.052280 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:34.052157 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90807657-53da-46c4-9395-32d2838799fb-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-s87vd\" (UID: \"90807657-53da-46c4-9395-32d2838799fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-s87vd" Jul 15 21:15:34.052280 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:34.052181 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90807657-53da-46c4-9395-32d2838799fb-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-s87vd\" (UID: \"90807657-53da-46c4-9395-32d2838799fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-s87vd" Jul 15 21:15:34.052280 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:34.052206 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49qfj\" (UniqueName: \"kubernetes.io/projected/90807657-53da-46c4-9395-32d2838799fb-kube-api-access-49qfj\") pod \"maas-default-gateway-openshift-default-5896d4dd49-s87vd\" (UID: \"90807657-53da-46c4-9395-32d2838799fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-s87vd" Jul 15 21:15:34.052280 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:34.052229 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90807657-53da-46c4-9395-32d2838799fb-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-s87vd\" (UID: \"90807657-53da-46c4-9395-32d2838799fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-s87vd" Jul 15 21:15:34.052280 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:34.052249 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90807657-53da-46c4-9395-32d2838799fb-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-s87vd\" (UID: \"90807657-53da-46c4-9395-32d2838799fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-s87vd" Jul 15 21:15:34.052532 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:34.052413 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90807657-53da-46c4-9395-32d2838799fb-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-s87vd\" (UID: \"90807657-53da-46c4-9395-32d2838799fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-s87vd" Jul 15 21:15:34.052532 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:34.052461 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90807657-53da-46c4-9395-32d2838799fb-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-s87vd\" (UID: \"90807657-53da-46c4-9395-32d2838799fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-s87vd" Jul 15 21:15:34.052532 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:34.052487 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90807657-53da-46c4-9395-32d2838799fb-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-s87vd\" (UID: \"90807657-53da-46c4-9395-32d2838799fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-s87vd" Jul 15 21:15:34.052874 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:34.052853 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90807657-53da-46c4-9395-32d2838799fb-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-s87vd\" (UID: \"90807657-53da-46c4-9395-32d2838799fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-s87vd" Jul 15 21:15:34.052969 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:34.052888 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90807657-53da-46c4-9395-32d2838799fb-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-s87vd\" (UID: \"90807657-53da-46c4-9395-32d2838799fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-s87vd" Jul 15 21:15:34.053058 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:34.053036 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90807657-53da-46c4-9395-32d2838799fb-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-s87vd\" (UID: \"90807657-53da-46c4-9395-32d2838799fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-s87vd" Jul 15 21:15:34.053101 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:34.053070 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90807657-53da-46c4-9395-32d2838799fb-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-s87vd\" (UID: \"90807657-53da-46c4-9395-32d2838799fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-s87vd" Jul 15 21:15:34.053135 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:34.053116 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90807657-53da-46c4-9395-32d2838799fb-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-s87vd\" (UID: \"90807657-53da-46c4-9395-32d2838799fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-s87vd" Jul 15 21:15:34.054519 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:34.054494 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90807657-53da-46c4-9395-32d2838799fb-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-s87vd\" (UID: \"90807657-53da-46c4-9395-32d2838799fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-s87vd" Jul 15 21:15:34.054738 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:34.054709 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90807657-53da-46c4-9395-32d2838799fb-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-s87vd\" (UID: \"90807657-53da-46c4-9395-32d2838799fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-s87vd" Jul 15 21:15:34.064189 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:34.064163 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90807657-53da-46c4-9395-32d2838799fb-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-s87vd\" (UID: \"90807657-53da-46c4-9395-32d2838799fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-s87vd" Jul 15 21:15:34.066053 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:34.066037 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49qfj\" (UniqueName: \"kubernetes.io/projected/90807657-53da-46c4-9395-32d2838799fb-kube-api-access-49qfj\") pod \"maas-default-gateway-openshift-default-5896d4dd49-s87vd\" (UID: \"90807657-53da-46c4-9395-32d2838799fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-s87vd" Jul 15 21:15:34.168231 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:34.168205 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-s87vd" Jul 15 21:15:34.304071 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:34.304048 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-s87vd"] Jul 15 21:15:34.305706 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:15:34.305685 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90807657_53da_46c4_9395_32d2838799fb.slice/crio-b0f94da73448706b4d33e9ed6dc07ab78a7f7164b6bd22f8fa47ddac10f602d7 WatchSource:0}: Error finding container b0f94da73448706b4d33e9ed6dc07ab78a7f7164b6bd22f8fa47ddac10f602d7: Status 404 returned error can't find the container with id b0f94da73448706b4d33e9ed6dc07ab78a7f7164b6bd22f8fa47ddac10f602d7 Jul 15 21:15:34.307812 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:34.307782 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:15:34.307907 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:34.307859 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:15:34.307977 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:34.307903 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:15:34.743212 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:34.743176 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-s87vd" event={"ID":"90807657-53da-46c4-9395-32d2838799fb","Type":"ContainerStarted","Data":"5a496b79c03c97fa266533dbcadc07540444b6dfeeb905bfff0bb9b9c5f30a34"} Jul 15 21:15:34.743411 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:34.743224 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-s87vd" event={"ID":"90807657-53da-46c4-9395-32d2838799fb","Type":"ContainerStarted","Data":"b0f94da73448706b4d33e9ed6dc07ab78a7f7164b6bd22f8fa47ddac10f602d7"} Jul 15 21:15:34.764274 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:34.764229 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-s87vd" podStartSLOduration=1.764214854 podStartE2EDuration="1.764214854s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:15:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:15:34.762719523 +0000 UTC m=+543.013144657" watchObservedRunningTime="2026-07-15 21:15:34.764214854 +0000 UTC m=+543.014639985" Jul 15 21:15:35.169294 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:35.169266 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-s87vd" Jul 15 21:15:35.173986 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:35.173959 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-s87vd" Jul 15 21:15:35.747486 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:35.747457 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-s87vd" Jul 15 21:15:35.748268 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:15:35.748251 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-s87vd" Jul 15 21:16:30.731742 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:16:30.731688 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-86c7975d8d-cfgm2"] Jul 15 21:16:30.735000 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:16:30.734984 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86c7975d8d-cfgm2" Jul 15 21:16:30.741250 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:16:30.740897 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 15 21:16:30.741250 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:16:30.741113 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-s5qqb\"" Jul 15 21:16:30.742086 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:16:30.742059 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 15 21:16:30.753170 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:16:30.753142 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-86c7975d8d-cfgm2"] Jul 15 21:16:30.828463 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:16:30.828428 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/52717291-efdc-4fa1-80f8-c9df43246cd4-webhook-cert\") pod \"maas-controller-86c7975d8d-cfgm2\" (UID: \"52717291-efdc-4fa1-80f8-c9df43246cd4\") " pod="opendatahub/maas-controller-86c7975d8d-cfgm2" Jul 15 21:16:30.828605 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:16:30.828467 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbr8r\" (UniqueName: \"kubernetes.io/projected/52717291-efdc-4fa1-80f8-c9df43246cd4-kube-api-access-gbr8r\") pod \"maas-controller-86c7975d8d-cfgm2\" (UID: \"52717291-efdc-4fa1-80f8-c9df43246cd4\") " pod="opendatahub/maas-controller-86c7975d8d-cfgm2" Jul 15 21:16:30.929468 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:16:30.929437 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/52717291-efdc-4fa1-80f8-c9df43246cd4-webhook-cert\") pod \"maas-controller-86c7975d8d-cfgm2\" (UID: \"52717291-efdc-4fa1-80f8-c9df43246cd4\") " pod="opendatahub/maas-controller-86c7975d8d-cfgm2" Jul 15 21:16:30.929468 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:16:30.929469 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbr8r\" (UniqueName: \"kubernetes.io/projected/52717291-efdc-4fa1-80f8-c9df43246cd4-kube-api-access-gbr8r\") pod \"maas-controller-86c7975d8d-cfgm2\" (UID: \"52717291-efdc-4fa1-80f8-c9df43246cd4\") " pod="opendatahub/maas-controller-86c7975d8d-cfgm2" Jul 15 21:16:30.931802 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:16:30.931781 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/52717291-efdc-4fa1-80f8-c9df43246cd4-webhook-cert\") pod \"maas-controller-86c7975d8d-cfgm2\" (UID: \"52717291-efdc-4fa1-80f8-c9df43246cd4\") " pod="opendatahub/maas-controller-86c7975d8d-cfgm2" Jul 15 21:16:30.950297 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:16:30.950270 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbr8r\" (UniqueName: \"kubernetes.io/projected/52717291-efdc-4fa1-80f8-c9df43246cd4-kube-api-access-gbr8r\") pod \"maas-controller-86c7975d8d-cfgm2\" (UID: \"52717291-efdc-4fa1-80f8-c9df43246cd4\") " pod="opendatahub/maas-controller-86c7975d8d-cfgm2" Jul 15 21:16:30.967080 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:16:30.967058 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6594f49bc9-g2nnb"] Jul 15 21:16:30.970317 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:16:30.970302 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6594f49bc9-g2nnb" Jul 15 21:16:30.983823 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:16:30.983773 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6594f49bc9-g2nnb"] Jul 15 21:16:31.047773 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:16:31.047715 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86c7975d8d-cfgm2" Jul 15 21:16:31.130718 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:16:31.130663 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgc9b\" (UniqueName: \"kubernetes.io/projected/9479c4ed-f115-4ce7-9835-978605fe45fc-kube-api-access-wgc9b\") pod \"maas-controller-6594f49bc9-g2nnb\" (UID: \"9479c4ed-f115-4ce7-9835-978605fe45fc\") " pod="opendatahub/maas-controller-6594f49bc9-g2nnb" Jul 15 21:16:31.130855 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:16:31.130827 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9479c4ed-f115-4ce7-9835-978605fe45fc-webhook-cert\") pod \"maas-controller-6594f49bc9-g2nnb\" (UID: \"9479c4ed-f115-4ce7-9835-978605fe45fc\") " pod="opendatahub/maas-controller-6594f49bc9-g2nnb" Jul 15 21:16:31.180750 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:16:31.180705 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-86c7975d8d-cfgm2"] Jul 15 21:16:31.182018 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:16:31.181991 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52717291_efdc_4fa1_80f8_c9df43246cd4.slice/crio-7686e80aefbcc308fe977bd355c767496c862630d9f99bd713adfa0e7c158d6a WatchSource:0}: Error finding container 7686e80aefbcc308fe977bd355c767496c862630d9f99bd713adfa0e7c158d6a: Status 404 returned error can't find the container with id 7686e80aefbcc308fe977bd355c767496c862630d9f99bd713adfa0e7c158d6a Jul 15 21:16:31.232145 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:16:31.232113 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9479c4ed-f115-4ce7-9835-978605fe45fc-webhook-cert\") pod \"maas-controller-6594f49bc9-g2nnb\" (UID: \"9479c4ed-f115-4ce7-9835-978605fe45fc\") " pod="opendatahub/maas-controller-6594f49bc9-g2nnb" Jul 15 21:16:31.232266 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:16:31.232192 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgc9b\" (UniqueName: \"kubernetes.io/projected/9479c4ed-f115-4ce7-9835-978605fe45fc-kube-api-access-wgc9b\") pod \"maas-controller-6594f49bc9-g2nnb\" (UID: \"9479c4ed-f115-4ce7-9835-978605fe45fc\") " pod="opendatahub/maas-controller-6594f49bc9-g2nnb" Jul 15 21:16:31.234452 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:16:31.234396 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9479c4ed-f115-4ce7-9835-978605fe45fc-webhook-cert\") pod \"maas-controller-6594f49bc9-g2nnb\" (UID: \"9479c4ed-f115-4ce7-9835-978605fe45fc\") " pod="opendatahub/maas-controller-6594f49bc9-g2nnb" Jul 15 21:16:31.244518 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:16:31.244497 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgc9b\" (UniqueName: \"kubernetes.io/projected/9479c4ed-f115-4ce7-9835-978605fe45fc-kube-api-access-wgc9b\") pod \"maas-controller-6594f49bc9-g2nnb\" (UID: \"9479c4ed-f115-4ce7-9835-978605fe45fc\") " pod="opendatahub/maas-controller-6594f49bc9-g2nnb" Jul 15 21:16:31.280474 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:16:31.280454 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6594f49bc9-g2nnb" Jul 15 21:16:31.411153 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:16:31.411129 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6594f49bc9-g2nnb"] Jul 15 21:16:31.412636 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:16:31.412605 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9479c4ed_f115_4ce7_9835_978605fe45fc.slice/crio-0e7d2dbbb81d29250bb39daf62295db5a521ed41b08c5aca038094439f898668 WatchSource:0}: Error finding container 0e7d2dbbb81d29250bb39daf62295db5a521ed41b08c5aca038094439f898668: Status 404 returned error can't find the container with id 0e7d2dbbb81d29250bb39daf62295db5a521ed41b08c5aca038094439f898668 Jul 15 21:16:32.002222 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:16:32.002175 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86c7975d8d-cfgm2" event={"ID":"52717291-efdc-4fa1-80f8-c9df43246cd4","Type":"ContainerStarted","Data":"7686e80aefbcc308fe977bd355c767496c862630d9f99bd713adfa0e7c158d6a"} Jul 15 21:16:32.004082 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:16:32.004050 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6594f49bc9-g2nnb" event={"ID":"9479c4ed-f115-4ce7-9835-978605fe45fc","Type":"ContainerStarted","Data":"0e7d2dbbb81d29250bb39daf62295db5a521ed41b08c5aca038094439f898668"} Jul 15 21:16:32.187430 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:16:32.187399 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qm2hk_8224ce90-3f8b-4562-b8ae-14f9d965f20f/ovn-acl-logging/0.log" Jul 15 21:16:32.188019 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:16:32.187994 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qm2hk_8224ce90-3f8b-4562-b8ae-14f9d965f20f/ovn-acl-logging/0.log" Jul 15 21:16:33.824901 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:16:33.824877 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 15 21:16:34.015545 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:16:34.015500 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6594f49bc9-g2nnb" event={"ID":"9479c4ed-f115-4ce7-9835-978605fe45fc","Type":"ContainerStarted","Data":"f12ffb58ee7b0b83288d54070b63ff63de9adefeae6cac5e2655c7596b7d80bd"} Jul 15 21:16:34.015713 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:16:34.015654 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6594f49bc9-g2nnb" Jul 15 21:16:34.017165 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:16:34.017140 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86c7975d8d-cfgm2" event={"ID":"52717291-efdc-4fa1-80f8-c9df43246cd4","Type":"ContainerStarted","Data":"37cb2fdfb4af33246ad6c3f3e3c0f81d43c3723b8e261ee16bd84ecd56d5e6f9"} Jul 15 21:16:34.017279 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:16:34.017271 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-86c7975d8d-cfgm2" Jul 15 21:16:34.045799 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:16:34.045755 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6594f49bc9-g2nnb" podStartSLOduration=1.630788417 podStartE2EDuration="4.045742018s" totalImagesPullingTime="2.414953601s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:16:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:16:34.04364947 +0000 UTC m=+602.294074604" watchObservedRunningTime="2026-07-15 21:16:34.045742018 +0000 UTC m=+602.296167140" Jul 15 21:16:34.074486 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:16:34.074408 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-86c7975d8d-cfgm2" podStartSLOduration=1.435673062 podStartE2EDuration="4.07439477s" totalImagesPullingTime="2.638721708s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:16:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:16:34.071982105 +0000 UTC m=+602.322407244" watchObservedRunningTime="2026-07-15 21:16:34.07439477 +0000 UTC m=+602.324819901" Jul 15 21:16:45.023283 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:16:45.023249 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6594f49bc9-g2nnb" Jul 15 21:16:45.025843 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:16:45.023320 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-86c7975d8d-cfgm2" Jul 15 21:16:45.120773 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:16:45.120741 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-86c7975d8d-cfgm2"] Jul 15 21:16:45.120947 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:16:45.120924 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-86c7975d8d-cfgm2" podUID="52717291-efdc-4fa1-80f8-c9df43246cd4" containerName="manager" containerID="cri-o://37cb2fdfb4af33246ad6c3f3e3c0f81d43c3723b8e261ee16bd84ecd56d5e6f9" gracePeriod=30 Jul 15 21:16:45.367431 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:16:45.367408 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86c7975d8d-cfgm2" Jul 15 21:16:45.459373 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:16:45.459343 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gbr8r\" (UniqueName: \"kubernetes.io/projected/52717291-efdc-4fa1-80f8-c9df43246cd4-kube-api-access-gbr8r\") pod \"52717291-efdc-4fa1-80f8-c9df43246cd4\" (UID: \"52717291-efdc-4fa1-80f8-c9df43246cd4\") " Jul 15 21:16:45.459531 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:16:45.459429 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/52717291-efdc-4fa1-80f8-c9df43246cd4-webhook-cert\") pod \"52717291-efdc-4fa1-80f8-c9df43246cd4\" (UID: \"52717291-efdc-4fa1-80f8-c9df43246cd4\") " Jul 15 21:16:45.461492 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:16:45.461467 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52717291-efdc-4fa1-80f8-c9df43246cd4-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "52717291-efdc-4fa1-80f8-c9df43246cd4" (UID: "52717291-efdc-4fa1-80f8-c9df43246cd4"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 21:16:45.461601 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:16:45.461502 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52717291-efdc-4fa1-80f8-c9df43246cd4-kube-api-access-gbr8r" (OuterVolumeSpecName: "kube-api-access-gbr8r") pod "52717291-efdc-4fa1-80f8-c9df43246cd4" (UID: "52717291-efdc-4fa1-80f8-c9df43246cd4"). InnerVolumeSpecName "kube-api-access-gbr8r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:16:45.560579 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:16:45.560520 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gbr8r\" (UniqueName: \"kubernetes.io/projected/52717291-efdc-4fa1-80f8-c9df43246cd4-kube-api-access-gbr8r\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\"" Jul 15 21:16:45.560579 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:16:45.560545 2577 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/52717291-efdc-4fa1-80f8-c9df43246cd4-webhook-cert\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\"" Jul 15 21:16:46.070777 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:16:46.070746 2577 generic.go:356] "Generic (PLEG): container finished" podID="52717291-efdc-4fa1-80f8-c9df43246cd4" containerID="37cb2fdfb4af33246ad6c3f3e3c0f81d43c3723b8e261ee16bd84ecd56d5e6f9" exitCode=0 Jul 15 21:16:46.071159 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:16:46.070786 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86c7975d8d-cfgm2" Jul 15 21:16:46.071159 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:16:46.070796 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86c7975d8d-cfgm2" event={"ID":"52717291-efdc-4fa1-80f8-c9df43246cd4","Type":"ContainerDied","Data":"37cb2fdfb4af33246ad6c3f3e3c0f81d43c3723b8e261ee16bd84ecd56d5e6f9"} Jul 15 21:16:46.071159 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:16:46.070843 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86c7975d8d-cfgm2" event={"ID":"52717291-efdc-4fa1-80f8-c9df43246cd4","Type":"ContainerDied","Data":"7686e80aefbcc308fe977bd355c767496c862630d9f99bd713adfa0e7c158d6a"} Jul 15 21:16:46.071159 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:16:46.070867 2577 scope.go:117] "RemoveContainer" containerID="37cb2fdfb4af33246ad6c3f3e3c0f81d43c3723b8e261ee16bd84ecd56d5e6f9" Jul 15 21:16:46.080003 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:16:46.079982 2577 scope.go:117] "RemoveContainer" containerID="37cb2fdfb4af33246ad6c3f3e3c0f81d43c3723b8e261ee16bd84ecd56d5e6f9" Jul 15 21:16:46.080233 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:16:46.080212 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37cb2fdfb4af33246ad6c3f3e3c0f81d43c3723b8e261ee16bd84ecd56d5e6f9\": container with ID starting with 37cb2fdfb4af33246ad6c3f3e3c0f81d43c3723b8e261ee16bd84ecd56d5e6f9 not found: ID does not exist" containerID="37cb2fdfb4af33246ad6c3f3e3c0f81d43c3723b8e261ee16bd84ecd56d5e6f9" Jul 15 21:16:46.080276 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:16:46.080241 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37cb2fdfb4af33246ad6c3f3e3c0f81d43c3723b8e261ee16bd84ecd56d5e6f9"} err="failed to get container status \"37cb2fdfb4af33246ad6c3f3e3c0f81d43c3723b8e261ee16bd84ecd56d5e6f9\": rpc error: code = NotFound desc = could not find container \"37cb2fdfb4af33246ad6c3f3e3c0f81d43c3723b8e261ee16bd84ecd56d5e6f9\": container with ID starting with 37cb2fdfb4af33246ad6c3f3e3c0f81d43c3723b8e261ee16bd84ecd56d5e6f9 not found: ID does not exist" Jul 15 21:16:46.096261 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:16:46.096236 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-86c7975d8d-cfgm2"] Jul 15 21:16:46.101545 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:16:46.101522 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-86c7975d8d-cfgm2"] Jul 15 21:16:46.339925 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:16:46.339852 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52717291-efdc-4fa1-80f8-c9df43246cd4" path="/var/lib/kubelet/pods/52717291-efdc-4fa1-80f8-c9df43246cd4/volumes" Jul 15 21:17:05.095354 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:05.095277 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-dxszc"] Jul 15 21:17:05.095846 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:05.095678 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52717291-efdc-4fa1-80f8-c9df43246cd4" containerName="manager" Jul 15 21:17:05.095846 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:05.095694 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="52717291-efdc-4fa1-80f8-c9df43246cd4" containerName="manager" Jul 15 21:17:05.095846 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:05.095797 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="52717291-efdc-4fa1-80f8-c9df43246cd4" containerName="manager" Jul 15 21:17:05.098607 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:05.098591 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-dxszc" Jul 15 21:17:05.101066 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:05.101041 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 15 21:17:05.101246 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:05.101218 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-8h5cb\"" Jul 15 21:17:05.108125 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:05.108095 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-dxszc"] Jul 15 21:17:05.228794 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:05.228764 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85c8cf11-c6a3-4285-accb-d2a184df5835-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-dxszc\" (UID: \"85c8cf11-c6a3-4285-accb-d2a184df5835\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-dxszc" Jul 15 21:17:05.228960 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:05.228862 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhztl\" (UniqueName: \"kubernetes.io/projected/85c8cf11-c6a3-4285-accb-d2a184df5835-kube-api-access-lhztl\") pod \"payload-pre-processing-74584bb9f8-dxszc\" (UID: \"85c8cf11-c6a3-4285-accb-d2a184df5835\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-dxszc" Jul 15 21:17:05.330319 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:05.330288 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhztl\" (UniqueName: \"kubernetes.io/projected/85c8cf11-c6a3-4285-accb-d2a184df5835-kube-api-access-lhztl\") pod \"payload-pre-processing-74584bb9f8-dxszc\" (UID: \"85c8cf11-c6a3-4285-accb-d2a184df5835\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-dxszc" Jul 15 21:17:05.330474 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:05.330342 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85c8cf11-c6a3-4285-accb-d2a184df5835-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-dxszc\" (UID: \"85c8cf11-c6a3-4285-accb-d2a184df5835\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-dxszc" Jul 15 21:17:05.331023 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:05.331005 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85c8cf11-c6a3-4285-accb-d2a184df5835-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-dxszc\" (UID: \"85c8cf11-c6a3-4285-accb-d2a184df5835\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-dxszc" Jul 15 21:17:05.346095 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:05.346037 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhztl\" (UniqueName: \"kubernetes.io/projected/85c8cf11-c6a3-4285-accb-d2a184df5835-kube-api-access-lhztl\") pod \"payload-pre-processing-74584bb9f8-dxszc\" (UID: \"85c8cf11-c6a3-4285-accb-d2a184df5835\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-dxszc" Jul 15 21:17:05.409313 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:05.409291 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-dxszc" Jul 15 21:17:05.547178 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:05.547139 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-dxszc"] Jul 15 21:17:05.548909 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:17:05.548872 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85c8cf11_c6a3_4285_accb_d2a184df5835.slice/crio-3bb4c4bd946c7a0cd33b70dfd4113f7511a1210eb2a30f467fc75c38d8bd23d3 WatchSource:0}: Error finding container 3bb4c4bd946c7a0cd33b70dfd4113f7511a1210eb2a30f467fc75c38d8bd23d3: Status 404 returned error can't find the container with id 3bb4c4bd946c7a0cd33b70dfd4113f7511a1210eb2a30f467fc75c38d8bd23d3 Jul 15 21:17:05.551221 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:05.551202 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 21:17:06.167393 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:06.167359 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-dxszc" event={"ID":"85c8cf11-c6a3-4285-accb-d2a184df5835","Type":"ContainerStarted","Data":"3bb4c4bd946c7a0cd33b70dfd4113f7511a1210eb2a30f467fc75c38d8bd23d3"} Jul 15 21:17:08.178561 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:08.178524 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-dxszc" event={"ID":"85c8cf11-c6a3-4285-accb-d2a184df5835","Type":"ContainerStarted","Data":"d068c38dc8998ab3d0f377c45e47aeb9b02ffade3d0eea4a7481c57093d5ac2e"} Jul 15 21:17:08.178976 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:08.178598 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-dxszc" Jul 15 21:17:08.199238 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:08.199191 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-74584bb9f8-dxszc" podStartSLOduration=1.584441069 podStartE2EDuration="3.199176707s" totalImagesPullingTime="1.614735638s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:17:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:17:08.197293513 +0000 UTC m=+636.447718669" watchObservedRunningTime="2026-07-15 21:17:08.199176707 +0000 UTC m=+636.449601839" Jul 15 21:17:13.203834 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:13.203798 2577 generic.go:356] "Generic (PLEG): container finished" podID="90807657-53da-46c4-9395-32d2838799fb" containerID="5a496b79c03c97fa266533dbcadc07540444b6dfeeb905bfff0bb9b9c5f30a34" exitCode=0 Jul 15 21:17:13.204235 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:13.203871 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-s87vd" event={"ID":"90807657-53da-46c4-9395-32d2838799fb","Type":"ContainerDied","Data":"5a496b79c03c97fa266533dbcadc07540444b6dfeeb905bfff0bb9b9c5f30a34"} Jul 15 21:17:13.204235 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:13.204226 2577 scope.go:117] "RemoveContainer" containerID="5a496b79c03c97fa266533dbcadc07540444b6dfeeb905bfff0bb9b9c5f30a34" Jul 15 21:17:13.205171 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:13.205139 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:17:13.205243 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:13.205220 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:17:13.205279 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:13.205267 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:17:14.211211 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:14.211181 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-s87vd" event={"ID":"90807657-53da-46c4-9395-32d2838799fb","Type":"ContainerStarted","Data":"839ccb2323d5b08e4bc9ad0b1e3542b63a55847fc33c79328c1881813a19c968"} Jul 15 21:17:15.169168 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:15.169132 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-s87vd" Jul 15 21:17:15.169387 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:15.169328 2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-s87vd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body= Jul 15 21:17:15.169429 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:15.169385 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-s87vd" podUID="90807657-53da-46c4-9395-32d2838799fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" Jul 15 21:17:16.169204 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:16.169168 2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-s87vd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body= Jul 15 21:17:16.169567 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:16.169223 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-s87vd" podUID="90807657-53da-46c4-9395-32d2838799fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" Jul 15 21:17:17.168784 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:17.168743 2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-s87vd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body= Jul 15 21:17:17.168990 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:17.168803 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-s87vd" podUID="90807657-53da-46c4-9395-32d2838799fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" Jul 15 21:17:18.169418 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:18.169383 2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-s87vd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body= Jul 15 21:17:18.169825 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:18.169433 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-s87vd" podUID="90807657-53da-46c4-9395-32d2838799fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" Jul 15 21:17:19.172970 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:19.172938 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-s87vd" Jul 15 21:17:19.173329 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:19.173206 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-s87vd" Jul 15 21:17:19.173811 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:19.173792 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-s87vd" Jul 15 21:17:19.185226 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:19.185201 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-74584bb9f8-dxszc" podUID="85c8cf11-c6a3-4285-accb-d2a184df5835" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.133.0.34:9004: connect: connection refused" Jul 15 21:17:29.184471 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:29.184438 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-dxszc" Jul 15 21:17:34.431665 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:34.431627 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h6wq5"] Jul 15 21:17:34.438154 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:34.438130 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h6wq5" Jul 15 21:17:34.441685 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:34.441663 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 15 21:17:34.442920 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:34.442900 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-ms4wp\"" Jul 15 21:17:34.443023 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:34.442918 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 15 21:17:34.443023 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:34.442940 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 15 21:17:34.445307 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:34.445285 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h6wq5"] Jul 15 21:17:34.502038 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:34.502009 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ddf3654-9878-42be-ab09-3ca66015eeea-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h6wq5\" (UID: \"7ddf3654-9878-42be-ab09-3ca66015eeea\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h6wq5" Jul 15 21:17:34.502167 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:34.502046 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ddf3654-9878-42be-ab09-3ca66015eeea-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h6wq5\" (UID: \"7ddf3654-9878-42be-ab09-3ca66015eeea\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h6wq5" Jul 15 21:17:34.502167 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:34.502068 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ddf3654-9878-42be-ab09-3ca66015eeea-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h6wq5\" (UID: \"7ddf3654-9878-42be-ab09-3ca66015eeea\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h6wq5" Jul 15 21:17:34.502288 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:34.502165 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ddf3654-9878-42be-ab09-3ca66015eeea-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h6wq5\" (UID: \"7ddf3654-9878-42be-ab09-3ca66015eeea\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h6wq5" Jul 15 21:17:34.502288 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:34.502266 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ddf3654-9878-42be-ab09-3ca66015eeea-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h6wq5\" (UID: \"7ddf3654-9878-42be-ab09-3ca66015eeea\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h6wq5" Jul 15 21:17:34.502380 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:34.502294 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25jcn\" (UniqueName: \"kubernetes.io/projected/7ddf3654-9878-42be-ab09-3ca66015eeea-kube-api-access-25jcn\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h6wq5\" (UID: \"7ddf3654-9878-42be-ab09-3ca66015eeea\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h6wq5" Jul 15 21:17:34.603238 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:34.603201 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ddf3654-9878-42be-ab09-3ca66015eeea-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h6wq5\" (UID: \"7ddf3654-9878-42be-ab09-3ca66015eeea\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h6wq5" Jul 15 21:17:34.603238 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:34.603239 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25jcn\" (UniqueName: \"kubernetes.io/projected/7ddf3654-9878-42be-ab09-3ca66015eeea-kube-api-access-25jcn\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h6wq5\" (UID: \"7ddf3654-9878-42be-ab09-3ca66015eeea\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h6wq5" Jul 15 21:17:34.603448 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:34.603289 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ddf3654-9878-42be-ab09-3ca66015eeea-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h6wq5\" (UID: \"7ddf3654-9878-42be-ab09-3ca66015eeea\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h6wq5" Jul 15 21:17:34.603448 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:34.603309 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ddf3654-9878-42be-ab09-3ca66015eeea-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h6wq5\" (UID: \"7ddf3654-9878-42be-ab09-3ca66015eeea\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h6wq5" Jul 15 21:17:34.603448 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:34.603326 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ddf3654-9878-42be-ab09-3ca66015eeea-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h6wq5\" (UID: \"7ddf3654-9878-42be-ab09-3ca66015eeea\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h6wq5" Jul 15 21:17:34.603448 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:34.603344 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ddf3654-9878-42be-ab09-3ca66015eeea-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h6wq5\" (UID: \"7ddf3654-9878-42be-ab09-3ca66015eeea\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h6wq5" Jul 15 21:17:34.603711 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:34.603673 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ddf3654-9878-42be-ab09-3ca66015eeea-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h6wq5\" (UID: \"7ddf3654-9878-42be-ab09-3ca66015eeea\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h6wq5" Jul 15 21:17:34.603891 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:34.603689 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ddf3654-9878-42be-ab09-3ca66015eeea-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h6wq5\" (UID: \"7ddf3654-9878-42be-ab09-3ca66015eeea\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h6wq5" Jul 15 21:17:34.603891 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:34.603779 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ddf3654-9878-42be-ab09-3ca66015eeea-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h6wq5\" (UID: \"7ddf3654-9878-42be-ab09-3ca66015eeea\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h6wq5" Jul 15 21:17:34.605656 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:34.605636 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ddf3654-9878-42be-ab09-3ca66015eeea-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h6wq5\" (UID: \"7ddf3654-9878-42be-ab09-3ca66015eeea\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h6wq5" Jul 15 21:17:34.605928 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:34.605911 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ddf3654-9878-42be-ab09-3ca66015eeea-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h6wq5\" (UID: \"7ddf3654-9878-42be-ab09-3ca66015eeea\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h6wq5" Jul 15 21:17:34.614148 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:34.614121 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-25jcn\" (UniqueName: \"kubernetes.io/projected/7ddf3654-9878-42be-ab09-3ca66015eeea-kube-api-access-25jcn\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h6wq5\" (UID: \"7ddf3654-9878-42be-ab09-3ca66015eeea\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h6wq5" Jul 15 21:17:34.750196 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:34.750104 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h6wq5" Jul 15 21:17:34.885561 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:34.885536 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h6wq5"] Jul 15 21:17:34.887135 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:17:34.887106 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ddf3654_9878_42be_ab09_3ca66015eeea.slice/crio-22183f3407165243a731262e19198070b7ea9904c33e0a90b7ecf292f954d017 WatchSource:0}: Error finding container 22183f3407165243a731262e19198070b7ea9904c33e0a90b7ecf292f954d017: Status 404 returned error can't find the container with id 22183f3407165243a731262e19198070b7ea9904c33e0a90b7ecf292f954d017 Jul 15 21:17:35.314745 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:35.314677 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h6wq5" event={"ID":"7ddf3654-9878-42be-ab09-3ca66015eeea","Type":"ContainerStarted","Data":"22183f3407165243a731262e19198070b7ea9904c33e0a90b7ecf292f954d017"} Jul 15 21:17:36.320424 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:36.320338 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h6wq5" event={"ID":"7ddf3654-9878-42be-ab09-3ca66015eeea","Type":"ContainerStarted","Data":"a1bfe934591e51330ed6019d177b69a8ab634a05b266466c46387c3ca775bd60"} Jul 15 21:17:36.342622 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:36.342573 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h6wq5" podStartSLOduration=1.213696702 podStartE2EDuration="2.342557045s" totalImagesPullingTime="1.128860343s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:17:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:17:36.340586357 +0000 UTC m=+664.591011511" watchObservedRunningTime="2026-07-15 21:17:36.342557045 +0000 UTC m=+664.592982175" Jul 15 21:17:44.750991 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:44.750958 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h6wq5" Jul 15 21:17:44.751574 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:44.751540 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h6wq5" Jul 15 21:17:44.764135 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:44.764103 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h6wq5" Jul 15 21:17:45.375397 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:45.375371 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h6wq5" Jul 15 21:17:55.607056 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:55.607016 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4nwt9"] Jul 15 21:17:55.611455 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:55.611437 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4nwt9" Jul 15 21:17:55.615487 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:55.615466 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 15 21:17:55.624537 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:55.624518 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4nwt9"] Jul 15 21:17:55.790504 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:55.790468 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5a307da-4ba8-485f-b61c-7bb76365781d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4nwt9\" (UID: \"a5a307da-4ba8-485f-b61c-7bb76365781d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4nwt9" Jul 15 21:17:55.790669 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:55.790569 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5a307da-4ba8-485f-b61c-7bb76365781d-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4nwt9\" (UID: \"a5a307da-4ba8-485f-b61c-7bb76365781d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4nwt9" Jul 15 21:17:55.790669 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:55.790608 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5a307da-4ba8-485f-b61c-7bb76365781d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4nwt9\" (UID: \"a5a307da-4ba8-485f-b61c-7bb76365781d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4nwt9" Jul 15 21:17:55.790669 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:55.790639 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5a307da-4ba8-485f-b61c-7bb76365781d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4nwt9\" (UID: \"a5a307da-4ba8-485f-b61c-7bb76365781d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4nwt9" Jul 15 21:17:55.790669 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:55.790655 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4pt8\" (UniqueName: \"kubernetes.io/projected/a5a307da-4ba8-485f-b61c-7bb76365781d-kube-api-access-s4pt8\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4nwt9\" (UID: \"a5a307da-4ba8-485f-b61c-7bb76365781d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4nwt9" Jul 15 21:17:55.790863 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:55.790741 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5a307da-4ba8-485f-b61c-7bb76365781d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4nwt9\" (UID: \"a5a307da-4ba8-485f-b61c-7bb76365781d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4nwt9" Jul 15 21:17:55.891971 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:55.891888 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5a307da-4ba8-485f-b61c-7bb76365781d-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4nwt9\" (UID: \"a5a307da-4ba8-485f-b61c-7bb76365781d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4nwt9" Jul 15 21:17:55.891971 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:55.891925 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5a307da-4ba8-485f-b61c-7bb76365781d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4nwt9\" (UID: \"a5a307da-4ba8-485f-b61c-7bb76365781d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4nwt9" Jul 15 21:17:55.891971 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:55.891957 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5a307da-4ba8-485f-b61c-7bb76365781d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4nwt9\" (UID: \"a5a307da-4ba8-485f-b61c-7bb76365781d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4nwt9" Jul 15 21:17:55.892234 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:55.891980 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4pt8\" (UniqueName: \"kubernetes.io/projected/a5a307da-4ba8-485f-b61c-7bb76365781d-kube-api-access-s4pt8\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4nwt9\" (UID: \"a5a307da-4ba8-485f-b61c-7bb76365781d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4nwt9" Jul 15 21:17:55.892234 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:55.892024 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5a307da-4ba8-485f-b61c-7bb76365781d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4nwt9\" (UID: \"a5a307da-4ba8-485f-b61c-7bb76365781d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4nwt9" Jul 15 21:17:55.892234 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:55.892075 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5a307da-4ba8-485f-b61c-7bb76365781d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4nwt9\" (UID: \"a5a307da-4ba8-485f-b61c-7bb76365781d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4nwt9" Jul 15 21:17:55.892432 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:55.892357 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5a307da-4ba8-485f-b61c-7bb76365781d-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4nwt9\" (UID: \"a5a307da-4ba8-485f-b61c-7bb76365781d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4nwt9" Jul 15 21:17:55.892432 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:55.892389 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5a307da-4ba8-485f-b61c-7bb76365781d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4nwt9\" (UID: \"a5a307da-4ba8-485f-b61c-7bb76365781d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4nwt9" Jul 15 21:17:55.892503 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:55.892440 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5a307da-4ba8-485f-b61c-7bb76365781d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4nwt9\" (UID: \"a5a307da-4ba8-485f-b61c-7bb76365781d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4nwt9" Jul 15 21:17:55.894255 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:55.894232 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5a307da-4ba8-485f-b61c-7bb76365781d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4nwt9\" (UID: \"a5a307da-4ba8-485f-b61c-7bb76365781d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4nwt9" Jul 15 21:17:55.894406 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:55.894385 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5a307da-4ba8-485f-b61c-7bb76365781d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4nwt9\" (UID: \"a5a307da-4ba8-485f-b61c-7bb76365781d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4nwt9" Jul 15 21:17:55.906319 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:55.906299 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4pt8\" (UniqueName: \"kubernetes.io/projected/a5a307da-4ba8-485f-b61c-7bb76365781d-kube-api-access-s4pt8\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4nwt9\" (UID: \"a5a307da-4ba8-485f-b61c-7bb76365781d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4nwt9" Jul 15 21:17:55.920866 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:55.920848 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4nwt9" Jul 15 21:17:56.052762 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:56.052736 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4nwt9"] Jul 15 21:17:56.054507 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:17:56.054479 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5a307da_4ba8_485f_b61c_7bb76365781d.slice/crio-db3e065b487f10c7036273dc412c850ca6ca2d34f582959467ec08ecea52639b WatchSource:0}: Error finding container db3e065b487f10c7036273dc412c850ca6ca2d34f582959467ec08ecea52639b: Status 404 returned error can't find the container with id db3e065b487f10c7036273dc412c850ca6ca2d34f582959467ec08ecea52639b Jul 15 21:17:56.413561 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:56.413531 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4nwt9" event={"ID":"a5a307da-4ba8-485f-b61c-7bb76365781d","Type":"ContainerStarted","Data":"d6392afc3c6bed9ae802279b5ed75275ea5a2d3886cdcbd0b2b67a07a972c661"} Jul 15 21:17:56.413766 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:56.413579 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4nwt9" event={"ID":"a5a307da-4ba8-485f-b61c-7bb76365781d","Type":"ContainerStarted","Data":"db3e065b487f10c7036273dc412c850ca6ca2d34f582959467ec08ecea52639b"} Jul 15 21:17:56.446075 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:17:56.446026 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4nwt9" podStartSLOduration=1.265873743 podStartE2EDuration="1.446011585s" totalImagesPullingTime="180.137842ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:17:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:17:56.442674764 +0000 UTC m=+684.693099898" watchObservedRunningTime="2026-07-15 21:17:56.446011585 +0000 UTC m=+684.696436716" Jul 15 21:18:03.173548 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:18:03.173512 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-ljnrr"] Jul 15 21:18:03.177145 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:18:03.177123 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ljnrr" Jul 15 21:18:03.179702 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:18:03.179681 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 15 21:18:03.187566 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:18:03.187541 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-ljnrr"] Jul 15 21:18:03.256869 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:18:03.256829 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00dbde61-bc29-4038-90ac-bb9cc5dfafbd-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ljnrr\" (UID: \"00dbde61-bc29-4038-90ac-bb9cc5dfafbd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ljnrr" Jul 15 21:18:03.256869 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:18:03.256869 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00dbde61-bc29-4038-90ac-bb9cc5dfafbd-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ljnrr\" (UID: \"00dbde61-bc29-4038-90ac-bb9cc5dfafbd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ljnrr" Jul 15 21:18:03.257071 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:18:03.256888 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00dbde61-bc29-4038-90ac-bb9cc5dfafbd-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ljnrr\" (UID: \"00dbde61-bc29-4038-90ac-bb9cc5dfafbd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ljnrr" Jul 15 21:18:03.257071 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:18:03.256961 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00dbde61-bc29-4038-90ac-bb9cc5dfafbd-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ljnrr\" (UID: \"00dbde61-bc29-4038-90ac-bb9cc5dfafbd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ljnrr" Jul 15 21:18:03.257071 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:18:03.256989 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00dbde61-bc29-4038-90ac-bb9cc5dfafbd-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ljnrr\" (UID: \"00dbde61-bc29-4038-90ac-bb9cc5dfafbd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ljnrr" Jul 15 21:18:03.257071 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:18:03.257008 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gwn6\" (UniqueName: \"kubernetes.io/projected/00dbde61-bc29-4038-90ac-bb9cc5dfafbd-kube-api-access-4gwn6\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ljnrr\" (UID: \"00dbde61-bc29-4038-90ac-bb9cc5dfafbd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ljnrr" Jul 15 21:18:03.357886 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:18:03.357856 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00dbde61-bc29-4038-90ac-bb9cc5dfafbd-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ljnrr\" (UID: \"00dbde61-bc29-4038-90ac-bb9cc5dfafbd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ljnrr" Jul 15 21:18:03.357886 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:18:03.357892 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gwn6\" (UniqueName: \"kubernetes.io/projected/00dbde61-bc29-4038-90ac-bb9cc5dfafbd-kube-api-access-4gwn6\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ljnrr\" (UID: \"00dbde61-bc29-4038-90ac-bb9cc5dfafbd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ljnrr" Jul 15 21:18:03.358107 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:18:03.357977 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00dbde61-bc29-4038-90ac-bb9cc5dfafbd-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ljnrr\" (UID: \"00dbde61-bc29-4038-90ac-bb9cc5dfafbd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ljnrr" Jul 15 21:18:03.358107 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:18:03.357994 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00dbde61-bc29-4038-90ac-bb9cc5dfafbd-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ljnrr\" (UID: \"00dbde61-bc29-4038-90ac-bb9cc5dfafbd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ljnrr" Jul 15 21:18:03.358107 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:18:03.358009 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00dbde61-bc29-4038-90ac-bb9cc5dfafbd-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ljnrr\" (UID: \"00dbde61-bc29-4038-90ac-bb9cc5dfafbd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ljnrr" Jul 15 21:18:03.358107 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:18:03.358039 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00dbde61-bc29-4038-90ac-bb9cc5dfafbd-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ljnrr\" (UID: \"00dbde61-bc29-4038-90ac-bb9cc5dfafbd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ljnrr" Jul 15 21:18:03.358309 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:18:03.358260 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00dbde61-bc29-4038-90ac-bb9cc5dfafbd-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ljnrr\" (UID: \"00dbde61-bc29-4038-90ac-bb9cc5dfafbd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ljnrr" Jul 15 21:18:03.358389 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:18:03.358365 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00dbde61-bc29-4038-90ac-bb9cc5dfafbd-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ljnrr\" (UID: \"00dbde61-bc29-4038-90ac-bb9cc5dfafbd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ljnrr" Jul 15 21:18:03.358446 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:18:03.358405 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00dbde61-bc29-4038-90ac-bb9cc5dfafbd-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ljnrr\" (UID: \"00dbde61-bc29-4038-90ac-bb9cc5dfafbd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ljnrr" Jul 15 21:18:03.360213 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:18:03.360188 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00dbde61-bc29-4038-90ac-bb9cc5dfafbd-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ljnrr\" (UID: \"00dbde61-bc29-4038-90ac-bb9cc5dfafbd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ljnrr" Jul 15 21:18:03.360490 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:18:03.360474 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00dbde61-bc29-4038-90ac-bb9cc5dfafbd-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ljnrr\" (UID: \"00dbde61-bc29-4038-90ac-bb9cc5dfafbd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ljnrr" Jul 15 21:18:03.367634 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:18:03.367599 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gwn6\" (UniqueName: \"kubernetes.io/projected/00dbde61-bc29-4038-90ac-bb9cc5dfafbd-kube-api-access-4gwn6\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ljnrr\" (UID: \"00dbde61-bc29-4038-90ac-bb9cc5dfafbd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ljnrr" Jul 15 21:18:03.489479 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:18:03.489408 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ljnrr" Jul 15 21:18:03.620426 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:18:03.620406 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-ljnrr"] Jul 15 21:18:03.622256 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:18:03.622232 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00dbde61_bc29_4038_90ac_bb9cc5dfafbd.slice/crio-fa16d31dbc6724e9f23117401f156c451bd4685d59b774616afe0174ec417284 WatchSource:0}: Error finding container fa16d31dbc6724e9f23117401f156c451bd4685d59b774616afe0174ec417284: Status 404 returned error can't find the container with id fa16d31dbc6724e9f23117401f156c451bd4685d59b774616afe0174ec417284 Jul 15 21:18:04.452841 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:18:04.452799 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ljnrr" event={"ID":"00dbde61-bc29-4038-90ac-bb9cc5dfafbd","Type":"ContainerStarted","Data":"eb3abb62cd175e6518fc47337b40ed3d376655f61df3fda95de4f4b8208f1903"} Jul 15 21:18:04.453314 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:18:04.452852 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ljnrr" event={"ID":"00dbde61-bc29-4038-90ac-bb9cc5dfafbd","Type":"ContainerStarted","Data":"fa16d31dbc6724e9f23117401f156c451bd4685d59b774616afe0174ec417284"} Jul 15 21:18:04.479395 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:18:04.479345 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ljnrr" podStartSLOduration=1.303889382 podStartE2EDuration="1.479330171s" totalImagesPullingTime="175.440789ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:18:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:18:04.479057408 +0000 UTC m=+692.729482538" watchObservedRunningTime="2026-07-15 21:18:04.479330171 +0000 UTC m=+692.729755302" Jul 15 21:18:05.921248 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:18:05.921211 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4nwt9" Jul 15 21:18:05.921623 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:18:05.921285 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4nwt9" Jul 15 21:18:05.934276 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:18:05.934248 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4nwt9" Jul 15 21:18:06.472889 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:18:06.472858 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4nwt9" Jul 15 21:18:13.490168 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:18:13.490130 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ljnrr" Jul 15 21:18:13.490557 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:18:13.490194 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ljnrr" Jul 15 21:18:13.502322 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:18:13.502301 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ljnrr" Jul 15 21:18:14.508059 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:18:14.508027 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ljnrr" Jul 15 21:20:03.159290 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:03.159208 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6594f49bc9-g2nnb"] Jul 15 21:20:03.159845 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:03.159483 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6594f49bc9-g2nnb" podUID="9479c4ed-f115-4ce7-9835-978605fe45fc" containerName="manager" containerID="cri-o://f12ffb58ee7b0b83288d54070b63ff63de9adefeae6cac5e2655c7596b7d80bd" gracePeriod=30 Jul 15 21:20:03.412389 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:03.412335 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6594f49bc9-g2nnb" Jul 15 21:20:03.522233 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:03.522205 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wgc9b\" (UniqueName: \"kubernetes.io/projected/9479c4ed-f115-4ce7-9835-978605fe45fc-kube-api-access-wgc9b\") pod \"9479c4ed-f115-4ce7-9835-978605fe45fc\" (UID: \"9479c4ed-f115-4ce7-9835-978605fe45fc\") " Jul 15 21:20:03.522393 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:03.522287 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9479c4ed-f115-4ce7-9835-978605fe45fc-webhook-cert\") pod \"9479c4ed-f115-4ce7-9835-978605fe45fc\" (UID: \"9479c4ed-f115-4ce7-9835-978605fe45fc\") " Jul 15 21:20:03.524217 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:03.524182 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9479c4ed-f115-4ce7-9835-978605fe45fc-kube-api-access-wgc9b" (OuterVolumeSpecName: "kube-api-access-wgc9b") pod "9479c4ed-f115-4ce7-9835-978605fe45fc" (UID: "9479c4ed-f115-4ce7-9835-978605fe45fc"). InnerVolumeSpecName "kube-api-access-wgc9b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:20:03.524217 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:03.524190 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9479c4ed-f115-4ce7-9835-978605fe45fc-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "9479c4ed-f115-4ce7-9835-978605fe45fc" (UID: "9479c4ed-f115-4ce7-9835-978605fe45fc"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 21:20:03.623688 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:03.623659 2577 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9479c4ed-f115-4ce7-9835-978605fe45fc-webhook-cert\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\"" Jul 15 21:20:03.623688 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:03.623681 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wgc9b\" (UniqueName: \"kubernetes.io/projected/9479c4ed-f115-4ce7-9835-978605fe45fc-kube-api-access-wgc9b\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\"" Jul 15 21:20:04.030078 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:04.030047 2577 generic.go:356] "Generic (PLEG): container finished" podID="9479c4ed-f115-4ce7-9835-978605fe45fc" containerID="f12ffb58ee7b0b83288d54070b63ff63de9adefeae6cac5e2655c7596b7d80bd" exitCode=0 Jul 15 21:20:04.030244 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:04.030084 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6594f49bc9-g2nnb" event={"ID":"9479c4ed-f115-4ce7-9835-978605fe45fc","Type":"ContainerDied","Data":"f12ffb58ee7b0b83288d54070b63ff63de9adefeae6cac5e2655c7596b7d80bd"} Jul 15 21:20:04.030244 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:04.030091 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6594f49bc9-g2nnb" Jul 15 21:20:04.030244 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:04.030127 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6594f49bc9-g2nnb" event={"ID":"9479c4ed-f115-4ce7-9835-978605fe45fc","Type":"ContainerDied","Data":"0e7d2dbbb81d29250bb39daf62295db5a521ed41b08c5aca038094439f898668"} Jul 15 21:20:04.030244 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:04.030149 2577 scope.go:117] "RemoveContainer" containerID="f12ffb58ee7b0b83288d54070b63ff63de9adefeae6cac5e2655c7596b7d80bd" Jul 15 21:20:04.039017 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:04.039001 2577 scope.go:117] "RemoveContainer" containerID="f12ffb58ee7b0b83288d54070b63ff63de9adefeae6cac5e2655c7596b7d80bd" Jul 15 21:20:04.039286 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:20:04.039261 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f12ffb58ee7b0b83288d54070b63ff63de9adefeae6cac5e2655c7596b7d80bd\": container with ID starting with f12ffb58ee7b0b83288d54070b63ff63de9adefeae6cac5e2655c7596b7d80bd not found: ID does not exist" containerID="f12ffb58ee7b0b83288d54070b63ff63de9adefeae6cac5e2655c7596b7d80bd" Jul 15 21:20:04.039324 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:04.039297 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f12ffb58ee7b0b83288d54070b63ff63de9adefeae6cac5e2655c7596b7d80bd"} err="failed to get container status \"f12ffb58ee7b0b83288d54070b63ff63de9adefeae6cac5e2655c7596b7d80bd\": rpc error: code = NotFound desc = could not find container \"f12ffb58ee7b0b83288d54070b63ff63de9adefeae6cac5e2655c7596b7d80bd\": container with ID starting with f12ffb58ee7b0b83288d54070b63ff63de9adefeae6cac5e2655c7596b7d80bd not found: ID does not exist" Jul 15 21:20:04.053751 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:04.053711 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6594f49bc9-g2nnb"] Jul 15 21:20:04.058468 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:04.058448 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6594f49bc9-g2nnb"] Jul 15 21:20:04.341109 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:04.341032 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9479c4ed-f115-4ce7-9835-978605fe45fc" path="/var/lib/kubelet/pods/9479c4ed-f115-4ce7-9835-978605fe45fc/volumes" Jul 15 21:20:04.551765 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:04.551732 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6594f49bc9-zrlsk"] Jul 15 21:20:04.552177 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:04.552159 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9479c4ed-f115-4ce7-9835-978605fe45fc" containerName="manager" Jul 15 21:20:04.552177 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:04.552178 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="9479c4ed-f115-4ce7-9835-978605fe45fc" containerName="manager" Jul 15 21:20:04.552316 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:04.552281 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="9479c4ed-f115-4ce7-9835-978605fe45fc" containerName="manager" Jul 15 21:20:04.556554 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:04.556533 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6594f49bc9-zrlsk" Jul 15 21:20:04.560755 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:04.560735 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-s5qqb\"" Jul 15 21:20:04.560847 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:04.560740 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 15 21:20:04.560847 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:04.560742 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 15 21:20:04.567413 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:04.567384 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6594f49bc9-zrlsk"] Jul 15 21:20:04.631242 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:04.631164 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a552debf-8bef-4f1e-8843-8f4a9eca67eb-webhook-cert\") pod \"maas-controller-6594f49bc9-zrlsk\" (UID: \"a552debf-8bef-4f1e-8843-8f4a9eca67eb\") " pod="opendatahub/maas-controller-6594f49bc9-zrlsk" Jul 15 21:20:04.631378 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:04.631280 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbxgf\" (UniqueName: \"kubernetes.io/projected/a552debf-8bef-4f1e-8843-8f4a9eca67eb-kube-api-access-zbxgf\") pod \"maas-controller-6594f49bc9-zrlsk\" (UID: \"a552debf-8bef-4f1e-8843-8f4a9eca67eb\") " pod="opendatahub/maas-controller-6594f49bc9-zrlsk" Jul 15 21:20:04.732185 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:04.732146 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbxgf\" (UniqueName: \"kubernetes.io/projected/a552debf-8bef-4f1e-8843-8f4a9eca67eb-kube-api-access-zbxgf\") pod \"maas-controller-6594f49bc9-zrlsk\" (UID: \"a552debf-8bef-4f1e-8843-8f4a9eca67eb\") " pod="opendatahub/maas-controller-6594f49bc9-zrlsk" Jul 15 21:20:04.732327 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:04.732216 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a552debf-8bef-4f1e-8843-8f4a9eca67eb-webhook-cert\") pod \"maas-controller-6594f49bc9-zrlsk\" (UID: \"a552debf-8bef-4f1e-8843-8f4a9eca67eb\") " pod="opendatahub/maas-controller-6594f49bc9-zrlsk" Jul 15 21:20:04.734534 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:04.734512 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a552debf-8bef-4f1e-8843-8f4a9eca67eb-webhook-cert\") pod \"maas-controller-6594f49bc9-zrlsk\" (UID: \"a552debf-8bef-4f1e-8843-8f4a9eca67eb\") " pod="opendatahub/maas-controller-6594f49bc9-zrlsk" Jul 15 21:20:04.741816 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:04.741794 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbxgf\" (UniqueName: \"kubernetes.io/projected/a552debf-8bef-4f1e-8843-8f4a9eca67eb-kube-api-access-zbxgf\") pod \"maas-controller-6594f49bc9-zrlsk\" (UID: \"a552debf-8bef-4f1e-8843-8f4a9eca67eb\") " pod="opendatahub/maas-controller-6594f49bc9-zrlsk" Jul 15 21:20:04.866881 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:04.866851 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6594f49bc9-zrlsk" Jul 15 21:20:04.997039 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:04.997012 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6594f49bc9-zrlsk"] Jul 15 21:20:04.999510 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:20:04.999483 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda552debf_8bef_4f1e_8843_8f4a9eca67eb.slice/crio-8393b7e696e9f5d827126ad2fb6d3f538d211c71aa0511a8f4c9d62758d0895b WatchSource:0}: Error finding container 8393b7e696e9f5d827126ad2fb6d3f538d211c71aa0511a8f4c9d62758d0895b: Status 404 returned error can't find the container with id 8393b7e696e9f5d827126ad2fb6d3f538d211c71aa0511a8f4c9d62758d0895b Jul 15 21:20:05.035923 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:05.035895 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6594f49bc9-zrlsk" event={"ID":"a552debf-8bef-4f1e-8843-8f4a9eca67eb","Type":"ContainerStarted","Data":"8393b7e696e9f5d827126ad2fb6d3f538d211c71aa0511a8f4c9d62758d0895b"} Jul 15 21:20:06.043830 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:06.043791 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6594f49bc9-zrlsk" event={"ID":"a552debf-8bef-4f1e-8843-8f4a9eca67eb","Type":"ContainerStarted","Data":"1ccd84bf39364db293450dd9bb826a2c176e4daf593a3b0b7691eccaafdb5227"} Jul 15 21:20:06.044298 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:06.043930 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6594f49bc9-zrlsk" Jul 15 21:20:06.095006 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:06.094949 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6594f49bc9-zrlsk" podStartSLOduration=1.677562985 podStartE2EDuration="2.094935447s" totalImagesPullingTime="417.372462ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:20:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:20:06.094466602 +0000 UTC m=+814.344891736" watchObservedRunningTime="2026-07-15 21:20:06.094935447 +0000 UTC m=+814.345360576" Jul 15 21:20:17.050413 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:17.050383 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6594f49bc9-zrlsk" Jul 15 21:20:29.885381 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:29.885349 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6594f49bc9-zrlsk"] Jul 15 21:20:29.885761 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:29.885567 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6594f49bc9-zrlsk" podUID="a552debf-8bef-4f1e-8843-8f4a9eca67eb" containerName="manager" containerID="cri-o://1ccd84bf39364db293450dd9bb826a2c176e4daf593a3b0b7691eccaafdb5227" gracePeriod=30 Jul 15 21:20:30.131777 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:30.131754 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6594f49bc9-zrlsk" Jul 15 21:20:30.159607 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:30.159569 2577 generic.go:356] "Generic (PLEG): container finished" podID="a552debf-8bef-4f1e-8843-8f4a9eca67eb" containerID="1ccd84bf39364db293450dd9bb826a2c176e4daf593a3b0b7691eccaafdb5227" exitCode=0 Jul 15 21:20:30.159607 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:30.159601 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6594f49bc9-zrlsk" Jul 15 21:20:30.159772 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:30.159621 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6594f49bc9-zrlsk" event={"ID":"a552debf-8bef-4f1e-8843-8f4a9eca67eb","Type":"ContainerDied","Data":"1ccd84bf39364db293450dd9bb826a2c176e4daf593a3b0b7691eccaafdb5227"} Jul 15 21:20:30.159772 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:30.159673 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6594f49bc9-zrlsk" event={"ID":"a552debf-8bef-4f1e-8843-8f4a9eca67eb","Type":"ContainerDied","Data":"8393b7e696e9f5d827126ad2fb6d3f538d211c71aa0511a8f4c9d62758d0895b"} Jul 15 21:20:30.159772 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:30.159696 2577 scope.go:117] "RemoveContainer" containerID="1ccd84bf39364db293450dd9bb826a2c176e4daf593a3b0b7691eccaafdb5227" Jul 15 21:20:30.168964 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:30.168946 2577 scope.go:117] "RemoveContainer" containerID="1ccd84bf39364db293450dd9bb826a2c176e4daf593a3b0b7691eccaafdb5227" Jul 15 21:20:30.169241 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:20:30.169224 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ccd84bf39364db293450dd9bb826a2c176e4daf593a3b0b7691eccaafdb5227\": container with ID starting with 1ccd84bf39364db293450dd9bb826a2c176e4daf593a3b0b7691eccaafdb5227 not found: ID does not exist" containerID="1ccd84bf39364db293450dd9bb826a2c176e4daf593a3b0b7691eccaafdb5227" Jul 15 21:20:30.169299 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:30.169252 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ccd84bf39364db293450dd9bb826a2c176e4daf593a3b0b7691eccaafdb5227"} err="failed to get container status \"1ccd84bf39364db293450dd9bb826a2c176e4daf593a3b0b7691eccaafdb5227\": rpc error: code = NotFound desc = could not find container \"1ccd84bf39364db293450dd9bb826a2c176e4daf593a3b0b7691eccaafdb5227\": container with ID starting with 1ccd84bf39364db293450dd9bb826a2c176e4daf593a3b0b7691eccaafdb5227 not found: ID does not exist" Jul 15 21:20:30.248036 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:30.248011 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a552debf-8bef-4f1e-8843-8f4a9eca67eb-webhook-cert\") pod \"a552debf-8bef-4f1e-8843-8f4a9eca67eb\" (UID: \"a552debf-8bef-4f1e-8843-8f4a9eca67eb\") " Jul 15 21:20:30.248168 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:30.248120 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zbxgf\" (UniqueName: \"kubernetes.io/projected/a552debf-8bef-4f1e-8843-8f4a9eca67eb-kube-api-access-zbxgf\") pod \"a552debf-8bef-4f1e-8843-8f4a9eca67eb\" (UID: \"a552debf-8bef-4f1e-8843-8f4a9eca67eb\") " Jul 15 21:20:30.249928 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:30.249903 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a552debf-8bef-4f1e-8843-8f4a9eca67eb-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "a552debf-8bef-4f1e-8843-8f4a9eca67eb" (UID: "a552debf-8bef-4f1e-8843-8f4a9eca67eb"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 21:20:30.250050 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:30.250032 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a552debf-8bef-4f1e-8843-8f4a9eca67eb-kube-api-access-zbxgf" (OuterVolumeSpecName: "kube-api-access-zbxgf") pod "a552debf-8bef-4f1e-8843-8f4a9eca67eb" (UID: "a552debf-8bef-4f1e-8843-8f4a9eca67eb"). InnerVolumeSpecName "kube-api-access-zbxgf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:20:30.349333 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:30.349311 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zbxgf\" (UniqueName: \"kubernetes.io/projected/a552debf-8bef-4f1e-8843-8f4a9eca67eb-kube-api-access-zbxgf\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\"" Jul 15 21:20:30.349422 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:30.349335 2577 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a552debf-8bef-4f1e-8843-8f4a9eca67eb-webhook-cert\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\"" Jul 15 21:20:30.480069 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:30.479996 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6594f49bc9-zrlsk"] Jul 15 21:20:30.490276 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:30.490248 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6594f49bc9-zrlsk"] Jul 15 21:20:31.314314 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:31.314272 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6594f49bc9-vzl7w"] Jul 15 21:20:31.314919 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:31.314899 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a552debf-8bef-4f1e-8843-8f4a9eca67eb" containerName="manager" Jul 15 21:20:31.315017 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:31.314921 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a552debf-8bef-4f1e-8843-8f4a9eca67eb" containerName="manager" Jul 15 21:20:31.315070 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:31.315022 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a552debf-8bef-4f1e-8843-8f4a9eca67eb" containerName="manager" Jul 15 21:20:31.319288 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:31.319265 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6594f49bc9-vzl7w" Jul 15 21:20:31.323280 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:31.323260 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-s5qqb\"" Jul 15 21:20:31.323280 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:31.323270 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 15 21:20:31.323437 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:31.323270 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 15 21:20:31.331408 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:31.331386 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6594f49bc9-vzl7w"] Jul 15 21:20:31.357126 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:31.357104 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/02cf777b-aea3-4116-ae3c-33cdc41973d8-webhook-cert\") pod \"maas-controller-6594f49bc9-vzl7w\" (UID: \"02cf777b-aea3-4116-ae3c-33cdc41973d8\") " pod="opendatahub/maas-controller-6594f49bc9-vzl7w" Jul 15 21:20:31.357273 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:31.357255 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22w7c\" (UniqueName: \"kubernetes.io/projected/02cf777b-aea3-4116-ae3c-33cdc41973d8-kube-api-access-22w7c\") pod \"maas-controller-6594f49bc9-vzl7w\" (UID: \"02cf777b-aea3-4116-ae3c-33cdc41973d8\") " pod="opendatahub/maas-controller-6594f49bc9-vzl7w" Jul 15 21:20:31.458394 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:31.458356 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/02cf777b-aea3-4116-ae3c-33cdc41973d8-webhook-cert\") pod \"maas-controller-6594f49bc9-vzl7w\" (UID: \"02cf777b-aea3-4116-ae3c-33cdc41973d8\") " pod="opendatahub/maas-controller-6594f49bc9-vzl7w" Jul 15 21:20:31.458515 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:31.458461 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22w7c\" (UniqueName: \"kubernetes.io/projected/02cf777b-aea3-4116-ae3c-33cdc41973d8-kube-api-access-22w7c\") pod \"maas-controller-6594f49bc9-vzl7w\" (UID: \"02cf777b-aea3-4116-ae3c-33cdc41973d8\") " pod="opendatahub/maas-controller-6594f49bc9-vzl7w" Jul 15 21:20:31.461892 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:31.461866 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/02cf777b-aea3-4116-ae3c-33cdc41973d8-webhook-cert\") pod \"maas-controller-6594f49bc9-vzl7w\" (UID: \"02cf777b-aea3-4116-ae3c-33cdc41973d8\") " pod="opendatahub/maas-controller-6594f49bc9-vzl7w" Jul 15 21:20:31.469352 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:31.469327 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22w7c\" (UniqueName: \"kubernetes.io/projected/02cf777b-aea3-4116-ae3c-33cdc41973d8-kube-api-access-22w7c\") pod \"maas-controller-6594f49bc9-vzl7w\" (UID: \"02cf777b-aea3-4116-ae3c-33cdc41973d8\") " pod="opendatahub/maas-controller-6594f49bc9-vzl7w" Jul 15 21:20:31.629461 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:31.629388 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6594f49bc9-vzl7w" Jul 15 21:20:31.760412 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:31.760383 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6594f49bc9-vzl7w"] Jul 15 21:20:31.762228 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:20:31.762200 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02cf777b_aea3_4116_ae3c_33cdc41973d8.slice/crio-34306de0ba2079908e1721fc892eb806a79fd764ce0d1cd3b5ae39a4c353e162 WatchSource:0}: Error finding container 34306de0ba2079908e1721fc892eb806a79fd764ce0d1cd3b5ae39a4c353e162: Status 404 returned error can't find the container with id 34306de0ba2079908e1721fc892eb806a79fd764ce0d1cd3b5ae39a4c353e162 Jul 15 21:20:32.170895 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:32.170863 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6594f49bc9-vzl7w" event={"ID":"02cf777b-aea3-4116-ae3c-33cdc41973d8","Type":"ContainerStarted","Data":"34306de0ba2079908e1721fc892eb806a79fd764ce0d1cd3b5ae39a4c353e162"} Jul 15 21:20:32.189419 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:32.189400 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 15 21:20:32.341076 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:32.341046 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a552debf-8bef-4f1e-8843-8f4a9eca67eb" path="/var/lib/kubelet/pods/a552debf-8bef-4f1e-8843-8f4a9eca67eb/volumes" Jul 15 21:20:33.176862 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:33.176830 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6594f49bc9-vzl7w" event={"ID":"02cf777b-aea3-4116-ae3c-33cdc41973d8","Type":"ContainerStarted","Data":"78b6d1e9370bf91b9a9d9b5e1f37f0716ec82abbf5f97549ec3ac8dd034cecf5"} Jul 15 21:20:33.177092 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:33.176942 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6594f49bc9-vzl7w" Jul 15 21:20:33.196304 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:33.196258 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6594f49bc9-vzl7w" podStartSLOduration=1.773391232 podStartE2EDuration="2.196243656s" totalImagesPullingTime="422.852424ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:20:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:20:33.195399321 +0000 UTC m=+841.445824452" watchObservedRunningTime="2026-07-15 21:20:33.196243656 +0000 UTC m=+841.446668786" Jul 15 21:20:44.184043 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:20:44.184016 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6594f49bc9-vzl7w" Jul 15 21:21:32.228452 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:21:32.228381 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qm2hk_8224ce90-3f8b-4562-b8ae-14f9d965f20f/ovn-acl-logging/0.log" Jul 15 21:21:32.231118 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:21:32.231096 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qm2hk_8224ce90-3f8b-4562-b8ae-14f9d965f20f/ovn-acl-logging/0.log" Jul 15 21:25:19.505700 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:25:19.505669 2577 generic.go:356] "Generic (PLEG): container finished" podID="742496a3-53cf-42f8-a443-fb25b83dc60c" containerID="045db3d3e2a32a0dbe3385ea7b5743221ea07834b7376e99b06d535e3aee893e" exitCode=1 Jul 15 21:25:19.506084 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:25:19.505756 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6dd8d546cd-w7xnh" event={"ID":"742496a3-53cf-42f8-a443-fb25b83dc60c","Type":"ContainerDied","Data":"045db3d3e2a32a0dbe3385ea7b5743221ea07834b7376e99b06d535e3aee893e"} Jul 15 21:25:19.506132 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:25:19.506093 2577 scope.go:117] "RemoveContainer" containerID="045db3d3e2a32a0dbe3385ea7b5743221ea07834b7376e99b06d535e3aee893e" Jul 15 21:25:20.511761 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:25:20.511708 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6dd8d546cd-w7xnh" event={"ID":"742496a3-53cf-42f8-a443-fb25b83dc60c","Type":"ContainerStarted","Data":"b0ecd179638f9cb08a3a0932c99acc5fa15ba19534700f603b863ca3d37cd538"} Jul 15 21:25:20.512217 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:25:20.511924 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6dd8d546cd-w7xnh" Jul 15 21:25:20.513158 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:25:20.513136 2577 generic.go:356] "Generic (PLEG): container finished" podID="02cf777b-aea3-4116-ae3c-33cdc41973d8" containerID="78b6d1e9370bf91b9a9d9b5e1f37f0716ec82abbf5f97549ec3ac8dd034cecf5" exitCode=1 Jul 15 21:25:20.513253 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:25:20.513201 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6594f49bc9-vzl7w" event={"ID":"02cf777b-aea3-4116-ae3c-33cdc41973d8","Type":"ContainerDied","Data":"78b6d1e9370bf91b9a9d9b5e1f37f0716ec82abbf5f97549ec3ac8dd034cecf5"} Jul 15 21:25:20.513477 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:25:20.513465 2577 scope.go:117] "RemoveContainer" containerID="78b6d1e9370bf91b9a9d9b5e1f37f0716ec82abbf5f97549ec3ac8dd034cecf5" Jul 15 21:25:20.513749 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:25:20.513736 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 21:25:22.523391 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:25:22.523358 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6594f49bc9-vzl7w" event={"ID":"02cf777b-aea3-4116-ae3c-33cdc41973d8","Type":"ContainerStarted","Data":"6187b02b0f0a957375771ce98b81d1093c94c65d77883e1ac3f211a42f8c58dd"} Jul 15 21:25:22.523775 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:25:22.523572 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6594f49bc9-vzl7w" Jul 15 21:25:31.519862 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:25:31.519825 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6dd8d546cd-w7xnh" Jul 15 21:25:33.532509 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:25:33.532475 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6594f49bc9-vzl7w" Jul 15 21:26:32.265288 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:26:32.265252 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qm2hk_8224ce90-3f8b-4562-b8ae-14f9d965f20f/ovn-acl-logging/0.log" Jul 15 21:26:32.268080 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:26:32.268059 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qm2hk_8224ce90-3f8b-4562-b8ae-14f9d965f20f/ovn-acl-logging/0.log" Jul 15 21:31:32.295829 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:31:32.295802 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qm2hk_8224ce90-3f8b-4562-b8ae-14f9d965f20f/ovn-acl-logging/0.log" Jul 15 21:31:32.299822 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:31:32.299801 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qm2hk_8224ce90-3f8b-4562-b8ae-14f9d965f20f/ovn-acl-logging/0.log" Jul 15 21:33:29.605985 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:29.605892 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq"] Jul 15 21:33:29.610072 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:29.610049 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq" Jul 15 21:33:29.612591 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:29.612568 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-57e21af7-openshift-default-dockercfg-p6svk\"" Jul 15 21:33:29.633438 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:29.633392 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/414a1ab1-cc8f-42de-b6a7-570ba3f93c0c-workload-certs\") pod \"e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq\" (UID: \"414a1ab1-cc8f-42de-b6a7-570ba3f93c0c\") " pod="openshift-ingress/e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq" Jul 15 21:33:29.633555 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:29.633475 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/414a1ab1-cc8f-42de-b6a7-570ba3f93c0c-istio-podinfo\") pod \"e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq\" (UID: \"414a1ab1-cc8f-42de-b6a7-570ba3f93c0c\") " pod="openshift-ingress/e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq" Jul 15 21:33:29.633675 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:29.633650 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/414a1ab1-cc8f-42de-b6a7-570ba3f93c0c-istio-envoy\") pod \"e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq\" (UID: \"414a1ab1-cc8f-42de-b6a7-570ba3f93c0c\") " pod="openshift-ingress/e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq" Jul 15 21:33:29.633851 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:29.633763 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zddsp\" (UniqueName: \"kubernetes.io/projected/414a1ab1-cc8f-42de-b6a7-570ba3f93c0c-kube-api-access-zddsp\") pod \"e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq\" (UID: \"414a1ab1-cc8f-42de-b6a7-570ba3f93c0c\") " pod="openshift-ingress/e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq" Jul 15 21:33:29.633851 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:29.633797 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/414a1ab1-cc8f-42de-b6a7-570ba3f93c0c-istiod-ca-cert\") pod \"e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq\" (UID: \"414a1ab1-cc8f-42de-b6a7-570ba3f93c0c\") " pod="openshift-ingress/e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq" Jul 15 21:33:29.633851 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:29.633830 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/414a1ab1-cc8f-42de-b6a7-570ba3f93c0c-workload-socket\") pod \"e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq\" (UID: \"414a1ab1-cc8f-42de-b6a7-570ba3f93c0c\") " pod="openshift-ingress/e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq" Jul 15 21:33:29.634063 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:29.633910 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/414a1ab1-cc8f-42de-b6a7-570ba3f93c0c-istio-token\") pod \"e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq\" (UID: \"414a1ab1-cc8f-42de-b6a7-570ba3f93c0c\") " pod="openshift-ingress/e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq" Jul 15 21:33:29.634063 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:29.633939 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/414a1ab1-cc8f-42de-b6a7-570ba3f93c0c-istio-data\") pod \"e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq\" (UID: \"414a1ab1-cc8f-42de-b6a7-570ba3f93c0c\") " pod="openshift-ingress/e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq" Jul 15 21:33:29.634063 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:29.633960 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/414a1ab1-cc8f-42de-b6a7-570ba3f93c0c-credential-socket\") pod \"e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq\" (UID: \"414a1ab1-cc8f-42de-b6a7-570ba3f93c0c\") " pod="openshift-ingress/e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq" Jul 15 21:33:29.634361 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:29.634336 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq"] Jul 15 21:33:29.734955 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:29.734912 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/414a1ab1-cc8f-42de-b6a7-570ba3f93c0c-istio-token\") pod \"e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq\" (UID: \"414a1ab1-cc8f-42de-b6a7-570ba3f93c0c\") " pod="openshift-ingress/e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq" Jul 15 21:33:29.734955 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:29.734960 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/414a1ab1-cc8f-42de-b6a7-570ba3f93c0c-istio-data\") pod \"e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq\" (UID: \"414a1ab1-cc8f-42de-b6a7-570ba3f93c0c\") " pod="openshift-ingress/e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq" Jul 15 21:33:29.735190 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:29.734991 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/414a1ab1-cc8f-42de-b6a7-570ba3f93c0c-credential-socket\") pod \"e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq\" (UID: \"414a1ab1-cc8f-42de-b6a7-570ba3f93c0c\") " pod="openshift-ingress/e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq" Jul 15 21:33:29.735190 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:29.735042 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/414a1ab1-cc8f-42de-b6a7-570ba3f93c0c-workload-certs\") pod \"e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq\" (UID: \"414a1ab1-cc8f-42de-b6a7-570ba3f93c0c\") " pod="openshift-ingress/e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq" Jul 15 21:33:29.735190 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:29.735070 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/414a1ab1-cc8f-42de-b6a7-570ba3f93c0c-istio-podinfo\") pod \"e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq\" (UID: \"414a1ab1-cc8f-42de-b6a7-570ba3f93c0c\") " pod="openshift-ingress/e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq" Jul 15 21:33:29.735190 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:29.735129 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/414a1ab1-cc8f-42de-b6a7-570ba3f93c0c-istio-envoy\") pod \"e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq\" (UID: \"414a1ab1-cc8f-42de-b6a7-570ba3f93c0c\") " pod="openshift-ingress/e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq" Jul 15 21:33:29.735190 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:29.735164 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zddsp\" (UniqueName: \"kubernetes.io/projected/414a1ab1-cc8f-42de-b6a7-570ba3f93c0c-kube-api-access-zddsp\") pod \"e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq\" (UID: \"414a1ab1-cc8f-42de-b6a7-570ba3f93c0c\") " pod="openshift-ingress/e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq" Jul 15 21:33:29.735927 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:29.735189 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/414a1ab1-cc8f-42de-b6a7-570ba3f93c0c-istiod-ca-cert\") pod \"e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq\" (UID: \"414a1ab1-cc8f-42de-b6a7-570ba3f93c0c\") " pod="openshift-ingress/e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq" Jul 15 21:33:29.735927 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:29.735225 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/414a1ab1-cc8f-42de-b6a7-570ba3f93c0c-workload-socket\") pod \"e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq\" (UID: \"414a1ab1-cc8f-42de-b6a7-570ba3f93c0c\") " pod="openshift-ingress/e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq" Jul 15 21:33:29.735927 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:29.735584 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/414a1ab1-cc8f-42de-b6a7-570ba3f93c0c-istio-data\") pod \"e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq\" (UID: \"414a1ab1-cc8f-42de-b6a7-570ba3f93c0c\") " pod="openshift-ingress/e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq" Jul 15 21:33:29.735927 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:29.735635 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/414a1ab1-cc8f-42de-b6a7-570ba3f93c0c-credential-socket\") pod \"e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq\" (UID: \"414a1ab1-cc8f-42de-b6a7-570ba3f93c0c\") " pod="openshift-ingress/e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq" Jul 15 21:33:29.735927 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:29.735658 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/414a1ab1-cc8f-42de-b6a7-570ba3f93c0c-workload-socket\") pod \"e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq\" (UID: \"414a1ab1-cc8f-42de-b6a7-570ba3f93c0c\") " pod="openshift-ingress/e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq" Jul 15 21:33:29.735927 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:29.735879 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/414a1ab1-cc8f-42de-b6a7-570ba3f93c0c-workload-certs\") pod \"e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq\" (UID: \"414a1ab1-cc8f-42de-b6a7-570ba3f93c0c\") " pod="openshift-ingress/e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq" Jul 15 21:33:29.736402 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:29.736381 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/414a1ab1-cc8f-42de-b6a7-570ba3f93c0c-istiod-ca-cert\") pod \"e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq\" (UID: \"414a1ab1-cc8f-42de-b6a7-570ba3f93c0c\") " pod="openshift-ingress/e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq" Jul 15 21:33:29.737902 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:29.737877 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/414a1ab1-cc8f-42de-b6a7-570ba3f93c0c-istio-envoy\") pod \"e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq\" (UID: \"414a1ab1-cc8f-42de-b6a7-570ba3f93c0c\") " pod="openshift-ingress/e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq" Jul 15 21:33:29.738209 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:29.738186 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/414a1ab1-cc8f-42de-b6a7-570ba3f93c0c-istio-podinfo\") pod \"e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq\" (UID: \"414a1ab1-cc8f-42de-b6a7-570ba3f93c0c\") " pod="openshift-ingress/e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq" Jul 15 21:33:29.749057 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:29.749036 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/414a1ab1-cc8f-42de-b6a7-570ba3f93c0c-istio-token\") pod \"e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq\" (UID: \"414a1ab1-cc8f-42de-b6a7-570ba3f93c0c\") " pod="openshift-ingress/e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq" Jul 15 21:33:29.750529 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:29.750509 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zddsp\" (UniqueName: \"kubernetes.io/projected/414a1ab1-cc8f-42de-b6a7-570ba3f93c0c-kube-api-access-zddsp\") pod \"e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq\" (UID: \"414a1ab1-cc8f-42de-b6a7-570ba3f93c0c\") " pod="openshift-ingress/e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq" Jul 15 21:33:29.921719 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:29.921675 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq" Jul 15 21:33:30.064453 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:30.064430 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq"] Jul 15 21:33:30.065952 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:33:30.065917 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod414a1ab1_cc8f_42de_b6a7_570ba3f93c0c.slice/crio-52ae567be966d5a6b8dde57f6c194ee61fb3fa204ff9d828a18606b2c9071e9e WatchSource:0}: Error finding container 52ae567be966d5a6b8dde57f6c194ee61fb3fa204ff9d828a18606b2c9071e9e: Status 404 returned error can't find the container with id 52ae567be966d5a6b8dde57f6c194ee61fb3fa204ff9d828a18606b2c9071e9e Jul 15 21:33:30.068050 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:30.068015 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:33:30.068164 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:30.068093 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:33:30.068164 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:30.068137 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:33:30.842409 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:30.842369 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq" event={"ID":"414a1ab1-cc8f-42de-b6a7-570ba3f93c0c","Type":"ContainerStarted","Data":"dbaf466b99c3de3575b97c12ce781fb005dfdfc25f4d1ec677d285263865f1f0"} Jul 15 21:33:30.842805 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:30.842429 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq" event={"ID":"414a1ab1-cc8f-42de-b6a7-570ba3f93c0c","Type":"ContainerStarted","Data":"52ae567be966d5a6b8dde57f6c194ee61fb3fa204ff9d828a18606b2c9071e9e"} Jul 15 21:33:30.868348 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:30.868299 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq" podStartSLOduration=1.868283903 podStartE2EDuration="1.868283903s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:33:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:33:30.866033708 +0000 UTC m=+1619.116458929" watchObservedRunningTime="2026-07-15 21:33:30.868283903 +0000 UTC m=+1619.118709033" Jul 15 21:33:30.922717 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:30.922687 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq" Jul 15 21:33:31.926538 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:31.926508 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq" Jul 15 21:33:32.854556 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:32.854452 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq" Jul 15 21:33:32.855881 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:32.855853 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq" Jul 15 21:33:35.942586 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:35.942545 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq"] Jul 15 21:33:35.943121 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:35.943067 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq" podUID="414a1ab1-cc8f-42de-b6a7-570ba3f93c0c" containerName="istio-proxy" containerID="cri-o://dbaf466b99c3de3575b97c12ce781fb005dfdfc25f4d1ec677d285263865f1f0" gracePeriod=30 Jul 15 21:33:40.793142 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:40.793118 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq" Jul 15 21:33:40.894080 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:40.893992 2577 generic.go:356] "Generic (PLEG): container finished" podID="414a1ab1-cc8f-42de-b6a7-570ba3f93c0c" containerID="dbaf466b99c3de3575b97c12ce781fb005dfdfc25f4d1ec677d285263865f1f0" exitCode=0 Jul 15 21:33:40.894080 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:40.894034 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq" Jul 15 21:33:40.894267 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:40.894033 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq" event={"ID":"414a1ab1-cc8f-42de-b6a7-570ba3f93c0c","Type":"ContainerDied","Data":"dbaf466b99c3de3575b97c12ce781fb005dfdfc25f4d1ec677d285263865f1f0"} Jul 15 21:33:40.894267 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:40.894173 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq" event={"ID":"414a1ab1-cc8f-42de-b6a7-570ba3f93c0c","Type":"ContainerDied","Data":"52ae567be966d5a6b8dde57f6c194ee61fb3fa204ff9d828a18606b2c9071e9e"} Jul 15 21:33:40.894267 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:40.894205 2577 scope.go:117] "RemoveContainer" containerID="dbaf466b99c3de3575b97c12ce781fb005dfdfc25f4d1ec677d285263865f1f0" Jul 15 21:33:40.902642 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:40.902627 2577 scope.go:117] "RemoveContainer" containerID="dbaf466b99c3de3575b97c12ce781fb005dfdfc25f4d1ec677d285263865f1f0" Jul 15 21:33:40.902907 ip-10-0-143-46 kubenswrapper[2577]: E0715 21:33:40.902887 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbaf466b99c3de3575b97c12ce781fb005dfdfc25f4d1ec677d285263865f1f0\": container with ID starting with dbaf466b99c3de3575b97c12ce781fb005dfdfc25f4d1ec677d285263865f1f0 not found: ID does not exist" containerID="dbaf466b99c3de3575b97c12ce781fb005dfdfc25f4d1ec677d285263865f1f0" Jul 15 21:33:40.902995 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:40.902915 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbaf466b99c3de3575b97c12ce781fb005dfdfc25f4d1ec677d285263865f1f0"} err="failed to get container status \"dbaf466b99c3de3575b97c12ce781fb005dfdfc25f4d1ec677d285263865f1f0\": rpc error: code = NotFound desc = could not find container \"dbaf466b99c3de3575b97c12ce781fb005dfdfc25f4d1ec677d285263865f1f0\": container with ID starting with dbaf466b99c3de3575b97c12ce781fb005dfdfc25f4d1ec677d285263865f1f0 not found: ID does not exist" Jul 15 21:33:40.941225 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:40.941202 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/414a1ab1-cc8f-42de-b6a7-570ba3f93c0c-credential-socket\") pod \"414a1ab1-cc8f-42de-b6a7-570ba3f93c0c\" (UID: \"414a1ab1-cc8f-42de-b6a7-570ba3f93c0c\") " Jul 15 21:33:40.941326 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:40.941242 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/414a1ab1-cc8f-42de-b6a7-570ba3f93c0c-workload-certs\") pod \"414a1ab1-cc8f-42de-b6a7-570ba3f93c0c\" (UID: \"414a1ab1-cc8f-42de-b6a7-570ba3f93c0c\") " Jul 15 21:33:40.941326 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:40.941282 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/414a1ab1-cc8f-42de-b6a7-570ba3f93c0c-istiod-ca-cert\") pod \"414a1ab1-cc8f-42de-b6a7-570ba3f93c0c\" (UID: \"414a1ab1-cc8f-42de-b6a7-570ba3f93c0c\") " Jul 15 21:33:40.941326 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:40.941318 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/414a1ab1-cc8f-42de-b6a7-570ba3f93c0c-workload-socket\") pod \"414a1ab1-cc8f-42de-b6a7-570ba3f93c0c\" (UID: \"414a1ab1-cc8f-42de-b6a7-570ba3f93c0c\") " Jul 15 21:33:40.941482 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:40.941346 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/414a1ab1-cc8f-42de-b6a7-570ba3f93c0c-istio-token\") pod \"414a1ab1-cc8f-42de-b6a7-570ba3f93c0c\" (UID: \"414a1ab1-cc8f-42de-b6a7-570ba3f93c0c\") " Jul 15 21:33:40.941482 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:40.941381 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/414a1ab1-cc8f-42de-b6a7-570ba3f93c0c-istio-envoy\") pod \"414a1ab1-cc8f-42de-b6a7-570ba3f93c0c\" (UID: \"414a1ab1-cc8f-42de-b6a7-570ba3f93c0c\") " Jul 15 21:33:40.941482 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:40.941467 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/414a1ab1-cc8f-42de-b6a7-570ba3f93c0c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "414a1ab1-cc8f-42de-b6a7-570ba3f93c0c" (UID: "414a1ab1-cc8f-42de-b6a7-570ba3f93c0c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:33:40.941632 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:40.941514 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zddsp\" (UniqueName: \"kubernetes.io/projected/414a1ab1-cc8f-42de-b6a7-570ba3f93c0c-kube-api-access-zddsp\") pod \"414a1ab1-cc8f-42de-b6a7-570ba3f93c0c\" (UID: \"414a1ab1-cc8f-42de-b6a7-570ba3f93c0c\") " Jul 15 21:33:40.941632 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:40.941547 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/414a1ab1-cc8f-42de-b6a7-570ba3f93c0c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "414a1ab1-cc8f-42de-b6a7-570ba3f93c0c" (UID: "414a1ab1-cc8f-42de-b6a7-570ba3f93c0c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:33:40.941632 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:40.941578 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/414a1ab1-cc8f-42de-b6a7-570ba3f93c0c-istio-podinfo\") pod \"414a1ab1-cc8f-42de-b6a7-570ba3f93c0c\" (UID: \"414a1ab1-cc8f-42de-b6a7-570ba3f93c0c\") " Jul 15 21:33:40.941815 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:40.941631 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/414a1ab1-cc8f-42de-b6a7-570ba3f93c0c-istio-data\") pod \"414a1ab1-cc8f-42de-b6a7-570ba3f93c0c\" (UID: \"414a1ab1-cc8f-42de-b6a7-570ba3f93c0c\") " Jul 15 21:33:40.941815 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:40.941647 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/414a1ab1-cc8f-42de-b6a7-570ba3f93c0c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "414a1ab1-cc8f-42de-b6a7-570ba3f93c0c" (UID: "414a1ab1-cc8f-42de-b6a7-570ba3f93c0c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:33:40.941815 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:40.941791 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/414a1ab1-cc8f-42de-b6a7-570ba3f93c0c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "414a1ab1-cc8f-42de-b6a7-570ba3f93c0c" (UID: "414a1ab1-cc8f-42de-b6a7-570ba3f93c0c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:33:40.942069 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:40.942052 2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/414a1ab1-cc8f-42de-b6a7-570ba3f93c0c-credential-socket\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\"" Jul 15 21:33:40.942131 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:40.942076 2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/414a1ab1-cc8f-42de-b6a7-570ba3f93c0c-workload-certs\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\"" Jul 15 21:33:40.942131 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:40.942091 2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/414a1ab1-cc8f-42de-b6a7-570ba3f93c0c-istiod-ca-cert\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\"" Jul 15 21:33:40.942131 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:40.942104 2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/414a1ab1-cc8f-42de-b6a7-570ba3f93c0c-workload-socket\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\"" Jul 15 21:33:40.942399 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:40.942379 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/414a1ab1-cc8f-42de-b6a7-570ba3f93c0c-istio-data" (OuterVolumeSpecName: "istio-data") pod "414a1ab1-cc8f-42de-b6a7-570ba3f93c0c" (UID: "414a1ab1-cc8f-42de-b6a7-570ba3f93c0c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:33:40.943663 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:40.943641 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/414a1ab1-cc8f-42de-b6a7-570ba3f93c0c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "414a1ab1-cc8f-42de-b6a7-570ba3f93c0c" (UID: "414a1ab1-cc8f-42de-b6a7-570ba3f93c0c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:33:40.943846 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:40.943690 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/414a1ab1-cc8f-42de-b6a7-570ba3f93c0c-istio-token" (OuterVolumeSpecName: "istio-token") pod "414a1ab1-cc8f-42de-b6a7-570ba3f93c0c" (UID: "414a1ab1-cc8f-42de-b6a7-570ba3f93c0c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:33:40.943915 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:40.943903 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/414a1ab1-cc8f-42de-b6a7-570ba3f93c0c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "414a1ab1-cc8f-42de-b6a7-570ba3f93c0c" (UID: "414a1ab1-cc8f-42de-b6a7-570ba3f93c0c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 21:33:40.943971 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:40.943907 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/414a1ab1-cc8f-42de-b6a7-570ba3f93c0c-kube-api-access-zddsp" (OuterVolumeSpecName: "kube-api-access-zddsp") pod "414a1ab1-cc8f-42de-b6a7-570ba3f93c0c" (UID: "414a1ab1-cc8f-42de-b6a7-570ba3f93c0c"). InnerVolumeSpecName "kube-api-access-zddsp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:33:41.043514 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:41.043491 2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/414a1ab1-cc8f-42de-b6a7-570ba3f93c0c-istio-data\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\"" Jul 15 21:33:41.043514 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:41.043511 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/414a1ab1-cc8f-42de-b6a7-570ba3f93c0c-istio-token\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\"" Jul 15 21:33:41.043645 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:41.043520 2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/414a1ab1-cc8f-42de-b6a7-570ba3f93c0c-istio-envoy\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\"" Jul 15 21:33:41.043645 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:41.043528 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zddsp\" (UniqueName: \"kubernetes.io/projected/414a1ab1-cc8f-42de-b6a7-570ba3f93c0c-kube-api-access-zddsp\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\"" Jul 15 21:33:41.043645 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:41.043536 2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/414a1ab1-cc8f-42de-b6a7-570ba3f93c0c-istio-podinfo\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\"" Jul 15 21:33:41.219431 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:41.219397 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq"] Jul 15 21:33:41.226826 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:41.226790 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-57e21af7-openshift-default-868c8c7879-6mctq"] Jul 15 21:33:42.342356 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:33:42.342326 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="414a1ab1-cc8f-42de-b6a7-570ba3f93c0c" path="/var/lib/kubelet/pods/414a1ab1-cc8f-42de-b6a7-570ba3f93c0c/volumes" Jul 15 21:36:32.325274 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:36:32.325246 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qm2hk_8224ce90-3f8b-4562-b8ae-14f9d965f20f/ovn-acl-logging/0.log" Jul 15 21:36:32.330479 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:36:32.330458 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qm2hk_8224ce90-3f8b-4562-b8ae-14f9d965f20f/ovn-acl-logging/0.log" Jul 15 21:41:32.356892 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:41:32.356862 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qm2hk_8224ce90-3f8b-4562-b8ae-14f9d965f20f/ovn-acl-logging/0.log" Jul 15 21:41:32.363272 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:41:32.363249 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qm2hk_8224ce90-3f8b-4562-b8ae-14f9d965f20f/ovn-acl-logging/0.log" Jul 15 21:45:00.140575 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:45:00.140539 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-fa020c-29735865-mkgkm"] Jul 15 21:45:00.141244 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:45:00.141057 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="414a1ab1-cc8f-42de-b6a7-570ba3f93c0c" containerName="istio-proxy" Jul 15 21:45:00.141244 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:45:00.141078 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="414a1ab1-cc8f-42de-b6a7-570ba3f93c0c" containerName="istio-proxy" Jul 15 21:45:00.141244 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:45:00.141200 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="414a1ab1-cc8f-42de-b6a7-570ba3f93c0c" containerName="istio-proxy" Jul 15 21:45:00.144631 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:45:00.144610 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735865-54p4z"] Jul 15 21:45:00.144779 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:45:00.144749 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-fa020c-29735865-mkgkm" Jul 15 21:45:00.147887 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:45:00.147867 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735865-54p4z" Jul 15 21:45:00.148001 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:45:00.147979 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tl4qg\"" Jul 15 21:45:00.155372 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:45:00.155353 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-fa020c-29735865-mkgkm" Jul 15 21:45:00.161347 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:45:00.161327 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735865-54p4z" Jul 15 21:45:00.166155 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:45:00.166132 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735865-54p4z"] Jul 15 21:45:00.169310 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:45:00.169288 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-fa020c-29735865-mkgkm"] Jul 15 21:45:00.507701 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:45:00.507676 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-fa020c-29735865-mkgkm"] Jul 15 21:45:00.509935 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:45:00.509901 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod934124b7_98a5_4183_94d6_47573b9a0771.slice/crio-a95520ee32a2309f5b3941d550e470b896a8140485805df710c866da23d47da5 WatchSource:0}: Error finding container a95520ee32a2309f5b3941d550e470b896a8140485805df710c866da23d47da5: Status 404 returned error can't find the container with id a95520ee32a2309f5b3941d550e470b896a8140485805df710c866da23d47da5 Jul 15 21:45:00.511833 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:45:00.511812 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 21:45:00.536340 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:45:00.536319 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735865-54p4z"] Jul 15 21:45:00.538286 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:45:00.538262 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc54a5754_5037_414e_b4d0_16cda62bcf3b.slice/crio-59aea999591aa61cf59d00e3ef75ae36d620efa4d8cd8009cee83bbe3a67bd32 WatchSource:0}: Error finding container 59aea999591aa61cf59d00e3ef75ae36d620efa4d8cd8009cee83bbe3a67bd32: Status 404 returned error can't find the container with id 59aea999591aa61cf59d00e3ef75ae36d620efa4d8cd8009cee83bbe3a67bd32 Jul 15 21:45:01.149993 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:45:01.149951 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735865-54p4z" event={"ID":"c54a5754-5037-414e-b4d0-16cda62bcf3b","Type":"ContainerStarted","Data":"59aea999591aa61cf59d00e3ef75ae36d620efa4d8cd8009cee83bbe3a67bd32"} Jul 15 21:45:01.151284 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:45:01.151247 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-fa020c-29735865-mkgkm" event={"ID":"934124b7-98a5-4183-94d6-47573b9a0771","Type":"ContainerStarted","Data":"a95520ee32a2309f5b3941d550e470b896a8140485805df710c866da23d47da5"} Jul 15 21:45:03.163142 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:45:03.163109 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-fa020c-29735865-mkgkm" event={"ID":"934124b7-98a5-4183-94d6-47573b9a0771","Type":"ContainerStarted","Data":"56c0b66102c9adaa8e0ba93edaa3ad29d39933904186981fe7cbd4b7e5ef7364"} Jul 15 21:45:03.164701 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:45:03.164677 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735865-54p4z" event={"ID":"c54a5754-5037-414e-b4d0-16cda62bcf3b","Type":"ContainerStarted","Data":"4c7fd6de61ce61c620967782ce00b43d653bddd1ecf3bc9f740f784cb11924cd"} Jul 15 21:45:03.181337 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:45:03.181295 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-fa020c-29735865-mkgkm" podStartSLOduration=1.1490229809999999 podStartE2EDuration="3.18127809s" totalImagesPullingTime="2.032255109s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:45:03.180379516 +0000 UTC m=+2311.430804650" watchObservedRunningTime="2026-07-15 21:45:03.18127809 +0000 UTC m=+2311.431703220" Jul 15 21:45:03.197401 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:45:03.197361 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735865-54p4z" podStartSLOduration=1.189852813 podStartE2EDuration="3.197349432s" totalImagesPullingTime="2.007496619s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:45:03.196603978 +0000 UTC m=+2311.447029110" watchObservedRunningTime="2026-07-15 21:45:03.197349432 +0000 UTC m=+2311.447774562" Jul 15 21:45:04.170738 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:45:04.170698 2577 generic.go:356] "Generic (PLEG): container finished" podID="c54a5754-5037-414e-b4d0-16cda62bcf3b" containerID="4c7fd6de61ce61c620967782ce00b43d653bddd1ecf3bc9f740f784cb11924cd" exitCode=0 Jul 15 21:45:04.171143 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:45:04.170763 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735865-54p4z" event={"ID":"c54a5754-5037-414e-b4d0-16cda62bcf3b","Type":"ContainerDied","Data":"4c7fd6de61ce61c620967782ce00b43d653bddd1ecf3bc9f740f784cb11924cd"} Jul 15 21:45:04.172290 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:45:04.172267 2577 generic.go:356] "Generic (PLEG): container finished" podID="934124b7-98a5-4183-94d6-47573b9a0771" containerID="56c0b66102c9adaa8e0ba93edaa3ad29d39933904186981fe7cbd4b7e5ef7364" exitCode=0 Jul 15 21:45:04.172392 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:45:04.172309 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-fa020c-29735865-mkgkm" event={"ID":"934124b7-98a5-4183-94d6-47573b9a0771","Type":"ContainerDied","Data":"56c0b66102c9adaa8e0ba93edaa3ad29d39933904186981fe7cbd4b7e5ef7364"} Jul 15 21:45:05.306678 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:45:05.306655 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-fa020c-29735865-mkgkm" Jul 15 21:45:05.352651 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:45:05.352624 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735865-54p4z" Jul 15 21:45:06.182888 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:45:06.182853 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-fa020c-29735865-mkgkm" Jul 15 21:45:06.182888 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:45:06.182867 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-fa020c-29735865-mkgkm" event={"ID":"934124b7-98a5-4183-94d6-47573b9a0771","Type":"ContainerDied","Data":"a95520ee32a2309f5b3941d550e470b896a8140485805df710c866da23d47da5"} Jul 15 21:45:06.183105 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:45:06.182916 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a95520ee32a2309f5b3941d550e470b896a8140485805df710c866da23d47da5" Jul 15 21:45:06.184051 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:45:06.184026 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735865-54p4z" event={"ID":"c54a5754-5037-414e-b4d0-16cda62bcf3b","Type":"ContainerDied","Data":"59aea999591aa61cf59d00e3ef75ae36d620efa4d8cd8009cee83bbe3a67bd32"} Jul 15 21:45:06.184146 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:45:06.184051 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735865-54p4z" Jul 15 21:45:06.184146 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:45:06.184073 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="59aea999591aa61cf59d00e3ef75ae36d620efa4d8cd8009cee83bbe3a67bd32" Jul 15 21:46:32.387650 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:46:32.387615 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qm2hk_8224ce90-3f8b-4562-b8ae-14f9d965f20f/ovn-acl-logging/0.log" Jul 15 21:46:32.397125 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:46:32.397103 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qm2hk_8224ce90-3f8b-4562-b8ae-14f9d965f20f/ovn-acl-logging/0.log" Jul 15 21:48:02.530905 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:02.530873 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-fa020c-29735865-mkgkm"] Jul 15 21:48:02.534241 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:02.534216 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-fa020c-29735865-mkgkm"] Jul 15 21:48:04.340474 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:04.340442 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="934124b7-98a5-4183-94d6-47573b9a0771" path="/var/lib/kubelet/pods/934124b7-98a5-4183-94d6-47573b9a0771/volumes" Jul 15 21:48:29.611428 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:29.611353 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6594f49bc9-vzl7w_02cf777b-aea3-4116-ae3c-33cdc41973d8/manager/1.log" Jul 15 21:48:30.091168 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:30.091140 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-858d4f578f-fw26k_82779c00-af56-4bb8-a70f-a5d57ed9c2a8/copy-manifests/0.log" Jul 15 21:48:30.105066 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:30.105036 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-858d4f578f-fw26k_82779c00-af56-4bb8-a70f-a5d57ed9c2a8/manager/0.log" Jul 15 21:48:30.843074 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:30.843044 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29735865-54p4z_c54a5754-5037-414e-b4d0-16cda62bcf3b/cleanup/0.log" Jul 15 21:48:33.477654 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:33.477624 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678tpbsr_aee0e022-eff4-467c-beeb-ed82aeda0745/istio-proxy/0.log" Jul 15 21:48:33.601840 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:33.601809 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-6tjm9_5522bda4-9085-4a65-9fb6-d21d0b6f2f7d/discovery/0.log" Jul 15 21:48:33.951979 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:33.951938 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-s87vd_90807657-53da-46c4-9395-32d2838799fb/istio-proxy/1.log" Jul 15 21:48:34.070847 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:34.070819 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-dxszc_85c8cf11-c6a3-4285-accb-d2a184df5835/payload-pre-processing/0.log" Jul 15 21:48:34.660599 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:34.660573 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-h6wq5_7ddf3654-9878-42be-ab09-3ca66015eeea/main/0.log" Jul 15 21:48:35.004978 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:35.004903 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4nwt9_a5a307da-4ba8-485f-b61c-7bb76365781d/main/0.log" Jul 15 21:48:35.121668 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:35.121641 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-ljnrr_00dbde61-bc29-4038-90ac-bb9cc5dfafbd/main/0.log" Jul 15 21:48:43.871376 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:43.871346 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6n6hw_f12efede-b144-4c22-9e44-0990b6bb00af/global-pull-secret-syncer/0.log" Jul 15 21:48:44.072040 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:44.072010 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-tsgc7_8e4f36da-9604-422b-a4b8-35e40e711b19/konnectivity-agent/0.log" Jul 15 21:48:44.191337 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:44.191313 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-46.ec2.internal_b1f0b417ff2ce60419276782687d4a52/haproxy/0.log" Jul 15 21:48:50.980351 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:50.980319 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cfeccf21-6b74-4a3c-b181-808c47017a9d/alertmanager/0.log" Jul 15 21:48:51.008137 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:51.008113 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cfeccf21-6b74-4a3c-b181-808c47017a9d/config-reloader/0.log" Jul 15 21:48:51.036869 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:51.036845 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cfeccf21-6b74-4a3c-b181-808c47017a9d/kube-rbac-proxy-web/0.log" Jul 15 21:48:51.075129 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:51.075105 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cfeccf21-6b74-4a3c-b181-808c47017a9d/kube-rbac-proxy/0.log" Jul 15 21:48:51.102420 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:51.102399 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cfeccf21-6b74-4a3c-b181-808c47017a9d/kube-rbac-proxy-metric/0.log" Jul 15 21:48:51.133495 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:51.133466 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cfeccf21-6b74-4a3c-b181-808c47017a9d/prom-label-proxy/0.log" Jul 15 21:48:51.163279 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:51.163258 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cfeccf21-6b74-4a3c-b181-808c47017a9d/init-config-reloader/0.log" Jul 15 21:48:51.255714 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:51.255638 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-nd8zb_4ab78046-a03c-46af-aea2-b6f1f8fc7a37/kube-state-metrics/0.log" Jul 15 21:48:51.288537 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:51.288509 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-nd8zb_4ab78046-a03c-46af-aea2-b6f1f8fc7a37/kube-rbac-proxy-main/0.log" Jul 15 21:48:51.318911 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:51.318887 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-nd8zb_4ab78046-a03c-46af-aea2-b6f1f8fc7a37/kube-rbac-proxy-self/0.log" Jul 15 21:48:51.440581 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:51.440554 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5f8pf_7ddcb79f-d39f-4152-930a-bb318e1ac148/node-exporter/0.log" Jul 15 21:48:51.472519 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:51.472491 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5f8pf_7ddcb79f-d39f-4152-930a-bb318e1ac148/kube-rbac-proxy/0.log" Jul 15 21:48:51.508189 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:51.508114 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5f8pf_7ddcb79f-d39f-4152-930a-bb318e1ac148/init-textfile/0.log" Jul 15 21:48:51.748096 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:51.748069 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-c6plm_fe7f1124-0391-435d-884d-8fbaf89be8f6/kube-rbac-proxy-main/0.log" Jul 15 21:48:51.779852 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:51.779770 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-c6plm_fe7f1124-0391-435d-884d-8fbaf89be8f6/kube-rbac-proxy-self/0.log" Jul 15 21:48:51.805858 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:51.805827 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-c6plm_fe7f1124-0391-435d-884d-8fbaf89be8f6/openshift-state-metrics/0.log" Jul 15 21:48:52.053106 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:52.053022 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-5mlzb_f391540e-4578-4baf-8b2a-92242f45c3e1/prometheus-operator/0.log" Jul 15 21:48:52.081310 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:52.081285 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-5mlzb_f391540e-4578-4baf-8b2a-92242f45c3e1/kube-rbac-proxy/0.log" Jul 15 21:48:52.112759 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:52.112709 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-rxsxm_e7dd7a2c-856f-4661-85a0-46b89d4f8e61/prometheus-operator-admission-webhook/0.log" Jul 15 21:48:52.154740 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:52.154695 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-59db54f7cd-lq9nw_8499994f-8522-47a4-b74e-870aa0ec723e/telemeter-client/0.log" Jul 15 21:48:52.184834 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:52.184809 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-59db54f7cd-lq9nw_8499994f-8522-47a4-b74e-870aa0ec723e/reload/0.log" Jul 15 21:48:52.213327 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:52.213293 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-59db54f7cd-lq9nw_8499994f-8522-47a4-b74e-870aa0ec723e/kube-rbac-proxy/0.log" Jul 15 21:48:53.647079 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:53.647048 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-hq278_fbe2bf2b-9f4b-4117-bcf1-1631124eb65d/networking-console-plugin/0.log" Jul 15 21:48:54.108178 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:54.108142 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-546bh/perf-node-gather-daemonset-ch7js"] Jul 15 21:48:54.108551 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:54.108538 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c54a5754-5037-414e-b4d0-16cda62bcf3b" containerName="cleanup" Jul 15 21:48:54.108591 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:54.108552 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c54a5754-5037-414e-b4d0-16cda62bcf3b" containerName="cleanup" Jul 15 21:48:54.108591 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:54.108572 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="934124b7-98a5-4183-94d6-47573b9a0771" containerName="cleanup" Jul 15 21:48:54.108591 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:54.108577 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="934124b7-98a5-4183-94d6-47573b9a0771" containerName="cleanup" Jul 15 21:48:54.108683 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:54.108639 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="934124b7-98a5-4183-94d6-47573b9a0771" containerName="cleanup" Jul 15 21:48:54.108683 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:54.108648 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c54a5754-5037-414e-b4d0-16cda62bcf3b" containerName="cleanup" Jul 15 21:48:54.111858 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:54.111831 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-546bh/perf-node-gather-daemonset-ch7js" Jul 15 21:48:54.114270 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:54.114245 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-546bh\"/\"kube-root-ca.crt\"" Jul 15 21:48:54.114270 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:54.114262 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-546bh\"/\"default-dockercfg-fkhhx\"" Jul 15 21:48:54.115254 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:54.115239 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-546bh\"/\"openshift-service-ca.crt\"" Jul 15 21:48:54.119653 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:54.119630 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-546bh/perf-node-gather-daemonset-ch7js"] Jul 15 21:48:54.208344 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:54.208313 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f0a1cdd6-0d18-4aec-803f-6b99d2c317fd-podres\") pod \"perf-node-gather-daemonset-ch7js\" (UID: \"f0a1cdd6-0d18-4aec-803f-6b99d2c317fd\") " pod="openshift-must-gather-546bh/perf-node-gather-daemonset-ch7js" Jul 15 21:48:54.208507 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:54.208414 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0a1cdd6-0d18-4aec-803f-6b99d2c317fd-sys\") pod \"perf-node-gather-daemonset-ch7js\" (UID: \"f0a1cdd6-0d18-4aec-803f-6b99d2c317fd\") " pod="openshift-must-gather-546bh/perf-node-gather-daemonset-ch7js" Jul 15 21:48:54.208507 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:54.208471 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jrq4\" (UniqueName: \"kubernetes.io/projected/f0a1cdd6-0d18-4aec-803f-6b99d2c317fd-kube-api-access-9jrq4\") pod \"perf-node-gather-daemonset-ch7js\" (UID: \"f0a1cdd6-0d18-4aec-803f-6b99d2c317fd\") " pod="openshift-must-gather-546bh/perf-node-gather-daemonset-ch7js" Jul 15 21:48:54.208507 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:54.208503 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f0a1cdd6-0d18-4aec-803f-6b99d2c317fd-proc\") pod \"perf-node-gather-daemonset-ch7js\" (UID: \"f0a1cdd6-0d18-4aec-803f-6b99d2c317fd\") " pod="openshift-must-gather-546bh/perf-node-gather-daemonset-ch7js" Jul 15 21:48:54.208617 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:54.208574 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f0a1cdd6-0d18-4aec-803f-6b99d2c317fd-lib-modules\") pod \"perf-node-gather-daemonset-ch7js\" (UID: \"f0a1cdd6-0d18-4aec-803f-6b99d2c317fd\") " pod="openshift-must-gather-546bh/perf-node-gather-daemonset-ch7js" Jul 15 21:48:54.309583 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:54.309549 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f0a1cdd6-0d18-4aec-803f-6b99d2c317fd-proc\") pod \"perf-node-gather-daemonset-ch7js\" (UID: \"f0a1cdd6-0d18-4aec-803f-6b99d2c317fd\") " pod="openshift-must-gather-546bh/perf-node-gather-daemonset-ch7js" Jul 15 21:48:54.309583 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:54.309585 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f0a1cdd6-0d18-4aec-803f-6b99d2c317fd-lib-modules\") pod \"perf-node-gather-daemonset-ch7js\" (UID: \"f0a1cdd6-0d18-4aec-803f-6b99d2c317fd\") " pod="openshift-must-gather-546bh/perf-node-gather-daemonset-ch7js" Jul 15 21:48:54.309868 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:54.309615 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f0a1cdd6-0d18-4aec-803f-6b99d2c317fd-podres\") pod \"perf-node-gather-daemonset-ch7js\" (UID: \"f0a1cdd6-0d18-4aec-803f-6b99d2c317fd\") " pod="openshift-must-gather-546bh/perf-node-gather-daemonset-ch7js" Jul 15 21:48:54.309868 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:54.309679 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0a1cdd6-0d18-4aec-803f-6b99d2c317fd-sys\") pod \"perf-node-gather-daemonset-ch7js\" (UID: \"f0a1cdd6-0d18-4aec-803f-6b99d2c317fd\") " pod="openshift-must-gather-546bh/perf-node-gather-daemonset-ch7js" Jul 15 21:48:54.309868 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:54.309695 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f0a1cdd6-0d18-4aec-803f-6b99d2c317fd-proc\") pod \"perf-node-gather-daemonset-ch7js\" (UID: \"f0a1cdd6-0d18-4aec-803f-6b99d2c317fd\") " pod="openshift-must-gather-546bh/perf-node-gather-daemonset-ch7js" Jul 15 21:48:54.309868 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:54.309751 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jrq4\" (UniqueName: \"kubernetes.io/projected/f0a1cdd6-0d18-4aec-803f-6b99d2c317fd-kube-api-access-9jrq4\") pod \"perf-node-gather-daemonset-ch7js\" (UID: \"f0a1cdd6-0d18-4aec-803f-6b99d2c317fd\") " pod="openshift-must-gather-546bh/perf-node-gather-daemonset-ch7js" Jul 15 21:48:54.309868 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:54.309787 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f0a1cdd6-0d18-4aec-803f-6b99d2c317fd-lib-modules\") pod \"perf-node-gather-daemonset-ch7js\" (UID: \"f0a1cdd6-0d18-4aec-803f-6b99d2c317fd\") " pod="openshift-must-gather-546bh/perf-node-gather-daemonset-ch7js" Jul 15 21:48:54.309868 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:54.309797 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0a1cdd6-0d18-4aec-803f-6b99d2c317fd-sys\") pod \"perf-node-gather-daemonset-ch7js\" (UID: \"f0a1cdd6-0d18-4aec-803f-6b99d2c317fd\") " pod="openshift-must-gather-546bh/perf-node-gather-daemonset-ch7js" Jul 15 21:48:54.309868 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:54.309811 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f0a1cdd6-0d18-4aec-803f-6b99d2c317fd-podres\") pod \"perf-node-gather-daemonset-ch7js\" (UID: \"f0a1cdd6-0d18-4aec-803f-6b99d2c317fd\") " pod="openshift-must-gather-546bh/perf-node-gather-daemonset-ch7js" Jul 15 21:48:54.319262 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:54.319237 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jrq4\" (UniqueName: \"kubernetes.io/projected/f0a1cdd6-0d18-4aec-803f-6b99d2c317fd-kube-api-access-9jrq4\") pod \"perf-node-gather-daemonset-ch7js\" (UID: \"f0a1cdd6-0d18-4aec-803f-6b99d2c317fd\") " pod="openshift-must-gather-546bh/perf-node-gather-daemonset-ch7js" Jul 15 21:48:54.422478 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:54.422447 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-546bh/perf-node-gather-daemonset-ch7js" Jul 15 21:48:54.556969 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:54.556944 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-546bh/perf-node-gather-daemonset-ch7js"] Jul 15 21:48:54.558941 ip-10-0-143-46 kubenswrapper[2577]: W0715 21:48:54.558912 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf0a1cdd6_0d18_4aec_803f_6b99d2c317fd.slice/crio-b6a47643c066bb6b0a3046f427d83417f493c98026f8ce3439c0837b22e7c805 WatchSource:0}: Error finding container b6a47643c066bb6b0a3046f427d83417f493c98026f8ce3439c0837b22e7c805: Status 404 returned error can't find the container with id b6a47643c066bb6b0a3046f427d83417f493c98026f8ce3439c0837b22e7c805 Jul 15 21:48:55.295597 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:55.295563 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-546bh/perf-node-gather-daemonset-ch7js" event={"ID":"f0a1cdd6-0d18-4aec-803f-6b99d2c317fd","Type":"ContainerStarted","Data":"2fcb44dd25308a0ddf9e576e113eb4345baef6d133853bf5813d989cce0e1ec6"} Jul 15 21:48:55.296072 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:55.295618 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-546bh/perf-node-gather-daemonset-ch7js" event={"ID":"f0a1cdd6-0d18-4aec-803f-6b99d2c317fd","Type":"ContainerStarted","Data":"b6a47643c066bb6b0a3046f427d83417f493c98026f8ce3439c0837b22e7c805"} Jul 15 21:48:55.296072 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:55.295654 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-546bh/perf-node-gather-daemonset-ch7js" Jul 15 21:48:55.312884 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:55.312838 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-546bh/perf-node-gather-daemonset-ch7js" podStartSLOduration=1.312823356 podStartE2EDuration="1.312823356s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:48:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:48:55.311858151 +0000 UTC m=+2543.562283282" watchObservedRunningTime="2026-07-15 21:48:55.312823356 +0000 UTC m=+2543.563248517" Jul 15 21:48:56.872181 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:56.872152 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2fm9z_3b3235b9-54ed-4356-be73-4bf0dccf41ac/dns/0.log" Jul 15 21:48:56.913754 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:56.913709 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2fm9z_3b3235b9-54ed-4356-be73-4bf0dccf41ac/kube-rbac-proxy/0.log" Jul 15 21:48:57.133973 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:57.133899 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dggdr_d657a4a7-22b8-4894-9ed2-89d76c9d3465/dns-node-resolver/0.log" Jul 15 21:48:57.792366 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:57.792337 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5577c596d-np767_3609b182-cc8b-4cb8-a87a-5b17b361b0df/registry/0.log" Jul 15 21:48:57.817769 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:57.817743 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lr7lm_31546197-e89f-42c3-a787-577e1441d466/node-ca/0.log" Jul 15 21:48:58.911692 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:58.911662 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678tpbsr_aee0e022-eff4-467c-beeb-ed82aeda0745/istio-proxy/0.log" Jul 15 21:48:59.018942 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:59.018907 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-6tjm9_5522bda4-9085-4a65-9fb6-d21d0b6f2f7d/discovery/0.log" Jul 15 21:48:59.110824 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:59.110796 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-s87vd_90807657-53da-46c4-9395-32d2838799fb/istio-proxy/0.log" Jul 15 21:48:59.137888 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:59.137858 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-s87vd_90807657-53da-46c4-9395-32d2838799fb/istio-proxy/1.log" Jul 15 21:48:59.170447 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:59.170374 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-dxszc_85c8cf11-c6a3-4285-accb-d2a184df5835/payload-pre-processing/0.log" Jul 15 21:48:59.999487 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:48:59.999458 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nnjbb_93d20337-473b-42b5-ac3d-a0194250fbed/serve-healthcheck-canary/0.log" Jul 15 21:49:00.523878 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:49:00.523853 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fnq4r_c0912f3f-c1ed-4638-b0d4-06b0c1e30446/kube-rbac-proxy/0.log" Jul 15 21:49:00.552656 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:49:00.552628 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fnq4r_c0912f3f-c1ed-4638-b0d4-06b0c1e30446/exporter/0.log" Jul 15 21:49:00.580815 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:49:00.580779 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fnq4r_c0912f3f-c1ed-4638-b0d4-06b0c1e30446/extractor/0.log" Jul 15 21:49:01.310899 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:49:01.310873 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-546bh/perf-node-gather-daemonset-ch7js" Jul 15 21:49:03.347587 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:49:03.347504 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6594f49bc9-vzl7w_02cf777b-aea3-4116-ae3c-33cdc41973d8/manager/0.log" Jul 15 21:49:03.388256 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:49:03.388224 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6594f49bc9-vzl7w_02cf777b-aea3-4116-ae3c-33cdc41973d8/manager/1.log" Jul 15 21:49:03.605676 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:49:03.605598 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-858d4f578f-fw26k_82779c00-af56-4bb8-a70f-a5d57ed9c2a8/manager/0.log" Jul 15 21:49:03.626853 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:49:03.626832 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-858d4f578f-fw26k_82779c00-af56-4bb8-a70f-a5d57ed9c2a8/copy-manifests/0.log" Jul 15 21:49:04.437913 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:49:04.437885 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678tpbsr_aee0e022-eff4-467c-beeb-ed82aeda0745/istio-proxy/0.log" Jul 15 21:49:04.570874 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:49:04.570791 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-6tjm9_5522bda4-9085-4a65-9fb6-d21d0b6f2f7d/discovery/0.log" Jul 15 21:49:04.627218 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:49:04.627188 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-s87vd_90807657-53da-46c4-9395-32d2838799fb/istio-proxy/0.log" Jul 15 21:49:04.657646 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:49:04.657616 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-s87vd_90807657-53da-46c4-9395-32d2838799fb/istio-proxy/1.log" Jul 15 21:49:04.679834 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:49:04.679797 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-dxszc_85c8cf11-c6a3-4285-accb-d2a184df5835/payload-pre-processing/0.log" Jul 15 21:49:05.052982 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:49:05.052949 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6dd8d546cd-w7xnh_742496a3-53cf-42f8-a443-fb25b83dc60c/manager/1.log" Jul 15 21:49:05.053230 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:49:05.053143 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6dd8d546cd-w7xnh_742496a3-53cf-42f8-a443-fb25b83dc60c/manager/0.log" Jul 15 21:49:05.982565 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:49:05.982538 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678tpbsr_aee0e022-eff4-467c-beeb-ed82aeda0745/istio-proxy/0.log" Jul 15 21:49:06.088092 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:49:06.088007 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-6tjm9_5522bda4-9085-4a65-9fb6-d21d0b6f2f7d/discovery/0.log" Jul 15 21:49:06.143998 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:49:06.143961 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-s87vd_90807657-53da-46c4-9395-32d2838799fb/istio-proxy/0.log" Jul 15 21:49:06.175227 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:49:06.175193 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-s87vd_90807657-53da-46c4-9395-32d2838799fb/istio-proxy/1.log" Jul 15 21:49:06.196686 ip-10-0-143-46 kubenswrapper[2577]: I0715 21:49:06.196650 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-dxszc_85c8cf11-c6a3-4285-accb-d2a184df5835/payload-pre-processing/0.log"